Instructions to use AlanNgaiJX/mk with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use AlanNgaiJX/mk with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf AlanNgaiJX/mk:F16 --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf AlanNgaiJX/mk:F16 --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible embeddings server: ./build/bin/llama serve -hf AlanNgaiJX/mk:F16 --embeddings
- Llama new
- LM Studio
- Jan
- Ollama
How to use AlanNgaiJX/mk with Ollama:
ollama run hf.co/AlanNgaiJX/mk:F16
- Unsloth Desktop
- Docker Model Runner
How to use AlanNgaiJX/mk with Docker Model Runner:
docker model run hf.co/AlanNgaiJX/mk:F16
- Lemonade
How to use AlanNgaiJX/mk with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull AlanNgaiJX/mk:F16
Run and chat with the model
lemonade run user.mk-F16
List all available models
lemonade list
- Atomic Chat
Commit History
-
Upload ggml-large-v3.bin
Verified signature7bc05d9
-
Upload testFile.txt
Verified signature4fbe915 -
Upload testFile.txt
Verified signature3af81ab -
Upload testFile.txt
Verified signatureffb38d3
-
Upload 4 files
Verified signaturee28e6a0 -
Upload ggml-multilingual-e5-large-instruct-f16-v5.gguf
Verified signature63827b2
-
Upload 2 files
Verified signature284f8f9
-
Upload Llama3_1-8B-instruct-Q4-v1.gguf
Verified signaturec9c4d3e -
Upload Llama3_1-8B-instruct-Q4-v1.gguf
Verified signature1e6c802
-
Delete multilingual-e5-large-instruct-F16.gguf
Verified signature2ceb209 -
Upload multilingual-e5-large-instruct-F16.gguf
Verified signature5e68777 -
Delete ggml-multilingual-e5-large-instruct-f16-v3.gguf_副本
Verified signature6949699 -
Upload ggml-multilingual-e5-large-instruct-f16-v3.gguf_副本
Verified signaturetest54ee36d -
Upload ggml-multilingual-e5-large-instruct-f16-v3.gguf
Verified signatureabbe938 -
Upload ggml-multilingual-e5-large-instruct-f16-v2.gguf
Verified signature7421b50 -
Delete multilingual-e5-large-instruct-f16-v2.gguf
Verified signature9691c93 -
Upload multilingual-e5-large-instruct-f16-v2.gguf
Verified signature00fd400
-
Upload ggml-multilingual-e5-large-instruct-f16.gguf
Verified signatureupdate embedding model fix tokenizer27f32c5
-
Upload Qwen2-7b-instruct-q4_0.gguf
Verified signature4802c44
-
Upload ggml-multilingual-e5-large-instruct.gguf
Verified signatureafa5ee0
-
Upload 2 files
Verified signaturebb4919c -
Upload whisper-large-v3-q8_0.gguf
Verified signature6628136 -
Upload ggml-model.gguf
Verified signature0810d9f
-
Upload 2 files
Verified signaturea4b977f
-
Upload README.md
Verified signatureadd readme71d04b9 -
Upload Llama3-8B-Chinese-Chat-Q4-v2_1.gguf
Verified signaturetest8cfb343 -
initial commit
Verified signature11a63d8