Instructions to use knifeayumu/LLM_Collection with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use knifeayumu/LLM_Collection with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf knifeayumu/LLM_Collection:Q4_K_M # Run inference directly in the terminal: llama cli -hf knifeayumu/LLM_Collection:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf knifeayumu/LLM_Collection:Q4_K_M # Run inference directly in the terminal: llama cli -hf knifeayumu/LLM_Collection:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf knifeayumu/LLM_Collection:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf knifeayumu/LLM_Collection:Q4_K_M
Use Docker
docker model run hf.co/knifeayumu/LLM_Collection:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use knifeayumu/LLM_Collection with Ollama:
ollama run hf.co/knifeayumu/LLM_Collection:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use knifeayumu/LLM_Collection with Docker Model Runner:
docker model run hf.co/knifeayumu/LLM_Collection:Q4_K_M
- Lemonade
How to use knifeayumu/LLM_Collection with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull knifeayumu/LLM_Collection:Q4_K_M
Run and chat with the model
lemonade run user.LLM_Collection-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
Rename 2024d/Cydonia-22B-v2k-Q8_0.gguf to Mistral-Small-2409_22B/Cydonia-22B-v2k-Q8_0.gguf
Verified signaturebb6fc0b -
Rename 2024d/Cydonia-22B-v2f-Q8_0.gguf to Mistral-Small-2409_22B/Cydonia-22B-v2f-Q8_0.gguf
Verified signature9cf6424 -
Rename 2024d/Cydonia-22B-v1f-Q8_0.gguf to Mistral-Small-2409_22B/Cydonia-22B-v1f-Q8_0.gguf
Verified signature8a77693 -
Rename 2024d/Cydonia-22B-v1e-Q8_0.gguf to Mistral-Small-2409_22B/Cydonia-22B-v1e-Q8_0.gguf
Verified signature4585807 -
Rename 2024c/nemo-sunfall-v0.6.1-Q8_0.gguf to Mistral-Nemo-2407_12B/nemo-sunfall-v0.6.1-Q8_0.gguf
Verified signature7e18dac -
Rename 2024c/magnum-12b-v2-q8_0.gguf to Mistral-Nemo-2407_12B/magnum-12b-v2-q8_0.gguf
Verified signaturec2c3684 -
Rename 2024c/Sunfall-NemoMix-Unleashed-12B-v0.6.1-Q8_0.gguf to Mistral-Nemo-2407_12B/Sunfall-NemoMix-Unleashed-12B-v0.6.1-Q8_0.gguf
Verified signatured1b21d2 -
Rename 2024c/Rocinante-12B-v1.1-Q8_0.gguf to Mistral-Nemo-2407_12B/Rocinante-12B-v1.1-Q8_0.gguf
Verified signature64d373f -
Rename 2024c/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q8_0.gguf to Mistral-Nemo-2407_12B/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q8_0.gguf
Verified signature8d09c55 -
Rename 2024c/Rocinante-12B-v1-Q8_0.gguf to Mistral-Nemo-2407_12B/Rocinante-12B-v1-Q8_0.gguf
Verified signature50a15af -
Rename 2024c/NemoMix-Unleashed-12B-Q8_0.gguf to Mistral-Nemo-2407_12B/NemoMix-Unleashed-12B-Q8_0.gguf
Verified signature20156f4 -
Rename 2024c/Mistral-Nemo-Instruct-2407-Q8_0.gguf to Mistral-Nemo-2407_12B/Mistral-Nemo-Instruct-2407-Q8_0.gguf
Verified signature4b08c31 -
Rename 2024c/Chronos-Gold-12B-1.0-Q8_0.gguf to Mistral-Nemo-2407_12B/Chronos-Gold-12B-1.0-Q8_0.gguf
Verified signature4017d24 -
Rename 2024c/Theia-21B-v2b-Q8_0.gguf to Mistral-Nemo-2407_12B_21B/Theia-21B-v2b-Q8_0.gguf
Verified signaturee4d45c0 -
Rename 2024c/Theia-21B-v1-Q8_0.gguf to Mistral-Nemo-2407_12B_21B/Theia-21B-v1-Q8_0.gguf
Verified signaturea30f983 -
Rename 2024c/Meta-Llama-3.1-8B-Instruct-Q8_0.gguf to Llama-3.1-8B/Meta-Llama-3.1-8B-Instruct-Q8_0.gguf
Verified signaturecb327fb -
Rename 2024c/L3.1-8B-sunfall-stheno-v0.6.1-q8_0.gguf to Llama-3.1-8B/L3.1-8B-sunfall-stheno-v0.6.1-q8_0.gguf
Verified signature50ac263 -
Rename 2024c/Cydonia-22B-v1a-Q8_0.gguf to Mistral-Small-2409_22B/Cydonia-22B-v1a-Q8_0.gguf
Verified signature39d5002 -
Rename 2024c/Codestral-22B-v0.1-Q8_0.gguf to Mistral-Small-2409_22B/Codestral-22B-v0.1-Q8_0.gguf
Verified signature34d01d6 -
Rename 2024c/Mistral-Small-Instruct-2409-Q8_0.gguf to Mistral-Small-2409_22B/Mistral-Small-Instruct-2409-Q8_0.gguf
Verified signature3c738cb -
Rename 2024c/gemma-2-27b-it-Q8_0.gguf to Gemma-2-27B/gemma-2-27b-it-Q8_0.gguf
Verified signature0115a97 -
Rename 2024c/c4ai-command-r-08-2024-Q8_0.gguf to Command-R-08-2024_32B/c4ai-command-r-08-2024-Q8_0.gguf
Verified signaturead5df45 -
Rename 2024c/Star-Command-32B-v2b-Q8_0.gguf to Command-R-08-2024_32B/Star-Command-32B-v2b-Q8_0.gguf
Verified signature1c05648 -
Rename 2024c/Qwen2.5-32B-Instruct-Q8_0.gguf to Qwen2.5-32B/Qwen2.5-32B-Instruct-Q8_0.gguf
Verified signatured9b0bdd -
Rename 2024b/kunoichi-dpo-v2-7b.Q8_0.gguf to Mistral-7B/kunoichi-dpo-v2-7b.Q8_0.gguf
Verified signature8f4ff74 -
Rename 2024b/WizardLM-2-7B.Q8_0.gguf to Mistral-7B/WizardLM-2-7B.Q8_0.gguf
Verified signaturedfd18f4 -
Rename 2024b/LemonadeRP-4.5.3.Q8_0.gguf to Mistral-7B/LemonadeRP-4.5.3.Q8_0.gguf
Verified signature9f00411 -
Rename 2024b/LemonWizardv3.Q8_0.gguf to Mistral-7B/LemonWizardv3.Q8_0.gguf
Verified signature6e5bed2 -
Rename 2024b/LemonKunoichiWizardV3.Q8_0.gguf to Mistral-7B/LemonKunoichiWizardV3.Q8_0.gguf
Verified signature3380fc1 -
Rename 2024b/Buddy-2B-v1-F16.gguf to Gemma-2B/Buddy-2B-v1-F16.gguf
Verified signatureba01043 -
Rename 2024b/NemoRemix-12B-q8_0.gguf to Mistral-Nemo-2407_12B/NemoRemix-12B-q8_0.gguf
Verified signaturef539998 -
Rename 2024b/NemoReRemix-12B-q8_0.gguf to Mistral-Nemo-2407_12B/NemoReRemix-12B-q8_0.gguf
Verified signaturea539317 -
Rename 2024b/llama3-8b-cunnygpt-16bit-q8_0.gguf to Llama-3-8B/llama3-8b-cunnygpt-16bit-q8_0.gguf
Verified signature76084f9 -
Rename 2024b/Llama-3SOME-8B-v2-Q8_0.gguf to Llama-3-8B/Llama-3SOME-8B-v2-Q8_0.gguf
Verified signature9b73897 -
Rename 2024b/L3.1-8B-sunfall-v0.6.1-dpo.Q8_0.gguf to Llama-3.1-8B/L3.1-8B-sunfall-v0.6.1-dpo.Q8_0.gguf
Verified signature98537a1 -
Rename 2024b/L3-8B-sunfall-v0.4-stheno-v3.2.Q8_0.gguf to Llama-3-8B/L3-8B-sunfall-v0.4-stheno-v3.2.Q8_0.gguf
Verified signaturea115e4f -
Rename 2024b/L3-8B-Sunfall-v0.4-Stheno-v3.2-Q8_0-imat.gguf to Llama-3-8B/L3-8B-Sunfall-v0.4-Stheno-v3.2-Q8_0-imat.gguf
Verified signature276c2f4 -
Rename 2024b/L3-8B-Stheno-v3.2-Q8_0.gguf to Llama-3-8B/L3-8B-Stheno-v3.2-Q8_0.gguf
Verified signaturee0d3c95 -
Rename 2024b/L3-8B-Lunaris-v1-Q8_0.gguf to Llama-3-8B/L3-8B-Lunaris-v1-Q8_0.gguf
Verified signatureb788d07 -
Rename 2024b/gemma-2-9b-it-Q8_0.gguf to Gemma-2-9B/gemma-2-9b-it-Q8_0.gguf
Verified signatureb9caffe -
Rename 2024b/Gemmasutra-9B-v1c-Q8_0.gguf to Gemma-2-9B/Gemmasutra-9B-v1c-Q8_0.gguf
Verified signature8020aac -
Rename 2024b/Moistral-11B-v3-Q8_0.gguf to SOLAR-10.7B-v1.0/Moistral-11B-v3-Q8_0.gguf
Verified signature6b49857 -
Rename 2024b/Fimbulvetr-11B-v2.1-16K.Q8_0.gguf to SOLAR-10.7B-v1.0/Fimbulvetr-11B-v2.1-16K.Q8_0.gguf
Verified signature5be5ba9 -
Rename 2024b/Fimbulvetr-11B-v2-Test-14.q8_0.gguf to SOLAR-10.7B-v1.0/Fimbulvetr-11B-v2-Test-14.q8_0.gguf
Verified signature9bc931d -
Rename 2024b/Gemmasutra-Pro-27B-v1i-Q8_0.gguf to Gemma-2-27B/Gemmasutra-Pro-27B-v1i-Q8_0.gguf
Verified signature4203467 -
Rename c4ai-command-r-v01_35B/Star-Command-R-32B-v1-Q8_0.gguf to Command-R-08-2024_32B/Star-Command-R-32B-v1-Q8_0.gguf
Verified signature0aa84aa -
Rename c4ai-command-r-v01_35B/c4ai-command-r-v01.Q8_0.gguf to Command-R-v01_35B/c4ai-command-r-v01.Q8_0.gguf
Verified signatureb14152f -
Rename c4ai-command-r-v01_35B/Coomand-R-35B-v1-Q8_0.gguf to Command-R-v01_35B/Coomand-R-35B-v1-Q8_0.gguf
Verified signature3f7e825 -
Rename 2024b/Star-Command-R-32B-v1-Q8_0.gguf to c4ai-command-r-v01_35B/Star-Command-R-32B-v1-Q8_0.gguf
Verified signaturea00a4e7 -
Rename 2024b/mixtral-8x7b-instruct-v0.1-limarp-zloss.Q6_K.gguf to Mixtral-8x7B-v0.1/mixtral-8x7b-instruct-v0.1-limarp-zloss.Q6_K.gguf
Verified signature3bf21a9