Instructions to use knifeayumu/LLM_Collection with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use knifeayumu/LLM_Collection with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf knifeayumu/LLM_Collection:Q4_K_M # Run inference directly in the terminal: llama cli -hf knifeayumu/LLM_Collection:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf knifeayumu/LLM_Collection:Q4_K_M # Run inference directly in the terminal: llama cli -hf knifeayumu/LLM_Collection:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf knifeayumu/LLM_Collection:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf knifeayumu/LLM_Collection:Q4_K_M
Use Docker
docker model run hf.co/knifeayumu/LLM_Collection:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use knifeayumu/LLM_Collection with Ollama:
ollama run hf.co/knifeayumu/LLM_Collection:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use knifeayumu/LLM_Collection with Docker Model Runner:
docker model run hf.co/knifeayumu/LLM_Collection:Q4_K_M
- Lemonade
How to use knifeayumu/LLM_Collection with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull knifeayumu/LLM_Collection:Q4_K_M
Run and chat with the model
lemonade run user.LLM_Collection-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Commit History
-
Upload TheDrummer_Cydonia-24B-v4-Q8_0.gguf
Verified signaturef1f1049 -
Upload TheDrummer_Big-Tiger-Gemma-27B-v3-Q8_0.gguf
Verified signature683ebaf -
Upload TheDrummer_Valkyrie-49B-v1a-Q6_K.gguf
Verified signature38e9436 -
Upload 2 files
Verified signaturebc4e587 -
Upload 2 files
Verified signaturecd7cd64 -
Upload 2 files
Verified signatureec429af -
Upload 2 files
Verified signature50f12cb
-
Upload Valkyrie-49B-v1a-Q6_K.gguf
Verified signaturee990f2f -
Upload Qwen3-32B-Q8_0.gguf
Verified signature8479195
-
Upload GLM-4-32B-0414-Q8_0.gguf
Verified signaturef6857ee
-
Upload 2 files
Verified signaturee8700ef -
Upload 2 files
Verified signature2d64dc1
-
Upload 2 files
Verified signature9efcd92 -
Upload 2 files
Verified signature48cd6a5
-
Upload 2 files
Verified signature0722fa5 -
Upload 2 files
Verified signature2d25e01 -
Upload 2 files
Verified signature2a0de22 -
Upload Fallen-QwQ-32B-v1d-Q8_0.gguf
Verified signature0aa58db -
Upload QwQ-32B-Q8_0.gguf
Verified signature0cd08aa
-
Upload 3 files
Verified signaturef2ac9c9 -
Upload 2 files
Verified signature5fe3c87 -
Upload 2 files
Verified signaturef7bce3b -
Upload 2 files
Verified signature3ecac7b -
Upload 2 files
Verified signature484c0c0
-
Upload 3 files
Verified signature83c24c6
-
Upload 2 files
Verified signature978c0e1 -
Upload 2 files
Verified signature51c92a5
-
Upload Mistral-Small-24B-Instruct-2501-Q8_0.gguf
Verified signature5da2ac5
-
Upload 2 files
Verified signature333549d -
Rename 2025a/Negative_LLAMA_70B-Q6_K-00002-of-00002.gguf to Llama-3.3-70B/Negative_LLAMA_70B-Q6_K-00002-of-00002.gguf
Verified signature503c6a8 -
Rename 2025a/Negative_LLAMA_70B-Q6_K-00001-of-00002.gguf to Llama-3.3-70B/Negative_LLAMA_70B-Q6_K-00001-of-00002.gguf
Verified signaturea3597a8 -
Rename 2025a/Negative-Anubis-70B-v1-Q6_K-00002-of-00002.gguf to Llama-3.3-70B/Negative-Anubis-70B-v1-Q6_K-00002-of-00002.gguf
Verified signature8453496 -
Rename 2025a/Negative-Anubis-70B-v1-Q6_K-00001-of-00002.gguf to Llama-3.3-70B/Negative-Anubis-70B-v1-Q6_K-00001-of-00002.gguf
Verified signaturecceb2e2 -
Rename 2025a/L3.3-MS-Nevoria-70b-Q6_K-00002-of-00002.gguf to Llama-3.3-70B/L3.3-MS-Nevoria-70b-Q6_K-00002-of-00002.gguf
Verified signature97515ea -
Rename 2025a/L3.3-MS-Nevoria-70b-Q6_K-00001-of-00002.gguf to Llama-3.3-70B/L3.3-MS-Nevoria-70b-Q6_K-00001-of-00002.gguf
Verified signatureb9cfb84 -
Rename 2025a/L3.3-70B-Magnum-v4-SE-Q6_K-00002-of-00002.gguf to Llama-3.3-70B/L3.3-70B-Magnum-v4-SE-Q6_K-00002-of-00002.gguf
Verified signaturef866dd0 -
Rename 2025a/L3.3-70B-Magnum-v4-SE-Q6_K-00001-of-00002.gguf to Llama-3.3-70B/L3.3-70B-Magnum-v4-SE-Q6_K-00001-of-00002.gguf
Verified signatureba1e461 -
Rename 2025a/Cydonia-v1.2-v1.3-Magnum-v4-22B.Q8_0.gguf to Mistral-Small-2409_22B/Cydonia-v1.2-v1.3-Magnum-v4-22B.Q8_0.gguf
Verified signaturee904176 -
Rename 2025a/Cydonia-v1.2-v1.3-22B.Q8_0.gguf to Mistral-Small-2409_22B/Cydonia-v1.2-v1.3-22B.Q8_0.gguf
Verified signature3b1fd6d -
Rename 2024e/L3.3-70B-Euryale-v2.3.Q6_K-00002-of-00002.gguf to Llama-3.3-70B/L3.3-70B-Euryale-v2.3.Q6_K-00002-of-00002.gguf
Verified signature92220a9 -
Rename 2024e/L3.3-70B-Euryale-v2.3.Q6_K-00001-of-00002.gguf to Llama-3.3-70B/L3.3-70B-Euryale-v2.3.Q6_K-00001-of-00002.gguf
Verified signature159f69f -
Rename 2024e/Anubis-70B-v1-Q6_K-00002-of-00002.gguf to Llama-3.3-70B/Anubis-70B-v1-Q6_K-00002-of-00002.gguf
Verified signatured8a7481 -
Rename Llama-3.1-70B/Anubis-70B-v1-Q6_K-00001-of-00002.gguf to Llama-3.3-70B/Anubis-70B-v1-Q6_K-00001-of-00002.gguf
Verified signatured6957af -
Rename 2024e/Anubis-70B-v1-Q6_K-00001-of-00002.gguf to Llama-3.1-70B/Anubis-70B-v1-Q6_K-00001-of-00002.gguf
Verified signaturefa618ef -
Rename 2024e/Endurance-100B-v1a-Q4_K_M-00002-of-00002.gguf to Mistral-Large-2407_123B_100B/Endurance-100B-v1a-Q4_K_M-00002-of-00002.gguf
Verified signaturea7c0528 -
Rename 2024e/Endurance-100B-v1a-Q4_K_M-00001-of-00002.gguf to Mistral-Large-2407_123B_100B/Endurance-100B-v1a-Q4_K_M-00001-of-00002.gguf
Verified signaturefd47ef2 -
Rename 2024e/Rocinante-12B-v2i-Q8_0.gguf to Mistral-Nemo-2407_12B/Rocinante-12B-v2i-Q8_0.gguf
Verified signature29bee11 -
Rename 2024e/Rocinante-12B-v2j-Q8_0.gguf to Mistral-Nemo-2407_12B/Rocinante-12B-v2j-Q8_0.gguf
Verified signature4d98bd1 -
Rename 2024e/Evathene-v1.3-Q5_K_M-00002-of-00002.gguf to Qwen2.5-72B/Evathene-v1.3-Q5_K_M-00002-of-00002.gguf
Verified signature14841d6 -
Rename 2024e/Evathene-v1.3-Q5_K_M-00001-of-00002.gguf to Qwen2.5-72B/Evathene-v1.3-Q5_K_M-00001-of-00002.gguf
Verified signatureb6b573c