Instructions to use miikhal/Llama-3.1-8B-python-mqp with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use miikhal/Llama-3.1-8B-python-mqp with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf miikhal/Llama-3.1-8B-python-mqp:BF16 --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf miikhal/Llama-3.1-8B-python-mqp:BF16 --embeddings
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible embeddings server: ./llama-server -hf miikhal/Llama-3.1-8B-python-mqp:BF16 --embeddings
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible embeddings server: ./build/bin/llama-server -hf miikhal/Llama-3.1-8B-python-mqp:BF16 --embeddings
- LM Studio
- Jan
- Ollama
How to use miikhal/Llama-3.1-8B-python-mqp with Ollama:
ollama run hf.co/miikhal/Llama-3.1-8B-python-mqp:BF16
- Unsloth Desktop
- Docker Model Runner
How to use miikhal/Llama-3.1-8B-python-mqp with Docker Model Runner:
docker model run hf.co/miikhal/Llama-3.1-8B-python-mqp:BF16
- Lemonade
How to use miikhal/Llama-3.1-8B-python-mqp with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull miikhal/Llama-3.1-8B-python-mqp:BF16
Run and chat with the model
lemonade run user.Llama-3.1-8B-python-mqp-BF16
List all available models
lemonade list
- Atomic Chat
Commit History
-
Upload folder using huggingface_hub
Verified signature9f5c72a -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster9cf51dd
-
Upload unsloth.Q8_0.gguf
Verified signatured895205 -
Upload unsloth.BF16.gguf
Verified signature07ccc7a -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster484cc60 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster6202ca0
-
Upload folder using huggingface_hub
Verified signaturebebf0c9 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster76fbf70 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster4f3058c -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterd52a3cb -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasterd566260 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster7fe6032 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x fasteref463ac -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster40a0c6f -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster961810f -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster976232c -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster37c00bf -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster5acfc63 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster23ce891 -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster4a4ac5f -
Upload model trained with Unsloth
Verified signatureUpload model trained with Unsloth 2x faster1cfdc86
-
Create README.md
Verified signature675fa1d
-
initial commit
Verified signaturedd5e1ab