Instructions to use Xananthium/Inference-Model-Archive-2026-10 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Xananthium/Inference-Model-Archive-2026-10 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0 # Run inference directly in the terminal: llama cli -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0 # Run inference directly in the terminal: llama cli -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0
Use Docker
docker model run hf.co/Xananthium/Inference-Model-Archive-2026-10:Q8_0
- Llama new
- LM Studio
- Jan
- Ollama
How to use Xananthium/Inference-Model-Archive-2026-10 with Ollama:
ollama run hf.co/Xananthium/Inference-Model-Archive-2026-10:Q8_0
- Unsloth Desktop
- Pi
How to use Xananthium/Inference-Model-Archive-2026-10 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Xananthium/Inference-Model-Archive-2026-10:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Xananthium/Inference-Model-Archive-2026-10 with Docker Model Runner:
docker model run hf.co/Xananthium/Inference-Model-Archive-2026-10:Q8_0
- Lemonade
How to use Xananthium/Inference-Model-Archive-2026-10 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Xananthium/Inference-Model-Archive-2026-10:Q8_0
Run and chat with the model
lemonade run user.Inference-Model-Archive-2026-10-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use Xananthium/Inference-Model-Archive-2026-10 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default Xananthium/Inference-Model-Archive-2026-10:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Xananthium/Inference-Model-Archive-2026-10 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Xananthium/Inference-Model-Archive-2026-10:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "Xananthium/Inference-Model-Archive-2026-10:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
-
Publish verified checkpoint registry and completion status
Verified signature3075844 -
Refresh source credits, loader instructions and measured comparison reports
Verified signature7ee66c5 -
Refresh source credits, loader instructions and measured comparison reports
Verified signature2671ed7 -
Refresh source credits, loader instructions and measured comparison reports
Verified signature7e7728d -
Refresh source credits, loader instructions and measured comparison reports
Verified signature02d0e9d -
Refresh source credits, loader instructions and measured comparison reports
Verified signature8fdbc34 -
Refresh source credits, loader instructions and measured comparison reports
Verified signature37e6adf -
Refresh source credits, loader instructions and measured comparison reports
Verified signature420388b -
Refresh source credits, loader instructions and measured comparison reports
Verified signature7fc695c -
Refresh source credits, loader instructions and measured comparison reports
Verified signatureef36243 -
Refresh source credits, loader instructions and measured comparison reports
Verified signature5b1c71c -
Refresh source credits, loader instructions and measured comparison reports
Verified signaturefdad9ec -
Refresh source credits, loader instructions and measured comparison reports
Verified signature250d1b9 -
Refresh source credits, loader instructions and measured comparison reports
Verified signature3446ea8 -
Publish qwen3.8-27b-w4a16-vision-mtp with measured results and source credits
Verified signature6a9f5b5 -
Publish qwen3.8-27b-hauhau-w8a8-vision-mtp with measured results and source credits
Verified signature9c42be4 -
Publish qwen3.6-35b-hauhau-w8a8-tq4-runtime with measured results and source credits
Verified signatureeaf3eb5 -
Publish qwen3.6-35b-hauhau-w8a16-trt with measured results and source credits
Verified signaturebf16dcd -
Publish qwen3.6-35b-hauhau-reconstructed-bf16 with measured results and source credits
Verified signature671f52b -
Publish qwen3.6-35b-hauhau-nvfp4-trt with measured results and source credits
Verified signaturea56f78a -
Publish qwen3.6-35b-hauhau-int8-sq-trt with measured results and source credits
Verified signature05e3d5e -
Publish qwen3.5-35b-a3b-nvfp4 with measured results and source credits
Verified signaturecfcc7e1 -
Publish olmoe-1b-7b-0924-bf16 with measured results and source credits
Verified signaturef64ee1e -
Publish hauhau-qwen3.8-27b-source with measured results and source credits
Verified signatured3005ca -
Publish hauhau-qwen3.6-35b-source with measured results and source credits
Verified signatureeb5ce07 -
Publish qwen36-int8-sq-export-probe with measured results and source credits
Verified signatureb312337 -
Publish qwen36-int8-mixed-probe with measured results and source credits
Verified signature5a053e8 -
Document checkpoint archive inventory and publication status
Verified signature1e59dcd -
initial commit
Verified signature1cae634