Instructions to use mkleinegger/tmp with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use mkleinegger/tmp with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf mkleinegger/tmp:IQ1_M # Run inference directly in the terminal: llama cli -hf mkleinegger/tmp:IQ1_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf mkleinegger/tmp:IQ1_M # Run inference directly in the terminal: llama cli -hf mkleinegger/tmp:IQ1_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf mkleinegger/tmp:IQ1_M # Run inference directly in the terminal: ./build/bin/llama cli -hf mkleinegger/tmp:IQ1_M
Use Docker
docker model run hf.co/mkleinegger/tmp:IQ1_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use mkleinegger/tmp with Ollama:
ollama run hf.co/mkleinegger/tmp:IQ1_M
- Unsloth Desktop
- Pi
How to use mkleinegger/tmp with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf mkleinegger/tmp:IQ1_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "mkleinegger/tmp:IQ1_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use mkleinegger/tmp with Docker Model Runner:
docker model run hf.co/mkleinegger/tmp:IQ1_M
- Lemonade
How to use mkleinegger/tmp with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull mkleinegger/tmp:IQ1_M
Run and chat with the model
lemonade run user.tmp-IQ1_M
List all available models
lemonade list
- Hermes Agent
How to use mkleinegger/tmp with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf mkleinegger/tmp:IQ1_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default mkleinegger/tmp:IQ1_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use mkleinegger/tmp with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf mkleinegger/tmp:IQ1_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "mkleinegger/tmp:IQ1_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download data-copy-manifest.json from mkleinegger/tmp: direct link, hf CLI and curl.
- Browser
- Download file 12.5 kB
-
https://huggingface.co/mkleinegger/tmp/resolve/main/data-copy-manifest.json
- Command line
-
hf download hf://mkleinegger/tmp/data-copy-manifest.json
-
curl -L -o data-copy-manifest.json https://huggingface.co/mkleinegger/tmp/resolve/main/data-copy-manifest.json
12.5 kB
| { | |
| "source": "/srv/shared-gsq-rco/qwen3.8-27b-gsq-rco", | |
| "total_bytes": 170431653751, | |
| "files": [ | |
| { | |
| "path": "models/Qwen3.8-27B/LICENSE", | |
| "bytes": 11544, | |
| "copy_check": "full-sha256", | |
| "sha256": "bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/README.md", | |
| "bytes": 65012, | |
| "copy_check": "full-sha256", | |
| "sha256": "57e4bdb258ee1a7d2635c5174ebd4e56abe392505cdb5f8bbb356b0dc4293641" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/chat_template.jinja", | |
| "bytes": 8952, | |
| "copy_check": "full-sha256", | |
| "sha256": "c3cf9e34abf4f9e36c2d72165aa9c132d3e2a725b6c2586aaa3a8af9d7a81041" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/config.json", | |
| "bytes": 4312, | |
| "copy_check": "full-sha256", | |
| "sha256": "191e0af232104ed8b65258cf3fb2b842e288008baca7633c11b82a1ac7203aab" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/crc32.txt", | |
| "bytes": 238, | |
| "copy_check": "full-sha256", | |
| "sha256": "b42dd291f5f98b05807e458f5b47849969a9b3326acbf0c97d28b05826740b83" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/generation_config.json", | |
| "bytes": 202, | |
| "copy_check": "full-sha256", | |
| "sha256": "e70c136c1b78ddc1fb0905bac8e733a4dc448d4f852a5dd75143fffc70be550e" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/merges.txt", | |
| "bytes": 3353259, | |
| "copy_check": "full-sha256", | |
| "sha256": "a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00001-of-00018.safetensors", | |
| "bytes": 3966730552, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00002-of-00018.safetensors", | |
| "bytes": 3043080328, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00003-of-00018.safetensors", | |
| "bytes": 2542796952, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00004-of-00018.safetensors", | |
| "bytes": 3988973152, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00005-of-00018.safetensors", | |
| "bytes": 2099339864, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00006-of-00018.safetensors", | |
| "bytes": 3979553696, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00007-of-00018.safetensors", | |
| "bytes": 2108759344, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00008-of-00018.safetensors", | |
| "bytes": 3979553696, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00009-of-00018.safetensors", | |
| "bytes": 2108759344, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00010-of-00018.safetensors", | |
| "bytes": 3979553696, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00011-of-00018.safetensors", | |
| "bytes": 2108759344, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00012-of-00018.safetensors", | |
| "bytes": 3979553696, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00013-of-00018.safetensors", | |
| "bytes": 2108759344, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00014-of-00018.safetensors", | |
| "bytes": 3979553696, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00015-of-00018.safetensors", | |
| "bytes": 2108759344, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00016-of-00018.safetensors", | |
| "bytes": 3979564040, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00017-of-00018.safetensors", | |
| "bytes": 2108759344, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model-00018-of-00018.safetensors", | |
| "bytes": 3392197344, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/model.safetensors.index.json", | |
| "bytes": 112216, | |
| "copy_check": "full-sha256", | |
| "sha256": "77042094076611b69791a610065f28b7013b8c621795fa86ddccc8bac7d1b9df" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/preprocessor_config.json", | |
| "bytes": 390, | |
| "copy_check": "full-sha256", | |
| "sha256": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/tokenizer.json", | |
| "bytes": 12809320, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/tokenizer_config.json", | |
| "bytes": 17928, | |
| "copy_check": "full-sha256", | |
| "sha256": "b11349aafa7cdc6a320767cf7ceb29ed82f7eda5d65e8e0819e76f0ce947bf27" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/video_preprocessor_config.json", | |
| "bytes": 385, | |
| "copy_check": "full-sha256", | |
| "sha256": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13" | |
| }, | |
| { | |
| "path": "models/Qwen3.8-27B/vocab.json", | |
| "bytes": 6722759, | |
| "copy_check": "full-sha256", | |
| "sha256": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003" | |
| }, | |
| { | |
| "path": "calibration/fineweb_edu.json", | |
| "bytes": 195, | |
| "copy_check": "full-sha256", | |
| "sha256": "39db332b2ed04b850ea19ea0fbe6f950620b2f3490fc197b2340a2fc861bd887" | |
| }, | |
| { | |
| "path": "calibration/fineweb_edu.pt", | |
| "bytes": 20801707, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "calibration/wikitext2/dataset_dict.json", | |
| "bytes": 43, | |
| "copy_check": "full-sha256", | |
| "sha256": "494e7596c43cc051a863f0662a43682fe87ba461434d551d42c68310c5a292f3" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/test/data-00000-of-00001.arrow", | |
| "bytes": 1306200, | |
| "copy_check": "full-sha256", | |
| "sha256": "2b8a3efac7b468cbe6432edba5f55c21e435d93873acc6727431f08d5ed328ea" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/test/dataset_info.json", | |
| "bytes": 872, | |
| "copy_check": "full-sha256", | |
| "sha256": "8c4dc361b1fb813c27b5d3efc171272ae5762e2badf8277df309132ec44b23f0" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/test/state.json", | |
| "bytes": 249, | |
| "copy_check": "full-sha256", | |
| "sha256": "948eef62634ec432b05cb5524d91325ea5dd65017758b0855c9fe9770cd92aaf" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/train/data-00000-of-00001.arrow", | |
| "bytes": 11068328, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "calibration/wikitext2/train/dataset_info.json", | |
| "bytes": 872, | |
| "copy_check": "full-sha256", | |
| "sha256": "8c4dc361b1fb813c27b5d3efc171272ae5762e2badf8277df309132ec44b23f0" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/train/state.json", | |
| "bytes": 250, | |
| "copy_check": "full-sha256", | |
| "sha256": "6edea174d559f61575e925cd4d00e1cce1e845d24ba3d25f5c298990031de069" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/validation/data-00000-of-00001.arrow", | |
| "bytes": 1160224, | |
| "copy_check": "full-sha256", | |
| "sha256": "8e136ab7130c5fca602eb406ce2557967a974d901b53c4f2992f87b873e0fe5b" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/validation/dataset_info.json", | |
| "bytes": 872, | |
| "copy_check": "full-sha256", | |
| "sha256": "8c4dc361b1fb813c27b5d3efc171272ae5762e2badf8277df309132ec44b23f0" | |
| }, | |
| { | |
| "path": "calibration/wikitext2/validation/state.json", | |
| "bytes": 255, | |
| "copy_check": "full-sha256", | |
| "sha256": "b45257cf8916da55564795f92e8354454b0e4cd128644e0a1d6a273825bdc361" | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ1_M.gguf", | |
| "bytes": 5946522208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ1_S.gguf", | |
| "bytes": 5376359008, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ2_S.gguf", | |
| "bytes": 8675482208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ2_XS.gguf", | |
| "bytes": 7915264608, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ2_XXS.gguf", | |
| "bytes": 7155047008, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ3_S.gguf", | |
| "bytes": 11614362208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ3_XXS.gguf", | |
| "bytes": 10354842208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-IQ4_XS.gguf", | |
| "bytes": 14343322208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-Q2_0.gguf", | |
| "bytes": 7745427104, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-Q2_K.gguf", | |
| "bytes": 8885402208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-Q3_K.gguf", | |
| "bytes": 11614362208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "qwen3.8-27b-gguf-uniform/Qwen3.8-27B-Q4_K.gguf", | |
| "bytes": 15183002208, | |
| "copy_check": "size-plus-first-and-last-1MiB", | |
| "sha256": null | |
| }, | |
| { | |
| "path": "reference-assignments/gsq-types-1.85bpw.json", | |
| "bytes": 24959, | |
| "copy_check": "full-sha256", | |
| "sha256": "89cf99bcb4a3de74ee95321494a52a171b53303260a59637983d0aab97394c86" | |
| }, | |
| { | |
| "path": "reference-assignments/projected_gumbel_kl_bw1-2-3-4-5-6-7-8-9-10_target1.8346_fineweb_edu_256s_grpnogrp.json", | |
| "bytes": 538653, | |
| "copy_check": "full-sha256", | |
| "sha256": "561b218c98d8b1600aa3af56a6c2912612ac3179491b68e9ba75f04618028bdd" | |
| }, | |
| { | |
| "path": "reference-assignments/projected_gumbel_kl_bw1-2-3-4-5-6-7-8-9-10_target3.236_fineweb_edu_256s_grpnogrp.json", | |
| "bytes": 539150, | |
| "copy_check": "full-sha256", | |
| "sha256": "9cd13c7f6ea84b682491fb605c542ab7bd37985fe727742df72857428819b90c" | |
| }, | |
| { | |
| "path": "reference-assignments/projected_gumbel_kl_bw1-2-3-4-5-6-7-8-9-10_target3.4862_fineweb_edu_256s_grpnogrp.json", | |
| "bytes": 538644, | |
| "copy_check": "full-sha256", | |
| "sha256": "4e96d618ccc1b4efb8f8bca47ac6c08311b37faac1fed3706a93591c90a5ebd4" | |
| }, | |
| { | |
| "path": "model-manifest.json", | |
| "bytes": 5046, | |
| "copy_check": "full-sha256", | |
| "sha256": "aade29951bb138512479163b57b2c4166bc6afee9afbcc361af1a45c0a9f7cdc" | |
| }, | |
| { | |
| "path": "input-manifest.json", | |
| "bytes": 1161, | |
| "copy_check": "full-sha256", | |
| "sha256": "1d98cc5c0b516bf56f024cf111465b3ddbdcf3470652b33d3b454150266eb67c" | |
| }, | |
| { | |
| "path": "model-metadata/ssm_perms_38-27b.json", | |
| "bytes": 132220, | |
| "copy_check": "full-sha256", | |
| "sha256": "5a9913b0c479104fc618ca70e2904f44b0c6cfccf73f5ac81dd4da8527607349" | |
| }, | |
| { | |
| "path": "model-metadata/hf_linear_modules_38-27b.json", | |
| "bytes": 25166, | |
| "copy_check": "full-sha256", | |
| "sha256": "9336e13b9ed60b27b264834bc1f3b1cb32114f662a622ca2062bcb769710542a" | |
| } | |
| ] | |
| } |