Instructions to use cstr/index-echo-2b-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use cstr/index-echo-2b-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf cstr/index-echo-2b-GGUF:F16 # Run inference directly in the terminal: llama cli -hf cstr/index-echo-2b-GGUF:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf cstr/index-echo-2b-GGUF:F16 # Run inference directly in the terminal: llama cli -hf cstr/index-echo-2b-GGUF:F16
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf cstr/index-echo-2b-GGUF:F16 # Run inference directly in the terminal: ./build/bin/llama cli -hf cstr/index-echo-2b-GGUF:F16
Use Docker
docker model run hf.co/cstr/index-echo-2b-GGUF:F16
- Llama new
- LM Studio
- Jan
- Ollama
How to use cstr/index-echo-2b-GGUF with Ollama:
ollama run hf.co/cstr/index-echo-2b-GGUF:F16
- Unsloth Desktop
- Pi
How to use cstr/index-echo-2b-GGUF with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf cstr/index-echo-2b-GGUF:F16
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "cstr/index-echo-2b-GGUF:F16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use cstr/index-echo-2b-GGUF with Docker Model Runner:
docker model run hf.co/cstr/index-echo-2b-GGUF:F16
- Lemonade
How to use cstr/index-echo-2b-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull cstr/index-echo-2b-GGUF:F16
Run and chat with the model
lemonade run user.index-echo-2b-GGUF-F16
List all available models
lemonade list
- Hermes Agent
How to use cstr/index-echo-2b-GGUF with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf cstr/index-echo-2b-GGUF:F16
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default cstr/index-echo-2b-GGUF:F16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use cstr/index-echo-2b-GGUF with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf cstr/index-echo-2b-GGUF:F16
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "cstr/index-echo-2b-GGUF:F16" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download conversion-receipt.json from cstr/index-echo-2b-GGUF: direct link, hf CLI and curl.
- Browser
- Download file 5.59 kB
-
https://huggingface.co/cstr/index-echo-2b-GGUF/resolve/main/conversion-receipt.json
- Command line
-
hf download hf://cstr/index-echo-2b-GGUF/conversion-receipt.json
-
curl -L -o conversion-receipt.json https://huggingface.co/cstr/index-echo-2b-GGUF/resolve/main/conversion-receipt.json
5.59 kB
| { | |
| "source": "IndexTeam/Index-Echo-S2TT-2B", | |
| "revision": "5d98a34d9685869b11e9c94d01dee22a8b8e53b5", | |
| "converter_revision": "42d958167a748f2c04b1f888e84e7a58f609ddcb", | |
| "destination": "cstr/index-echo-2b-GGUF", | |
| "validated": false, | |
| "artifacts": [ | |
| { | |
| "path": "LICENSE", | |
| "bytes": 11343, | |
| "sha256": "50cbab8a892c5f2993b8c7351a99182507472def3b1374558308605d99b86b32" | |
| }, | |
| { | |
| "path": "index-echo-2b-f16.gguf", | |
| "bytes": 1313848896, | |
| "sha256": "fcb3f431c5898ce2029b96b04ef01d9bb8ed913ab1aad3d0ee01e1e17f8a0f44" | |
| }, | |
| { | |
| "path": "index-echo-2b-decoder-f16.gguf", | |
| "bytes": 3775708896, | |
| "sha256": "3f503cbd23ba45fd3b9f83db4d7d0060cb95ba227b5f133237ed539ad2bdde44" | |
| }, | |
| { | |
| "path": "index-echo-2b-q8_0.gguf", | |
| "bytes": 702951040, | |
| "sha256": "c1d0d99086204c8640452666ca854f0140261c9654c47ace4e9eee4a72e7e06a" | |
| }, | |
| { | |
| "path": "index-echo-2b-decoder-q8_0.gguf", | |
| "bytes": 2012012256, | |
| "sha256": "4c18f70d402600f74fce568ebe7fddff9d3d14ba3b97c19c59e79b11636c3ce1" | |
| }, | |
| { | |
| "path": "index-echo-2b-q4_k.gguf", | |
| "bytes": 377138816, | |
| "sha256": "18698dac260b1cfac3d95e49ebdbc7787362ce19ae5e0faa802d70d4becbaa1a" | |
| }, | |
| { | |
| "path": "index-echo-2b-decoder-q4_k.gguf", | |
| "bytes": 1071374048, | |
| "sha256": "57fee5c3a64d02b49e069654ec2d32d4f81b3e9a6e6fd54d7a86f971fc04cbd0" | |
| } | |
| ], | |
| "events": [ | |
| { | |
| "name": "download pinned source", | |
| "utc": "2026-10-01T15:36:27Z" | |
| }, | |
| { | |
| "name": "uploaded: LICENSE", | |
| "utc": "2026-10-01T15:36:58Z" | |
| }, | |
| { | |
| "name": "run: git init /mnt/heavy/scratch/index-echo/llama-converter", | |
| "utc": "2026-10-01T15:36:58Z" | |
| }, | |
| { | |
| "name": "run: git remote add origin https://github.com/ggml-org/llama.cpp.git", | |
| "utc": "2026-10-01T15:36:58Z" | |
| }, | |
| { | |
| "name": "run: git fetch --depth=1 origin 42d958167a748f2c04b1f888e84e7a58f609ddcb", | |
| "utc": "2026-10-01T15:36:58Z" | |
| }, | |
| { | |
| "name": "run: git checkout FETCH_HEAD", | |
| "utc": "2026-10-01T15:37:02Z" | |
| }, | |
| { | |
| "name": "run: /opt/hostedtoolcache/Python/3.12.14/arm64/bin/python /home/runner/work/CrispASR/CrispASR/models/convert-index-echo-to-gguf.py --model /mnt/heavy/scratch/index-echo/source --output /mnt/heavy/scratch/index-echo/index-echo-2b-f16.gguf", | |
| "utc": "2026-10-01T15:37:03Z" | |
| }, | |
| { | |
| "name": "uploaded: index-echo-2b-f16.gguf", | |
| "utc": "2026-10-01T15:37:11Z" | |
| }, | |
| { | |
| "name": "run: /opt/hostedtoolcache/Python/3.12.14/arm64/bin/python /mnt/heavy/scratch/index-echo/llama-converter/convert_hf_to_gguf.py /mnt/heavy/scratch/index-echo/source/llm --outfile /mnt/heavy/scratch/index-echo/index-echo-2b-decoder-f16.gguf --outtype f16 --no-mtp", | |
| "utc": "2026-10-01T15:37:11Z" | |
| }, | |
| { | |
| "name": "uploaded: index-echo-2b-decoder-f16.gguf", | |
| "utc": "2026-10-01T15:37:47Z" | |
| }, | |
| { | |
| "name": "run: cmake -S /home/runner/work/CrispASR/CrispASR -B /mnt/heavy/scratch/index-echo/build -G Ninja -DCMAKE_BUILD_TYPE=Release -DCRISPASR_BUILD_TESTS=OFF -DCRISPASR_BUILD_SERVER=OFF -DGGML_NATIVE=OFF", | |
| "utc": "2026-10-01T15:37:47Z" | |
| }, | |
| { | |
| "name": "run: cmake --build /mnt/heavy/scratch/index-echo/build --target crispasr-quantize -j 4", | |
| "utc": "2026-10-01T15:37:51Z" | |
| }, | |
| { | |
| "name": "run: /opt/hostedtoolcache/Python/3.12.14/arm64/bin/python /home/runner/work/CrispASR/CrispASR/models/convert-index-echo-to-gguf.py --model /mnt/heavy/scratch/index-echo/source --output /mnt/heavy/scratch/index-echo/index-echo-2b-f16.gguf --decoder-name index-echo-2b-decoder-q8_0.gguf", | |
| "utc": "2026-10-01T15:41:06Z" | |
| }, | |
| { | |
| "name": "run: /mnt/heavy/scratch/index-echo/build/bin/crispasr-quantize /mnt/heavy/scratch/index-echo/index-echo-2b-f16.gguf /mnt/heavy/scratch/index-echo/index-echo-2b-q8_0.gguf q8_0", | |
| "utc": "2026-10-01T15:41:14Z" | |
| }, | |
| { | |
| "name": "uploaded: index-echo-2b-q8_0.gguf", | |
| "utc": "2026-10-01T15:41:19Z" | |
| }, | |
| { | |
| "name": "run: /mnt/heavy/scratch/index-echo/build/bin/crispasr-quantize /mnt/heavy/scratch/index-echo/index-echo-2b-decoder-f16.gguf /mnt/heavy/scratch/index-echo/index-echo-2b-decoder-q8_0.gguf q8_0", | |
| "utc": "2026-10-01T15:41:19Z" | |
| }, | |
| { | |
| "name": "uploaded: index-echo-2b-decoder-q8_0.gguf", | |
| "utc": "2026-10-01T15:41:35Z" | |
| }, | |
| { | |
| "name": "run: /opt/hostedtoolcache/Python/3.12.14/arm64/bin/python /home/runner/work/CrispASR/CrispASR/models/convert-index-echo-to-gguf.py --model /mnt/heavy/scratch/index-echo/source --output /mnt/heavy/scratch/index-echo/index-echo-2b-f16.gguf --decoder-name index-echo-2b-decoder-q4_k.gguf", | |
| "utc": "2026-10-01T15:41:35Z" | |
| }, | |
| { | |
| "name": "run: /mnt/heavy/scratch/index-echo/build/bin/crispasr-quantize /mnt/heavy/scratch/index-echo/index-echo-2b-f16.gguf /mnt/heavy/scratch/index-echo/index-echo-2b-q4_k.gguf q4_k", | |
| "utc": "2026-10-01T15:41:44Z" | |
| }, | |
| { | |
| "name": "uploaded: index-echo-2b-q4_k.gguf", | |
| "utc": "2026-10-01T15:42:33Z" | |
| }, | |
| { | |
| "name": "run: /mnt/heavy/scratch/index-echo/build/bin/crispasr-quantize /mnt/heavy/scratch/index-echo/index-echo-2b-decoder-f16.gguf /mnt/heavy/scratch/index-echo/index-echo-2b-decoder-q4_k.gguf q4_k", | |
| "utc": "2026-10-01T15:42:33Z" | |
| }, | |
| { | |
| "name": "uploaded: index-echo-2b-decoder-q4_k.gguf", | |
| "utc": "2026-10-01T15:44:43Z" | |
| }, | |
| { | |
| "name": "all conversion cohorts complete", | |
| "utc": "2026-10-01T15:44:43Z" | |
| } | |
| ], | |
| "decoder_no_mtp": true | |
| } | |