Instructions to use addyo07/vox-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Notebooks
Google Colab
Kaggle
Local Apps Settings

How to use addyo07/vox-models with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf addyo07/vox-models:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf addyo07/vox-models:Q4_K_M

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf addyo07/vox-models:Q4_K_M
# Run inference directly in the terminal:
llama cli -hf addyo07/vox-models:Q4_K_M

Build from source code

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-app
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama serve -hf addyo07/vox-models:Q4_K_M
# Run inference directly in the terminal:
./build/bin/llama cli -hf addyo07/vox-models:Q4_K_M

Use Docker

docker model run hf.co/addyo07/vox-models:Q4_K_M

Llama new
LM Studio
Jan
Ollama
How to use addyo07/vox-models with Ollama:
```
ollama run hf.co/addyo07/vox-models:Q4_K_M
```
Unsloth Desktop

How to use addyo07/vox-models with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf addyo07/vox-models:Q4_K_M

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "addyo07/vox-models:Q4_K_M"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use addyo07/vox-models with Docker Model Runner:
```
docker model run hf.co/addyo07/vox-models:Q4_K_M
```

Lemonade

How to use addyo07/vox-models with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull addyo07/vox-models:Q4_K_M

Run and chat with the model

lemonade run user.vox-models-Q4_K_M

List all available models

lemonade list

Hermes Agent

How to use addyo07/vox-models with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf addyo07/vox-models:Q4_K_M

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default addyo07/vox-models:Q4_K_M

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use addyo07/vox-models with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf addyo07/vox-models:Q4_K_M

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "addyo07/vox-models:Q4_K_M" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

addy-hypr4 commited on Aug 29

Commit

bfa2a2a

1 Parent(s): bcfbf2d

feat: updated nemotron to sherpa onnx weights

Browse files

Files changed (7) hide show

.gitattributes +4 -0
models_manifest.json +16 -16
stt/nemotron-3.5/config.json +0 -28
stt/nemotron-3.5/{decoder_joint.onnx → decoder.int8.onnx} +2 -2
stt/nemotron-3.5/{encoder.onnx → encoder.int8.onnx} +2 -2
stt/nemotron-3.5/joiner.int8.onnx +3 -0
stt/nemotron-3.5/{tokenizer.model → tokens.txt} +2 -2

.gitattributes CHANGED Viewed

@@ -59,3 +59,7 @@ nli/**/* filter=lfs diff=lfs merge=lfs -text
 classifier/modernbert_edge_creation filter=lfs diff=lfs merge=lfs -text
 classifier/modernbert_memory_scope filter=lfs diff=lfs merge=lfs -text
 nli/nli-deberta-v3-base filter=lfs diff=lfs merge=lfs -text

 classifier/modernbert_edge_creation filter=lfs diff=lfs merge=lfs -text
 classifier/modernbert_memory_scope filter=lfs diff=lfs merge=lfs -text
 nli/nli-deberta-v3-base filter=lfs diff=lfs merge=lfs -text
+stt/nemotron-3.5/decoder.int8.onnx filter=lfs diff=lfs merge=lfs -text
+stt/nemotron-3.5/encoder.int8.onnx filter=lfs diff=lfs merge=lfs -text
+stt/nemotron-3.5/joiner.int8.onnx filter=lfs diff=lfs merge=lfs -text
+stt/nemotron-3.5/tokens.txt filter=lfs diff=lfs merge=lfs -text

models_manifest.json CHANGED Viewed

@@ -104,31 +104,31 @@
       "is_remote": false,
       "files": [
         {
-          "id": "stt_nemotron_config",
-          "path": "stt/nemotron-3.5/config.json",
-          "size": 602,
-          "sha256": "0592a224f30670e00f5e0f1f106f0171428b0abde0fd4cbc64237b02c2241502",
           "required": true
         },
         {
-          "id": "stt_nemotron_decoder_joint",
-          "path": "stt/nemotron-3.5/decoder_joint.onnx",
-          "size": 97590054,
-          "sha256": "634dfadf24cb4f73c2fae170b36611d68db48186426882cbc8f7e02ed9f2bb29",
           "required": true
         },
         {
-          "id": "stt_nemotron_encoder",
-          "path": "stt/nemotron-3.5/encoder.onnx",
-          "size": 657572215,
-          "sha256": "e653d494a4855ee87f6251e8a9677416a73edf6f36578841316fa2b77a53cda7",
           "required": true
         },
         {
-          "id": "stt_nemotron_tokenizer",
-          "path": "stt/nemotron-3.5/tokenizer.model",
-          "size": 406554,
-          "sha256": "ce3895e40806f02a26c3a225161b96ef682d6c0054bae32a245dec4258d7d291",
           "required": true
         }
       ]

       "is_remote": false,
       "files": [
         {
+          "id": "stt_nemotron_encoder",
+          "path": "stt/nemotron-3.5/encoder.int8.onnx",
+          "size": 657601403,
+          "sha256": "012e9321373af99021415e0b0eb3ec827b4be3153be6f30d9b448fe65e896e68",
           "required": true
         },
         {
+          "id": "stt_nemotron_decoder",
+          "path": "stt/nemotron-3.5/decoder.int8.onnx",
+          "size": 14978075,
+          "sha256": "19f9c98fc6d0a2c33a65a43b36fdb2e914c26c0aa9764be3aebc502a1e982fb0",
           "required": true
         },
         {
+          "id": "stt_nemotron_joiner",
+          "path": "stt/nemotron-3.5/joiner.int8.onnx",
+          "size": 9504438,
+          "sha256": "4101c7c679a0bc30483794b27a059e34e79232aa2068d78d51231a22c8b0d7ce",
           "required": true
         },
         {
+          "id": "stt_nemotron_tokens",
+          "path": "stt/nemotron-3.5/tokens.txt",
+          "size": 131440,
+          "sha256": "729cc103155bafa785f9cd45746cd41cabe97eab7182fc04d594129587958f8a",
           "required": true
         }
       ]

stt/nemotron-3.5/config.json DELETED Viewed

@@ -1,28 +0,0 @@
-{
-  "modelName": "nemotron-3.5-asr-streaming-multilingual-0.6b",
-  "numMelBins": 128,
-  "sampleRate": 16000,
-  "nFFT": 512,
-  "hopLength": 160,
-  "winLength": 400,
-  "preEmphasis": 0.97,
-  "encoderHidden": 1024,
-  "encoderLayers": 24,
-  "subsamplingFactor": 8,
-  "attentionLeftContext": 56,
-  "convCacheSize": 8,
-  "decoderHidden": 640,
-  "decoderLayers": 2,
-  "vocabSize": 13087,
-  "blankTokenId": 13087,
-  "numPrompts": 128,
-  "streaming": {
-    "chunkMs": 320,
-    "chunkSize": 4,
-    "rightContext": 3,
-    "lookaheadMs": 240,
-    "melFrames": 32,
-    "preCacheSize": 9,
-    "outputFrames": 4
-  }
-}

stt/nemotron-3.5/{decoder_joint.onnx → decoder.int8.onnx} RENAMED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:634dfadf24cb4f73c2fae170b36611d68db48186426882cbc8f7e02ed9f2bb29
-size 97590054

 version https://git-lfs.github.com/spec/v1
+oid sha256:19f9c98fc6d0a2c33a65a43b36fdb2e914c26c0aa9764be3aebc502a1e982fb0
+size 14978075

stt/nemotron-3.5/{encoder.onnx → encoder.int8.onnx} RENAMED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e653d494a4855ee87f6251e8a9677416a73edf6f36578841316fa2b77a53cda7
-size 657572215

 version https://git-lfs.github.com/spec/v1
+oid sha256:012e9321373af99021415e0b0eb3ec827b4be3153be6f30d9b448fe65e896e68
+size 657601403

stt/nemotron-3.5/joiner.int8.onnx ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:4101c7c679a0bc30483794b27a059e34e79232aa2068d78d51231a22c8b0d7ce
+size 9504438

stt/nemotron-3.5/{tokenizer.model → tokens.txt} RENAMED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ce3895e40806f02a26c3a225161b96ef682d6c0054bae32a245dec4258d7d291
-size 406554

 version https://git-lfs.github.com/spec/v1
+oid sha256:729cc103155bafa785f9cd45746cd41cabe97eab7182fc04d594129587958f8a
+size 131440