Instructions to use shuko-tuto/npc-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use shuko-tuto/npc-models with Piper:

# No code snippets available yet for this library.

# To use this model, check the repository files and the library's documentation.

# Want to help? PRs adding snippets are welcome at:
# https://github.com/huggingface/huggingface.js

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use shuko-tuto/npc-models with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf shuko-tuto/npc-models:UD-Q4_K_XL
# Run inference directly in the terminal:
llama cli -hf shuko-tuto/npc-models:UD-Q4_K_XL

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf shuko-tuto/npc-models:UD-Q4_K_XL
# Run inference directly in the terminal:
llama cli -hf shuko-tuto/npc-models:UD-Q4_K_XL

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf shuko-tuto/npc-models:UD-Q4_K_XL
# Run inference directly in the terminal:
./llama-cli -hf shuko-tuto/npc-models:UD-Q4_K_XL

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf shuko-tuto/npc-models:UD-Q4_K_XL
# Run inference directly in the terminal:
./build/bin/llama-cli -hf shuko-tuto/npc-models:UD-Q4_K_XL

Use Docker

docker model run hf.co/shuko-tuto/npc-models:UD-Q4_K_XL

LM Studio
Jan

vLLM

How to use shuko-tuto/npc-models with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "shuko-tuto/npc-models"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "shuko-tuto/npc-models",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/shuko-tuto/npc-models:UD-Q4_K_XL

Ollama
How to use shuko-tuto/npc-models with Ollama:
```
ollama run hf.co/shuko-tuto/npc-models:UD-Q4_K_XL
```
Unsloth Desktop

How to use shuko-tuto/npc-models with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf shuko-tuto/npc-models:UD-Q4_K_XL

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "shuko-tuto/npc-models:UD-Q4_K_XL"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use shuko-tuto/npc-models with Docker Model Runner:
```
docker model run hf.co/shuko-tuto/npc-models:UD-Q4_K_XL
```

Lemonade

How to use shuko-tuto/npc-models with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull shuko-tuto/npc-models:UD-Q4_K_XL

Run and chat with the model

lemonade run user.npc-models-UD-Q4_K_XL

List all available models

lemonade list

Hermes Agent

How to use shuko-tuto/npc-models with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf shuko-tuto/npc-models:UD-Q4_K_XL

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default shuko-tuto/npc-models:UD-Q4_K_XL

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use shuko-tuto/npc-models with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf shuko-tuto/npc-models:UD-Q4_K_XL

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "shuko-tuto/npc-models:UD-Q4_K_XL" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

shuko-tuto commited on Sep 3

Commit

65f3748

verified ·

1 Parent(s): 584c50f

silero_vad_16k: the folder the addon reads

Browse files

Files changed (3) hide show

silero_vad_16k/silero_vad_16k.LICENSE +21 -0
silero_vad_16k/silero_vad_16k.ncnn.bin +3 -0
silero_vad_16k/silero_vad_16k.ncnn.param +23 -0

silero_vad_16k/silero_vad_16k.LICENSE ADDED Viewed

	@@ -0,0 +1,21 @@

+MIT License
+Copyright (c) 2020-present Silero Team
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

silero_vad_16k/silero_vad_16k.ncnn.bin ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:3f692e9645f8ff39b48b8298b49025091f6ee229d34587795718bfffa2657bac
+size 1236520

silero_vad_16k/silero_vad_16k.ncnn.param ADDED Viewed

	@@ -0,0 +1,23 @@

+7767517
+21 24
+Input                    in0                      0 1 in0
+Input                    in1                      0 1 in1
+Input                    in2                      0 1 in2
+ExpandDims               unsqueeze_17             1 1 in0 3 -23303=1,0
+Padding                  pad_6                    1 1 3 4 0=0 1=0 2=0 3=64 4=2 5=0 6=0
+Convolution1D            conv1d_0                 1 1 4 5 0=258 1=256 2=1 3=128 4=0 5=0 6=66048
+Slice                    tensor_split_0           1 2 5 6 7 -23300=2,129,-233 1=0
+UnaryOp                  pow_0                    1 1 7 8 0=4
+UnaryOp                  pow_1                    1 1 6 9 0=4
+BinaryOp                 add_2                    2 1 9 8 10 0=0
+UnaryOp                  sqrt_3                   1 1 10 11 0=5
+Convolution1D            conv1drelu_0             1 1 11 12 0=128 1=3 2=1 3=1 4=1 5=1 6=49536 9=1
+Convolution1D            conv1drelu_1             1 1 12 13 0=64 1=3 2=1 3=2 4=1 5=1 6=24576 9=1
+Convolution1D            conv1drelu_2             1 1 13 14 0=64 1=3 2=1 3=2 4=1 5=1 6=12288 9=1
+Convolution1D            conv1drelu_3             1 1 14 15 0=128 1=3 2=1 3=1 4=1 5=1 6=24576 9=1
+Reshape                  reshape_14               1 1 15 16 0=128 1=1
+LSTM                     lstm_13                  3 3 16 in1 in2 17 out1 out2 0=128 1=65536 2=0 3=128
+ReLU                     relu_11                  1 1 17 20
+Reshape                  reshape_15               1 1 20 21 0=1 1=128
+Convolution1D            conv1dsigmoid_4          1 1 21 22 0=1 1=1 2=1 3=1 4=0 5=1 6=128 9=4
+Reshape                  reshape_16               1 1 22 out0 0=1