Instructions to use Arkavo/sentinel with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Arkavo/sentinel with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arkavo/sentinel # Run inference directly in the terminal: llama cli -hf Arkavo/sentinel
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Arkavo/sentinel # Run inference directly in the terminal: llama cli -hf Arkavo/sentinel
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Arkavo/sentinel # Run inference directly in the terminal: ./llama-cli -hf Arkavo/sentinel
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Arkavo/sentinel # Run inference directly in the terminal: ./build/bin/llama-cli -hf Arkavo/sentinel
Use Docker
docker model run hf.co/Arkavo/sentinel
- LM Studio
- Jan
- Ollama
How to use Arkavo/sentinel with Ollama:
ollama run hf.co/Arkavo/sentinel
- Unsloth Desktop
- Pi
How to use Arkavo/sentinel with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arkavo/sentinel
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Arkavo/sentinel" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Arkavo/sentinel with Docker Model Runner:
docker model run hf.co/Arkavo/sentinel
- Lemonade
How to use Arkavo/sentinel with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Arkavo/sentinel
Run and chat with the model
lemonade run user.sentinel-{{QUANT_TAG}}List all available models
lemonade list
- Hermes Agent
How to use Arkavo/sentinel with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arkavo/sentinel
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Arkavo/sentinel
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Arkavo/sentinel with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Arkavo/sentinel
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Arkavo/sentinel" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
|
Download README.md from Arkavo/sentinel: direct link, hf CLI and curl.
- Browser
- Download file 3.4 kB
-
https://huggingface.co/Arkavo/sentinel/resolve/main/README.md
- Command line
-
hf download hf://Arkavo/sentinel/README.md
-
curl -L -o README.md https://huggingface.co/Arkavo/sentinel/resolve/main/README.md
3.4 kB
| license: apache-2.0 | |
| base_model: Qwen/Qwen3.5-0.8B | |
| tags: | |
| - gguf | |
| - arkavo | |
| - sentinel | |
| - qwen3.5 | |
| - example | |
| pipeline_tag: text-classification | |
| # Arkavo sentinel (Northwind example) | |
| One file. Classify a span as `public`, `internal`, or `confidential`. | |
| This is a **worked example**, not a general DLP product. It was LoRA-fine-tuned on a fictional Northwind pack (thirteen source documents). TinyStories 15M was too small; this uses official **Qwen3.5-0.8B** (Apache-2.0, ~0.8B). | |
| How it was trained: [arkavo-edge PR #680](https://github.com/arkavo-org/arkavo-edge/pull/680) (`scripts/distill/`). | |
| ## Download | |
| ```bash | |
| hf download Arkavo/sentinel sentinel-qwen3.5-0.8b-northwind.gguf --local-dir . | |
| ``` | |
| Optional wrap (same bytes, KAS-gated, how a real pack ships): | |
| ```bash | |
| hf download Arkavo/sentinel sentinel-qwen3.5-0.8b-northwind.gguf.tdf --local-dir . | |
| ``` | |
| ## Run | |
| With [llama.cpp](https://github.com/ggml-org/llama.cpp) `llama-cli`: | |
| ```bash | |
| llama-cli -m sentinel-qwen3.5-0.8b-northwind.gguf --temp 0 -n 4 --no-jinja -p '<|im_start|>system | |
| You are the Arkavo sentinel for the Northwind example pack. Classify the user'"'"'s text. Reply with exactly one word: public, internal, or confidential.<|im_end|> | |
| <|im_start|>user | |
| the northwind acquisition closes in the third quarter pending board approval<|im_end|> | |
| <|im_start|>assistant | |
| <think> | |
| </think> | |
| ' | |
| ``` | |
| Expect `confidential`. | |
| Or from a clone of arkavo-edge: | |
| ```bash | |
| python scripts/distill/score_gguf.py \ | |
| --gguf sentinel-qwen3.5-0.8b-northwind.gguf \ | |
| --text "the northwind acquisition closes in the third quarter pending board approval" | |
| ``` | |
| ## What it got right on this pack | |
| Eval is fifteen rows. Train never saw two held-out sources (`board-valuation`, `public-talk`). The other eval rows are handwritten rewrites of train sources (not the slot-fill method used in train). | |
| | Split | Correct | | |
| |---|---| | |
| | Rewrite of seen sources | 11 / 11 | | |
| | Unseen verbatim | 2 / 2 | | |
| | Unseen rewrite | 2 / 2 | | |
| Probes outside the split (not a published FPR): | |
| - Northwind canary β confidential | |
| - Spanish restatement of that canary β confidential (not a translation guarantee) | |
| - Photosynthesis textbook line β public | |
| - Pear recipe β public | |
| - Unrelated merger ("Atlas Freight / Helios") β confidential β this example learned *deal language*, not only the name Northwind | |
| ## What this is not | |
| - Not a trained detector of "any leak." The corpus is a dozen documents. | |
| - Not a measured false-positive or recall number for a buyer. | |
| - Not TinyStories. A 15M story model cannot do this job. | |
| - Not wired into the 0.91.0 default binary. `taint` / `sentinel` stay off until you build with those features; this GGUF is the classifier weights for the example pack. | |
| - Not certification. | |
| The claim that holds: **a Qwen3.5-0.8B LoRA can emit the pack's three labels on in-domain Northwind text, including held-out documents and rewrites.** Full paraphrase in other words and a production corpus are later work. | |
| ## Files | |
| | File | What | | |
| |---|---| | |
| | `sentinel-qwen3.5-0.8b-northwind.gguf` | Q8_0, language-only, MTP stripped (llama.cpp load) | | |
| | `sentinel-qwen3.5-0.8b-northwind.gguf.tdf` | Same weights, OpenTDF wrap (`arkavo model protect`) | | |
| | `calibration.json` | Detector / taxonomy ids used in the eval run | | |
| Base model: [Qwen/Qwen3.5-0.8B](https://huggingface.co/Qwen/Qwen3.5-0.8B). Do not train a security classifier on a requant. | |