Instructions to use SkyIsNotGreen/hive-reader-1.7b-v1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SkyIsNotGreen/hive-reader-1.7b-v1")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("SkyIsNotGreen/hive-reader-1.7b-v1", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M # Run inference directly in the terminal: llama cli -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M # Run inference directly in the terminal: llama cli -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Use Docker
docker model run hf.co/SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SkyIsNotGreen/hive-reader-1.7b-v1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SkyIsNotGreen/hive-reader-1.7b-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
- SGLang
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SkyIsNotGreen/hive-reader-1.7b-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SkyIsNotGreen/hive-reader-1.7b-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SkyIsNotGreen/hive-reader-1.7b-v1" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SkyIsNotGreen/hive-reader-1.7b-v1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with Ollama:
ollama run hf.co/SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
- Unsloth Desktop
- Pi
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with Docker Model Runner:
docker model run hf.co/SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
- Lemonade
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Run and chat with the model
lemonade run user.hive-reader-1.7b-v1-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use SkyIsNotGreen/hive-reader-1.7b-v1 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "SkyIsNotGreen/hive-reader-1.7b-v1:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download eval/eval-rag.json from SkyIsNotGreen/hive-reader-1.7b-v1: direct link, hf CLI and curl.
- Browser
- Download file 6.01 kB
-
https://huggingface.co/SkyIsNotGreen/hive-reader-1.7b-v1/resolve/main/eval/eval-rag.json
- Command line
-
hf download hf://SkyIsNotGreen/hive-reader-1.7b-v1/eval/eval-rag.json
-
curl -L -o eval-rag.json https://huggingface.co/SkyIsNotGreen/hive-reader-1.7b-v1/resolve/main/eval/eval-rag.json
6.01 kB
| { | |
| "model_dir": "<work>/train-runs/clerk-sft-v1/merged", | |
| "device": "cuda:0", | |
| "temperature": 0.0, | |
| "overall": { | |
| "n": 40, | |
| "skipped": 0, | |
| "accuracy": 1.0, | |
| "median_s": 0.061, | |
| "tokens": 176 | |
| }, | |
| "by_role": { | |
| "rag": { | |
| "n": 40, | |
| "skipped": 0, | |
| "accuracy": 1.0, | |
| "median_s": 0.061, | |
| "tokens": 176 | |
| } | |
| }, | |
| "rows": [ | |
| { | |
| "role": "rag", | |
| "task_id": "rag-001", | |
| "ok": true, | |
| "answer": "card1", | |
| "wall_s": 0.573, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-002", | |
| "ok": true, | |
| "answer": "32k", | |
| "wall_s": 0.052, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-003", | |
| "ok": true, | |
| "answer": "card0, 32k", | |
| "wall_s": 0.115, | |
| "tokens": 7, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-004", | |
| "ok": true, | |
| "answer": "9.54", | |
| "wall_s": 0.068, | |
| "tokens": 4, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-204", | |
| "ok": true, | |
| "answer": "card 0, 32k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-205", | |
| "ok": true, | |
| "answer": "2", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-206", | |
| "ok": true, | |
| "answer": "2", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-207", | |
| "ok": true, | |
| "answer": "1", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-208", | |
| "ok": true, | |
| "answer": "card 1, 8k", | |
| "wall_s": 0.132, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-209", | |
| "ok": true, | |
| "answer": "card 1, 8k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-210", | |
| "ok": true, | |
| "answer": "9.54", | |
| "wall_s": 0.07, | |
| "tokens": 4, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-211", | |
| "ok": true, | |
| "answer": "4.99", | |
| "wall_s": 0.07, | |
| "tokens": 4, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-212", | |
| "ok": true, | |
| "answer": "1", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-213", | |
| "ok": true, | |
| "answer": "2", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-214", | |
| "ok": true, | |
| "answer": "card 0, 16k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-215", | |
| "ok": true, | |
| "answer": "card 0, 32k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-216", | |
| "ok": true, | |
| "answer": "9.98", | |
| "wall_s": 0.069, | |
| "tokens": 4, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-217", | |
| "ok": true, | |
| "answer": "16k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-218", | |
| "ok": true, | |
| "answer": "1", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-219", | |
| "ok": true, | |
| "answer": "card 0, 16k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-220", | |
| "ok": true, | |
| "answer": "16k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-221", | |
| "ok": true, | |
| "answer": "card 1, 8k", | |
| "wall_s": 0.132, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-222", | |
| "ok": true, | |
| "answer": "2", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-223", | |
| "ok": true, | |
| "answer": "8k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-224", | |
| "ok": true, | |
| "answer": "8k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-225", | |
| "ok": true, | |
| "answer": "9.54", | |
| "wall_s": 0.07, | |
| "tokens": 4, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-226", | |
| "ok": true, | |
| "answer": "32k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-227", | |
| "ok": true, | |
| "answer": "card 1, 64k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-228", | |
| "ok": true, | |
| "answer": "card 1, 8k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-229", | |
| "ok": true, | |
| "answer": "32k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-230", | |
| "ok": true, | |
| "answer": "0", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-231", | |
| "ok": true, | |
| "answer": "8k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-232", | |
| "ok": true, | |
| "answer": "5.69", | |
| "wall_s": 0.07, | |
| "tokens": 4, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-233", | |
| "ok": true, | |
| "answer": "4.99", | |
| "wall_s": 0.07, | |
| "tokens": 4, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-234", | |
| "ok": true, | |
| "answer": "card 1, 8k", | |
| "wall_s": 0.132, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-235", | |
| "ok": true, | |
| "answer": "2", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-236", | |
| "ok": true, | |
| "answer": "32k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-237", | |
| "ok": true, | |
| "answer": "8k", | |
| "wall_s": 0.054, | |
| "tokens": 3, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-238", | |
| "ok": true, | |
| "answer": "card 0, 32k", | |
| "wall_s": 0.133, | |
| "tokens": 8, | |
| "error": null | |
| }, | |
| { | |
| "role": "rag", | |
| "task_id": "rag-239", | |
| "ok": true, | |
| "answer": "2", | |
| "wall_s": 0.038, | |
| "tokens": 2, | |
| "error": null | |
| } | |
| ] | |
| } | |