Text Generation
Safetensors
GGUF
Chinese
diet-nutrition
patient-education
qa
rag
qwen3
lora
retrieval-augmented-generation
health-routing
conversational
Instructions to use chenhaodev/diet-nutrition-qa with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use chenhaodev/diet-nutrition-qa with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf chenhaodev/diet-nutrition-qa:Q8_0 # Run inference directly in the terminal: llama cli -hf chenhaodev/diet-nutrition-qa:Q8_0
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf chenhaodev/diet-nutrition-qa:Q8_0 # Run inference directly in the terminal: llama cli -hf chenhaodev/diet-nutrition-qa:Q8_0
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf chenhaodev/diet-nutrition-qa:Q8_0 # Run inference directly in the terminal: ./build/bin/llama cli -hf chenhaodev/diet-nutrition-qa:Q8_0
Use Docker
docker model run hf.co/chenhaodev/diet-nutrition-qa:Q8_0
- Llama new
- LM Studio
- Jan
- vLLM
How to use chenhaodev/diet-nutrition-qa with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "chenhaodev/diet-nutrition-qa" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "chenhaodev/diet-nutrition-qa", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/chenhaodev/diet-nutrition-qa:Q8_0
- Ollama
How to use chenhaodev/diet-nutrition-qa with Ollama:
ollama run hf.co/chenhaodev/diet-nutrition-qa:Q8_0
- Unsloth Desktop
- Pi
How to use chenhaodev/diet-nutrition-qa with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenhaodev/diet-nutrition-qa:Q8_0
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:9931/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "chenhaodev/diet-nutrition-qa:Q8_0" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use chenhaodev/diet-nutrition-qa with Docker Model Runner:
docker model run hf.co/chenhaodev/diet-nutrition-qa:Q8_0
- Lemonade
How to use chenhaodev/diet-nutrition-qa with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull chenhaodev/diet-nutrition-qa:Q8_0
Run and chat with the model
lemonade run user.diet-nutrition-qa-Q8_0
List all available models
lemonade list
- Hermes Agent
How to use chenhaodev/diet-nutrition-qa with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenhaodev/diet-nutrition-qa:Q8_0
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:9931/v1 hermes config set model.default chenhaodev/diet-nutrition-qa:Q8_0
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use chenhaodev/diet-nutrition-qa with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf chenhaodev/diet-nutrition-qa:Q8_0
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:9931/v1 \ --custom-model-id "chenhaodev/diet-nutrition-qa:Q8_0" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download scripts/build_multi_rag.py from chenhaodev/diet-nutrition-qa: direct link, hf CLI and curl.
- Browser
- Download file 3.1 kB
-
https://huggingface.co/chenhaodev/diet-nutrition-qa/resolve/main/scripts/build_multi_rag.py
- Command line
-
hf download hf://chenhaodev/diet-nutrition-qa/scripts/build_multi_rag.py
-
curl -L -o build_multi_rag.py https://huggingface.co/chenhaodev/diet-nutrition-qa/resolve/main/scripts/build_multi_rag.py
3.1 kB
| #!/usr/bin/env python3 | |
| """Build per-category FAISS indexes (multi-RAG) from the parsed diet/nutrition QA. | |
| One flat IndexFlatIP per category (12 indexes) using BAAI/bge-m3 (multilingual, | |
| so Chinese patient queries embed fine). Each doc = question + answer. | |
| Categories MUST equal the router's category output (sub_intents[].category): | |
| gastro: esophagus-cancer, gastritis, peptic-ulcer, stomach-cancer, diarrhea, | |
| gi-bleeding, colorectal-cancer, constipation, ibs, ibd | |
| diabetes, osteoporosis | |
| """ | |
| import json | |
| import os | |
| import numpy as np | |
| from collections import defaultdict | |
| os.environ.setdefault("HF_ENDPOINT", "https://hf-mirror.com") | |
| ROOT = os.path.dirname(os.path.dirname(os.path.abspath(__file__))) | |
| OUT = os.path.join(ROOT, "data/rag") | |
| MODEL_NAME = "BAAI/bge-m3" | |
| from sentence_transformers import SentenceTransformer | |
| import faiss | |
| os.makedirs(OUT, exist_ok=True) | |
| model = SentenceTransformer(MODEL_NAME) | |
| model.max_seq_length = 512 | |
| print("embedder loaded:", MODEL_NAME, "| device:", model.device, flush=True) | |
| rows = [] | |
| for key in ("gastro", "diabetes", "osteoporosis"): | |
| p = os.path.join(ROOT, "data", f"qa_{key}.jsonl") | |
| rows += [json.loads(l) for l in open(p, encoding="utf-8")] | |
| print("total QA rows:", len(rows), flush=True) | |
| bycat = defaultdict(list) | |
| for r in rows: | |
| if r.get("category"): | |
| bycat[r["category"]].append(r) | |
| print("categories:", sorted(bycat), flush=True) | |
| # junk markers: front-matter / watermark / copyright glue that may carry book titles | |
| _JUNK = ["z-library", "下载", "Downloaded by", "版权", "ISBN", "责任编辑", | |
| "总前言", "《中国慢性疾病营养", "北京协和", "专家委员会", "出版"] | |
| def _is_junk(d): | |
| return any(k in d for k in _JUNK) | |
| stats = {} | |
| for cat, items in bycat.items(): | |
| seen = set() | |
| uniq = [] | |
| for r in items: | |
| if r["question"] in seen: | |
| continue | |
| seen.add(r["question"]) | |
| uniq.append(r) | |
| docs = [] | |
| meta = [] | |
| for r in uniq: | |
| d = f"Q:{r['question']}\nA:{r['answer']}" | |
| if _is_junk(d): | |
| continue | |
| docs.append(d) | |
| meta.append({"slug": r["slug"], "page": r["page"], "category": cat, | |
| "question": r["question"], "book": r["book"], | |
| "answer": r["answer"][:900]}) | |
| emb = model.encode(docs, normalize_embeddings=True, show_progress_bar=False, batch_size=32) | |
| emb = np.asarray(emb, dtype="float32") | |
| idx = faiss.IndexFlatIP(emb.shape[1]) | |
| idx.add(emb) | |
| sub = os.path.join(OUT, cat) | |
| os.makedirs(sub, exist_ok=True) | |
| faiss.write_index(idx, os.path.join(sub, "index.faiss")) | |
| with open(os.path.join(sub, "docs.json"), "w", encoding="utf-8") as f: | |
| json.dump(docs, f, ensure_ascii=False) | |
| with open(os.path.join(sub, "meta.json"), "w", encoding="utf-8") as f: | |
| json.dump(meta, f, ensure_ascii=False) | |
| stats[cat] = len(docs) | |
| print(f" [{cat}] docs={len(docs)}", flush=True) | |
| with open(os.path.join(OUT, "index_map.json"), "w", encoding="utf-8") as f: | |
| json.dump(stats, f, ensure_ascii=False, indent=1) | |
| print("DONE", stats) | |