Text Generation
GGUF
English
Vietnamese
llama.cpp
on-device
mobile
ios
macos
qwen3.5
automatic-speech-recognition
asr
speech
qwen3-asr
conversational
Instructions to use haohan84/darksurf-models with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use haohan84/darksurf-models with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf haohan84/darksurf-models:UD-Q4_K_XL # Run inference directly in the terminal: llama cli -hf haohan84/darksurf-models:UD-Q4_K_XL
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf haohan84/darksurf-models:UD-Q4_K_XL # Run inference directly in the terminal: llama cli -hf haohan84/darksurf-models:UD-Q4_K_XL
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf haohan84/darksurf-models:UD-Q4_K_XL # Run inference directly in the terminal: ./build/bin/llama cli -hf haohan84/darksurf-models:UD-Q4_K_XL
Use Docker
docker model run hf.co/haohan84/darksurf-models:UD-Q4_K_XL
- Llama new
- LM Studio
- Jan
- vLLM
How to use haohan84/darksurf-models with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "haohan84/darksurf-models" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "haohan84/darksurf-models", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/haohan84/darksurf-models:UD-Q4_K_XL
- Ollama
How to use haohan84/darksurf-models with Ollama:
ollama run hf.co/haohan84/darksurf-models:UD-Q4_K_XL
- Unsloth Desktop
- Docker Model Runner
How to use haohan84/darksurf-models with Docker Model Runner:
docker model run hf.co/haohan84/darksurf-models:UD-Q4_K_XL
- Lemonade
How to use haohan84/darksurf-models with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull haohan84/darksurf-models:UD-Q4_K_XL
Run and chat with the model
lemonade run user.darksurf-models-UD-Q4_K_XL
List all available models
lemonade list
- Atomic Chat
Catalog version 4
Browse files- catalog.json +18 -1
- catalog.json.sig +1 -1
catalog.json
CHANGED
|
@@ -1,6 +1,6 @@
|
|
| 1 |
{
|
| 2 |
"comment": "On-device models DarkSurf offers in Settings. Pinned to a Hugging Face commit; the app checks size and SHA-256 after download. Apache-2.0 (Qwen3.5), GGUF by Unsloth.",
|
| 3 |
-
"version":
|
| 4 |
"feed": "https://huggingface.co/haohan84/darksurf-models/resolve/main/catalog.json",
|
| 5 |
"models": [
|
| 6 |
{
|
|
@@ -13,6 +13,23 @@
|
|
| 13 |
"sha256": "3177ebd67afe4438374da19e690bc1b98756f7e0fea9240e1be404336156a7b5",
|
| 14 |
"minMemoryGB": 3.0,
|
| 15 |
"note": "Fast on every device. The default."
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
}
|
| 17 |
],
|
| 18 |
"speech": [
|
|
|
|
| 1 |
{
|
| 2 |
"comment": "On-device models DarkSurf offers in Settings. Pinned to a Hugging Face commit; the app checks size and SHA-256 after download. Apache-2.0 (Qwen3.5), GGUF by Unsloth.",
|
| 3 |
+
"version": 4,
|
| 4 |
"feed": "https://huggingface.co/haohan84/darksurf-models/resolve/main/catalog.json",
|
| 5 |
"models": [
|
| 6 |
{
|
|
|
|
| 13 |
"sha256": "3177ebd67afe4438374da19e690bc1b98756f7e0fea9240e1be404336156a7b5",
|
| 14 |
"minMemoryGB": 3.0,
|
| 15 |
"note": "Fast on every device. The default."
|
| 16 |
+
},
|
| 17 |
+
{
|
| 18 |
+
"id": "qwen3.5-2b-ud-q4kxl",
|
| 19 |
+
"name": "Qwen3.5 2B",
|
| 20 |
+
"quantization": "UD-Q4_K_XL",
|
| 21 |
+
"file": "Qwen3.5-2B-UD-Q4_K_XL.gguf",
|
| 22 |
+
"url": "https://huggingface.co/haohan84/darksurf-models/resolve/9ff1e30b03aaa767e9c4e2afe0526b07b9ff5374/Qwen3.5-2B-UD-Q4_K_XL.gguf",
|
| 23 |
+
"size": 1339752704,
|
| 24 |
+
"sha256": "0af96165ea615bea39a04118d63f0b6d35908aea850ee4a51aa6151d851b8b35",
|
| 25 |
+
"minMemoryGB": 6.0,
|
| 26 |
+
"note": "Understands photos and reads text in them, answers better than the 0.8B. For phones with 6 GB of RAM or more.",
|
| 27 |
+
"mmproj": {
|
| 28 |
+
"file": "mmproj-F16.gguf",
|
| 29 |
+
"url": "https://huggingface.co/haohan84/darksurf-models/resolve/a570ba3a26ce1b30a05715dcb1f1f1605c6550e2/mmproj-F16.gguf",
|
| 30 |
+
"size": 668227264,
|
| 31 |
+
"sha256": "7035e9cb8d7c6a9681d07eef9a364783e86ea4cd73faab2eabb4f43a101830c7"
|
| 32 |
+
}
|
| 33 |
}
|
| 34 |
],
|
| 35 |
"speech": [
|
catalog.json.sig
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
|
|
|
|
| 1 |
+
DL3U33I+nxJn0xy3tAzafPH9Fo/1Q2m2KT+XhNxKYQ8wkms4tCmllge20+bJsXrCqHTvcyBAKv4WUasVbWojCw==
|