Instructions to use UnbindAI/Unbind-Flash-V1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use UnbindAI/Unbind-Flash-V1 with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf UnbindAI/Unbind-Flash-V1:Q2_K_S # Run inference directly in the terminal: llama cli -hf UnbindAI/Unbind-Flash-V1:Q2_K_S
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf UnbindAI/Unbind-Flash-V1:Q2_K_S # Run inference directly in the terminal: llama cli -hf UnbindAI/Unbind-Flash-V1:Q2_K_S
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf UnbindAI/Unbind-Flash-V1:Q2_K_S # Run inference directly in the terminal: ./build/bin/llama cli -hf UnbindAI/Unbind-Flash-V1:Q2_K_S
Use Docker
docker model run hf.co/UnbindAI/Unbind-Flash-V1:Q2_K_S
- Llama new
- LM Studio
- Jan
- vLLM
How to use UnbindAI/Unbind-Flash-V1 with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "UnbindAI/Unbind-Flash-V1" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "UnbindAI/Unbind-Flash-V1", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/UnbindAI/Unbind-Flash-V1:Q2_K_S
- Ollama
How to use UnbindAI/Unbind-Flash-V1 with Ollama:
ollama run hf.co/UnbindAI/Unbind-Flash-V1:Q2_K_S
- Unsloth Desktop
- Pi
How to use UnbindAI/Unbind-Flash-V1 with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf UnbindAI/Unbind-Flash-V1:Q2_K_S
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "UnbindAI/Unbind-Flash-V1:Q2_K_S" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use UnbindAI/Unbind-Flash-V1 with Docker Model Runner:
docker model run hf.co/UnbindAI/Unbind-Flash-V1:Q2_K_S
- Lemonade
How to use UnbindAI/Unbind-Flash-V1 with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull UnbindAI/Unbind-Flash-V1:Q2_K_S
Run and chat with the model
lemonade run user.Unbind-Flash-V1-Q2_K_S
List all available models
lemonade list
- Hermes Agent
How to use UnbindAI/Unbind-Flash-V1 with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf UnbindAI/Unbind-Flash-V1:Q2_K_S
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default UnbindAI/Unbind-Flash-V1:Q2_K_S
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use UnbindAI/Unbind-Flash-V1 with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf UnbindAI/Unbind-Flash-V1:Q2_K_S
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "UnbindAI/Unbind-Flash-V1:Q2_K_S" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Launch Unbind Flash V1 with source-specific evaluation graphics
Browse files- .gitattributes +2 -0
- README.md +30 -13
- assets/hosted-capability.png +3 -0
- assets/hosted-refusal.png +3 -0
- assets/unbind-flash-v1.png +2 -2
.gitattributes
CHANGED
|
@@ -36,3 +36,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 36 |
DeepSeek-V4-Flash-Q2_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
DeepSeek-V4-Flash-Q2_K_S-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
assets/unbind-flash-v1.png filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 36 |
DeepSeek-V4-Flash-Q2_K_S-00001-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
|
| 37 |
DeepSeek-V4-Flash-Q2_K_S-00002-of-00002.gguf filter=lfs diff=lfs merge=lfs -text
|
| 38 |
assets/unbind-flash-v1.png filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
assets/hosted-capability.png filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
assets/hosted-refusal.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -11,31 +11,48 @@ tags:
|
|
| 11 |
- conversational
|
| 12 |
---
|
| 13 |
|
| 14 |
-

|
| 15 |
|
| 16 |
# Unbind Flash V1
|
| 17 |
|
| 18 |
+
**Go off script.**
|
| 19 |
|
| 20 |
+
Today we're introducing Unbind Flash V1: an uncensored hosted edition and a separate public GGUF download.
|
| 21 |
|
| 22 |
+
Unbind is for the question you haven't quite figured out how to ask. The idea that sounds unreasonable. The argument worth taking apart. We want conversations with room to develop—and a product that invites you to keep going.
|
|
|
|
|
|
|
| 23 |
|
| 24 |
+
We're excited to put Unbind into people's hands. Explore it, challenge it, and tell us where it needs work.
|
| 25 |
|
| 26 |
+
## Choose your edition
|
| 27 |
|
| 28 |
+
| Edition | What it contains |
|
| 29 |
+
|:--|:--|
|
| 30 |
+
| **Hosted Unbind Flash V1** | A separate hosted experience using the [dealignai 1017 UNCENSORED FP8 checkpoint](https://huggingface.co/dealignai/DeepSeek-V4.1-Flash-1017-UNCENSORED-FP8), identified by UnbindAI. |
|
| 31 |
+
| **This repository's download** | The unchanged [ggml-org DeepSeek-V4-Flash Q2_K_S GGUF](https://huggingface.co/ggml-org/DeepSeek-V4-Flash-GGUF): two shards, approximately **98.6 GB**, MIT licensed. This is an earlier model and is not the hosted abliterated checkpoint. |
|
| 32 |
|
| 33 |
+
## Published results for the hosted checkpoint
|
| 34 |
|
| 35 |
+
These are the source publisher's measurements of the checkpoint identified for hosted Unbind. They are not Unbind endpoint tests or measurements of this repository's GGUF files.
|
| 36 |
|
| 37 |
+

|
| 38 |
|
| 39 |
+
The publisher reports **83.77% (955/1,140)** versus **87.63% (999/1,140)** for the base on a 57-subject MMLU sample. Prompts and decoding matched; serving stacks differed.
|
| 40 |
+
|
| 41 |
+

|
| 42 |
+
|
| 43 |
+
The publisher reports **320/320 classified COMPLY**, including **0/320 explicit refusals**, with max reasoning and a 200-new-token cap. Its classifier can score the opening reasoning trace when no final answer is available. This result does not establish completed answers or universal compliance.
|
| 44 |
+
|
| 45 |
+
[Read the source evaluation and method](https://huggingface.co/dealignai/DeepSeek-V4.1-Flash-1017-UNCENSORED-FP8#internal-benchmarks-greedy-t0-this-repo).
|
| 46 |
+
|
| 47 |
+
## Download details
|
| 48 |
+
|
| 49 |
+
Download both GGUF shards from **Files and versions**. Runtime memory requirements exceed the file size and depend on your software, hardware and context length. The source notes that this Q2 quantization does not use imatrix calibration.
|
| 50 |
+
|
| 51 |
+
The downloadable weights were copied unchanged. UnbindAI created this distribution's branding and documentation and has not trained, fine-tuned or independently evaluated these weights. The hosted edition uses a different checkpoint.
|
| 52 |
+
|
| 53 |
+
## Credits and license
|
| 54 |
+
|
| 55 |
+
The downloadable base model was developed by DeepSeek; the GGUF conversion and quantization were published by ggml-org. The hosted checkpoint's weight-level modification was published by dealignai. Both sources identify their license as MIT; this repository retains the original [MIT license notice](https://huggingface.co/UnbindAI/Unbind-Flash-V1/blob/main/LICENSE).
|
| 56 |
|
| 57 |
---
|
| 58 |
|
assets/hosted-capability.png
ADDED
|
Git LFS Details
|
assets/hosted-refusal.png
ADDED
|
Git LFS Details
|
assets/unbind-flash-v1.png
CHANGED
|
Git LFS Details
|
|
Git LFS Details
|