Spaces:
Running on Zero
Running on Zero
File size: 2,597 Bytes
434c049 ced540f 434c049 ced540f 434c049 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 | # OpenAI-compatible API cookbook
The Space exposes a private OpenAI-compatible chat API at
`https://abalanescu-flow.hf.space/v1`. The bearer token is the `FLOW_API_KEY`
Space secret. Never put the token in this repository.
## Discover models
```bash
curl -sS \
-H "Authorization: Bearer $FLOW_API_KEY" \
https://abalanescu-flow.hf.space/v1/models
```
Only model IDs returned by this endpoint are live. Supported model files:
- `Qwen3.8-27B-Q6_K.gguf` (lazy-downloaded from `unsloth/Qwen3.8-27B-GGUF` into `/data`)
- `gemma-4-26B-A4B-it-ultra-uncensored-heretic.i1-Q4_K_M.gguf`
- `gemma-4-26B-A4B-it-ultra-uncensored-heretic.i1-Q6_K.gguf`
- `Qwen3.8-9B-Distill-uncensored-heretic-Q8_0.gguf` / `...-F16.gguf` (lazy-downloaded from `petruhonk/Qwen3.8-9B-Distill-uncensored-heretic-GGUF`)
- `DeepSeek-V4-Pro-Qwen3.5-9B-MTP-Q4_K_M.gguf` / `...-Q8_0.gguf` / `...-BF16.gguf` (lazy-downloaded from `Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B-MTP-GGUF`)
Accepted aliases for chat completions include:
- `gemma-q4`, `gemma-q6`
- `qwen3.8-heretic`, `petruhonk/qwen3.8-9b-distill-uncensored-heretic`, `qwen-heretic`
- `deepseek-v4`, `deepseek-v4-pro`, `jackrong/deepseek-v4-pro-qwen3.5-9b-mtp`, `deepseek-v4-pro-q8`, `deepseek-v4-pro-bf16`
## Chat with the exact live model ID
### Qwen 3.8 27B Q6 (Native Context, No Artificial Caps)
```bash
MODEL_ID="Qwen3.8-27B-Q6_K.gguf"
curl -sS \
-H "Authorization: Bearer $FLOW_API_KEY" \
-H "Content-Type: application/json" \
https://abalanescu-flow.hf.space/v1/chat/completions \
-d "$(python3 -c 'import json,os; print(json.dumps({"model":os.environ["MODEL_ID"],"messages":[{"role":"user","content":"Tell me a joke."}],"max_tokens":64}))')"
```
### Gemma 4 26B Heretic Q4
```bash
MODEL_ID="gemma-4-26B-A4B-it-ultra-uncensored-heretic.i1-Q4_K_M.gguf"
curl -sS \
-H "Authorization: Bearer $FLOW_API_KEY" \
-H "Content-Type: application/json" \
https://abalanescu-flow.hf.space/v1/chat/completions \
-d "$(python3 -c 'import json,os; print(json.dumps({"model":os.environ["MODEL_ID"],"messages":[{"role":"user","content":"Reply with FINAL_LIVE_OK"}],"max_tokens":32}))')"
```
Set `MODEL_ID` in the shell before running the example. An unknown model returns HTTP 400 instead of silently selecting a different GGUF.
## Verification status
- **Gemma 4 26B Heretic (Q4_K_M & Q6_K)**: Live-verified on ZeroGPU.
- **Qwen 3.8 27B (Q6_K)**: Live-verified on ZeroGPU (`unsloth/Qwen3.8-27B-GGUF`), native context (`n_ctx=0`, max 262,144 tokens).
- Vision, streaming, embeddings, STT, and TTS are not claimed here until each has a live test on the Space.
|