File size: 1,136 Bytes
0a8c69f
fd674ab
 
 
0a8c69f
 
fd674ab
0a8c69f
fd674ab
 
 
0a8c69f
 
fd674ab
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
---
title: Stealth Rifle API
emoji: 🎯
colorFrom: gray
colorTo: blue
sdk: docker
app_port: 7860
pinned: false
license: mit
models:
  - cloudunity/stealth-rifle
---

# Stealth-Rifle API

OpenAI-compatible inference for [`cloudunity/stealth-rifle`](https://huggingface.co/cloudunity/stealth-rifle)
(a CPU-friendly Qwen2.5-0.5B roleplay fine-tune, Q4_K_M GGUF), served by
llama.cpp on the free CPU tier (16GB RAM / 2 vCPU).

## Endpoints

Base URL: `https://cloudunity-stealth-rifle-api.hf.space`

- `GET  /v1/models`
- `POST /v1/chat/completions`
- `POST /v1/completions`
- `GET  /health`

## Example

```bash
curl https://cloudunity-stealth-rifle-api.hf.space/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "stealth-rifle",
    "messages": [
      {"role": "system", "content": "You are Kael, a dry-witted exiled mage."},
      {"role": "user", "content": "You find me bleeding by the road. What do you do?"}
    ],
    "temperature": 0.8,
    "max_tokens": 300
  }'
```

Works with any OpenAI client by pointing `base_url` at
`https://cloudunity-stealth-rifle-api.hf.space/v1` (any/empty API key).