---
license: apache-2.0
base_model: sriram1983007/SRA-RiskGate-4B
base_model_relation: quantized
library_name: gguf
pipeline_tag: text-generation
tags:
- gguf
- qwen3
- q4_k_m
- quantized
---

# SRA-RiskGate-4B - GGUF

GGUF quantizations of [sriram1983007/SRA-RiskGate-4B](https://huggingface.co/sriram1983007/SRA-RiskGate-4B), produced with llama.cpp.

## Available files

| File | Quantization |
|---|---|
| model-F16.gguf | F16 |
| model-Q8_0.gguf | Q8_0 |
| model-Q6_K.gguf | Q6_K |
| model-Q5_K_M.gguf | Q5_K_M |
| model-Q5_K_S.gguf | Q5_K_S |
| model-Q5_0.gguf | Q5_0 |
| model-Q4_K_M.gguf | Q4_K_M |
| model-Q4_K_S.gguf | Q4_K_S |
| model-Q4_0.gguf | Q4_0 |
| model-Q3_K_L.gguf | Q3_K_L |
| model-Q3_K_M.gguf | Q3_K_M |
| model-Q3_K_S.gguf | Q3_K_S |
| model-Q2_K.gguf | Q2_K |

## Usage

With llama.cpp:

```bash
./llama-cli -m model-Q4_K_M.gguf -p "Your prompt" -n 256
```

## License

Apache 2.0, inherited from the base model.