Instructions to use evalengine/decision-4b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use evalengine/decision-4b with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen3.5-4B") model = PeftModel.from_pretrained(base_model, "evalengine/decision-4b") - Notebooks
- Google Colab
- Kaggle
Link GGUF repo
Browse files
README.md
CHANGED
|
@@ -21,7 +21,7 @@ Give it a state, a question, and a list of options. It picks one option and retu
|
|
| 21 |
|
| 22 |
**Try it now:** [Unbound on the App Store](https://apps.apple.com/us/app/unbound-ai/id6769727542) 路 [Unbound on the web](https://unbound.evalengine.ai/chat)
|
| 23 |
|
| 24 |
-
This repo holds a 65 MB LoRA adapter for [`Qwen/Qwen3.5-4B`](https://huggingface.co/Qwen/Qwen3.5-4B).
|
| 25 |
|
| 26 |
## Benchmark
|
| 27 |
|
|
|
|
| 21 |
|
| 22 |
**Try it now:** [Unbound on the App Store](https://apps.apple.com/us/app/unbound-ai/id6769727542) 路 [Unbound on the web](https://unbound.evalengine.ai/chat)
|
| 23 |
|
| 24 |
+
This repo holds a 65 MB LoRA adapter for [`Qwen/Qwen3.5-4B`](https://huggingface.co/Qwen/Qwen3.5-4B). A ready-to-run Q4_K_M GGUF (2.7 GB) for llama.cpp and Ollama is at [`evalengine/decision-4b-gguf`](https://huggingface.co/evalengine/decision-4b-gguf).
|
| 25 |
|
| 26 |
## Benchmark
|
| 27 |
|