Instructions to use guell00/Nexora-Qwen-Coder-4B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use guell00/Nexora-Qwen-Coder-4B with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M # Run inference directly in the terminal: llama cli -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M # Run inference directly in the terminal: llama cli -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama cli -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Use Docker
docker model run hf.co/guell00/Nexora-Qwen-Coder-4B:Q4_K_M
- Llama new
- LM Studio
- Jan
- Ollama
How to use guell00/Nexora-Qwen-Coder-4B with Ollama:
ollama run hf.co/guell00/Nexora-Qwen-Coder-4B:Q4_K_M
- Unsloth Desktop
- Pi
How to use guell00/Nexora-Qwen-Coder-4B with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "guell00/Nexora-Qwen-Coder-4B:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use guell00/Nexora-Qwen-Coder-4B with Docker Model Runner:
docker model run hf.co/guell00/Nexora-Qwen-Coder-4B:Q4_K_M
- Lemonade
How to use guell00/Nexora-Qwen-Coder-4B with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Run and chat with the model
lemonade run user.Nexora-Qwen-Coder-4B-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use guell00/Nexora-Qwen-Coder-4B with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use guell00/Nexora-Qwen-Coder-4B with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf guell00/Nexora-Qwen-Coder-4B:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "guell00/Nexora-Qwen-Coder-4B:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,7 +1,634 @@
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
|
|
|
| 4 |
|
|
|
|
| 5 |
|
| 6 |
-
|
| 7 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: mit
|
| 3 |
---
|
| 4 |
+
<div align="center">
|
| 5 |
|
| 6 |
+
# Nexora-Qwen-Coder-4B
|
| 7 |
|
| 8 |
+
### Compact Agentic Coding Model
|
| 9 |
|
| 10 |
+
**Coding Β· Debugging Β· Tool Use Β· Structured Reasoning Β· Local AI**
|
| 11 |
+
|
| 12 |
+
[](https://huggingface.co/guell00/Nexora-Qwen-Coder-4B)
|
| 13 |
+
[](https://github.com/ggerganov/llama.cpp)
|
| 14 |
+
[](https://unsloth.ai/)
|
| 15 |
+
[](#-disclaimer)
|
| 16 |
+
|
| 17 |
+
</div>
|
| 18 |
+
|
| 19 |
+
<p align="center">
|
| 20 |
+
<img src="https://cdn-uploads.huggingface.co/production/uploads/644afe169279988e0cbcd2d9/AVI5Rk73jQfx76ePPXx90.png" width="100%">
|
| 21 |
+
</p>
|
| 22 |
+
|
| 23 |
+
---
|
| 24 |
+
|
| 25 |
+
> **Nexora-Qwen-Coder-4B** is a compact coding-focused language model fine-tuned from the **Qwen 3.5 4B family**, optimized for **code generation, debugging, structured reasoning, tool calling, and local agentic workflows**.
|
| 26 |
+
|
| 27 |
+
Designed around a simple idea:
|
| 28 |
+
|
| 29 |
+
> **A small model should not just write code. It should be able to reason about the problem, interact with tools, inspect feedback, and fix what it got wrong.**
|
| 30 |
+
|
| 31 |
+
---
|
| 32 |
+
|
| 33 |
+
## Model at a Glance
|
| 34 |
+
|
| 35 |
+
| | |
|
| 36 |
+
| -------------------- | ------------------------------ |
|
| 37 |
+
| **Model** | `Nexora-Qwen-Coder-4B` |
|
| 38 |
+
| **Hugging Face** | `guell00/Nexora-Qwen-Coder-4B` |
|
| 39 |
+
| **Base Model** | Qwen 3.5 4B |
|
| 40 |
+
| **Architecture** | Dense Transformer |
|
| 41 |
+
| **Specialization** | Coding & Agentic Workflows |
|
| 42 |
+
| **Fine-Tuning** | Nexora Fine-Tuning |
|
| 43 |
+
| **Training** | SFT + Curriculum Learning |
|
| 44 |
+
| **Reasoning Data** | Trace Inversion |
|
| 45 |
+
| **Agent Data** | Tool-Use & Agent Trajectories |
|
| 46 |
+
| **MTP Evaluation** | `n=2` |
|
| 47 |
+
| **Training Context** | Up to 32K tokens |
|
| 48 |
+
| **Format** | GGUF |
|
| 49 |
+
| **Inference** | llama.cpp compatible |
|
| 50 |
+
|
| 51 |
+
---
|
| 52 |
+
|
| 53 |
+
# Why Nexora-Qwen-Coder-4B?
|
| 54 |
+
|
| 55 |
+
The goal of Nexora-Qwen-Coder-4B is not to compete purely on parameter count.
|
| 56 |
+
|
| 57 |
+
It is designed to maximize the practical usefulness of a **compact local model** for software development.
|
| 58 |
+
|
| 59 |
+
The training pipeline focuses on four areas:
|
| 60 |
+
|
| 61 |
+
### `01` Coding
|
| 62 |
+
|
| 63 |
+
Code generation, completion, explanation, refactoring, and implementation of programming tasks.
|
| 64 |
+
|
| 65 |
+
### `02` Debugging
|
| 66 |
+
|
| 67 |
+
Bug localization, error analysis, reasoning about failures, and minimal code repair.
|
| 68 |
+
|
| 69 |
+
### `03` Agentic Workflows
|
| 70 |
+
|
| 71 |
+
Learning to operate in environments where the model can inspect files, call tools, execute actions, receive feedback, and iterate.
|
| 72 |
+
|
| 73 |
+
### `04` Structured Reasoning
|
| 74 |
+
|
| 75 |
+
Improving consistency on multi-step technical tasks that require planning before producing the final solution.
|
| 76 |
+
|
| 77 |
+
---
|
| 78 |
+
|
| 79 |
+
# Benchmark Performance
|
| 80 |
+
|
| 81 |
+
Nexora-Qwen-Coder-4B was evaluated locally using the **benchlocal** evaluation framework.
|
| 82 |
+
|
| 83 |
+
The evaluation focuses on practical developer workflows rather than only general knowledge benchmarks.
|
| 84 |
+
|
| 85 |
+
### Evaluation Areas
|
| 86 |
+
|
| 87 |
+
```text
|
| 88 |
+
βββββββββββββββββββββββββββββββββββββββββββββββ
|
| 89 |
+
β β
|
| 90 |
+
β π Debugging β
|
| 91 |
+
β π§ Agent Workflow β
|
| 92 |
+
β π οΈ Tool Routing β
|
| 93 |
+
β π Instruction Following β
|
| 94 |
+
β β
|
| 95 |
+
βββββββββββββββββββββββββββββββββββββββββββββββ
|
| 96 |
+
```
|
| 97 |
+
|
| 98 |
+
## Results
|
| 99 |
+
|
| 100 |
+
| Benchmark | Nexora-Qwen-Coder-4B | Qwen 3.5 4B | Delta |
|
| 101 |
+
| :-------------------- | -------------------: | ----------: | ------: |
|
| 102 |
+
| **BugFind-15** | **71 / 100** | 52 / 100 | **+19** |
|
| 103 |
+
| **HermesAgent-20** | **64 / 100** | 61 / 100 | **+3** |
|
| 104 |
+
| **ToolCall-15** | **100 / 100** | 90 / 100 | **+10** |
|
| 105 |
+
| **InstructFollow-15** | **93 / 100** | 93 / 100 | **0** |
|
| 106 |
+
|
| 107 |
+
---
|
| 108 |
+
|
| 109 |
+
## Benchmark Highlights
|
| 110 |
+
|
| 111 |
+
### π BugFind-15
|
| 112 |
+
|
| 113 |
+
**71 / 100**
|
| 114 |
+
|
| 115 |
+
The model showed a significant improvement over the Qwen 3.5 4B baseline in the evaluated debugging scenarios.
|
| 116 |
+
|
| 117 |
+
**+19 points over baseline**
|
| 118 |
+
|
| 119 |
+
---
|
| 120 |
+
|
| 121 |
+
### π οΈ ToolCall-15
|
| 122 |
+
|
| 123 |
+
**100 / 100**
|
| 124 |
+
|
| 125 |
+
Nexora-Qwen-Coder-4B achieved a **perfect score** in the evaluated tool-routing benchmark.
|
| 126 |
+
|
| 127 |
+
This benchmark measures the model's ability to select and structure tool calls correctly.
|
| 128 |
+
|
| 129 |
+
---
|
| 130 |
+
|
| 131 |
+
### π§ HermesAgent-20
|
| 132 |
+
|
| 133 |
+
**64 / 100**
|
| 134 |
+
|
| 135 |
+
The model showed improved performance over the base 4B model in the evaluated agent workflow scenarios.
|
| 136 |
+
|
| 137 |
+
The benchmark covers areas including:
|
| 138 |
+
|
| 139 |
+
* Memory recall
|
| 140 |
+
* Workspace orchestration
|
| 141 |
+
* Procedural skills
|
| 142 |
+
* Scheduling and delivery behavior
|
| 143 |
+
|
| 144 |
+
---
|
| 145 |
+
|
| 146 |
+
### π InstructFollow-15
|
| 147 |
+
|
| 148 |
+
**93 / 100**
|
| 149 |
+
|
| 150 |
+
Nexora-Qwen-Coder-4B matched the Qwen 3.5 4B baseline in the evaluated instruction-following benchmark.
|
| 151 |
+
|
| 152 |
+
This indicates strong reliability in structured output and constraint-following tasks.
|
| 153 |
+
|
| 154 |
+
---
|
| 155 |
+
|
| 156 |
+
# Benchmark Positioning
|
| 157 |
+
|
| 158 |
+
The evaluated results indicate that Nexora-Qwen-Coder-4B is particularly strong in **coding-oriented and agentic workflows** relative to its compact parameter class.
|
| 159 |
+
|
| 160 |
+
```text
|
| 161 |
+
Nexora-Qwen-Coder-4B
|
| 162 |
+
|
| 163 |
+
Coding ββββββββββββββββββββ
|
| 164 |
+
Debugging ββββββββββββββββββββ
|
| 165 |
+
Tool Use ββββββββββββββββββββ
|
| 166 |
+
Agent Tasks ββββββββββββββββββββ
|
| 167 |
+
Instruction ββββββββββββββββββββ
|
| 168 |
+
Local Use ββββββββββββββββββββ
|
| 169 |
+
```
|
| 170 |
+
|
| 171 |
+
The strongest observed areas are:
|
| 172 |
+
|
| 173 |
+
* **Code debugging**
|
| 174 |
+
* **Tool routing**
|
| 175 |
+
* **Structured coding workflows**
|
| 176 |
+
* **Instruction following**
|
| 177 |
+
* **Local agent deployment**
|
| 178 |
+
|
| 179 |
+
Benchmark results are evaluation snapshots and may vary depending on model quantization, inference backend, prompt format, context length, sampling parameters, and hardware.
|
| 180 |
+
|
| 181 |
+
---
|
| 182 |
+
|
| 183 |
+
# Training Approach
|
| 184 |
+
|
| 185 |
+
Nexora-Qwen-Coder-4B uses a multi-stage fine-tuning pipeline designed around **coding + reasoning + agent interaction**.
|
| 186 |
+
|
| 187 |
+
The overall training philosophy can be summarized as:
|
| 188 |
+
|
| 189 |
+
```text
|
| 190 |
+
Raw Coding Data
|
| 191 |
+
β
|
| 192 |
+
βΌ
|
| 193 |
+
Structured SFT Data
|
| 194 |
+
β
|
| 195 |
+
βΌ
|
| 196 |
+
Trace Inversion
|
| 197 |
+
β
|
| 198 |
+
βΌ
|
| 199 |
+
Agent Trajectories
|
| 200 |
+
β
|
| 201 |
+
βΌ
|
| 202 |
+
Curriculum Learning
|
| 203 |
+
β
|
| 204 |
+
βΌ
|
| 205 |
+
Long-Context SFT
|
| 206 |
+
β
|
| 207 |
+
βΌ
|
| 208 |
+
Nexora-Qwen-Coder-4B
|
| 209 |
+
```
|
| 210 |
+
|
| 211 |
+
The training mixture includes:
|
| 212 |
+
|
| 213 |
+
* Coding tasks
|
| 214 |
+
* Debugging examples
|
| 215 |
+
* Structured reasoning
|
| 216 |
+
* Tool-use trajectories
|
| 217 |
+
* Multi-turn interactions
|
| 218 |
+
* Agent workflows
|
| 219 |
+
* Long-context samples
|
| 220 |
+
* Instruction-following data
|
| 221 |
+
|
| 222 |
+
---
|
| 223 |
+
|
| 224 |
+
# Trace Inversion
|
| 225 |
+
|
| 226 |
+
A core component of the training pipeline is **Trace Inversion**.
|
| 227 |
+
|
| 228 |
+
The approach is designed to reconstruct more complete reasoning traces from compressed reasoning outputs and use these traces as additional training signals.
|
| 229 |
+
|
| 230 |
+
The resulting data is combined with the original prompt and final response to create structured training examples.
|
| 231 |
+
|
| 232 |
+
Conceptually:
|
| 233 |
+
|
| 234 |
+
```text
|
| 235 |
+
Original Prompt
|
| 236 |
+
β
|
| 237 |
+
βΌ
|
| 238 |
+
Compressed Reasoning
|
| 239 |
+
β
|
| 240 |
+
βΌ
|
| 241 |
+
Trace Inversion
|
| 242 |
+
β
|
| 243 |
+
βΌ
|
| 244 |
+
Reconstructed Reasoning Trace
|
| 245 |
+
β
|
| 246 |
+
βΌ
|
| 247 |
+
Prompt + Reasoning + Response
|
| 248 |
+
β
|
| 249 |
+
βΌ
|
| 250 |
+
SFT Dataset
|
| 251 |
+
```
|
| 252 |
+
|
| 253 |
+
The goal is to improve the model's ability to handle tasks requiring multiple reasoning steps, particularly:
|
| 254 |
+
|
| 255 |
+
* Debugging
|
| 256 |
+
* Code analysis
|
| 257 |
+
* Error diagnosis
|
| 258 |
+
* Tool selection
|
| 259 |
+
* Multi-step programming
|
| 260 |
+
* Agentic workflows
|
| 261 |
+
|
| 262 |
+
Trace Inversion is a training technique and does not guarantee improved performance on every task.
|
| 263 |
+
|
| 264 |
+
---
|
| 265 |
+
|
| 266 |
+
# Curriculum Learning
|
| 267 |
+
|
| 268 |
+
The fine-tuning process follows a three-stage curriculum.
|
| 269 |
+
|
| 270 |
+
| Stage | Focus | Context |
|
| 271 |
+
| :---------- | :-------------------------------------- | :--------: |
|
| 272 |
+
| **Stage 1** | Format stability & structured reasoning | `< 4K` |
|
| 273 |
+
| **Stage 2** | Coding, debugging & agent trajectories | `4K β 8K` |
|
| 274 |
+
| **Stage 3** | Long-context & multi-turn SFT | `8K β 32K` |
|
| 275 |
+
|
| 276 |
+
### Stage 1 Β· Format Inception
|
| 277 |
+
|
| 278 |
+
The model is first exposed to shorter, cleaner examples.
|
| 279 |
+
|
| 280 |
+
The objective is to establish:
|
| 281 |
+
|
| 282 |
+
* Stable output formatting
|
| 283 |
+
* Instruction following
|
| 284 |
+
* Structured reasoning behavior
|
| 285 |
+
* Consistent response boundaries
|
| 286 |
+
|
| 287 |
+
### Stage 2 Β· Complexity Expansion
|
| 288 |
+
|
| 289 |
+
The training mixture becomes more complex.
|
| 290 |
+
|
| 291 |
+
The model is introduced to:
|
| 292 |
+
|
| 293 |
+
* Harder coding problems
|
| 294 |
+
* Debugging scenarios
|
| 295 |
+
* Tool calls
|
| 296 |
+
* Multi-turn interactions
|
| 297 |
+
* Agent trajectories
|
| 298 |
+
* Environment feedback
|
| 299 |
+
|
| 300 |
+
### Stage 3 Β· Long-Context SFT
|
| 301 |
+
|
| 302 |
+
The final stage introduces longer samples and multi-turn workflows while replaying high-quality shorter examples.
|
| 303 |
+
|
| 304 |
+
This helps reduce instruction-following drift while improving performance on longer technical tasks.
|
| 305 |
+
|
| 306 |
+
> **Note:** The 32K token value describes the training sequence length and data distribution used during fine-tuning. It should not automatically be interpreted as a hard architectural context limit.
|
| 307 |
+
|
| 308 |
+
---
|
| 309 |
+
|
| 310 |
+
# Agentic Coding
|
| 311 |
+
|
| 312 |
+
Nexora-Qwen-Coder-4B is designed for workflows where the model is not limited to generating a single static response.
|
| 313 |
+
|
| 314 |
+
A typical agent loop looks like this:
|
| 315 |
+
|
| 316 |
+
```text
|
| 317 |
+
ββββββββββββββββ
|
| 318 |
+
β User Request β
|
| 319 |
+
ββββββββ¬ββββββββ
|
| 320 |
+
β
|
| 321 |
+
βΌ
|
| 322 |
+
ββββββββββββββββ
|
| 323 |
+
β Understand β
|
| 324 |
+
β the Task β
|
| 325 |
+
ββββββββ¬ββββββββ
|
| 326 |
+
β
|
| 327 |
+
βΌ
|
| 328 |
+
ββββββββββββββββ
|
| 329 |
+
β Plan β
|
| 330 |
+
β Solution β
|
| 331 |
+
ββββββββ¬ββββββββ
|
| 332 |
+
β
|
| 333 |
+
βΌ
|
| 334 |
+
ββββββββββββββββ
|
| 335 |
+
β Select Tool β
|
| 336 |
+
ββββββββ¬ββββββββ
|
| 337 |
+
β
|
| 338 |
+
βΌ
|
| 339 |
+
ββββββββββββββββ
|
| 340 |
+
β Execute β
|
| 341 |
+
β Action β
|
| 342 |
+
ββββββββ¬ββββββββ
|
| 343 |
+
β
|
| 344 |
+
βΌ
|
| 345 |
+
ββββββββββββββββ
|
| 346 |
+
β Inspect β
|
| 347 |
+
β Feedback β
|
| 348 |
+
ββββββββ¬ββββββββ
|
| 349 |
+
β
|
| 350 |
+
βββββββββββββββββ
|
| 351 |
+
β β
|
| 352 |
+
βΌ β
|
| 353 |
+
Success? β
|
| 354 |
+
β β
|
| 355 |
+
Yesβ βNo
|
| 356 |
+
β β
|
| 357 |
+
βΌ β
|
| 358 |
+
Final Answer βββββββββ
|
| 359 |
+
```
|
| 360 |
+
|
| 361 |
+
This makes the model suitable for local environments that provide tools such as:
|
| 362 |
+
|
| 363 |
+
* File operations
|
| 364 |
+
* Terminal execution
|
| 365 |
+
* Code search
|
| 366 |
+
* Repository inspection
|
| 367 |
+
* Build systems
|
| 368 |
+
* Test runners
|
| 369 |
+
* Linters
|
| 370 |
+
* Debugging environments
|
| 371 |
+
|
| 372 |
+
Tool-call reliability depends heavily on the prompt template and tool schema used by the application.
|
| 373 |
+
|
| 374 |
+
---
|
| 375 |
+
|
| 376 |
+
# Quick Start
|
| 377 |
+
|
| 378 |
+
## llama.cpp
|
| 379 |
+
|
| 380 |
+
Run the model directly from Hugging Face:
|
| 381 |
+
|
| 382 |
+
```bash
|
| 383 |
+
llama-cli -hf guell00/Nexora-Qwen-Coder-4B --jinja
|
| 384 |
+
```
|
| 385 |
+
|
| 386 |
+
For a local OpenAI-compatible server:
|
| 387 |
+
|
| 388 |
+
```bash
|
| 389 |
+
llama-server -hf guell00/Nexora-Qwen-Coder-4B --jinja
|
| 390 |
+
```
|
| 391 |
+
|
| 392 |
+
> Command availability may depend on your `llama.cpp` version and the model files available in the repository.
|
| 393 |
+
|
| 394 |
+
---
|
| 395 |
+
|
| 396 |
+
# Model Files
|
| 397 |
+
|
| 398 |
+
Nexora-Qwen-Coder-4B is available in GGUF format for efficient local inference.
|
| 399 |
+
|
| 400 |
+
| Quantization | Recommended For |
|
| 401 |
+
| :----------- | :-------------------------------------------- |
|
| 402 |
+
| **Q8_0** | Maximum quality with higher memory usage |
|
| 403 |
+
| **Q6_K** | High quality with reduced memory requirements |
|
| 404 |
+
| **Q5_K_M** | Excellent quality-to-size ratio |
|
| 405 |
+
| **Q4_K_M** | Best general-purpose local deployment |
|
| 406 |
+
|
| 407 |
+
### Recommended
|
| 408 |
+
|
| 409 |
+
**Q4_K_M**
|
| 410 |
+
|
| 411 |
+
Recommended for most users looking for a strong balance between:
|
| 412 |
+
|
| 413 |
+
`Quality` Β· `Memory` Β· `Speed`
|
| 414 |
+
|
| 415 |
+
**Q8_0**
|
| 416 |
+
|
| 417 |
+
Recommended when memory is not a major constraint and maximum quantized quality is preferred.
|
| 418 |
+
|
| 419 |
+
---
|
| 420 |
+
|
| 421 |
+
# Context Length
|
| 422 |
+
|
| 423 |
+
The model was fine-tuned with sequences reaching approximately **32K tokens**.
|
| 424 |
+
|
| 425 |
+
The underlying Qwen 3.5 family may support larger context windows depending on the specific architecture and inference backend.
|
| 426 |
+
|
| 427 |
+
For long-context inference, performance depends on:
|
| 428 |
+
|
| 429 |
+
* Backend support
|
| 430 |
+
* RoPE configuration
|
| 431 |
+
* YaRN scaling
|
| 432 |
+
* Quantization
|
| 433 |
+
* KV cache
|
| 434 |
+
* Available memory
|
| 435 |
+
* Context size
|
| 436 |
+
|
| 437 |
+
When extending beyond the training distribution, users should validate the model on their own workloads.
|
| 438 |
+
|
| 439 |
+
Example `llama.cpp` configuration:
|
| 440 |
+
|
| 441 |
+
```bash
|
| 442 |
+
./llama-server \
|
| 443 |
+
-m model.gguf \
|
| 444 |
+
--ctx-size 131072 \
|
| 445 |
+
--rope-scaling yarn \
|
| 446 |
+
--rope-scale 4 \
|
| 447 |
+
--yarn-orig-ctx 32768
|
| 448 |
+
```
|
| 449 |
+
|
| 450 |
+
> **Important:** Increasing `--ctx-size` alone does not guarantee reliable long-context behavior.
|
| 451 |
+
|
| 452 |
+
---
|
| 453 |
+
|
| 454 |
+
# Recommended Generation Settings
|
| 455 |
+
|
| 456 |
+
For deterministic coding and debugging workflows:
|
| 457 |
+
|
| 458 |
+
| Parameter | Value |
|
| 459 |
+
| :--------------------- | :----: |
|
| 460 |
+
| **Temperature** | `0` |
|
| 461 |
+
| **Top P** | `0.95` |
|
| 462 |
+
| **Top K** | `40` |
|
| 463 |
+
| **Min P** | `0.05` |
|
| 464 |
+
| **Repetition Penalty** | `1.1` |
|
| 465 |
+
| **Presence Penalty** | Off |
|
| 466 |
+
| **Max Tokens** | Max |
|
| 467 |
+
|
| 468 |
+
```text
|
| 469 |
+
Temperature: 0
|
| 470 |
+
Top P: 0.95
|
| 471 |
+
Top K: 40
|
| 472 |
+
Min P: 0.05
|
| 473 |
+
Repetition Penalty: 1.1
|
| 474 |
+
Presence Penalty: Off
|
| 475 |
+
Max Tokens: Max
|
| 476 |
+
```
|
| 477 |
+
|
| 478 |
+
For creative coding tasks or brainstorming, a higher temperature may be useful.
|
| 479 |
+
|
| 480 |
+
For debugging, code generation, and agentic workflows, lower temperatures generally provide more deterministic behavior.
|
| 481 |
+
|
| 482 |
+
---
|
| 483 |
+
|
| 484 |
+
# Recommended Use Cases
|
| 485 |
+
|
| 486 |
+
Nexora-Qwen-Coder-4B is designed for:
|
| 487 |
+
|
| 488 |
+
| Use Case | Fit |
|
| 489 |
+
| :-------------------- | :---: |
|
| 490 |
+
| Code Generation | β
β
β
β
β
|
|
| 491 |
+
| Debugging | β
β
β
β
β
|
|
| 492 |
+
| Tool Calling | β
β
β
β
β
|
|
| 493 |
+
| Code Explanation | β
β
β
β
β
|
|
| 494 |
+
| Refactoring | β
β
β
β
β |
|
| 495 |
+
| Repository Analysis | β
β
β
β
β |
|
| 496 |
+
| Technical Reasoning | β
β
β
β
β |
|
| 497 |
+
| Local Coding Agents | β
β
β
β
β
|
|
| 498 |
+
| Documentation | β
β
β
β
β |
|
| 499 |
+
| Software Architecture | β
β
β
ββ |
|
| 500 |
+
|
| 501 |
+
### Best suited for
|
| 502 |
+
|
| 503 |
+
* Code generation
|
| 504 |
+
* Code completion
|
| 505 |
+
* Debugging
|
| 506 |
+
* Bug localization
|
| 507 |
+
* Refactoring
|
| 508 |
+
* Error analysis
|
| 509 |
+
* Technical reasoning
|
| 510 |
+
* Repository inspection
|
| 511 |
+
* Tool calling
|
| 512 |
+
* Local coding agents
|
| 513 |
+
* Multi-step development tasks
|
| 514 |
+
|
| 515 |
+
---
|
| 516 |
+
|
| 517 |
+
# Built for Local AI
|
| 518 |
+
|
| 519 |
+
The 4B parameter class is intentionally compact.
|
| 520 |
+
|
| 521 |
+
Nexora-Qwen-Coder-4B aims to provide a practical balance between:
|
| 522 |
+
|
| 523 |
+
```text
|
| 524 |
+
CAPABILITY
|
| 525 |
+
β²
|
| 526 |
+
β
|
| 527 |
+
β β Nexora-Qwen-Coder-4B
|
| 528 |
+
β
|
| 529 |
+
β
|
| 530 |
+
β
|
| 531 |
+
ββββββββββββββββββββββββββββΊ
|
| 532 |
+
LOCAL EFFICIENCY
|
| 533 |
+
```
|
| 534 |
+
|
| 535 |
+
The goal is to make capable coding and agentic behavior accessible on consumer hardware without requiring a large datacenter-scale deployment.
|
| 536 |
+
|
| 537 |
+
This makes the model suitable for:
|
| 538 |
+
|
| 539 |
+
* Local development
|
| 540 |
+
* Personal coding assistants
|
| 541 |
+
* Offline workflows
|
| 542 |
+
* Lightweight coding agents
|
| 543 |
+
* Developer workstations
|
| 544 |
+
* Experimental AI agents
|
| 545 |
+
|
| 546 |
+
---
|
| 547 |
+
|
| 548 |
+
# β οΈ Limitations
|
| 549 |
+
|
| 550 |
+
Nexora-Qwen-Coder-4B is a compact 4B-class model.
|
| 551 |
+
|
| 552 |
+
It may struggle with:
|
| 553 |
+
|
| 554 |
+
* Extremely large repository-wide changes
|
| 555 |
+
* Complex multi-file dependencies
|
| 556 |
+
* Highly specialized professional domains
|
| 557 |
+
* Tasks requiring extensive external knowledge
|
| 558 |
+
* Long autonomous workflows without verification
|
| 559 |
+
* Deep architectural decisions involving large systems
|
| 560 |
+
|
| 561 |
+
The model should be treated as a **coding assistant**, not a fully autonomous software engineer.
|
| 562 |
+
|
| 563 |
+
Generated code should always be:
|
| 564 |
+
|
| 565 |
+
> **Reviewed β Tested β Validated**
|
| 566 |
+
|
| 567 |
+
before being deployed to production.
|
| 568 |
+
|
| 569 |
+
Depending on the inference template, the model may produce reasoning content inside:
|
| 570 |
+
|
| 571 |
+
```text
|
| 572 |
+
<think>
|
| 573 |
+
...
|
| 574 |
+
</think>
|
| 575 |
+
```
|
| 576 |
+
|
| 577 |
+
Applications may parse, hide, or otherwise handle these sections according to their requirements.
|
| 578 |
+
|
| 579 |
+
---
|
| 580 |
+
|
| 581 |
+
# π οΈ Built With
|
| 582 |
+
|
| 583 |
+
| Technology | Role |
|
| 584 |
+
| :------------- | :--------------------------------- |
|
| 585 |
+
| **Qwen** | Base model family |
|
| 586 |
+
| **Unsloth** | Fine-tuning & conversion workflows |
|
| 587 |
+
| **GGUF** | Local model format |
|
| 588 |
+
| **llama.cpp** | Local inference |
|
| 589 |
+
| **benchlocal** | Coding & agent evaluation |
|
| 590 |
+
|
| 591 |
+
---
|
| 592 |
+
|
| 593 |
+
# Acknowledgements
|
| 594 |
+
|
| 595 |
+
Special thanks to:
|
| 596 |
+
|
| 597 |
+
* The **Qwen team** for the base model family.
|
| 598 |
+
* The **Unsloth team** for efficient fine-tuning and conversion tooling.
|
| 599 |
+
* The open-source AI community for datasets, tools, and research.
|
| 600 |
+
* Contributors supporting local hardware testing and evaluation.
|
| 601 |
+
|
| 602 |
+
---
|
| 603 |
+
|
| 604 |
+
# Disclaimer
|
| 605 |
+
|
| 606 |
+
Nexora-Qwen-Coder-4B is provided for **research, development, experimentation, and local inference**.
|
| 607 |
+
|
| 608 |
+
Actual performance may vary depending on:
|
| 609 |
+
|
| 610 |
+
* Quantization method
|
| 611 |
+
* Inference backend
|
| 612 |
+
* Hardware
|
| 613 |
+
* Context length
|
| 614 |
+
* Prompt formatting
|
| 615 |
+
* Sampling parameters
|
| 616 |
+
* Evaluation methodology
|
| 617 |
+
|
| 618 |
+
Benchmark results represent specific evaluation runs and should not be interpreted as guaranteed performance across all environments or tasks.
|
| 619 |
+
|
| 620 |
+
Always review and test generated code before using it in production systems.
|
| 621 |
+
|
| 622 |
+
---
|
| 623 |
+
|
| 624 |
+
<div align="center">
|
| 625 |
+
|
| 626 |
+
# Nexora
|
| 627 |
+
|
| 628 |
+
### Intelligence. Code. Evolve.
|
| 629 |
+
|
| 630 |
+
**Built for developers who want capable AI coding assistance running locally.**
|
| 631 |
+
|
| 632 |
+
`guell00/Nexora-Qwen-Coder-4B`
|
| 633 |
+
|
| 634 |
+
</div>
|