guell00 commited on
Commit
6aa51e7
Β·
verified Β·
1 Parent(s): dd999d6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +628 -1
README.md CHANGED
@@ -1,7 +1,634 @@
1
  ---
2
  license: mit
3
  ---
 
4
 
 
5
 
6
- ![image](https://cdn-uploads.huggingface.co/production/uploads/644afe169279988e0cbcd2d9/AVI5Rk73jQfx76ePPXx90.png)
7
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+ <div align="center">
5
 
6
+ # Nexora-Qwen-Coder-4B
7
 
8
+ ### Compact Agentic Coding Model
9
 
10
+ **Coding Β· Debugging Β· Tool Use Β· Structured Reasoning Β· Local AI**
11
+
12
+ [![Hugging Face](https://img.shields.io/badge/Hugging%20Face-Nexora--Qwen--Coder--4B-yellow?logo=huggingface)](https://huggingface.co/guell00/Nexora-Qwen-Coder-4B)
13
+ [![GGUF](https://img.shields.io/badge/Format-GGUF-blue)](https://github.com/ggerganov/llama.cpp)
14
+ [![Unsloth](https://img.shields.io/badge/Fine--Tuning-Unsloth-orange)](https://unsloth.ai/)
15
+ [![License](https://img.shields.io/badge/Model-Research%20%2F%20Community-lightgrey)](#-disclaimer)
16
+
17
+ </div>
18
+
19
+ <p align="center">
20
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/644afe169279988e0cbcd2d9/AVI5Rk73jQfx76ePPXx90.png" width="100%">
21
+ </p>
22
+
23
+ ---
24
+
25
+ > **Nexora-Qwen-Coder-4B** is a compact coding-focused language model fine-tuned from the **Qwen 3.5 4B family**, optimized for **code generation, debugging, structured reasoning, tool calling, and local agentic workflows**.
26
+
27
+ Designed around a simple idea:
28
+
29
+ > **A small model should not just write code. It should be able to reason about the problem, interact with tools, inspect feedback, and fix what it got wrong.**
30
+
31
+ ---
32
+
33
+ ## Model at a Glance
34
+
35
+ | | |
36
+ | -------------------- | ------------------------------ |
37
+ | **Model** | `Nexora-Qwen-Coder-4B` |
38
+ | **Hugging Face** | `guell00/Nexora-Qwen-Coder-4B` |
39
+ | **Base Model** | Qwen 3.5 4B |
40
+ | **Architecture** | Dense Transformer |
41
+ | **Specialization** | Coding & Agentic Workflows |
42
+ | **Fine-Tuning** | Nexora Fine-Tuning |
43
+ | **Training** | SFT + Curriculum Learning |
44
+ | **Reasoning Data** | Trace Inversion |
45
+ | **Agent Data** | Tool-Use & Agent Trajectories |
46
+ | **MTP Evaluation** | `n=2` |
47
+ | **Training Context** | Up to 32K tokens |
48
+ | **Format** | GGUF |
49
+ | **Inference** | llama.cpp compatible |
50
+
51
+ ---
52
+
53
+ # Why Nexora-Qwen-Coder-4B?
54
+
55
+ The goal of Nexora-Qwen-Coder-4B is not to compete purely on parameter count.
56
+
57
+ It is designed to maximize the practical usefulness of a **compact local model** for software development.
58
+
59
+ The training pipeline focuses on four areas:
60
+
61
+ ### `01` Coding
62
+
63
+ Code generation, completion, explanation, refactoring, and implementation of programming tasks.
64
+
65
+ ### `02` Debugging
66
+
67
+ Bug localization, error analysis, reasoning about failures, and minimal code repair.
68
+
69
+ ### `03` Agentic Workflows
70
+
71
+ Learning to operate in environments where the model can inspect files, call tools, execute actions, receive feedback, and iterate.
72
+
73
+ ### `04` Structured Reasoning
74
+
75
+ Improving consistency on multi-step technical tasks that require planning before producing the final solution.
76
+
77
+ ---
78
+
79
+ # Benchmark Performance
80
+
81
+ Nexora-Qwen-Coder-4B was evaluated locally using the **benchlocal** evaluation framework.
82
+
83
+ The evaluation focuses on practical developer workflows rather than only general knowledge benchmarks.
84
+
85
+ ### Evaluation Areas
86
+
87
+ ```text
88
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
89
+ β”‚ β”‚
90
+ β”‚ πŸ› Debugging β”‚
91
+ β”‚ 🧠 Agent Workflow β”‚
92
+ β”‚ πŸ› οΈ Tool Routing β”‚
93
+ β”‚ πŸ“„ Instruction Following β”‚
94
+ β”‚ β”‚
95
+ β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜
96
+ ```
97
+
98
+ ## Results
99
+
100
+ | Benchmark | Nexora-Qwen-Coder-4B | Qwen 3.5 4B | Delta |
101
+ | :-------------------- | -------------------: | ----------: | ------: |
102
+ | **BugFind-15** | **71 / 100** | 52 / 100 | **+19** |
103
+ | **HermesAgent-20** | **64 / 100** | 61 / 100 | **+3** |
104
+ | **ToolCall-15** | **100 / 100** | 90 / 100 | **+10** |
105
+ | **InstructFollow-15** | **93 / 100** | 93 / 100 | **0** |
106
+
107
+ ---
108
+
109
+ ## Benchmark Highlights
110
+
111
+ ### πŸ› BugFind-15
112
+
113
+ **71 / 100**
114
+
115
+ The model showed a significant improvement over the Qwen 3.5 4B baseline in the evaluated debugging scenarios.
116
+
117
+ **+19 points over baseline**
118
+
119
+ ---
120
+
121
+ ### πŸ› οΈ ToolCall-15
122
+
123
+ **100 / 100**
124
+
125
+ Nexora-Qwen-Coder-4B achieved a **perfect score** in the evaluated tool-routing benchmark.
126
+
127
+ This benchmark measures the model's ability to select and structure tool calls correctly.
128
+
129
+ ---
130
+
131
+ ### 🧠 HermesAgent-20
132
+
133
+ **64 / 100**
134
+
135
+ The model showed improved performance over the base 4B model in the evaluated agent workflow scenarios.
136
+
137
+ The benchmark covers areas including:
138
+
139
+ * Memory recall
140
+ * Workspace orchestration
141
+ * Procedural skills
142
+ * Scheduling and delivery behavior
143
+
144
+ ---
145
+
146
+ ### πŸ“„ InstructFollow-15
147
+
148
+ **93 / 100**
149
+
150
+ Nexora-Qwen-Coder-4B matched the Qwen 3.5 4B baseline in the evaluated instruction-following benchmark.
151
+
152
+ This indicates strong reliability in structured output and constraint-following tasks.
153
+
154
+ ---
155
+
156
+ # Benchmark Positioning
157
+
158
+ The evaluated results indicate that Nexora-Qwen-Coder-4B is particularly strong in **coding-oriented and agentic workflows** relative to its compact parameter class.
159
+
160
+ ```text
161
+ Nexora-Qwen-Coder-4B
162
+
163
+ Coding β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
164
+ Debugging β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
165
+ Tool Use β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
166
+ Agent Tasks β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‘β–‘β–‘
167
+ Instruction β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–‘
168
+ Local Use β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ
169
+ ```
170
+
171
+ The strongest observed areas are:
172
+
173
+ * **Code debugging**
174
+ * **Tool routing**
175
+ * **Structured coding workflows**
176
+ * **Instruction following**
177
+ * **Local agent deployment**
178
+
179
+ Benchmark results are evaluation snapshots and may vary depending on model quantization, inference backend, prompt format, context length, sampling parameters, and hardware.
180
+
181
+ ---
182
+
183
+ # Training Approach
184
+
185
+ Nexora-Qwen-Coder-4B uses a multi-stage fine-tuning pipeline designed around **coding + reasoning + agent interaction**.
186
+
187
+ The overall training philosophy can be summarized as:
188
+
189
+ ```text
190
+ Raw Coding Data
191
+ β”‚
192
+ β–Ό
193
+ Structured SFT Data
194
+ β”‚
195
+ β–Ό
196
+ Trace Inversion
197
+ β”‚
198
+ β–Ό
199
+ Agent Trajectories
200
+ β”‚
201
+ β–Ό
202
+ Curriculum Learning
203
+ β”‚
204
+ β–Ό
205
+ Long-Context SFT
206
+ β”‚
207
+ β–Ό
208
+ Nexora-Qwen-Coder-4B
209
+ ```
210
+
211
+ The training mixture includes:
212
+
213
+ * Coding tasks
214
+ * Debugging examples
215
+ * Structured reasoning
216
+ * Tool-use trajectories
217
+ * Multi-turn interactions
218
+ * Agent workflows
219
+ * Long-context samples
220
+ * Instruction-following data
221
+
222
+ ---
223
+
224
+ # Trace Inversion
225
+
226
+ A core component of the training pipeline is **Trace Inversion**.
227
+
228
+ The approach is designed to reconstruct more complete reasoning traces from compressed reasoning outputs and use these traces as additional training signals.
229
+
230
+ The resulting data is combined with the original prompt and final response to create structured training examples.
231
+
232
+ Conceptually:
233
+
234
+ ```text
235
+ Original Prompt
236
+ β”‚
237
+ β–Ό
238
+ Compressed Reasoning
239
+ β”‚
240
+ β–Ό
241
+ Trace Inversion
242
+ β”‚
243
+ β–Ό
244
+ Reconstructed Reasoning Trace
245
+ β”‚
246
+ β–Ό
247
+ Prompt + Reasoning + Response
248
+ β”‚
249
+ β–Ό
250
+ SFT Dataset
251
+ ```
252
+
253
+ The goal is to improve the model's ability to handle tasks requiring multiple reasoning steps, particularly:
254
+
255
+ * Debugging
256
+ * Code analysis
257
+ * Error diagnosis
258
+ * Tool selection
259
+ * Multi-step programming
260
+ * Agentic workflows
261
+
262
+ Trace Inversion is a training technique and does not guarantee improved performance on every task.
263
+
264
+ ---
265
+
266
+ # Curriculum Learning
267
+
268
+ The fine-tuning process follows a three-stage curriculum.
269
+
270
+ | Stage | Focus | Context |
271
+ | :---------- | :-------------------------------------- | :--------: |
272
+ | **Stage 1** | Format stability & structured reasoning | `< 4K` |
273
+ | **Stage 2** | Coding, debugging & agent trajectories | `4K – 8K` |
274
+ | **Stage 3** | Long-context & multi-turn SFT | `8K – 32K` |
275
+
276
+ ### Stage 1 Β· Format Inception
277
+
278
+ The model is first exposed to shorter, cleaner examples.
279
+
280
+ The objective is to establish:
281
+
282
+ * Stable output formatting
283
+ * Instruction following
284
+ * Structured reasoning behavior
285
+ * Consistent response boundaries
286
+
287
+ ### Stage 2 Β· Complexity Expansion
288
+
289
+ The training mixture becomes more complex.
290
+
291
+ The model is introduced to:
292
+
293
+ * Harder coding problems
294
+ * Debugging scenarios
295
+ * Tool calls
296
+ * Multi-turn interactions
297
+ * Agent trajectories
298
+ * Environment feedback
299
+
300
+ ### Stage 3 Β· Long-Context SFT
301
+
302
+ The final stage introduces longer samples and multi-turn workflows while replaying high-quality shorter examples.
303
+
304
+ This helps reduce instruction-following drift while improving performance on longer technical tasks.
305
+
306
+ > **Note:** The 32K token value describes the training sequence length and data distribution used during fine-tuning. It should not automatically be interpreted as a hard architectural context limit.
307
+
308
+ ---
309
+
310
+ # Agentic Coding
311
+
312
+ Nexora-Qwen-Coder-4B is designed for workflows where the model is not limited to generating a single static response.
313
+
314
+ A typical agent loop looks like this:
315
+
316
+ ```text
317
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
318
+ β”‚ User Request β”‚
319
+ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
320
+ β”‚
321
+ β–Ό
322
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
323
+ β”‚ Understand β”‚
324
+ β”‚ the Task β”‚
325
+ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
326
+ β”‚
327
+ β–Ό
328
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
329
+ β”‚ Plan β”‚
330
+ β”‚ Solution β”‚
331
+ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
332
+ β”‚
333
+ β–Ό
334
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
335
+ β”‚ Select Tool β”‚
336
+ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
337
+ β”‚
338
+ β–Ό
339
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
340
+ β”‚ Execute β”‚
341
+ β”‚ Action β”‚
342
+ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
343
+ β”‚
344
+ β–Ό
345
+ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
346
+ β”‚ Inspect β”‚
347
+ β”‚ Feedback β”‚
348
+ β””β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜
349
+ β”‚
350
+ β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
351
+ β”‚ β”‚
352
+ β–Ό β”‚
353
+ Success? β”‚
354
+ β”‚ β”‚
355
+ Yesβ”‚ β”‚No
356
+ β”‚ β”‚
357
+ β–Ό β”‚
358
+ Final Answer β—„β”€β”€β”€β”€β”€β”€β”€β”˜
359
+ ```
360
+
361
+ This makes the model suitable for local environments that provide tools such as:
362
+
363
+ * File operations
364
+ * Terminal execution
365
+ * Code search
366
+ * Repository inspection
367
+ * Build systems
368
+ * Test runners
369
+ * Linters
370
+ * Debugging environments
371
+
372
+ Tool-call reliability depends heavily on the prompt template and tool schema used by the application.
373
+
374
+ ---
375
+
376
+ # Quick Start
377
+
378
+ ## llama.cpp
379
+
380
+ Run the model directly from Hugging Face:
381
+
382
+ ```bash
383
+ llama-cli -hf guell00/Nexora-Qwen-Coder-4B --jinja
384
+ ```
385
+
386
+ For a local OpenAI-compatible server:
387
+
388
+ ```bash
389
+ llama-server -hf guell00/Nexora-Qwen-Coder-4B --jinja
390
+ ```
391
+
392
+ > Command availability may depend on your `llama.cpp` version and the model files available in the repository.
393
+
394
+ ---
395
+
396
+ # Model Files
397
+
398
+ Nexora-Qwen-Coder-4B is available in GGUF format for efficient local inference.
399
+
400
+ | Quantization | Recommended For |
401
+ | :----------- | :-------------------------------------------- |
402
+ | **Q8_0** | Maximum quality with higher memory usage |
403
+ | **Q6_K** | High quality with reduced memory requirements |
404
+ | **Q5_K_M** | Excellent quality-to-size ratio |
405
+ | **Q4_K_M** | Best general-purpose local deployment |
406
+
407
+ ### Recommended
408
+
409
+ **Q4_K_M**
410
+
411
+ Recommended for most users looking for a strong balance between:
412
+
413
+ `Quality` Β· `Memory` Β· `Speed`
414
+
415
+ **Q8_0**
416
+
417
+ Recommended when memory is not a major constraint and maximum quantized quality is preferred.
418
+
419
+ ---
420
+
421
+ # Context Length
422
+
423
+ The model was fine-tuned with sequences reaching approximately **32K tokens**.
424
+
425
+ The underlying Qwen 3.5 family may support larger context windows depending on the specific architecture and inference backend.
426
+
427
+ For long-context inference, performance depends on:
428
+
429
+ * Backend support
430
+ * RoPE configuration
431
+ * YaRN scaling
432
+ * Quantization
433
+ * KV cache
434
+ * Available memory
435
+ * Context size
436
+
437
+ When extending beyond the training distribution, users should validate the model on their own workloads.
438
+
439
+ Example `llama.cpp` configuration:
440
+
441
+ ```bash
442
+ ./llama-server \
443
+ -m model.gguf \
444
+ --ctx-size 131072 \
445
+ --rope-scaling yarn \
446
+ --rope-scale 4 \
447
+ --yarn-orig-ctx 32768
448
+ ```
449
+
450
+ > **Important:** Increasing `--ctx-size` alone does not guarantee reliable long-context behavior.
451
+
452
+ ---
453
+
454
+ # Recommended Generation Settings
455
+
456
+ For deterministic coding and debugging workflows:
457
+
458
+ | Parameter | Value |
459
+ | :--------------------- | :----: |
460
+ | **Temperature** | `0` |
461
+ | **Top P** | `0.95` |
462
+ | **Top K** | `40` |
463
+ | **Min P** | `0.05` |
464
+ | **Repetition Penalty** | `1.1` |
465
+ | **Presence Penalty** | Off |
466
+ | **Max Tokens** | Max |
467
+
468
+ ```text
469
+ Temperature: 0
470
+ Top P: 0.95
471
+ Top K: 40
472
+ Min P: 0.05
473
+ Repetition Penalty: 1.1
474
+ Presence Penalty: Off
475
+ Max Tokens: Max
476
+ ```
477
+
478
+ For creative coding tasks or brainstorming, a higher temperature may be useful.
479
+
480
+ For debugging, code generation, and agentic workflows, lower temperatures generally provide more deterministic behavior.
481
+
482
+ ---
483
+
484
+ # Recommended Use Cases
485
+
486
+ Nexora-Qwen-Coder-4B is designed for:
487
+
488
+ | Use Case | Fit |
489
+ | :-------------------- | :---: |
490
+ | Code Generation | β˜…β˜…β˜…β˜…β˜… |
491
+ | Debugging | β˜…β˜…β˜…β˜…β˜… |
492
+ | Tool Calling | β˜…β˜…β˜…β˜…β˜… |
493
+ | Code Explanation | β˜…β˜…β˜…β˜…β˜… |
494
+ | Refactoring | β˜…β˜…β˜…β˜…β˜† |
495
+ | Repository Analysis | β˜…β˜…β˜…β˜…β˜† |
496
+ | Technical Reasoning | β˜…β˜…β˜…β˜…β˜† |
497
+ | Local Coding Agents | β˜…β˜…β˜…β˜…β˜… |
498
+ | Documentation | β˜…β˜…β˜…β˜…β˜† |
499
+ | Software Architecture | β˜…β˜…β˜…β˜†β˜† |
500
+
501
+ ### Best suited for
502
+
503
+ * Code generation
504
+ * Code completion
505
+ * Debugging
506
+ * Bug localization
507
+ * Refactoring
508
+ * Error analysis
509
+ * Technical reasoning
510
+ * Repository inspection
511
+ * Tool calling
512
+ * Local coding agents
513
+ * Multi-step development tasks
514
+
515
+ ---
516
+
517
+ # Built for Local AI
518
+
519
+ The 4B parameter class is intentionally compact.
520
+
521
+ Nexora-Qwen-Coder-4B aims to provide a practical balance between:
522
+
523
+ ```text
524
+ CAPABILITY
525
+ β–²
526
+ β”‚
527
+ β”‚ ● Nexora-Qwen-Coder-4B
528
+ β”‚
529
+ β”‚
530
+ β”‚
531
+ └──────────────────────────►
532
+ LOCAL EFFICIENCY
533
+ ```
534
+
535
+ The goal is to make capable coding and agentic behavior accessible on consumer hardware without requiring a large datacenter-scale deployment.
536
+
537
+ This makes the model suitable for:
538
+
539
+ * Local development
540
+ * Personal coding assistants
541
+ * Offline workflows
542
+ * Lightweight coding agents
543
+ * Developer workstations
544
+ * Experimental AI agents
545
+
546
+ ---
547
+
548
+ # ⚠️ Limitations
549
+
550
+ Nexora-Qwen-Coder-4B is a compact 4B-class model.
551
+
552
+ It may struggle with:
553
+
554
+ * Extremely large repository-wide changes
555
+ * Complex multi-file dependencies
556
+ * Highly specialized professional domains
557
+ * Tasks requiring extensive external knowledge
558
+ * Long autonomous workflows without verification
559
+ * Deep architectural decisions involving large systems
560
+
561
+ The model should be treated as a **coding assistant**, not a fully autonomous software engineer.
562
+
563
+ Generated code should always be:
564
+
565
+ > **Reviewed β†’ Tested β†’ Validated**
566
+
567
+ before being deployed to production.
568
+
569
+ Depending on the inference template, the model may produce reasoning content inside:
570
+
571
+ ```text
572
+ <think>
573
+ ...
574
+ </think>
575
+ ```
576
+
577
+ Applications may parse, hide, or otherwise handle these sections according to their requirements.
578
+
579
+ ---
580
+
581
+ # πŸ› οΈ Built With
582
+
583
+ | Technology | Role |
584
+ | :------------- | :--------------------------------- |
585
+ | **Qwen** | Base model family |
586
+ | **Unsloth** | Fine-tuning & conversion workflows |
587
+ | **GGUF** | Local model format |
588
+ | **llama.cpp** | Local inference |
589
+ | **benchlocal** | Coding & agent evaluation |
590
+
591
+ ---
592
+
593
+ # Acknowledgements
594
+
595
+ Special thanks to:
596
+
597
+ * The **Qwen team** for the base model family.
598
+ * The **Unsloth team** for efficient fine-tuning and conversion tooling.
599
+ * The open-source AI community for datasets, tools, and research.
600
+ * Contributors supporting local hardware testing and evaluation.
601
+
602
+ ---
603
+
604
+ # Disclaimer
605
+
606
+ Nexora-Qwen-Coder-4B is provided for **research, development, experimentation, and local inference**.
607
+
608
+ Actual performance may vary depending on:
609
+
610
+ * Quantization method
611
+ * Inference backend
612
+ * Hardware
613
+ * Context length
614
+ * Prompt formatting
615
+ * Sampling parameters
616
+ * Evaluation methodology
617
+
618
+ Benchmark results represent specific evaluation runs and should not be interpreted as guaranteed performance across all environments or tasks.
619
+
620
+ Always review and test generated code before using it in production systems.
621
+
622
+ ---
623
+
624
+ <div align="center">
625
+
626
+ # Nexora
627
+
628
+ ### Intelligence. Code. Evolve.
629
+
630
+ **Built for developers who want capable AI coding assistance running locally.**
631
+
632
+ `guell00/Nexora-Qwen-Coder-4B`
633
+
634
+ </div>