Update README.md
Browse files
README.md
CHANGED
|
@@ -26,7 +26,7 @@ datasets:
|
|
| 26 |
This model is a surgically optimized and distilled version of **Qwen3.5-0.5B-Base-Rearchitected**,
|
| 27 |
created with the techniques covered in **Chapter 6** in the book **"Rearchitecting LLMs"**.
|
| 28 |
|
| 29 |
-
* **Book:** [Rearchitecting LLMs](https://hubs.la/
|
| 30 |
* **Framework:** [OptiPFair](https://github.com/peremartra/optipfair)
|
| 31 |
* **Technique:** Depth Pruning + Knowledge Distillation (Labels-Only with Skew KL Divergence)
|
| 32 |
* **Chapter:** Chapter 6 - Knowledge Recovery
|
|
@@ -185,4 +185,4 @@ This model was created following the methodologies taught in **"Rearchitecting L
|
|
| 185 |
- Loss function weights (α, β, temperature)
|
| 186 |
- Training epochs and learning rate
|
| 187 |
|
| 188 |
-
Share your results in the [book's discussion forum](https://hubs.la/
|
|
|
|
| 26 |
This model is a surgically optimized and distilled version of **Qwen3.5-0.5B-Base-Rearchitected**,
|
| 27 |
created with the techniques covered in **Chapter 6** in the book **"Rearchitecting LLMs"**.
|
| 28 |
|
| 29 |
+
* **Book:** [Rearchitecting LLMs](https://hubs.la/Q04k2VyY0)
|
| 30 |
* **Framework:** [OptiPFair](https://github.com/peremartra/optipfair)
|
| 31 |
* **Technique:** Depth Pruning + Knowledge Distillation (Labels-Only with Skew KL Divergence)
|
| 32 |
* **Chapter:** Chapter 6 - Knowledge Recovery
|
|
|
|
| 185 |
- Loss function weights (α, β, temperature)
|
| 186 |
- Training epochs and learning rate
|
| 187 |
|
| 188 |
+
Share your results in the [book's discussion forum](https://hubs.la/Q04k2VyY0)!
|