Update README.md
Browse files
README.md
CHANGED
|
@@ -21,7 +21,7 @@ tags:
|
|
| 21 |
# - HuggingFaceTB/smoltalk
|
| 22 |
---
|
| 23 |
|
| 24 |
-
# LibraMind (565M parameters)
|
| 25 |
|
| 26 |
**LibraMind** is a 565M-parameter chat model pretrained from scratch by [alby13](https://github.com/alby13/LibraMind-AI) on a single consumer GPU (NVIDIA RTX 4090). It is a hybrid architecture that interleaves **18 Gated DeltaNet** linear-recurrent layers with **6 Gated Attention** layers (a repeating `DDDA × 6` pattern), with Block Attention Residuals and logit soft-capping, trained with the Muon optimizer. It went through a full five-stage pipeline: pretraining, midtraining, supervised fine-tuning, preference tuning, and RL with verifiable rewards.
|
| 27 |
|
|
|
|
| 21 |
# - HuggingFaceTB/smoltalk
|
| 22 |
---
|
| 23 |
|
| 24 |
+
# LibraMind Mini (565M parameters)
|
| 25 |
|
| 26 |
**LibraMind** is a 565M-parameter chat model pretrained from scratch by [alby13](https://github.com/alby13/LibraMind-AI) on a single consumer GPU (NVIDIA RTX 4090). It is a hybrid architecture that interleaves **18 Gated DeltaNet** linear-recurrent layers with **6 Gated Attention** layers (a repeating `DDDA × 6` pattern), with Block Attention Residuals and logit soft-capping, trained with the Muon optimizer. It went through a full five-stage pipeline: pretraining, midtraining, supervised fine-tuning, preference tuning, and RL with verifiable rewards.
|
| 27 |
|