Publish OpenSML organization card
Browse files
README.md
CHANGED
|
@@ -7,4 +7,16 @@ sdk: static
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 7 |
pinned: false
|
| 8 |
---
|
| 9 |
|
| 10 |
+
# OpenSML
|
| 11 |
+
|
| 12 |
+
**small models. bigger possibilities.**
|
| 13 |
+
|
| 14 |
+
OpenSML is an independent research lab exploring the full process of building small language models鈥攆rom preparing data and training tokenizers to pretraining, evaluation, and fine-tuning.
|
| 15 |
+
|
| 16 |
+
We build from scratch on Apple Silicon. Our current training setup connects five Macs for distributed training.
|
| 17 |
+
|
| 18 |
+
We share model weights, code, and research findings so others can explore, experiment, and build on the work.
|
| 19 |
+
|
| 20 |
+
**Explore:** [OpenSML-150M](https://huggingface.co/OpenSML/OpenSML-150M) 路 [Website](https://www.open-sml.com/) 路 [Technical report](https://github.com/williamzebrowskI/opensml-150m/blob/main/sml-mlx-v1/docs/TECHNICAL_REPORT.md)
|
| 21 |
+
|
| 22 |
+
**Contact:** [william.zebrowski@me.com](mailto:william.zebrowski@me.com)
|