wzebrowski commited on
Commit
d1144e4
路
verified 路
1 Parent(s): f7fa659

Publish OpenSML organization card

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -7,4 +7,16 @@ sdk: static
7
  pinned: false
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  pinned: false
8
  ---
9
 
10
+ # OpenSML
11
+
12
+ **small models. bigger possibilities.**
13
+
14
+ OpenSML is an independent research lab exploring the full process of building small language models鈥攆rom preparing data and training tokenizers to pretraining, evaluation, and fine-tuning.
15
+
16
+ We build from scratch on Apple Silicon. Our current training setup connects five Macs for distributed training.
17
+
18
+ We share model weights, code, and research findings so others can explore, experiment, and build on the work.
19
+
20
+ **Explore:** [OpenSML-150M](https://huggingface.co/OpenSML/OpenSML-150M) 路 [Website](https://www.open-sml.com/) 路 [Technical report](https://github.com/williamzebrowskI/opensml-150m/blob/main/sml-mlx-v1/docs/TECHNICAL_REPORT.md)
21
+
22
+ **Contact:** [william.zebrowski@me.com](mailto:william.zebrowski@me.com)