Text Generation
MLX
Safetensors
English
pretraining
from-scratch
small-language-model
post-training
silicon
Instructions to use wzebrowski/OpenSML-150M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use wzebrowski/OpenSML-150M with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("wzebrowski/OpenSML-150M") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use wzebrowski/OpenSML-150M with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "wzebrowski/OpenSML-150M" --prompt "Once upon a time"
- Atomic Chat
Use OpenSML-152M branding throughout model card
Browse files
README.md
CHANGED
|
@@ -22,7 +22,7 @@ An independently trained, English-first small language model built with Apple's
|
|
| 22 |
> after checkpoint selection and release review.
|
| 23 |
|
| 24 |
**OpenSML-152M is the project-facing name. The implemented model has exactly
|
| 25 |
-
150,439,168 parameters (150.44M).**
|
| 26 |
This repository describes one model, not a family of released models.
|
| 27 |
|
| 28 |
## At a Glance
|
|
@@ -39,7 +39,7 @@ This repository describes one model, not a family of released models.
|
|
| 39 |
| Cluster | One M3 Ultra and three M4 Max Mac Studios |
|
| 40 |
| Communication | Four-node Thunderbolt RDMA ring using JACCL |
|
| 41 |
| Planned exposure | 15B total tokens, including the completed pilot |
|
| 42 |
-
| Current status | Continued pretraining; no
|
| 43 |
|
| 44 |
## Architecture
|
| 45 |
|
|
@@ -57,7 +57,7 @@ not a claim of a new attention architecture.
|
|
| 57 |
|
| 58 |
The model uses a prose-first mixture streamed from Hugging Face. This replaces
|
| 59 |
the earlier OpenWebText description on this page; that description does not apply
|
| 60 |
-
to
|
| 61 |
|
| 62 |
| Source | Training token share | Selection |
|
| 63 |
| --- | ---: | --- |
|
|
@@ -187,8 +187,8 @@ Early generations show repetition, factual errors, and incoherence. Improving
|
|
| 187 |
next-token loss does not establish reliable answers or instruction following.
|
| 188 |
|
| 189 |
Independent downstream benchmarks, an untouched final evaluation, full generation
|
| 190 |
-
reviews, and post-training results are **not yet reported for
|
| 191 |
-
|
| 192 |
Losses are not directly comparable to other models with different tokenizers or
|
| 193 |
validation corpora, even when vocabulary sizes are similar.
|
| 194 |
|
|
@@ -199,7 +199,7 @@ experimentation. It is not currently a validated assistant. It may generate
|
|
| 199 |
incorrect, repetitive, biased, offensive, or unsafe text. Do not rely on it for
|
| 200 |
high-stakes decisions. Broader capability and safety assessments remain pending.
|
| 201 |
|
| 202 |
-
Architecture, tokenizer, data, and context differ from earlier
|
| 203 |
this run alone cannot attribute any improvement to a single change.
|
| 204 |
|
| 205 |
## Repository Contents and Release Plan
|
|
|
|
| 22 |
> after checkpoint selection and release review.
|
| 23 |
|
| 24 |
**OpenSML-152M is the project-facing name. The implemented model has exactly
|
| 25 |
+
150,439,168 parameters (150.44M).**
|
| 26 |
This repository describes one model, not a family of released models.
|
| 27 |
|
| 28 |
## At a Glance
|
|
|
|
| 39 |
| Cluster | One M3 Ultra and three M4 Max Mac Studios |
|
| 40 |
| Communication | Four-node Thunderbolt RDMA ring using JACCL |
|
| 41 |
| Planned exposure | 15B total tokens, including the completed pilot |
|
| 42 |
+
| Current status | Continued pretraining; no SFT results or final benchmarks yet |
|
| 43 |
|
| 44 |
## Architecture
|
| 45 |
|
|
|
|
| 57 |
|
| 58 |
The model uses a prose-first mixture streamed from Hugging Face. This replaces
|
| 59 |
the earlier OpenWebText description on this page; that description does not apply
|
| 60 |
+
to OpenSML-152M.
|
| 61 |
|
| 62 |
| Source | Training token share | Selection |
|
| 63 |
| --- | ---: | --- |
|
|
|
|
| 187 |
next-token loss does not establish reliable answers or instruction following.
|
| 188 |
|
| 189 |
Independent downstream benchmarks, an untouched final evaluation, full generation
|
| 190 |
+
reviews, and post-training results are **not yet reported for OpenSML-152M**.
|
| 191 |
+
Results from earlier experiments are not results for this model.
|
| 192 |
Losses are not directly comparable to other models with different tokenizers or
|
| 193 |
validation corpora, even when vocabulary sizes are similar.
|
| 194 |
|
|
|
|
| 199 |
incorrect, repetitive, biased, offensive, or unsafe text. Do not rely on it for
|
| 200 |
high-stakes decisions. Broader capability and safety assessments remain pending.
|
| 201 |
|
| 202 |
+
Architecture, tokenizer, data, and context differ from earlier experiments;
|
| 203 |
this run alone cannot attribute any improvement to a single change.
|
| 204 |
|
| 205 |
## Repository Contents and Release Plan
|