Text Generation
MLX
Safetensors
English
small-language-model
from-scratch
conversational
apple-silicon
research
Instructions to use OpenSML/Solstice-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use OpenSML/Solstice-1 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("OpenSML/Solstice-1") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use OpenSML/Solstice-1 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "OpenSML/Solstice-1"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "OpenSML/Solstice-1" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OpenSML/Solstice-1", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Prepare Solstice-1 public research release
Browse files- FILE_MANIFEST.json +8 -8
- README.md +1 -1
- REPOSITORIES.json +3 -3
- RUN_GUIDE.md +1 -1
- SHA256SUMS +5 -4
- docs/TECHNICAL_REPORT.md +1 -1
FILE_MANIFEST.json
CHANGED
|
@@ -22,16 +22,16 @@
|
|
| 22 |
"sha256": "0e6865f1a81cfd69ca48e6987658854ce0c0d23e91d72ae545393cd5fa032375"
|
| 23 |
},
|
| 24 |
"README.md": {
|
| 25 |
-
"bytes":
|
| 26 |
-
"sha256": "
|
| 27 |
},
|
| 28 |
"REPOSITORIES.json": {
|
| 29 |
-
"bytes":
|
| 30 |
-
"sha256": "
|
| 31 |
},
|
| 32 |
"RUN_GUIDE.md": {
|
| 33 |
-
"bytes":
|
| 34 |
-
"sha256": "
|
| 35 |
},
|
| 36 |
"SOURCE_NOTICE.md": {
|
| 37 |
"bytes": 1054,
|
|
@@ -138,8 +138,8 @@
|
|
| 138 |
"sha256": "7a818c365f1c047b349479829396ba5cd841ca8d2f04fa14fc1489083a1fd4b3"
|
| 139 |
},
|
| 140 |
"docs/TECHNICAL_REPORT.md": {
|
| 141 |
-
"bytes":
|
| 142 |
-
"sha256": "
|
| 143 |
},
|
| 144 |
"docs/figures/benchmark-comparison.png": {
|
| 145 |
"bytes": 125053,
|
|
|
|
| 22 |
"sha256": "0e6865f1a81cfd69ca48e6987658854ce0c0d23e91d72ae545393cd5fa032375"
|
| 23 |
},
|
| 24 |
"README.md": {
|
| 25 |
+
"bytes": 13125,
|
| 26 |
+
"sha256": "fb8c647b3adb0d7fdbd8585efac0db74137179c8fcbe293eed09e881d5a2cba3"
|
| 27 |
},
|
| 28 |
"REPOSITORIES.json": {
|
| 29 |
+
"bytes": 723,
|
| 30 |
+
"sha256": "291c0f7dc01cd1c0aeb5f49bb8822e0ab32617c72a6886615673ab08e9431891"
|
| 31 |
},
|
| 32 |
"RUN_GUIDE.md": {
|
| 33 |
+
"bytes": 3149,
|
| 34 |
+
"sha256": "cf237498a98efb229977939cfceaf78a112f25658f32559cad41aab3b8880202"
|
| 35 |
},
|
| 36 |
"SOURCE_NOTICE.md": {
|
| 37 |
"bytes": 1054,
|
|
|
|
| 138 |
"sha256": "7a818c365f1c047b349479829396ba5cd841ca8d2f04fa14fc1489083a1fd4b3"
|
| 139 |
},
|
| 140 |
"docs/TECHNICAL_REPORT.md": {
|
| 141 |
+
"bytes": 13512,
|
| 142 |
+
"sha256": "5fab4741ab86f46c97f8094b75ab3b560197b1a8c9e3d9e4c0783a0cd9de14eb"
|
| 143 |
},
|
| 144 |
"docs/figures/benchmark-comparison.png": {
|
| 145 |
"bytes": 125053,
|
README.md
CHANGED
|
@@ -152,7 +152,7 @@ Greedy FP32 outputs reproduced in the release environment. The incorrect example
|
|
| 152 |
|
| 153 |
## Run locally
|
| 154 |
|
| 155 |
-
Use Python 3.11 on Apple Silicon.
|
| 156 |
|
| 157 |
```bash
|
| 158 |
python3.11 -m venv .venv
|
|
|
|
| 152 |
|
| 153 |
## Run locally
|
| 154 |
|
| 155 |
+
Use Python 3.11 on Apple Silicon. The public model package can be downloaded without signing in.
|
| 156 |
|
| 157 |
```bash
|
| 158 |
python3.11 -m venv .venv
|
REPOSITORIES.json
CHANGED
|
@@ -3,16 +3,16 @@
|
|
| 3 |
"organization": "OpenSML",
|
| 4 |
"parameter_label": "175M",
|
| 5 |
"license": "Apache-2.0",
|
| 6 |
-
"release_status": "
|
| 7 |
"repositories": {
|
| 8 |
"github": {
|
| 9 |
"url": "https://github.com/williamzebrowskI/Solstice-1",
|
| 10 |
-
"visibility": "
|
| 11 |
"role": "Native inference code, documentation, training provenance, evaluation evidence"
|
| 12 |
},
|
| 13 |
"huggingface": {
|
| 14 |
"url": "https://huggingface.co/OpenSML/Solstice-1",
|
| 15 |
-
"visibility": "
|
| 16 |
"role": "Complete runnable package, including merged FP32 weights and tokenizer"
|
| 17 |
}
|
| 18 |
},
|
|
|
|
| 3 |
"organization": "OpenSML",
|
| 4 |
"parameter_label": "175M",
|
| 5 |
"license": "Apache-2.0",
|
| 6 |
+
"release_status": "public research release",
|
| 7 |
"repositories": {
|
| 8 |
"github": {
|
| 9 |
"url": "https://github.com/williamzebrowskI/Solstice-1",
|
| 10 |
+
"visibility": "public",
|
| 11 |
"role": "Native inference code, documentation, training provenance, evaluation evidence"
|
| 12 |
},
|
| 13 |
"huggingface": {
|
| 14 |
"url": "https://huggingface.co/OpenSML/Solstice-1",
|
| 15 |
+
"visibility": "public",
|
| 16 |
"role": "Complete runnable package, including merged FP32 weights and tokenizer"
|
| 17 |
}
|
| 18 |
},
|
RUN_GUIDE.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
|
| 3 |
Use Python 3.11 on Apple Silicon macOS with the pinned requirements. The tested public MLX wheel is 0.32.3; it requires a compatible macOS version. See PACKAGING_VERIFICATION.json for the actual tested system. Inference is offline after downloading the package and installing dependencies.
|
| 4 |
|
| 5 |
-
|
| 6 |
|
| 7 |
```bash
|
| 8 |
python3.11 -m venv .venv
|
|
|
|
| 2 |
|
| 3 |
Use Python 3.11 on Apple Silicon macOS with the pinned requirements. The tested public MLX wheel is 0.32.3; it requires a compatible macOS version. See PACKAGING_VERIFICATION.json for the actual tested system. Inference is offline after downloading the package and installing dependencies.
|
| 4 |
|
| 5 |
+
The model package is public. No Hugging Face sign-in is required to download it.
|
| 6 |
|
| 7 |
```bash
|
| 8 |
python3.11 -m venv .venv
|
SHA256SUMS
CHANGED
|
@@ -3,9 +3,9 @@ f09ed498cc42b482dae88d9fb5026bf74e1d8b9187f9ea301aeda0db76d6c859 BACKUP_AND_CLE
|
|
| 3 |
af646a190d135ec25a6ee2c76d1594c3f9ba8005cd3ca6df908606a15023273e CITATION.cff
|
| 4 |
cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30 LICENSE
|
| 5 |
0e6865f1a81cfd69ca48e6987658854ce0c0d23e91d72ae545393cd5fa032375 PACKAGING_VERIFICATION.json
|
| 6 |
-
|
| 7 |
-
|
| 8 |
-
|
| 9 |
87fa33719fe1182d467a05ab417be2a362f50eea59f0ac6496d40e677544e27c SOURCE_NOTICE.md
|
| 10 |
85525fd4cfd74dbabeb8fe767074cf02a8834dc40a3fc2e648180ef2a3ff35d9 THIRD_PARTY_NOTICES.md
|
| 11 |
a4bbaa7901cce3f88cdcac1ffd30ecdf60d4999c198054dce6bb7ef1d72607b2 TRAINING_AND_REPRODUCIBILITY.md
|
|
@@ -32,7 +32,7 @@ ae708eca3c09d5a27eab3fddbe4106d0658787beebc9393de57f75234480a284 configs/sft3/p
|
|
| 32 |
e0b0c730321360c40f20e53a22890c52cd5294bad2a5777a0a891096557a2f0a docs/DATA.md
|
| 33 |
fc5860bdad9ac24a5931c15fdb0931caeac1751352377a8ef5d57b5240425bb6 docs/EVALUATION.md
|
| 34 |
7a818c365f1c047b349479829396ba5cd841ca8d2f04fa14fc1489083a1fd4b3 docs/EXAMPLES.md
|
| 35 |
-
|
| 36 |
37438bfe291e2cc5b7513ec912cab9eaf7ce3d6352543f8e63d44da3a4f7d5b3 docs/figures/benchmark-comparison.png
|
| 37 |
64297355167c23c84cc4227bf54eb6be8d66c5837d45e201ed9304594df36d85 docs/figures/benchmark-comparison.svg
|
| 38 |
08388301b65a94ce3bd166de02dd6aa887515f9ed617a8972359b742334cb422 docs/figures/chat-diagnostics.png
|
|
@@ -473,3 +473,4 @@ ff056da7218dfbcae9d5c30e1a7770739683866bff398eebc05f3cfd686b1957 training/sourc
|
|
| 473 |
ff84dc0dfacceb506e54b6af73c1a76d65fcbf9cf75c7d96fc4489b8ab4f79e6 training/source_blobs/ff84dc0dfacceb506e54b6af73c1a76d65fcbf9cf75c7d96fc4489b8ab4f79e6.py
|
| 474 |
ff9cd7e99a7b66c901137a7f61c97c9ecbd3e5effec879cb82a5c68e9ced35f7 training/source_blobs/ff9cd7e99a7b66c901137a7f61c97c9ecbd3e5effec879cb82a5c68e9ced35f7.py
|
| 475 |
ffc3d395e98ab0f55c9d38060d65ff8dcdae4b954a25aafb40c14f513d8067ba training/source_blobs/ffc3d395e98ab0f55c9d38060d65ff8dcdae4b954a25aafb40c14f513d8067ba.py
|
|
|
|
|
|
| 3 |
af646a190d135ec25a6ee2c76d1594c3f9ba8005cd3ca6df908606a15023273e CITATION.cff
|
| 4 |
cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30 LICENSE
|
| 5 |
0e6865f1a81cfd69ca48e6987658854ce0c0d23e91d72ae545393cd5fa032375 PACKAGING_VERIFICATION.json
|
| 6 |
+
fb8c647b3adb0d7fdbd8585efac0db74137179c8fcbe293eed09e881d5a2cba3 README.md
|
| 7 |
+
291c0f7dc01cd1c0aeb5f49bb8822e0ab32617c72a6886615673ab08e9431891 REPOSITORIES.json
|
| 8 |
+
cf237498a98efb229977939cfceaf78a112f25658f32559cad41aab3b8880202 RUN_GUIDE.md
|
| 9 |
87fa33719fe1182d467a05ab417be2a362f50eea59f0ac6496d40e677544e27c SOURCE_NOTICE.md
|
| 10 |
85525fd4cfd74dbabeb8fe767074cf02a8834dc40a3fc2e648180ef2a3ff35d9 THIRD_PARTY_NOTICES.md
|
| 11 |
a4bbaa7901cce3f88cdcac1ffd30ecdf60d4999c198054dce6bb7ef1d72607b2 TRAINING_AND_REPRODUCIBILITY.md
|
|
|
|
| 32 |
e0b0c730321360c40f20e53a22890c52cd5294bad2a5777a0a891096557a2f0a docs/DATA.md
|
| 33 |
fc5860bdad9ac24a5931c15fdb0931caeac1751352377a8ef5d57b5240425bb6 docs/EVALUATION.md
|
| 34 |
7a818c365f1c047b349479829396ba5cd841ca8d2f04fa14fc1489083a1fd4b3 docs/EXAMPLES.md
|
| 35 |
+
5fab4741ab86f46c97f8094b75ab3b560197b1a8c9e3d9e4c0783a0cd9de14eb docs/TECHNICAL_REPORT.md
|
| 36 |
37438bfe291e2cc5b7513ec912cab9eaf7ce3d6352543f8e63d44da3a4f7d5b3 docs/figures/benchmark-comparison.png
|
| 37 |
64297355167c23c84cc4227bf54eb6be8d66c5837d45e201ed9304594df36d85 docs/figures/benchmark-comparison.svg
|
| 38 |
08388301b65a94ce3bd166de02dd6aa887515f9ed617a8972359b742334cb422 docs/figures/chat-diagnostics.png
|
|
|
|
| 473 |
ff84dc0dfacceb506e54b6af73c1a76d65fcbf9cf75c7d96fc4489b8ab4f79e6 training/source_blobs/ff84dc0dfacceb506e54b6af73c1a76d65fcbf9cf75c7d96fc4489b8ab4f79e6.py
|
| 474 |
ff9cd7e99a7b66c901137a7f61c97c9ecbd3e5effec879cb82a5c68e9ced35f7 training/source_blobs/ff9cd7e99a7b66c901137a7f61c97c9ecbd3e5effec879cb82a5c68e9ced35f7.py
|
| 475 |
ffc3d395e98ab0f55c9d38060d65ff8dcdae4b954a25aafb40c14f513d8067ba training/source_blobs/ffc3d395e98ab0f55c9d38060d65ff8dcdae4b954a25aafb40c14f513d8067ba.py
|
| 476 |
+
b5db6ca19833c36e95806b520265c1a27dd10485405c2cd1912dcc21c7a3949c FILE_MANIFEST.json
|
docs/TECHNICAL_REPORT.md
CHANGED
|
@@ -14,7 +14,7 @@ The complete tensor shape inventory is in [TENSOR_INVENTORY.json](../provenance/
|
|
| 14 |
|
| 15 |
The model is a decoder-only causal transformer with 44 residual blocks and hidden width 576. Attention uses a combined QKV projection, nine query heads, three KV heads, and head dimension 64. Each query/key head is RMS-normalized. Rotary position embeddings use base 10,000. Blocks use pre-normalization and SwiGLU; the actual FFN intermediate width is 1,536. The packed gate/up matrix has shape 3,072 × 576. Input embeddings and output projection are tied. There are no linear biases or dropout.
|
| 16 |
|
| 17 |
-
The model has a deeper, narrower shape than the earlier 24-layer, width-768 JSONLite
|
| 18 |
|
| 19 |
Training uses MLX fast attention and packed Metal FFN/cross-entropy paths where specified by each frozen recipe. Release inference and the reported FP32 benchmarks use vanilla attention and reference FFN/cross-entropy paths. No quantization is applied to the release weights.
|
| 20 |
|
|
|
|
| 14 |
|
| 15 |
The model is a decoder-only causal transformer with 44 residual blocks and hidden width 576. Attention uses a combined QKV projection, nine query heads, three KV heads, and head dimension 64. Each query/key head is RMS-normalized. Rotary position embeddings use base 10,000. Blocks use pre-normalization and SwiGLU; the actual FFN intermediate width is 1,536. The packed gate/up matrix has shape 3,072 × 576. Input embeddings and output projection are tied. There are no linear biases or dropout.
|
| 16 |
|
| 17 |
+
The model has a deeper, narrower shape than the earlier 24-layer, width-768 JSONLite model or 20-layer OpenSML-150M. These runs also differ in data, optimization, and training exposure, so their results do not isolate an architectural advantage.
|
| 18 |
|
| 19 |
Training uses MLX fast attention and packed Metal FFN/cross-entropy paths where specified by each frozen recipe. Release inference and the reported FP32 benchmarks use vanilla attention and reference FFN/cross-entropy paths. No quantization is applied to the release weights.
|
| 20 |
|