Text Generation
MLX
Safetensors
English
information-extraction
structured-output
json
small-language-model
apple-silicon
from-scratch
post-training
research
Instructions to use OpenSML/OpenSML-JSONLite-175M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use OpenSML/OpenSML-JSONLite-175M with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # if on a CUDA device, also pip install mlx[cuda] # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("OpenSML/OpenSML-JSONLite-175M") prompt = "Once upon a time in" text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use OpenSML/OpenSML-JSONLite-175M with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "OpenSML/OpenSML-JSONLite-175M" --prompt "Once upon a time"
- Atomic Chat
Seal native runtime source snapshot and checksums
Browse filesVerified source archive, matching runner hash, dataset attribution and integrity manifest.
- PACKAGING_VERIFICATION.json +1 -1
- SHA256SUMS +3 -3
- inference.py +1 -1
- native_bundle.zip +2 -2
PACKAGING_VERIFICATION.json
CHANGED
|
@@ -5,7 +5,7 @@
|
|
| 5 |
"weight_file": "model.safetensors",
|
| 6 |
"weight_bytes": 351242342,
|
| 7 |
"weight_sha256": "25b406a7b86e3e8ac4dd0b7f32e27590d9d11349a0148a7815c32304150ac725",
|
| 8 |
-
"native_bundle_sha256": "
|
| 9 |
"source_snapshot_files": 418,
|
| 10 |
"runtime": "stock MLX 0.32.3; Apple Silicon; Python 3.11",
|
| 11 |
"requests": 1504,
|
|
|
|
| 5 |
"weight_file": "model.safetensors",
|
| 6 |
"weight_bytes": 351242342,
|
| 7 |
"weight_sha256": "25b406a7b86e3e8ac4dd0b7f32e27590d9d11349a0148a7815c32304150ac725",
|
| 8 |
+
"native_bundle_sha256": "8f5a075f63e1ff8857af3ddd916afc57742e614b1da5cbbe15452e9c84e94d2a",
|
| 9 |
"source_snapshot_files": 418,
|
| 10 |
"runtime": "stock MLX 0.32.3; Apple Silicon; Python 3.11",
|
| 11 |
"requests": 1504,
|
SHA256SUMS
CHANGED
|
@@ -3,7 +3,7 @@
|
|
| 3 |
e2e6e75848a42ea4bb5e50ab85a91f1e1cd2b413327fb9667d4893e15a86db04 INFERENCE_VERIFICATION.json
|
| 4 |
b6da2e34e1d59693c11b257203804260613f636f40d5fca56d4ae8b1e253ae3e JSONLITE_RESULTS.json
|
| 5 |
c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4 LICENSE
|
| 6 |
-
|
| 7 |
75d1d6e30f98bf99c8112e6a33e1f6405db6df3a808ef6ab404f14ba3abc3181 README.md
|
| 8 |
82a05c21b027d9cebd4d512c284c309159385dcebe457172bc9a350c74483a71 RUN_GUIDE.md
|
| 9 |
a0e232a2b134e771355f018706c69bf4fa46ab5c3c65f1c94314d5f0acb73e80 SOURCE_NOTICE.md
|
|
@@ -13,9 +13,9 @@ d79d1b4947327762b6833bdd147949c15fd2a60bf65865442e7ba0fcfd67a4a8 THIRD_PARTY_NO
|
|
| 13 |
edb05bb77440adc61f2833ee92af2abb2ccebd18bed22be66b2d4d2626461eec checkpoint_provenance.json
|
| 14 |
369cab2772baaa6dacc26dbceeb66cb3cc7df1aac49aec3fc747ce418908a35f complete-request-exact.svg
|
| 15 |
778bed0cc245b238e1f08ab3f67ddb2dc5cda79095c65b598437fb4fcf9c8a27 config.json
|
| 16 |
-
|
| 17 |
25b406a7b86e3e8ac4dd0b7f32e27590d9d11349a0148a7815c32304150ac725 model.safetensors
|
| 18 |
-
|
| 19 |
641fe860d6fd24547fe4d15bd852190f00ddec31bd74eb7ca9eeae74031c2f0c pretraining-training-loss.png
|
| 20 |
c7b1a3c0efb09ef3b5416a24072e48b25e2cc1f122fb5ed638c0f95b72594af9 requirements.txt
|
| 21 |
e095f0413a11fa91fbb58f37d00e4c6bcda59beb89b28f6f680db1436a7e8891 tokenizer.json
|
|
|
|
| 3 |
e2e6e75848a42ea4bb5e50ab85a91f1e1cd2b413327fb9667d4893e15a86db04 INFERENCE_VERIFICATION.json
|
| 4 |
b6da2e34e1d59693c11b257203804260613f636f40d5fca56d4ae8b1e253ae3e JSONLITE_RESULTS.json
|
| 5 |
c71d239df91726fc519c6eb72d318ec65820627232b2f796219e87dcf35d0ab4 LICENSE
|
| 6 |
+
bc70f2792409ca4af51a61b3925b9de0690dffc19155bb168ca5b983552c35db PACKAGING_VERIFICATION.json
|
| 7 |
75d1d6e30f98bf99c8112e6a33e1f6405db6df3a808ef6ab404f14ba3abc3181 README.md
|
| 8 |
82a05c21b027d9cebd4d512c284c309159385dcebe457172bc9a350c74483a71 RUN_GUIDE.md
|
| 9 |
a0e232a2b134e771355f018706c69bf4fa46ab5c3c65f1c94314d5f0acb73e80 SOURCE_NOTICE.md
|
|
|
|
| 13 |
edb05bb77440adc61f2833ee92af2abb2ccebd18bed22be66b2d4d2626461eec checkpoint_provenance.json
|
| 14 |
369cab2772baaa6dacc26dbceeb66cb3cc7df1aac49aec3fc747ce418908a35f complete-request-exact.svg
|
| 15 |
778bed0cc245b238e1f08ab3f67ddb2dc5cda79095c65b598437fb4fcf9c8a27 config.json
|
| 16 |
+
0957a6347cb5052847b713bfb8048e7aa2c84b79b6cc1080b0c64f2d3b7f73a9 inference.py
|
| 17 |
25b406a7b86e3e8ac4dd0b7f32e27590d9d11349a0148a7815c32304150ac725 model.safetensors
|
| 18 |
+
8f5a075f63e1ff8857af3ddd916afc57742e614b1da5cbbe15452e9c84e94d2a native_bundle.zip
|
| 19 |
641fe860d6fd24547fe4d15bd852190f00ddec31bd74eb7ca9eeae74031c2f0c pretraining-training-loss.png
|
| 20 |
c7b1a3c0efb09ef3b5416a24072e48b25e2cc1f122fb5ed638c0f95b72594af9 requirements.txt
|
| 21 |
e095f0413a11fa91fbb58f37d00e4c6bcda59beb89b28f6f680db1436a7e8891 tokenizer.json
|
inference.py
CHANGED
|
@@ -12,7 +12,7 @@ import tempfile
|
|
| 12 |
import zipfile
|
| 13 |
|
| 14 |
ROOT = Path(__file__).resolve().parent
|
| 15 |
-
BUNDLE_SHA256 = "
|
| 16 |
|
| 17 |
def main():
|
| 18 |
archive = ROOT / "native_bundle.zip"
|
|
|
|
| 12 |
import zipfile
|
| 13 |
|
| 14 |
ROOT = Path(__file__).resolve().parent
|
| 15 |
+
BUNDLE_SHA256 = "8f5a075f63e1ff8857af3ddd916afc57742e614b1da5cbbe15452e9c84e94d2a"
|
| 16 |
|
| 17 |
def main():
|
| 18 |
archive = ROOT / "native_bundle.zip"
|
native_bundle.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f5a075f63e1ff8857af3ddd916afc57742e614b1da5cbbe15452e9c84e94d2a
|
| 3 |
+
size 18095722
|