Text Generation
MLX
Safetensors
English
small-language-model
from-scratch
conversational
apple-silicon
research
Instructions to use OpenSML/Solstice-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use OpenSML/Solstice-1 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("OpenSML/Solstice-1") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use OpenSML/Solstice-1 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "OpenSML/Solstice-1"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "OpenSML/Solstice-1" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OpenSML/Solstice-1", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Ctrl+K
- 8.6 kB
- 1 Bytes
- 41.4 kB
- 2.73 kB
- 10.8 kB
- 12.7 kB
- 6.66 kB
- 6.19 kB
- 4.4 kB
- 6.84 kB
- 2.05 kB
- 1.08 kB
- 489 Bytes
- 30.7 kB
- 3.8 kB
- 4.51 kB
- 432 Bytes
- 2 kB
- 48.4 kB
- 46.5 kB
- 3.82 kB
- 58 kB
- 1.28 kB
- 31.5 kB
- 38.7 kB
- 8.83 kB
- 12.9 kB
- 24.5 kB
- 12.3 kB
- 5.27 kB
- 2.21 kB
- 3.23 kB
- 19.9 kB
- 36.2 kB
- 4.5 kB
- 31.9 kB
- 10.3 kB
- 10.6 kB
- 14.7 kB
- 2.75 kB
- 2.15 kB
- 2.8 kB
- 11.7 kB
- 17 kB
- 4.09 kB
- 11.3 kB
- 15.4 kB
- 7.79 kB
- 57.4 kB
- 9.21 kB