Instructions to use OpenSML/Solstice-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use OpenSML/Solstice-1 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("OpenSML/Solstice-1") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- MLX LM
How to use OpenSML/Solstice-1 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "OpenSML/Solstice-1"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "OpenSML/Solstice-1" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "OpenSML/Solstice-1", "messages": [ {"role": "user", "content": "Hello"} ] }' - Atomic Chat
Download docs/EXAMPLES.md from OpenSML/Solstice-1: direct link, hf CLI and curl.
- Browser
- Download file 1.12 kB
-
https://huggingface.co/OpenSML/Solstice-1/resolve/main/docs/EXAMPLES.md
- Command line
-
hf download hf://OpenSML/Solstice-1/docs/EXAMPLES.md
-
curl -L -o EXAMPLES.md https://huggingface.co/OpenSML/Solstice-1/resolve/main/docs/EXAMPLES.md
Recorded inference examples
Greedy FP32, no system message, no repetition penalty. Reproduced in the clean release environment. These include a factual error so that successful loading is not confused with correctness.
knowledge-00
User: What is the capital of Japan? Give a short answer.
Generated answer: Tokyo
Stop: turn_end. Saved answer matcher: True.
knowledge-01
User: Which planet is closest to the Sun? Give a short answer.
Generated answer: venus
Stop: turn_end. Saved answer matcher: False.
reading-00
User: Use only the information below. Give a short answer.
Anika brought a teal notebook. Greta brought a black notebook. What color was Anika’s notebook?
Generated answer: teal
Stop: turn_end. Saved answer matcher: True.
conversation-00
User: My reservation number is 217.
Assistant: Understood.
User: Correction: my reservation number is 317.
Assistant: Understood.
User: What is my current reservation number? Give only the number.
Generated answer: 317
Stop: turn_end. Saved answer matcher: True.