Instructions to use KRAFTON/Raon-1-mini-preview-mlx with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use KRAFTON/Raon-1-mini-preview-mlx with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("KRAFTON/Raon-1-mini-preview-mlx") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use KRAFTON/Raon-1-mini-preview-mlx with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "KRAFTON/Raon-1-mini-preview-mlx"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "KRAFTON/Raon-1-mini-preview-mlx" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use KRAFTON/Raon-1-mini-preview-mlx with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "KRAFTON/Raon-1-mini-preview-mlx"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "KRAFTON/Raon-1-mini-preview-mlx" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "KRAFTON/Raon-1-mini-preview-mlx", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use KRAFTON/Raon-1-mini-preview-mlx with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "KRAFTON/Raon-1-mini-preview-mlx"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default KRAFTON/Raon-1-mini-preview-mlx
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use KRAFTON/Raon-1-mini-preview-mlx with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "KRAFTON/Raon-1-mini-preview-mlx"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "KRAFTON/Raon-1-mini-preview-mlx" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Commit History
3 days ago
-
Update playground link and add Discord community badge
Verified signaturec65b3bc
4 days ago
-
Update MLX inference and document bundled DFlash2 and optional output head
Verified signaturec57a141 -
Fix chat template handling of userless history and reasoning delimiters
Verified signatureAllow conversations without a user query and preserve answer text after the first reasoning delimiter. Keep history reasoning by default and allow system messages in their original positions.071fcdd
8 days ago
-
Link Raon-1 mini model tree
Verified signature2474b55 -
Remove Beta Access section from README
Verified signature5363d72
9 days ago
-
Print reasoning and answer separately in the Transformers example
Verified signatureskip_special_tokens=True dropped </think>, so the reasoning and the answer printed as one block. Split the generated tokens at </think> instead.5f94545 -
Update README.md
Verified signatureFix MLX serving for agent harnesses. - Add --max-tokens 32768 to the MLX server command; mlx_lm defaults to 512 tokens, which truncates thinking output for clients that do not send max_tokens (e.g. Hermes Agent). - Note that MLX needs KRAFTON/Raon-1-mini-preview-mlx as the model ID in Agentic Use; mlx_lm server loads the model named in each request, so Raon-1-mini-preview returns 404.16025be -
Drop the precompiled kernel commit pin from the vLLM install
Verified signatureThe fork's setup.py now defaults to the matching commit (krafton-ai/vllm a9d4a5c85).9880bb9 -
Point --spec-model at the renamed DFlash2 draft repo
Verified signatureKRAFTON/Raon-1-mini-preview-assistant was renamed to KRAFTON/Raon-1-mini-preview-dflash2.4df732d -
Add Hugging Face login step; pin the vLLM precompiled kernel commit
Verified signature`pip install git+...` checks out a detached HEAD, so the fork's setup.py cannot resolve its upstream base and installs nightly kernels, whose op signatures no longer match (NVFP4 fails in gptq_marlin_repack). VLLM_PRECOMPILED_WHEEL_COMMIT selects the matching kernels.88a4f1f -
Add license notice
Verified signatureLicense section: US legal team's notice (Apache 2.0 scope, hosted API/playground terms, beta access).ed5695a -
Report DFlash2 acceptance length as the per-request mean
Verified signaturec558ec0 -
Link the English playground page
Verified signatureeff2193 -
Break the playground tip into two lines
Verified signature2c31f9b -
Mention the playground in Access and that it is free for a limited time
Verified signature59c9859 -
Point to the free playground at raon-mini.krafton.ai
Verified signature499c09f -
Make benchmark table readable in dark mode
Verified signature7d7fff4 -
Use PNG images with dark-mode versions
Verified signaturef186525 -
Load README images from github.com/krafton-ai/Raon-1-mini-preview so they show without access
Verified signature798d60f -
Show a light-text logo in dark mode
Verified signaturef963506 -
Request access before download
Verified signature40cbc75 -
Name DFlash2 and the lowercase repo suffixes
Verified signature937e23e -
Shorten model card note
Verified signature5e4dee3 -
Shorten model card note
Verified signature9b7b74e -
Add model card
Verified signaturea5b5da4 -
Raon-1 mini preview MLX
88ca1b1