Instructions to use nativ-community/flint-bf16 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use nativ-community/flint-bf16 with MLX:
# Make sure mlx-lm is installed # pip install --upgrade mlx-lm # Generate text with mlx-lm from mlx_lm import load, generate model, tokenizer = load("nativ-community/flint-bf16") prompt = "Write a story about Einstein" messages = [{"role": "user", "content": prompt}] prompt = tokenizer.apply_chat_template( messages, add_generation_prompt=True ) text = generate(model, tokenizer, prompt=prompt, verbose=True) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Pi
How to use nativ-community/flint-bf16 with Pi:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nativ-community/flint-bf16"
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "mlx-lm": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "nativ-community/flint-bf16" } ] } } }Run Pi
# Start Pi in your project directory: pi
- MLX LM
How to use nativ-community/flint-bf16 with MLX LM:
Generate or start a chat session
# Install MLX LM uv tool install mlx-lm # Interactive chat REPL mlx_lm.chat --model "nativ-community/flint-bf16"
Run an OpenAI-compatible server
# Install MLX LM uv tool install mlx-lm # Start the server mlx_lm.server --model "nativ-community/flint-bf16" # Calling the OpenAI-compatible server with curl curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "nativ-community/flint-bf16", "messages": [ {"role": "user", "content": "Hello"} ] }' - Hermes Agent
How to use nativ-community/flint-bf16 with Hermes Agent:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nativ-community/flint-bf16"
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default nativ-community/flint-bf16
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use nativ-community/flint-bf16 with OpenClaw:
Start the MLX server
# Install MLX LM: uv tool install mlx-lm # Start a local OpenAI-compatible server: mlx_lm.server --model "nativ-community/flint-bf16"
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "nativ-community/flint-bf16" \ --custom-provider-id mlx-lm \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download conversion.json from nativ-community/flint-bf16: direct link, hf CLI and curl.
- Browser
- Download file 3.82 kB
-
https://huggingface.co/nativ-community/flint-bf16/resolve/main/conversion.json
- Command line
-
hf download hf://nativ-community/flint-bf16/conversion.json
-
curl -L -o conversion.json https://huggingface.co/nativ-community/flint-bf16/resolve/main/conversion.json
3.82 kB
| { | |
| "source_model": "RecursiveSI/flint", | |
| "source_revision": "2a247be0c0aec895ccb0ac7ca92229ec6df37288", | |
| "converter_repository": "Blaizzy/mlx-vlm", | |
| "converter_revision": "6d9ba328abbd6129c7461eda86280aa9fbfd9986", | |
| "mlx_vlm_version": "0.7.10", | |
| "mlx_version": "0.32.4", | |
| "format": "bf16", | |
| "conversion_options": { | |
| "quantize": false, | |
| "dtype": "bfloat16", | |
| "trust_remote_code": false | |
| }, | |
| "quantization": null, | |
| "weight_bytes": 79570709520, | |
| "weights": { | |
| "model-00001-of-00016.safetensors": { | |
| "bytes": 5278053668, | |
| "sha256": "d3f4bb5727f1feaec1c9ab1bdce146c345986e96bdb6a56f73b33e9fd9a2fd9e" | |
| }, | |
| "model-00002-of-00016.safetensors": { | |
| "bytes": 4986013524, | |
| "sha256": "ddca3932199e410a05db9b7bfc16888f9b4ce994e3ea510e737257a7d8780d55" | |
| }, | |
| "model-00003-of-00016.safetensors": { | |
| "bytes": 4986013525, | |
| "sha256": "25375d91502b07591d7c8d299f5193108dda9d1c60a3dcbebda51836ee6f9784" | |
| }, | |
| "model-00004-of-00016.safetensors": { | |
| "bytes": 4986013581, | |
| "sha256": "66d77b019746488e35bae2458758cb02e5375fee467559814b4812f1ef2bff32" | |
| }, | |
| "model-00005-of-00016.safetensors": { | |
| "bytes": 4986013579, | |
| "sha256": "ce49004bafad0e21cc5b6739424ad3d1966e412d33ba02f85c43a6bd8ad5000b" | |
| }, | |
| "model-00006-of-00016.safetensors": { | |
| "bytes": 4986013555, | |
| "sha256": "48eb48d4b99ade8c14a5dad30123227407843b085f0691e9b18b145b3a6508ee" | |
| }, | |
| "model-00007-of-00016.safetensors": { | |
| "bytes": 4986013569, | |
| "sha256": "2d01c87fff7b612c5160a9099a8405e952a2c89e94fbd2a8c48fd34d855478ba" | |
| }, | |
| "model-00008-of-00016.safetensors": { | |
| "bytes": 4986013573, | |
| "sha256": "44abb12fc00fcb60d1225e487358fd916fa8f0316e9c1c868522fcfbc40d0c7f" | |
| }, | |
| "model-00009-of-00016.safetensors": { | |
| "bytes": 4986013581, | |
| "sha256": "71b7844cf1ea9b7d48bb53c65679c5b93a0de910642c099e34357308414d9cc1" | |
| }, | |
| "model-00010-of-00016.safetensors": { | |
| "bytes": 4986013535, | |
| "sha256": "9a5cca59a6924f773133a9bb103009d76d33b3b46d1a19624ccb1fc709a4263d" | |
| }, | |
| "model-00011-of-00016.safetensors": { | |
| "bytes": 4986013581, | |
| "sha256": "64ac2a7ecf0a9c11e0f46664ddfd0f3e0f5a9a523307c2e19ff6a4cab59b3616" | |
| }, | |
| "model-00012-of-00016.safetensors": { | |
| "bytes": 4986013581, | |
| "sha256": "e7b63878543ee20042505e92b161d505d29ff8b117475d5048cfb79a27e039b8" | |
| }, | |
| "model-00013-of-00016.safetensors": { | |
| "bytes": 4986013541, | |
| "sha256": "0da6ad613177f0ef9807e42d09f34820e8a6b1151e54dfcdf9bd9859b4bda8a7" | |
| }, | |
| "model-00014-of-00016.safetensors": { | |
| "bytes": 4986013563, | |
| "sha256": "37ec610c079b2f53ffb328c550324ab682cd241fa4a08bf044a941a29838f3f8" | |
| }, | |
| "model-00015-of-00016.safetensors": { | |
| "bytes": 4986013581, | |
| "sha256": "97c3c837a9e534b7a899f39346c6c8461acc6f86d49d4b35d232436720cfce8e" | |
| }, | |
| "model-00016-of-00016.safetensors": { | |
| "bytes": 4488465983, | |
| "sha256": "5d0e43b32e1971a6aefd20ec161a61335aefc69ed735087fbabe2596f2317cb2" | |
| } | |
| }, | |
| "sidecar_sha256": { | |
| "tokenizer.json": "a263cce0b7e2b03f7ee07ce809783ef4b47f160c3f268a4ea1524f638da45b68", | |
| "tokenizer_config.json": "159ac88217e90ffd0a4a294726048bb302829e82e1958dc85bb203aa79138fbf", | |
| "chat_template.jinja": "7940f4ffa3275c36caa4a582f845aaad79da11018b3961e8fbcad6ae29733466", | |
| "generation_config.json": "a499c71895e008abd572558a5ad5904feaed92cf2a3b6e2cb0e9cabf03b96ed3", | |
| "LICENSE": "43070e2d4e532684de521b885f385d0841030efa2b1a20bafb76133a5e1379c1" | |
| }, | |
| "seconds": 43.25340470788069, | |
| "peak_active_gb": 8.207236316, | |
| "device": { | |
| "device_name": "Apple M5 Max", | |
| "max_recommended_working_set_size": 115448725504, | |
| "memory_size": 137438953472, | |
| "architecture": "applegpu_g17s", | |
| "max_buffer_length": 86586540032, | |
| "resource_limit": 499000 | |
| } | |
| } |