Spaces:
Running
Running
Refresh Vontra organization profile
Browse files
README.md
CHANGED
|
@@ -6,23 +6,44 @@ pinned: false
|
|
| 6 |
|
| 7 |
# Vontra
|
| 8 |
|
| 9 |
-
|
| 10 |
|
| 11 |
-
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
-
|
| 16 |
-
|---|---:|---|
|
| 17 |
-
| [Laguna-S-2.1-MLX-8bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-8bit) | MLX 8-bit | Highest-fidelity local run |
|
| 18 |
-
| [Laguna-S-2.1-MLX-6bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-6bit) | MLX 6-bit | Middle ground between size and quality |
|
| 19 |
-
| [Laguna-S-2.1-MLX-4bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-4bit) | MLX 4-bit | Smaller local footprint |
|
| 20 |
|
| 21 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 22 |
|
| 23 |
- MLX conversions and quantized checkpoints
|
| 24 |
-
-
|
| 25 |
-
-
|
| 26 |
-
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
-
|
|
|
|
| 6 |
|
| 7 |
# Vontra
|
| 8 |
|
| 9 |
+
### Local AI, real hardware, and useful MLX releases for the community.
|
| 10 |
|
| 11 |
+
Hi — I’m one person with a strong interest in local AI.
|
| 12 |
|
| 13 |
+
I spend my time trying models on hardware I actually own, working through the awkward compatibility problems, and sharing the useful results. Most of my work here is focused on **MLX and Apple silicon**: model conversions, quantized checkpoints, architecture support, serving notes, and the occasional bit of glue needed to make a model run properly.
|
| 14 |
|
| 15 |
+
There is no big company or team behind this page. I’m simply exploring what local hardware can do and trying to make that work useful to other people.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
+
## The hardware
|
| 18 |
+
|
| 19 |
+
- Mac Studio
|
| 20 |
+
- MacBook Pro
|
| 21 |
+
- NVIDIA DGX Spark
|
| 22 |
+
|
| 23 |
+
The Apple machines are where most of the MLX work happens. The DGX Spark gives me another local platform for comparison and experimentation.
|
| 24 |
+
|
| 25 |
+
## What I share
|
| 26 |
|
| 27 |
- MLX conversions and quantized checkpoints
|
| 28 |
+
- Support for models that do not yet work cleanly with stock MLX-LM
|
| 29 |
+
- Practical oMLX and local-serving notes
|
| 30 |
+
- Measured memory and generation results when available
|
| 31 |
+
- Clear attribution to the original model creators
|
| 32 |
+
- Honest caveats when something is experimental
|
| 33 |
+
|
| 34 |
+
## Current MLX releases
|
| 35 |
+
|
| 36 |
+
| Model family | Available builds |
|
| 37 |
+
| --- | --- |
|
| 38 |
+
| **DeepSeek V4 Flash** | [MXFP4 MLX](https://huggingface.co/Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX) |
|
| 39 |
+
| **Ling 3.0 Flash** | [4-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-4bit) · [8-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-8bit) |
|
| 40 |
+
| **Laguna S 2.1** | [4-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-8bit) |
|
| 41 |
+
| **Solar Open 2 250B** | [4-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-8bit) |
|
| 42 |
+
|
| 43 |
+
## Why I publish this work
|
| 44 |
+
|
| 45 |
+
Local AI gets better when people share what worked, what failed, and what had to be changed along the way. If one of these releases saves someone else a long conversion, a difficult compatibility fix, or a few hours of testing, then publishing it was worthwhile.
|
| 46 |
+
|
| 47 |
+
All base models belong to their original authors and are released under their respective licences. Please check each model card for upstream attribution, usage instructions, trust requirements, and limitations.
|
| 48 |
|
| 49 |
+
If you find a problem, open a discussion on the relevant model repository. Useful reports and reproducible results are always welcome.
|