Spaces:
Running
Running
Make organization card evergreen
Browse files
README.md
CHANGED
|
@@ -4,46 +4,31 @@ sdk: static
|
|
| 4 |
pinned: false
|
| 5 |
---
|
| 6 |
|
| 7 |
-
|
| 8 |
-
|
| 9 |
-
### Local AI, real hardware, and useful MLX releases for the community.
|
| 10 |
-
|
| 11 |
-
Hi — I’m one person with a strong interest in local AI.
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
-
|
| 16 |
|
| 17 |
-
|
| 18 |
|
| 19 |
-
-
|
| 20 |
-
- MacBook Pro
|
| 21 |
-
- NVIDIA DGX Spark
|
| 22 |
|
| 23 |
-
|
| 24 |
|
| 25 |
-
## What
|
| 26 |
|
| 27 |
- MLX conversions and quantized checkpoints
|
| 28 |
-
-
|
| 29 |
-
- Practical
|
| 30 |
-
-
|
| 31 |
-
- Clear
|
| 32 |
-
- Honest
|
| 33 |
-
|
| 34 |
-
## Current MLX releases
|
| 35 |
-
|
| 36 |
-
| Model family | Available builds |
|
| 37 |
-
| --- | --- |
|
| 38 |
-
| **DeepSeek V4 Flash** | [MXFP4 MLX](https://huggingface.co/Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX) |
|
| 39 |
-
| **Ling 3.0 Flash** | [4-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-4bit) · [8-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-8bit) |
|
| 40 |
-
| **Laguna S 2.1** | [4-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-8bit) |
|
| 41 |
-
| **Solar Open 2 250B** | [4-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-8bit) |
|
| 42 |
|
| 43 |
-
## Why I
|
| 44 |
|
| 45 |
-
Local AI
|
| 46 |
|
| 47 |
-
|
| 48 |
|
| 49 |
-
If
|
|
|
|
| 4 |
pinned: false
|
| 5 |
---
|
| 6 |
|
| 7 |
+
<div align="center">
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
|
| 9 |
+
# Vontra
|
| 10 |
|
| 11 |
+
### Exploring local AI and sharing useful MLX work with the community.
|
| 12 |
|
| 13 |
+
</div>
|
| 14 |
|
| 15 |
+
Vontra is my personal local-AI project. I’m one person experimenting with open models, learning what today’s hardware can do, and publishing anything that might save somebody else time.
|
|
|
|
|
|
|
| 16 |
|
| 17 |
+
My main focus is **MLX and Apple silicon**. I run models on a Mac Studio and MacBook Pro, work through conversion and compatibility problems, and share usable checkpoints, code and notes when I get them running. I also use an NVIDIA DGX Spark for local inference experiments outside the Apple ecosystem.
|
| 18 |
|
| 19 |
+
## What you’ll find here
|
| 20 |
|
| 21 |
- MLX conversions and quantized checkpoints
|
| 22 |
+
- Compatibility work for architectures that need more than a stock conversion
|
| 23 |
+
- Practical notes from running and serving models locally
|
| 24 |
+
- Memory and performance observations where they are useful
|
| 25 |
+
- Clear links and credit to the original model creators
|
| 26 |
+
- Honest warnings when something is experimental or incomplete
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 27 |
|
| 28 |
+
## Why I share it
|
| 29 |
|
| 30 |
+
Local AI moves quickly, and a lot of the difficult work happens between a model being released and somebody being able to run it well on their own machine. Sharing that work makes the ecosystem more accessible and helps the next person avoid solving the same problems again.
|
| 31 |
|
| 32 |
+
This is a personal, best-effort project rather than a company or research lab. I don’t train the base models, and every release remains the work of its original authors. Each repository should explain what was changed, how it was tested, what needs to be trusted, and which upstream licence applies.
|
| 33 |
|
| 34 |
+
If something here helps, use it. If something breaks, a clear and reproducible report is always appreciated.
|