ashxhart commited on
Commit
04a71c3
·
verified ·
1 Parent(s): 3db3124

Make organization card evergreen

Browse files
Files changed (1) hide show
  1. README.md +16 -31
README.md CHANGED
@@ -4,46 +4,31 @@ sdk: static
4
  pinned: false
5
  ---
6
 
7
- # Vontra
8
-
9
- ### Local AI, real hardware, and useful MLX releases for the community.
10
-
11
- Hi — I’m one person with a strong interest in local AI.
12
 
13
- I spend my time trying models on hardware I actually own, working through the awkward compatibility problems, and sharing the useful results. Most of my work here is focused on **MLX and Apple silicon**: model conversions, quantized checkpoints, architecture support, serving notes, and the occasional bit of glue needed to make a model run properly.
14
 
15
- There is no big company or team behind this page. I’m simply exploring what local hardware can do and trying to make that work useful to other people.
16
 
17
- ## The hardware
18
 
19
- - Mac Studio
20
- - MacBook Pro
21
- - NVIDIA DGX Spark
22
 
23
- The Apple machines are where most of the MLX work happens. The DGX Spark gives me another local platform for comparison and experimentation.
24
 
25
- ## What I share
26
 
27
  - MLX conversions and quantized checkpoints
28
- - Support for models that do not yet work cleanly with stock MLX-LM
29
- - Practical oMLX and local-serving notes
30
- - Measured memory and generation results when available
31
- - Clear attribution to the original model creators
32
- - Honest caveats when something is experimental
33
-
34
- ## Current MLX releases
35
-
36
- | Model family | Available builds |
37
- | --- | --- |
38
- | **DeepSeek V4 Flash** | [MXFP4 MLX](https://huggingface.co/Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX) |
39
- | **Ling 3.0 Flash** | [4-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-4bit) · [8-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-8bit) |
40
- | **Laguna S 2.1** | [4-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-8bit) |
41
- | **Solar Open 2 250B** | [4-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-8bit) |
42
 
43
- ## Why I publish this work
44
 
45
- Local AI gets better when people share what worked, what failed, and what had to be changed along the way. If one of these releases saves someone else a long conversion, a difficult compatibility fix, or a few hours of testing, then publishing it was worthwhile.
46
 
47
- All base models belong to their original authors and are released under their respective licences. Please check each model card for upstream attribution, usage instructions, trust requirements, and limitations.
48
 
49
- If you find a problem, open a discussion on the relevant model repository. Useful reports and reproducible results are always welcome.
 
4
  pinned: false
5
  ---
6
 
7
+ <div align="center">
 
 
 
 
8
 
9
+ # Vontra
10
 
11
+ ### Exploring local AI and sharing useful MLX work with the community.
12
 
13
+ </div>
14
 
15
+ Vontra is my personal local-AI project. I’m one person experimenting with open models, learning what today’s hardware can do, and publishing anything that might save somebody else time.
 
 
16
 
17
+ My main focus is **MLX and Apple silicon**. I run models on a Mac Studio and MacBook Pro, work through conversion and compatibility problems, and share usable checkpoints, code and notes when I get them running. I also use an NVIDIA DGX Spark for local inference experiments outside the Apple ecosystem.
18
 
19
+ ## What you’ll find here
20
 
21
  - MLX conversions and quantized checkpoints
22
+ - Compatibility work for architectures that need more than a stock conversion
23
+ - Practical notes from running and serving models locally
24
+ - Memory and performance observations where they are useful
25
+ - Clear links and credit to the original model creators
26
+ - Honest warnings when something is experimental or incomplete
 
 
 
 
 
 
 
 
 
27
 
28
+ ## Why I share it
29
 
30
+ Local AI moves quickly, and a lot of the difficult work happens between a model being released and somebody being able to run it well on their own machine. Sharing that work makes the ecosystem more accessible and helps the next person avoid solving the same problems again.
31
 
32
+ This is a personal, best-effort project rather than a company or research lab. I don’t train the base models, and every release remains the work of its original authors. Each repository should explain what was changed, how it was tested, what needs to be trusted, and which upstream licence applies.
33
 
34
+ If something here helps, use it. If something breaks, a clear and reproducible report is always appreciated.