ashxhart commited on
Commit
3db3124
·
verified ·
1 Parent(s): ef4057b

Refresh Vontra organization profile

Browse files
Files changed (1) hide show
  1. README.md +34 -13
README.md CHANGED
@@ -6,23 +6,44 @@ pinned: false
6
 
7
  # Vontra
8
 
9
- Solo AI tinkerer publishing practical local-inference artifacts: MLX quants, serving notes, and the small bits of glue that make models easier to run on real machines.
10
 
11
- No startup theatre. No mystery benchmark fog. Just useful experiments, clean model cards, and attribution back to the original authors.
12
 
13
- ## Current Shelf
14
 
15
- | Model | Format | Best for |
16
- |---|---:|---|
17
- | [Laguna-S-2.1-MLX-8bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-8bit) | MLX 8-bit | Highest-fidelity local run |
18
- | [Laguna-S-2.1-MLX-6bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-6bit) | MLX 6-bit | Middle ground between size and quality |
19
- | [Laguna-S-2.1-MLX-4bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-4bit) | MLX 4-bit | Smaller local footprint |
20
 
21
- ## What Gets Published
 
 
 
 
 
 
 
 
22
 
23
  - MLX conversions and quantized checkpoints
24
- - Apple Silicon serving notes
25
- - OpenAI-compatible local server recipes
26
- - Honest caveats from running models on actual hardware
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
- Everything is shared best-effort, with clear credit to the original model authors where applicable.
 
6
 
7
  # Vontra
8
 
9
+ ### Local AI, real hardware, and useful MLX releases for the community.
10
 
11
+ Hi — I’m one person with a strong interest in local AI.
12
 
13
+ I spend my time trying models on hardware I actually own, working through the awkward compatibility problems, and sharing the useful results. Most of my work here is focused on **MLX and Apple silicon**: model conversions, quantized checkpoints, architecture support, serving notes, and the occasional bit of glue needed to make a model run properly.
14
 
15
+ There is no big company or team behind this page. I’m simply exploring what local hardware can do and trying to make that work useful to other people.
 
 
 
 
16
 
17
+ ## The hardware
18
+
19
+ - Mac Studio
20
+ - MacBook Pro
21
+ - NVIDIA DGX Spark
22
+
23
+ The Apple machines are where most of the MLX work happens. The DGX Spark gives me another local platform for comparison and experimentation.
24
+
25
+ ## What I share
26
 
27
  - MLX conversions and quantized checkpoints
28
+ - Support for models that do not yet work cleanly with stock MLX-LM
29
+ - Practical oMLX and local-serving notes
30
+ - Measured memory and generation results when available
31
+ - Clear attribution to the original model creators
32
+ - Honest caveats when something is experimental
33
+
34
+ ## Current MLX releases
35
+
36
+ | Model family | Available builds |
37
+ | --- | --- |
38
+ | **DeepSeek V4 Flash** | [MXFP4 MLX](https://huggingface.co/Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX) |
39
+ | **Ling 3.0 Flash** | [4-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-4bit) · [8-bit](https://huggingface.co/Vontra/Ling-3.0-flash-MLX-8bit) |
40
+ | **Laguna S 2.1** | [4-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Laguna-S-2.1-MLX-8bit) |
41
+ | **Solar Open 2 250B** | [4-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-4bit) · [6-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-6bit) · [8-bit](https://huggingface.co/Vontra/Solar-Open2-250B-MLX-8bit) |
42
+
43
+ ## Why I publish this work
44
+
45
+ Local AI gets better when people share what worked, what failed, and what had to be changed along the way. If one of these releases saves someone else a long conversion, a difficult compatibility fix, or a few hours of testing, then publishing it was worthwhile.
46
+
47
+ All base models belong to their original authors and are released under their respective licences. Please check each model card for upstream attribution, usage instructions, trust requirements, and limitations.
48
 
49
+ If you find a problem, open a discussion on the relevant model repository. Useful reports and reproducible results are always welcome.