Spaces:
Running
Running
Rebrand organization card to TensorFold
Browse files- .gitattributes +2 -0
- README.md +23 -38
- tensorfold-hero.png +3 -0
- tensorfold-logo.png +3 -0
.gitattributes
CHANGED
|
@@ -34,3 +34,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
assets/vontra-logo-512.png filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
| 34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
assets/vontra-logo-512.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
tensorfold-logo.png filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
tensorfold-hero.png filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
|
@@ -1,62 +1,47 @@
|
|
| 1 |
---
|
| 2 |
-
title:
|
| 3 |
sdk: static
|
| 4 |
pinned: false
|
| 5 |
---
|
| 6 |
|
| 7 |
-
|
| 8 |
<div align="center">
|
|
|
|
| 9 |
|
|
|
|
| 10 |
|
| 11 |
-
#
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
### Exploring local AI and sharing useful MLX work with the community.
|
| 15 |
-
|
| 16 |
|
|
|
|
| 17 |
</div>
|
| 18 |
|
|
|
|
| 19 |
|
| 20 |
-
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
My main focus is **MLX and Apple silicon**. I run models on a Mac Studio and MacBook Pro, work through conversion and compatibility problems, and share usable checkpoints, code and notes when I get them running. I also use a ThinkStation PGX (DGX Spark) for local inference experiments outside the Apple ecosystem.
|
| 24 |
-
|
| 25 |
-
|
| 26 |
-
## What you’ll find here
|
| 27 |
-
|
| 28 |
-
|
| 29 |
-
- MLX conversions and quantized checkpoints
|
| 30 |
-
- Compatibility work for architectures that need more than a stock conversion
|
| 31 |
-
- Practical notes from running and serving models locally
|
| 32 |
-
- Memory and performance observations where they are useful
|
| 33 |
-
- Clear links and credit to the original model creators
|
| 34 |
-
- Honest warnings when something is experimental or incomplete
|
| 35 |
-
|
| 36 |
-
|
| 37 |
-
## Why I share it
|
| 38 |
-
|
| 39 |
-
|
| 40 |
-
Local AI moves quickly, and a lot of the difficult work happens between a model being released and somebody being able to run it well on their own machine. Sharing that work makes the ecosystem more accessible and helps the next person avoid solving the same problems again.
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
This is a personal, best-effort project rather than a company or research lab. I don’t train the base models, and every release remains the work of its original authors. Each repository should explain what was changed, how it was tested, what needs to be trusted, and which upstream licence applies.
|
| 44 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 45 |
|
| 46 |
-
|
| 47 |
|
|
|
|
|
|
|
|
|
|
| 48 |
|
|
|
|
| 49 |
|
| 50 |
## Choose a model for your Mac
|
| 51 |
|
| 52 |
| Unified memory | Collection | Selection basis |
|
| 53 |
| --- | --- | --- |
|
| 54 |
-
|
|
| 55 |
-
|
|
| 56 |
-
|
|
| 57 |
|
| 58 |
-
These are
|
| 59 |
|
| 60 |
-
|
| 61 |
|
| 62 |
-
[Follow
|
|
|
|
| 1 |
---
|
| 2 |
+
title: TensorFold
|
| 3 |
sdk: static
|
| 4 |
pinned: false
|
| 5 |
---
|
| 6 |
|
|
|
|
| 7 |
<div align="center">
|
| 8 |
+
<img src="./tensorfold-hero.png" alt="TensorFold" width="100%">
|
| 9 |
|
| 10 |
+
# TensorFold
|
| 11 |
|
| 12 |
+
### Fast local LLM inference and tested model releases for Apple Silicon and NVIDIA CUDA.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 13 |
|
| 14 |
+
[tensorfold.dev](https://tensorfold.dev) · [Runtime and setup](https://github.com/ashhart/TensorFold) · [Model collections](https://huggingface.co/TensorFold/collections)
|
| 15 |
</div>
|
| 16 |
|
| 17 |
+
TensorFold is an open-source inference runtime and a practical model-release project. The runtime serves local models behind an OpenAI-compatible API, while this Hugging Face organization publishes checkpoints and supporting assets tested on real hardware.
|
| 18 |
|
| 19 |
+
## What you will find here
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 20 |
|
| 21 |
+
- MLX quantized checkpoints for Apple Silicon
|
| 22 |
+
- MTP and DFlash assets where the upstream model provides a compatible drafter
|
| 23 |
+
- NVIDIA and DGX Spark recipes when a release has been tested there
|
| 24 |
+
- Measured speed, memory use, runtime versions, and known limits
|
| 25 |
+
- Clear credit, licences, and links to the original model authors
|
| 26 |
|
| 27 |
+
## Run with TensorFold
|
| 28 |
|
| 29 |
+
```bash
|
| 30 |
+
curl -fsSL https://tensorfold.dev/install.sh | sh
|
| 31 |
+
```
|
| 32 |
|
| 33 |
+
TensorFold supports macOS and Linux. See the [setup guide](https://github.com/ashhart/TensorFold) for current model families, runtime flags, and benchmark conditions.
|
| 34 |
|
| 35 |
## Choose a model for your Mac
|
| 36 |
|
| 37 |
| Unified memory | Collection | Selection basis |
|
| 38 |
| --- | --- | --- |
|
| 39 |
+
| 64 GB | [Browse models](https://huggingface.co/collections/TensorFold/mlx-models-for-64gb-macs) | Published peak below 48 GB |
|
| 40 |
+
| 128 GB | [Browse models](https://huggingface.co/collections/TensorFold/mlx-models-for-128gb-macs) | Published peak below 96 GB |
|
| 41 |
+
| 256 GB | [Browse models](https://huggingface.co/collections/TensorFold/mlx-models-for-256gb-macs) | Published peak below 192 GB |
|
| 42 |
|
| 43 |
+
These collections are starting points with nominal context headroom, not guarantees at maximum context. Each model card records the tested runtime, prompt, output length, memory evidence, and any compatibility caveats.
|
| 44 |
|
| 45 |
+
TensorFold does not train the base models. Model design, training, evaluations, and upstream documentation remain the work of the original authors and contributors.
|
| 46 |
|
| 47 |
+
[Follow TensorFold for new model releases, runtime updates, and fixes.](https://huggingface.co/TensorFold)
|
tensorfold-hero.png
ADDED
|
Git LFS Details
|
tensorfold-logo.png
ADDED
|
Git LFS Details
|