Feature Extraction
MLX
Safetensors
muse_glimmer
mlx-vlm
metaencoder
multimodal
embeddings
quantized
8-bit precision
Instructions to use edgefloor/meta-encoder-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use edgefloor/meta-encoder-mlx-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download edgefloor/meta-encoder-mlx-8bit --local-dir meta-encoder-mlx-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
File size: 2,294 Bytes
e5030dc | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 | {
"model": "meta-encoder-mlx-8bit",
"load_seconds": 8.406539290997898,
"embedding_dim": 6656,
"checks": [
{
"name": "text_animal",
"seconds": 4.789314416004345,
"scores": [
0.3625825345516205,
0.2203747034072876,
0.16552267968654633
],
"candidates": [
"cat",
"dog",
"horse"
],
"predicted": "cat",
"expected": "cat",
"correct": true,
"norms": [
1.0,
1.0,
1.0,
1.0
]
},
{
"name": "text_action",
"seconds": 1.82342183298897,
"scores": [
0.6134610772132874,
0.16023504734039307,
0.20238327980041504
],
"candidates": [
"Click Cancel order",
"Open profile settings",
"Search products"
],
"predicted": "Click Cancel order",
"expected": "Click Cancel order",
"correct": true,
"norms": [
1.0,
1.0,
1.0,
1.0
]
},
{
"name": "image_color",
"seconds": 1.7876198329904582,
"scores": [
0.4851677715778351,
0.3475082814693451,
0.3573587238788605
],
"candidates": [
"red",
"blue",
"green"
],
"predicted": "red",
"expected": "red",
"correct": true,
"norms": [
1.0,
0.9999999403953552,
1.0,
1.0
]
},
{
"name": "video_color",
"seconds": 1.3898598329978995,
"scores": [
0.4881054162979126,
0.384658545255661,
0.3898668885231018
],
"candidates": [
"red",
"blue",
"green"
],
"predicted": "red",
"expected": "red",
"correct": true,
"norms": [
1.0,
0.9999999403953552,
1.0,
1.0
]
}
],
"total_seconds": 18.199415957991732,
"peak_mlx_memory_gb": 33.596695948,
"bf16_mlx_reference_task_cosine": 0.9996585845947266,
"bf16_mlx_reference_video_task_cosine": 0.9993553161621094,
"reference_scope": "One text task and one two-frame video task compared with streamed BF16 MLX inference from the original checkpoint. Full-model Transformers parity and benchmark accuracy were not measured."
}
|