Image Feature Extraction
Transformers
Safetensors
motif_vision
feature-extraction
motif
vision-transformer
self-supervised
video
custom_code
Instructions to use Motif-Technologies/Motif-Vision-Encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Motif-Technologies/Motif-Vision-Encoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
docs(README): Motif K400 = 87.4 (eval complete)
Browse filesFill Motif K400 attentive-probe top-1 (87.4); only KITTI remains in progress.
README.md
CHANGED
|
@@ -105,7 +105,7 @@ single-resolution (S) figure is available.
|
|
| 105 |
|
| 106 |
| Model | Training<br>data | DAVIS S<br>J&F β | DAVIS M<br>J&F β | DAVIS L<br>J&F β | ImageNet-1K<br>lin. probe β | ADE20K<br>mIoU β | K400 β | KITTI<br>depth MSE β |
|
| 107 |
|---|---|---|---|---|---|---|---|---|
|
| 108 |
-
| **Motif Vision Encoder** | 0.5B | **74.0** | **80.5** | **83.5** | 87.2 | 52.0 |
|
| 109 |
| DINOv3 | 1.7B | 71.1 | 79.7 | 83.3 | 88.4 | **55.9** | 87.8 | **2.3** |
|
| 110 |
| PEcore | 5.4B | 48.2 | 53.1 | 49.8 | **89.3** | 38.9 | **87.9** | 4.1 |
|
| 111 |
| SigLIP2 | 10B | 56.1 | 62.3 | 62.9 | 89.1 | 45.4 | 86.9 | β |
|
|
@@ -127,8 +127,8 @@ single-resolution (S) figure is available.
|
|
| 127 |
18.5M video clips), roughly **3.6Γ less data than DINOv3**, which is trained on LVD-1689M
|
| 128 |
(1,689M images). Despite the smaller corpus β and with only ~4% of samples being video β the
|
| 129 |
encoder stays competitive across both image and video benchmarks, and leads on DAVIS.
|
| 130 |
-
-
|
| 131 |
-
|
| 132 |
|
| 133 |
Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
|
| 134 |
video. Baseline DAVIS / ADE20K / K400 / KITTI figures are taken from the DINOv3 technical
|
|
|
|
| 105 |
|
| 106 |
| Model | Training<br>data | DAVIS S<br>J&F β | DAVIS M<br>J&F β | DAVIS L<br>J&F β | ImageNet-1K<br>lin. probe β | ADE20K<br>mIoU β | K400 β | KITTI<br>depth MSE β |
|
| 107 |
|---|---|---|---|---|---|---|---|---|
|
| 108 |
+
| **Motif Vision Encoder** | 0.5B | **74.0** | **80.5** | **83.5** | 87.2 | 52.0 | 87.4 | *in progress* |
|
| 109 |
| DINOv3 | 1.7B | 71.1 | 79.7 | 83.3 | 88.4 | **55.9** | 87.8 | **2.3** |
|
| 110 |
| PEcore | 5.4B | 48.2 | 53.1 | 49.8 | **89.3** | 38.9 | **87.9** | 4.1 |
|
| 111 |
| SigLIP2 | 10B | 56.1 | 62.3 | 62.9 | 89.1 | 45.4 | 86.9 | β |
|
|
|
|
| 127 |
18.5M video clips), roughly **3.6Γ less data than DINOv3**, which is trained on LVD-1689M
|
| 128 |
(1,689M images). Despite the smaller corpus β and with only ~4% of samples being video β the
|
| 129 |
encoder stays competitive across both image and video benchmarks, and leads on DAVIS.
|
| 130 |
+
- KITTI depth estimation is still being evaluated and will be added as the run completes.
|
| 131 |
+
Numbers in this table will be updated as evaluations finish.
|
| 132 |
|
| 133 |
Protocol: DINOv3-style linear/attentive probes for image tasks; V-JEPA 2-style protocol for
|
| 134 |
video. Baseline DAVIS / ADE20K / K400 / KITTI figures are taken from the DINOv3 technical
|