Image Feature Extraction
Transformers
Safetensors
motif_vision
feature-extraction
motif
vision-transformer
self-supervised
video
custom_code
Instructions to use Motif-Technologies/Motif-Vision-Encoder with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Motif-Technologies/Motif-Vision-Encoder with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-feature-extraction", model="Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True)# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Motif-Technologies/Motif-Vision-Encoder", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
docs(README): DAVIS S/M/L table, Publisher column, updated metrics
Browse filesReplace Params column with Publisher (Meta/Google/Motif); move DAVIS to front and split into S/M/L per DINOv3 Table 5; fill baseline numbers from Table 5; Motif DAVIS 74.0/80.5/83.5, ImageNet 87.2, ADE20K 52.0.
README.md
CHANGED
|
@@ -90,16 +90,21 @@ Compared against the strongest publicly reported self-supervised / vision backbo
|
|
| 90 |
better for every column **except KITTI depth MSE** (lower is better). Best value per column in
|
| 91 |
**bold**.
|
| 92 |
|
| 93 |
-
|
| 94 |
-
|
| 95 |
-
|
| 96 |
-
|
| 97 |
-
|
|
| 98 |
-
|
|
| 99 |
-
|
|
| 100 |
-
|
| 101 |
-
|
| 102 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 103 |
- **ImageNet-1K linear probe (87.2)** and **ADE20K semantic segmentation (52.0 mIoU)** are
|
| 104 |
second only to DINOv3 7B while ahead of DINOv2, V-JEPA 2.1, and SigLIP2.
|
| 105 |
- **Data efficiency** β these results come from **~0.47B training samples** (448.6M images +
|
|
|
|
| 90 |
better for every column **except KITTI depth MSE** (lower is better). Best value per column in
|
| 91 |
**bold**.
|
| 92 |
|
| 93 |
+
DAVIS S/M/L follow the DINOv3 protocol (J&F-mean at video short side 420/480, 840/960,
|
| 94 |
+
1260/1440 px). V-JEPA 2.1 is not part of the DINOv3 Table 5 tracking benchmark, so only its
|
| 95 |
+
single-resolution (S) figure is available.
|
| 96 |
+
|
| 97 |
+
| Model | Publisher | DAVIS S<br>J&F β | DAVIS M<br>J&F β | DAVIS L<br>J&F β | ImageNet-1K<br>lin. probe β | ADE20K<br>mIoU β | K400 β | KITTI<br>depth MSE β |
|
| 98 |
+
|---|---|---|---|---|---|---|---|---|
|
| 99 |
+
| **Motif Vision Encoder** | Motif | **74.0** | **80.5** | **83.5** | 87.2 | 52.0 | *in progress* | *in progress* |
|
| 100 |
+
| DINOv3 | Meta | 71.1 | 79.7 | 83.3 | **88.2** | **55.9** | **87.8** | **2.3** |
|
| 101 |
+
| DINOv2 | Meta | 63.9 | 73.6 | 76.6 | 86.5 | 49.0 | 84.4 | β |
|
| 102 |
+
| V-JEPA 2.1 | Meta | 69.0 | β | β | 85.5 | 47.9 | 87.7 | 3.x |
|
| 103 |
+
| SigLIP2 | Google | 56.1 | 62.3 | 62.9 | 84.5 | 45.4 | 86.9 | β |
|
| 104 |
+
|
| 105 |
+
- **DAVIS video segmentation (J&F)** β leads at every resolution: **74.0 (S) / 80.5 (M) /
|
| 106 |
+
83.5 (L)**, surpassing DINOv3 7B (71.1 / 79.7 / 83.3) across the board, reflecting the
|
| 107 |
+
encoder's dense, temporally-coherent patch features on video.
|
| 108 |
- **ImageNet-1K linear probe (87.2)** and **ADE20K semantic segmentation (52.0 mIoU)** are
|
| 109 |
second only to DINOv3 7B while ahead of DINOv2, V-JEPA 2.1, and SigLIP2.
|
| 110 |
- **Data efficiency** β these results come from **~0.47B training samples** (448.6M images +
|