lyunee commited on
Commit
84c6e00
·
verified ·
1 Parent(s): 3dc8257

Describe vision-encoder downstream evaluation checkpoints

Browse files
Files changed (2) hide show
  1. FILES.json +0 -0
  2. README.md +51 -0
FILES.json ADDED
The diff for this file is too large to render. See raw diff
 
README.md ADDED
@@ -0,0 +1,51 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - vision-encoder-evaluation
4
+ - multimodal
5
+ - visual-tokenizer-benchmark
6
+ - checkpoints
7
+ ---
8
+
9
+ # Vision Encoder MLLM Evaluation
10
+
11
+ Downstream evaluation checkpoints for comparing **vision encoders** in multimodal large language models (MLLMs), from the VisualTokenizerBench / RAVEL project.
12
+
13
+ The evaluation target is the vision encoder. Runs use different language backbones and are organized by backbone, vision encoder, and training stage. These are trained multimodal evaluation artifacts, rather than a standalone language-model release.
14
+
15
+ **Upload status:** In progress: the expected inventory is available in FILES.json; some checkpoints may not yet be uploaded.
16
+
17
+ ## Contents
18
+
19
+ | Language-backbone group | Files | Weight files | Size (GiB) |
20
+ | --- | ---: | ---: | ---: |
21
+ | qwen3base | 35 | 8 | 10.46 |
22
+ | smollm2 | 974 | 215 | 285.01 |
23
+ | qwen3 | 978 | 214 | 305.64 |
24
+ | qwen25 | 1173 | 268 | 326.19 |
25
+
26
+ Total checkpoint contents: **3,160 files**, **927.29 GiB** (995,673,068,120 bytes).
27
+
28
+ ```text
29
+ continuous/
30
+ qwen3base/<vision-encoder>/<training-stage>/...
31
+ smollm2/<vision-encoder>/<training-stage>/...
32
+ qwen3/<vision-encoder>/<training-stage>/...
33
+ qwen25/<vision-encoder>/<training-stage>/...
34
+ FILES.json
35
+ ```
36
+
37
+ Only the four completely restored continuous groups are included. Incomplete discrete archive volumes are excluded.
38
+
39
+ ## Download
40
+
41
+ ```python
42
+ from huggingface_hub import snapshot_download
43
+
44
+ snapshot_download(
45
+ repo_id="336labs/VisionEncoder-MLLM-Eval",
46
+ allow_patterns=["continuous/qwen3base/**", "FILES.json", "README.md"],
47
+ local_dir="VisionEncoder-MLLM-Eval",
48
+ )
49
+ ```
50
+
51
+ Choose the needed language-backbone group and vision-encoder run. Each run retains its original weights, configuration, tokenizer files, and available training metadata. Check the configuration in that subdirectory for the corresponding architecture.