Card: repository renamed
Browse files
README.md
CHANGED
|
@@ -14,18 +14,18 @@ datasets:
|
|
| 14 |
- ThinkMorph/Pretext-270K
|
| 15 |
---
|
| 16 |
|
| 17 |
-
# ThinkMorph-SSL
|
| 18 |
|
| 19 |
This is the **intermediate Stage 1 model** of the PRIMER recipe. It is the EMA weights at
|
| 20 |
step 5,500 of the pretext stage, trained from BAGEL-7B-MoT on
|
| 21 |
[Pretext-270K](https://huggingface.co/datasets/ThinkMorph/Pretext-270K). The final model,
|
| 22 |
-
[ThinkMorph-SSL](https://huggingface.co/ThinkMorph/ThinkMorph-SSL), starts its Stage 2 training from these weights.
|
| 23 |
|
| 24 |
> **This model has only had pretext training, with no question-answer supervision.** Its
|
| 25 |
> exercises take a corrupted input image and output a description, a restored image and a
|
| 26 |
> second description. It is not meant to answer questions directly. The paper's appendix
|
| 27 |
> reports roughly 40% on V\* and MMMU for this checkpoint. For question answering, use
|
| 28 |
-
> ThinkMorph-SSL.
|
| 29 |
|
| 30 |
## Files
|
| 31 |
|
|
@@ -43,9 +43,9 @@ step 5,500 of the pretext stage, trained from BAGEL-7B-MoT on
|
|
| 43 |
| `special_tokens_map.json` | 613 | `76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd` |
|
| 44 |
| `tokenizer_config.json` | 4,864 | `b7af0d4c9b917db05150006b466cfa2e8424b3915ff5fe2023a6f512a5e16dd5` |
|
| 45 |
|
| 46 |
-
All files except `ema.safetensors` are byte-identical to the ThinkMorph-SSL release. The
|
| 47 |
-
checkpoint's own config and tokenizer files were compared with those of ThinkMorph-SSL and
|
| 48 |
-
are the same. `ema.safetensors` uses the same format as ThinkMorph-SSL: 1,451 bfloat16 tensors
|
| 49 |
with the same names and shapes. The unused 26th SigLIP layer is left out.
|
| 50 |
|
| 51 |
## How the file was made
|
|
@@ -56,9 +56,9 @@ with the same names and shapes. The unused 26th SigLIP layer is left out.
|
|
| 56 |
2. `scripts/merge_checkpoint.py --checkpoint-type ema` from the PRIMER code release merged
|
| 57 |
the EMA state into a single fp32 `model.safetensors`. All 1,467 weights came from the EMA
|
| 58 |
state; none were filled in from a base model.
|
| 59 |
-
3. The 1,451 tensors that ThinkMorph-SSL ships were cast once to bfloat16, with no other
|
| 60 |
change, and saved as `ema.safetensors`. A spot check confirmed that the cast values match
|
| 61 |
-
exactly. The VAE weights are identical to ThinkMorph-SSL's, as expected, because the VAE
|
| 62 |
is frozen in both stages.
|
| 63 |
|
| 64 |
## Training
|
|
@@ -76,7 +76,7 @@ with the same names and shapes. The unused 26th SigLIP layer is left out.
|
|
| 76 |
|
| 77 |
## Loading
|
| 78 |
|
| 79 |
-
Loading works the same way as for ThinkMorph-SSL. With the official BAGEL inference code or
|
| 80 |
the PRIMER code release, point `model_path` at a local copy. The loader reads
|
| 81 |
`ema.safetensors`.
|
| 82 |
|
|
|
|
| 14 |
- ThinkMorph/Pretext-270K
|
| 15 |
---
|
| 16 |
|
| 17 |
+
# ThinkMorph-SSL
|
| 18 |
|
| 19 |
This is the **intermediate Stage 1 model** of the PRIMER recipe. It is the EMA weights at
|
| 20 |
step 5,500 of the pretext stage, trained from BAGEL-7B-MoT on
|
| 21 |
[Pretext-270K](https://huggingface.co/datasets/ThinkMorph/Pretext-270K). The final model,
|
| 22 |
+
[ThinkMorph-SSL-Instruct](https://huggingface.co/ThinkMorph/ThinkMorph-SSL-Instruct), starts its Stage 2 training from these weights.
|
| 23 |
|
| 24 |
> **This model has only had pretext training, with no question-answer supervision.** Its
|
| 25 |
> exercises take a corrupted input image and output a description, a restored image and a
|
| 26 |
> second description. It is not meant to answer questions directly. The paper's appendix
|
| 27 |
> reports roughly 40% on V\* and MMMU for this checkpoint. For question answering, use
|
| 28 |
+
> ThinkMorph-SSL-Instruct.
|
| 29 |
|
| 30 |
## Files
|
| 31 |
|
|
|
|
| 43 |
| `special_tokens_map.json` | 613 | `76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd` |
|
| 44 |
| `tokenizer_config.json` | 4,864 | `b7af0d4c9b917db05150006b466cfa2e8424b3915ff5fe2023a6f512a5e16dd5` |
|
| 45 |
|
| 46 |
+
All files except `ema.safetensors` are byte-identical to the ThinkMorph-SSL-Instruct release. The
|
| 47 |
+
checkpoint's own config and tokenizer files were compared with those of ThinkMorph-SSL-Instruct and
|
| 48 |
+
are the same. `ema.safetensors` uses the same format as ThinkMorph-SSL-Instruct: 1,451 bfloat16 tensors
|
| 49 |
with the same names and shapes. The unused 26th SigLIP layer is left out.
|
| 50 |
|
| 51 |
## How the file was made
|
|
|
|
| 56 |
2. `scripts/merge_checkpoint.py --checkpoint-type ema` from the PRIMER code release merged
|
| 57 |
the EMA state into a single fp32 `model.safetensors`. All 1,467 weights came from the EMA
|
| 58 |
state; none were filled in from a base model.
|
| 59 |
+
3. The 1,451 tensors that ThinkMorph-SSL-Instruct ships were cast once to bfloat16, with no other
|
| 60 |
change, and saved as `ema.safetensors`. A spot check confirmed that the cast values match
|
| 61 |
+
exactly. The VAE weights are identical to ThinkMorph-SSL-Instruct's, as expected, because the VAE
|
| 62 |
is frozen in both stages.
|
| 63 |
|
| 64 |
## Training
|
|
|
|
| 76 |
|
| 77 |
## Loading
|
| 78 |
|
| 79 |
+
Loading works the same way as for ThinkMorph-SSL-Instruct. With the official BAGEL inference code or
|
| 80 |
the PRIMER code release, point `model_path` at a local copy. The loader reads
|
| 81 |
`ema.safetensors`.
|
| 82 |
|