Card: repository renamed
Browse files
README.md
CHANGED
|
@@ -16,15 +16,15 @@ datasets:
|
|
| 16 |
- ThinkMorph/Instruct-181K
|
| 17 |
---
|
| 18 |
|
| 19 |
-
# ThinkMorph-SSL
|
| 20 |
|
| 21 |
-
ThinkMorph-SSL is a unified multimodal model that reasons with interleaved text and
|
| 22 |
generated images. It is trained from BAGEL-7B-MoT with the two-stage PRIMER recipe:
|
| 23 |
|
| 24 |
1. **Stage 1 (pretext).** Training on [Pretext-270K](https://huggingface.co/datasets/ThinkMorph/Pretext-270K),
|
| 25 |
which has 270,896 instruction-free text-image-text traces built from source images.
|
| 26 |
This repository starts from the Stage 1 EMA weights at step 5,500, published separately as
|
| 27 |
-
[ThinkMorph-SSL
|
| 28 |
2. **Stage 2 (instruction).** Training on [Instruct-181K](https://huggingface.co/datasets/ThinkMorph/Instruct-181K),
|
| 29 |
which has 181,291 question-driven interleaved traces.
|
| 30 |
|
|
@@ -69,7 +69,7 @@ has the same name, `ema.safetensors`. To load:
|
|
| 69 |
also reads `ema.safetensors` when there is no `model.safetensors`.
|
| 70 |
|
| 71 |
```bash
|
| 72 |
-
hf download ThinkMorph/ThinkMorph-SSL --local-dir ThinkMorph-SSL
|
| 73 |
```
|
| 74 |
|
| 75 |
## Training
|
|
@@ -95,7 +95,7 @@ the val files too (`include_val_in_training`).
|
|
| 95 |
|
| 96 |
The scores will be filled in after the paper's main table is final.
|
| 97 |
|
| 98 |
-
| Benchmark group | ThinkMorph-SSL |
|
| 99 |
| --- | --- |
|
| 100 |
| Visible evidence | TBD |
|
| 101 |
| Spatial structure | TBD |
|
|
|
|
| 16 |
- ThinkMorph/Instruct-181K
|
| 17 |
---
|
| 18 |
|
| 19 |
+
# ThinkMorph-SSL-Instruct
|
| 20 |
|
| 21 |
+
ThinkMorph-SSL-Instruct is a unified multimodal model that reasons with interleaved text and
|
| 22 |
generated images. It is trained from BAGEL-7B-MoT with the two-stage PRIMER recipe:
|
| 23 |
|
| 24 |
1. **Stage 1 (pretext).** Training on [Pretext-270K](https://huggingface.co/datasets/ThinkMorph/Pretext-270K),
|
| 25 |
which has 270,896 instruction-free text-image-text traces built from source images.
|
| 26 |
This repository starts from the Stage 1 EMA weights at step 5,500, published separately as
|
| 27 |
+
[ThinkMorph-SSL](https://huggingface.co/ThinkMorph/ThinkMorph-SSL).
|
| 28 |
2. **Stage 2 (instruction).** Training on [Instruct-181K](https://huggingface.co/datasets/ThinkMorph/Instruct-181K),
|
| 29 |
which has 181,291 question-driven interleaved traces.
|
| 30 |
|
|
|
|
| 69 |
also reads `ema.safetensors` when there is no `model.safetensors`.
|
| 70 |
|
| 71 |
```bash
|
| 72 |
+
hf download ThinkMorph/ThinkMorph-SSL-Instruct --local-dir ThinkMorph-SSL-Instruct
|
| 73 |
```
|
| 74 |
|
| 75 |
## Training
|
|
|
|
| 95 |
|
| 96 |
The scores will be filled in after the paper's main table is final.
|
| 97 |
|
| 98 |
+
| Benchmark group | ThinkMorph-SSL-Instruct |
|
| 99 |
| --- | --- |
|
| 100 |
| Visible evidence | TBD |
|
| 101 |
| Spatial structure | TBD |
|