Any-to-Any
bagel
custom_code
kuvvi commited on
Commit
28d5485
·
verified ·
1 Parent(s): 0d4ced7

Card: repository renamed

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -14,18 +14,18 @@ datasets:
14
  - ThinkMorph/Pretext-270K
15
  ---
16
 
17
- # ThinkMorph-SSL-Stage1
18
 
19
  This is the **intermediate Stage 1 model** of the PRIMER recipe. It is the EMA weights at
20
  step 5,500 of the pretext stage, trained from BAGEL-7B-MoT on
21
  [Pretext-270K](https://huggingface.co/datasets/ThinkMorph/Pretext-270K). The final model,
22
- [ThinkMorph-SSL](https://huggingface.co/ThinkMorph/ThinkMorph-SSL), starts its Stage 2 training from these weights.
23
 
24
  > **This model has only had pretext training, with no question-answer supervision.** Its
25
  > exercises take a corrupted input image and output a description, a restored image and a
26
  > second description. It is not meant to answer questions directly. The paper's appendix
27
  > reports roughly 40% on V\* and MMMU for this checkpoint. For question answering, use
28
- > ThinkMorph-SSL.
29
 
30
  ## Files
31
 
@@ -43,9 +43,9 @@ step 5,500 of the pretext stage, trained from BAGEL-7B-MoT on
43
  | `special_tokens_map.json` | 613 | `76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd` |
44
  | `tokenizer_config.json` | 4,864 | `b7af0d4c9b917db05150006b466cfa2e8424b3915ff5fe2023a6f512a5e16dd5` |
45
 
46
- All files except `ema.safetensors` are byte-identical to the ThinkMorph-SSL release. The
47
- checkpoint's own config and tokenizer files were compared with those of ThinkMorph-SSL and
48
- are the same. `ema.safetensors` uses the same format as ThinkMorph-SSL: 1,451 bfloat16 tensors
49
  with the same names and shapes. The unused 26th SigLIP layer is left out.
50
 
51
  ## How the file was made
@@ -56,9 +56,9 @@ with the same names and shapes. The unused 26th SigLIP layer is left out.
56
  2. `scripts/merge_checkpoint.py --checkpoint-type ema` from the PRIMER code release merged
57
  the EMA state into a single fp32 `model.safetensors`. All 1,467 weights came from the EMA
58
  state; none were filled in from a base model.
59
- 3. The 1,451 tensors that ThinkMorph-SSL ships were cast once to bfloat16, with no other
60
  change, and saved as `ema.safetensors`. A spot check confirmed that the cast values match
61
- exactly. The VAE weights are identical to ThinkMorph-SSL's, as expected, because the VAE
62
  is frozen in both stages.
63
 
64
  ## Training
@@ -76,7 +76,7 @@ with the same names and shapes. The unused 26th SigLIP layer is left out.
76
 
77
  ## Loading
78
 
79
- Loading works the same way as for ThinkMorph-SSL. With the official BAGEL inference code or
80
  the PRIMER code release, point `model_path` at a local copy. The loader reads
81
  `ema.safetensors`.
82
 
 
14
  - ThinkMorph/Pretext-270K
15
  ---
16
 
17
+ # ThinkMorph-SSL
18
 
19
  This is the **intermediate Stage 1 model** of the PRIMER recipe. It is the EMA weights at
20
  step 5,500 of the pretext stage, trained from BAGEL-7B-MoT on
21
  [Pretext-270K](https://huggingface.co/datasets/ThinkMorph/Pretext-270K). The final model,
22
+ [ThinkMorph-SSL-Instruct](https://huggingface.co/ThinkMorph/ThinkMorph-SSL-Instruct), starts its Stage 2 training from these weights.
23
 
24
  > **This model has only had pretext training, with no question-answer supervision.** Its
25
  > exercises take a corrupted input image and output a description, a restored image and a
26
  > second description. It is not meant to answer questions directly. The paper's appendix
27
  > reports roughly 40% on V\* and MMMU for this checkpoint. For question answering, use
28
+ > ThinkMorph-SSL-Instruct.
29
 
30
  ## Files
31
 
 
43
  | `special_tokens_map.json` | 613 | `76862e765266b85aa9459767e33cbaf13970f327a0e88d1c65846c2ddd3a1ecd` |
44
  | `tokenizer_config.json` | 4,864 | `b7af0d4c9b917db05150006b466cfa2e8424b3915ff5fe2023a6f512a5e16dd5` |
45
 
46
+ All files except `ema.safetensors` are byte-identical to the ThinkMorph-SSL-Instruct release. The
47
+ checkpoint's own config and tokenizer files were compared with those of ThinkMorph-SSL-Instruct and
48
+ are the same. `ema.safetensors` uses the same format as ThinkMorph-SSL-Instruct: 1,451 bfloat16 tensors
49
  with the same names and shapes. The unused 26th SigLIP layer is left out.
50
 
51
  ## How the file was made
 
56
  2. `scripts/merge_checkpoint.py --checkpoint-type ema` from the PRIMER code release merged
57
  the EMA state into a single fp32 `model.safetensors`. All 1,467 weights came from the EMA
58
  state; none were filled in from a base model.
59
+ 3. The 1,451 tensors that ThinkMorph-SSL-Instruct ships were cast once to bfloat16, with no other
60
  change, and saved as `ema.safetensors`. A spot check confirmed that the cast values match
61
+ exactly. The VAE weights are identical to ThinkMorph-SSL-Instruct's, as expected, because the VAE
62
  is frozen in both stages.
63
 
64
  ## Training
 
76
 
77
  ## Loading
78
 
79
+ Loading works the same way as for ThinkMorph-SSL-Instruct. With the official BAGEL inference code or
80
  the PRIMER code release, point `model_path` at a local copy. The loader reads
81
  `ema.safetensors`.
82