Rosie Zhao

rosieyzh

schonsense's profile picture

abhishekpanigrahi's profile picture

contactvaibhavi's profile picture

https://rosieyzh.github.io/

rosieyzh
rosieyzh

AI & ML interests

theory of machine learning, deep learning

Organizations

rosieyzh 's collections 16

Synthetic Multimodal Datasets

Datasets used in "Understanding the Design Space and Cross-Modality Transfer for Vision-Language Models"

rosieyzh/synthetic_ring

Viewer • Updated Sep 4, 2025 • 5.5k • 13 • 1
rosieyzh/synthetic_spatialmap

Viewer • Updated Sep 4, 2025 • 5.5k • 26 • 1
rosieyzh/synthetic_grid

Viewer • Updated Sep 4, 2025 • 5.5k • 33 • 1

Llama-3.2-1B Warmstart RLVR - Summarization

rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_{32,64}_ckpt_{i}_of_10

rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_1_of_10

1B • Updated Jan 26 • 6
rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_2_of_10

1B • Updated Jan 26 • 5
rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_3_of_10

1B • Updated Jan 26 • 6
rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_4_of_10

1B • Updated Jan 26 • 6

Llama-3.2-1B SFT - Summarization

rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_{64,128}_ckpt_{i}_of_5

rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_1_of_5

1B • Updated Jan 23 • 9
rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_64_ckpt_2_of_5

1B • Updated Jan 25 • 11
rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_64_ckpt_3_of_5

1B • Updated Jan 25 • 5
rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_64_ckpt_4_of_5

1B • Updated Jan 25 • 5

Qwen2.5-1.5B RLVR - GSM8K

rosieyzh/rlvr_qwen15_gsm8k_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_1_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_2_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_3_of_10

2B • Updated Jan 23 • 6
rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_4_of_10

2B • Updated Jan 23 • 8

Llama-3.2-1B RLVR - Translation

rlvr_llama1_bleu_alma_rbz_{128,256}_ckpt_{i}_of_10 128: [7, 12, 21, 36, 62, 106, 182, 313, 535, 917] 256: [3, 6, 10, 18, 31, 53, 91, 156, 267, 458]

rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_1_of_10

1B • Updated Jan 22 • 8
rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_2_of_10

1B • Updated Jan 22 • 9
rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_3_of_10

1B • Updated Jan 22 • 8
rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_4_of_10

1B • Updated Jan 22 • 11

Qwen2.5-1.5B Warmstart RLVR - Code

rosieyzh/rlvr_qwen15_warmstart_code200_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_1_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_2_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_3_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_4_of_10

2B • Updated Jan 23 • 7

Qwen2.5-1.5B SFT - Code

rosieyzh/sft_qwen15_code200_lr_{1e-5, 5e-6}_{cosine, constant}_bsz_{64, 128}_ckpt_{i}_of_5

rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_1_of_5

2B • Updated Jan 22 • 9
rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_2_of_5

2B • Updated Jan 22 • 12
rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_3_of_5

2B • Updated Jan 22 • 9
rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_4_of_5

2B • Updated Jan 22 • 9

OLMo-1B-as_fm3_tg_omi1_omi2

OLMo 1B model pretrained with Algebraic Stack, FineMath3, TinyGSM, OMI1, and OMI2. Includes checkpoints from doing PPO using GSM8K train.

rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_ppo

Text Generation • 1B • Updated Jun 19, 2025 • 13
rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_episode1

Text Generation • 1B • Updated Jun 19, 2025 • 15
rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_episode2

Text Generation • 1B • Updated Jun 19, 2025 • 17
rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_episode3

Text Generation • 1B • Updated Jun 19, 2025 • 16

Qwen2.5-1.5B SFT - Unstructured Code

rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_{64,128}_ckpt_{i}_of_5

rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_1_of_5

2B • Updated Jan 24 • 10
rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_2_of_5

2B • Updated Jan 24 • 8
rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_3_of_5

2B • Updated Jan 24 • 19
rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_4_of_5

2B • Updated Jan 24 • 10

Llama-3.2-1B RLVR - Summarization

rosieyzh/rlvr_llama1_rouge_xsum_rbz_{32,64}_ckpt_{i}_of_10

rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_1_of_10

1B • Updated Jan 26 • 5
rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_2_of_10

1B • Updated Jan 26 • 10
rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_3_of_10

1B • Updated Jan 26 • 8
rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_4_of_10

1B • Updated Jan 26 • 5

Qwen2.5-1.5B Warmstart RLVR - GSM8K

rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_1_of_10

2B • Updated Jan 23 • 7
rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_2_of_10

2B • Updated Jan 23 • 13
rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_3_of_10

2B • Updated Jan 23 • 6
rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_4_of_10

2B • Updated Jan 23 • 8

Llama-3.2-1B Warmstart RLVR - Translation

rlvr_llama1_warmstart_bleu_alma_rbz_{128, 256}_ckpt_{i}_of_10

rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_1_of_10

1B • Updated Jan 23 • 8
rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_2_of_10

1B • Updated Jan 23 • 7
rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_3_of_10

1B • Updated Jan 23 • 9
rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_4_of_10

1B • Updated Jan 23 • 7

Llama-3.2-1B SFT - Translation

rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_{64,128}_ckpt_{i}_of_5

rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_1_of_5

1B • Updated Jan 23 • 9
rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_2_of_5

1B • Updated Jan 23 • 9
rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_3_of_5

1B • Updated Jan 23 • 8
rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_4_of_5

1B • Updated Jan 23 • 18

Qwen2.5-1.5B RLVR - Code

rosieyzh/rlvr_qwen15_code200_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_1_of_10

2B • Updated Jan 22 • 9
rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_2_of_10

2B • Updated Jan 22 • 13
rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_3_of_10

2B • Updated Jan 22 • 8
rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_4_of_10

2B • Updated Jan 22 • 10

OLMo-150M and OLMo-1B Pretrained Models

Pretrained models from scratch used in "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining".

rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_base

Text Generation • 1B • Updated Jul 7, 2025 • 13
rosieyzh/OLMo-1B-as_fm3_tg_omi2_base

Text Generation • 1B • Updated Jul 7, 2025 • 24
rosieyzh/OLMo-150M-as_fm3_tg_omi1_omi2

Text Generation • 0.2B • Updated Jul 7, 2025 • 18
rosieyzh/OLMo-150M-as_fm3_tg_omi1

Text Generation • 0.2B • Updated Jul 7, 2025 • 10

OLMo-1B-as_fm3_tg_omi2

OLMo 1B model pretrained with Algebraic Stack, FineMath3, TinyGSM, and OpenMathInstruct2. Includes checkpoints from doing PPO using GSM8K train.

rosieyzh/OLMo-1B-as_fm3_tg_omi2_ppo

Text Generation • 1B • Updated Jun 19, 2025 • 12
rosieyzh/OLMo-1B-as_fm3_tg_omi2_episode1

Text Generation • 1B • Updated Jun 18, 2025 • 10
rosieyzh/OLMo-1B-as_fm3_tg_omi2_episode2

Text Generation • 1B • Updated Jun 18, 2025 • 10
rosieyzh/OLMo-1B-as_fm3_tg_omi2_episode3

Text Generation • 1B • Updated Jun 18, 2025 • 10

Synthetic Multimodal Datasets

Datasets used in "Understanding the Design Space and Cross-Modality Transfer for Vision-Language Models"

rosieyzh/synthetic_ring

Viewer • Updated Sep 4, 2025 • 5.5k • 13 • 1
rosieyzh/synthetic_spatialmap

Viewer • Updated Sep 4, 2025 • 5.5k • 26 • 1
rosieyzh/synthetic_grid

Viewer • Updated Sep 4, 2025 • 5.5k • 33 • 1

Qwen2.5-1.5B SFT - Unstructured Code

rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_{64,128}_ckpt_{i}_of_5

rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_1_of_5

2B • Updated Jan 24 • 10
rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_2_of_5

2B • Updated Jan 24 • 8
rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_3_of_5

2B • Updated Jan 24 • 19
rosieyzh/sft_qwen15_swallow_lr_1e-5_cosine_bsz_128_ckpt_4_of_5

2B • Updated Jan 24 • 10

Llama-3.2-1B Warmstart RLVR - Summarization

rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_{32,64}_ckpt_{i}_of_10

rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_1_of_10

1B • Updated Jan 26 • 6
rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_2_of_10

1B • Updated Jan 26 • 5
rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_3_of_10

1B • Updated Jan 26 • 6
rosieyzh/rlvr_llama1_warmstart_rouge_xsum_rbz_64_ckpt_4_of_10

1B • Updated Jan 26 • 6

Llama-3.2-1B RLVR - Summarization

rosieyzh/rlvr_llama1_rouge_xsum_rbz_{32,64}_ckpt_{i}_of_10

rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_1_of_10

1B • Updated Jan 26 • 5
rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_2_of_10

1B • Updated Jan 26 • 10
rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_3_of_10

1B • Updated Jan 26 • 8
rosieyzh/rlvr_llama1_rouge_xsum_rbz_64_ckpt_4_of_10

1B • Updated Jan 26 • 5

Llama-3.2-1B SFT - Summarization

rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_{64,128}_ckpt_{i}_of_5

rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_1_of_5

1B • Updated Jan 23 • 9
rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_64_ckpt_2_of_5

1B • Updated Jan 25 • 11
rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_64_ckpt_3_of_5

1B • Updated Jan 25 • 5
rosieyzh/sft_llama1_xsum_lr_1e-5_cosine_bsz_64_ckpt_4_of_5

1B • Updated Jan 25 • 5

Qwen2.5-1.5B Warmstart RLVR - GSM8K

rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_1_of_10

2B • Updated Jan 23 • 7
rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_2_of_10

2B • Updated Jan 23 • 13
rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_3_of_10

2B • Updated Jan 23 • 6
rosieyzh/rlvr_qwen15_warmstart_gsm8k_rbz_64_ckpt_4_of_10

2B • Updated Jan 23 • 8

Qwen2.5-1.5B RLVR - GSM8K

rosieyzh/rlvr_qwen15_gsm8k_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_1_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_2_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_3_of_10

2B • Updated Jan 23 • 6
rosieyzh/rlvr_qwen15_gsm8k_rbz_64_ckpt_4_of_10

2B • Updated Jan 23 • 8

Llama-3.2-1B Warmstart RLVR - Translation

rlvr_llama1_warmstart_bleu_alma_rbz_{128, 256}_ckpt_{i}_of_10

rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_1_of_10

1B • Updated Jan 23 • 8
rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_2_of_10

1B • Updated Jan 23 • 7
rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_3_of_10

1B • Updated Jan 23 • 9
rosieyzh/rlvr_llama1_warmstart_bleu_alma_rbz_256_ckpt_4_of_10

1B • Updated Jan 23 • 7

Llama-3.2-1B RLVR - Translation

rlvr_llama1_bleu_alma_rbz_{128,256}_ckpt_{i}_of_10 128: [7, 12, 21, 36, 62, 106, 182, 313, 535, 917] 256: [3, 6, 10, 18, 31, 53, 91, 156, 267, 458]

rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_1_of_10

1B • Updated Jan 22 • 8
rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_2_of_10

1B • Updated Jan 22 • 9
rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_3_of_10

1B • Updated Jan 22 • 8
rosieyzh/rlvr_llama1_bleu_alma_rbz_128_ckpt_4_of_10

1B • Updated Jan 22 • 11

Llama-3.2-1B SFT - Translation

rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_{64,128}_ckpt_{i}_of_5

rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_1_of_5

1B • Updated Jan 23 • 9
rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_2_of_5

1B • Updated Jan 23 • 9
rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_3_of_5

1B • Updated Jan 23 • 8
rosieyzh/sft_llama1_alma_lr_1e-5_cosine_bsz_64_ckpt_4_of_5

1B • Updated Jan 23 • 18

Qwen2.5-1.5B Warmstart RLVR - Code

rosieyzh/rlvr_qwen15_warmstart_code200_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_1_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_2_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_3_of_10

2B • Updated Jan 23 • 8
rosieyzh/rlvr_qwen15_warmstart_code200_rbz_32_ckpt_4_of_10

2B • Updated Jan 23 • 7

Qwen2.5-1.5B RLVR - Code

rosieyzh/rlvr_qwen15_code200_rbz_{32, 64}_ckpt_{I}_of_10

rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_1_of_10

2B • Updated Jan 22 • 9
rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_2_of_10

2B • Updated Jan 22 • 13
rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_3_of_10

2B • Updated Jan 22 • 8
rosieyzh/rlvr_qwen15_code200_rbz_64_ckpt_4_of_10

2B • Updated Jan 22 • 10

Qwen2.5-1.5B SFT - Code

rosieyzh/sft_qwen15_code200_lr_{1e-5, 5e-6}_{cosine, constant}_bsz_{64, 128}_ckpt_{i}_of_5

rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_1_of_5

2B • Updated Jan 22 • 9
rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_2_of_5

2B • Updated Jan 22 • 12
rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_3_of_5

2B • Updated Jan 22 • 9
rosieyzh/sft_qwen15_code200_lr_1e-5_cosine_bsz_64_ckpt_4_of_5

2B • Updated Jan 22 • 9

OLMo-150M and OLMo-1B Pretrained Models

Pretrained models from scratch used in "Echo Chamber: RL Post-training Amplifies Behaviors Learned in Pretraining".

rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_base

Text Generation • 1B • Updated Jul 7, 2025 • 13
rosieyzh/OLMo-1B-as_fm3_tg_omi2_base

Text Generation • 1B • Updated Jul 7, 2025 • 24
rosieyzh/OLMo-150M-as_fm3_tg_omi1_omi2

Text Generation • 0.2B • Updated Jul 7, 2025 • 18
rosieyzh/OLMo-150M-as_fm3_tg_omi1

Text Generation • 0.2B • Updated Jul 7, 2025 • 10

OLMo-1B-as_fm3_tg_omi1_omi2

OLMo 1B model pretrained with Algebraic Stack, FineMath3, TinyGSM, OMI1, and OMI2. Includes checkpoints from doing PPO using GSM8K train.

rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_ppo

Text Generation • 1B • Updated Jun 19, 2025 • 13
rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_episode1

Text Generation • 1B • Updated Jun 19, 2025 • 15
rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_episode2

Text Generation • 1B • Updated Jun 19, 2025 • 17
rosieyzh/OLMo-1B-as_fm3_tg_omi1_omi2_episode3

Text Generation • 1B • Updated Jun 19, 2025 • 16

OLMo-1B-as_fm3_tg_omi2

OLMo 1B model pretrained with Algebraic Stack, FineMath3, TinyGSM, and OpenMathInstruct2. Includes checkpoints from doing PPO using GSM8K train.

rosieyzh/OLMo-1B-as_fm3_tg_omi2_ppo

Text Generation • 1B • Updated Jun 19, 2025 • 12
rosieyzh/OLMo-1B-as_fm3_tg_omi2_episode1

Text Generation • 1B • Updated Jun 18, 2025 • 10
rosieyzh/OLMo-1B-as_fm3_tg_omi2_episode2

Text Generation • 1B • Updated Jun 18, 2025 • 10
rosieyzh/OLMo-1B-as_fm3_tg_omi2_episode3

Text Generation • 1B • Updated Jun 18, 2025 • 10