TanQT24 commited on
Commit
d9ee1e7
·
verified ·
1 Parent(s): d34cf2f

Update model card: drop step numbers from checkpoint names

Browse files
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -32,12 +32,12 @@ Each subfolder contains a standard `transformers` / vLLM-loadable model director
32
 
33
  | Environment | Teacher | Subfolder |
34
  |---|---|---|
35
- | ALFWorld | Qwen3-4B (GRPO, step 150) | `alfworld_grpo_qwen3_4b_step150/actor_hf` |
36
- | ALFWorld | Qwen3-30B-A3B (GRPO, step 200) | `alfworld_grpo_qwen3_30ba3b_step200/actor_hf` |
37
- | WebShop | Qwen3-4B (GRPO, step 150) | `webshop_grpo_qwen3_4b_step150/actor_hf` |
38
- | WebShop | Qwen3-30B-A3B (GRPO, step 200) | `webshop_grpo_qwen3_30ba3b_step200/actor_hf` |
39
- | Search-QA | Qwen3-4B (GRPO, step 150) | `search_grpo_qwen3_4b_step150/actor_hf` |
40
- | Search-QA | Qwen3-30B-A3B (GRPO, step 200) | `search_grpo_qwen3_30ba3b_step200/actor_hf` |
41
 
42
  ## Download
43
 
@@ -47,7 +47,7 @@ Download one checkpoint (recommended — the 30B-A3B models are large):
47
  pip install -U "huggingface_hub[cli]"
48
 
49
  hf download TanQT24/ATOD_ckpt \
50
- --include "alfworld_grpo_qwen3_4b_step150/*" \
51
  --local-dir ~/ckpts/ATOD_ckpt
52
  ```
53
 
@@ -64,7 +64,7 @@ from huggingface_hub import snapshot_download
64
 
65
  path = snapshot_download(
66
  repo_id="TanQT24/ATOD_ckpt",
67
- allow_patterns=["search_grpo_qwen3_4b_step150/*"],
68
  local_dir="~/ckpts/ATOD_ckpt",
69
  )
70
  ```
@@ -77,7 +77,7 @@ path = snapshot_download(
77
  from transformers import AutoModelForCausalLM, AutoTokenizer
78
 
79
  repo = "TanQT24/ATOD_ckpt"
80
- sub = "alfworld_grpo_qwen3_4b_step150/actor_hf"
81
 
82
  tokenizer = AutoTokenizer.from_pretrained(repo, subfolder=sub)
83
  model = AutoModelForCausalLM.from_pretrained(
@@ -88,7 +88,7 @@ model = AutoModelForCausalLM.from_pretrained(
88
  ### vLLM
89
 
90
  ```bash
91
- vllm serve ~/ckpts/ATOD_ckpt/alfworld_grpo_qwen3_4b_step150/actor_hf \
92
  --served-model-name atod-teacher-alfworld-4b
93
  ```
94
 
@@ -98,7 +98,7 @@ In the [ATOD repo](https://github.com/TanQT24/ATOD), point `teacher_model_path`
98
 
99
  ```bash
100
  student_model_path=Qwen/Qwen3-1.7B
101
- teacher_model_path=~/ckpts/ATOD_ckpt/alfworld_grpo_qwen3_4b_step150/actor_hf
102
  ```
103
 
104
  Using these checkpoints lets you skip teacher GRPO training and run ATOD distillation directly.
@@ -106,7 +106,7 @@ Using these checkpoints lets you skip teacher GRPO training and run ATOD distill
106
  ## Notes
107
 
108
  - Models are task-specific agents: use the ALFWorld teacher for ALFWorld, the WebShop teacher for WebShop, and the Search teacher for Search-QA. They expect the prompt / action formats produced by the environments in the ATOD repo.
109
- - Checkpoint names encode the environment, the base model, and the GRPO training step they were exported at.
110
 
111
  ## Citation
112
 
 
32
 
33
  | Environment | Teacher | Subfolder |
34
  |---|---|---|
35
+ | ALFWorld | Qwen3-4B (GRPO) | `alfworld_grpo_qwen3_4b/actor_hf` |
36
+ | ALFWorld | Qwen3-30B-A3B (GRPO) | `alfworld_grpo_qwen3_30ba3b/actor_hf` |
37
+ | WebShop | Qwen3-4B (GRPO) | `webshop_grpo_qwen3_4b/actor_hf` |
38
+ | WebShop | Qwen3-30B-A3B (GRPO) | `webshop_grpo_qwen3_30ba3b/actor_hf` |
39
+ | Search-QA | Qwen3-4B (GRPO) | `search_grpo_qwen3_4b/actor_hf` |
40
+ | Search-QA | Qwen3-30B-A3B (GRPO) | `search_grpo_qwen3_30ba3b/actor_hf` |
41
 
42
  ## Download
43
 
 
47
  pip install -U "huggingface_hub[cli]"
48
 
49
  hf download TanQT24/ATOD_ckpt \
50
+ --include "alfworld_grpo_qwen3_4b/*" \
51
  --local-dir ~/ckpts/ATOD_ckpt
52
  ```
53
 
 
64
 
65
  path = snapshot_download(
66
  repo_id="TanQT24/ATOD_ckpt",
67
+ allow_patterns=["search_grpo_qwen3_4b/*"],
68
  local_dir="~/ckpts/ATOD_ckpt",
69
  )
70
  ```
 
77
  from transformers import AutoModelForCausalLM, AutoTokenizer
78
 
79
  repo = "TanQT24/ATOD_ckpt"
80
+ sub = "alfworld_grpo_qwen3_4b/actor_hf"
81
 
82
  tokenizer = AutoTokenizer.from_pretrained(repo, subfolder=sub)
83
  model = AutoModelForCausalLM.from_pretrained(
 
88
  ### vLLM
89
 
90
  ```bash
91
+ vllm serve ~/ckpts/ATOD_ckpt/alfworld_grpo_qwen3_4b/actor_hf \
92
  --served-model-name atod-teacher-alfworld-4b
93
  ```
94
 
 
98
 
99
  ```bash
100
  student_model_path=Qwen/Qwen3-1.7B
101
+ teacher_model_path=~/ckpts/ATOD_ckpt/alfworld_grpo_qwen3_4b/actor_hf
102
  ```
103
 
104
  Using these checkpoints lets you skip teacher GRPO training and run ATOD distillation directly.
 
106
  ## Notes
107
 
108
  - Models are task-specific agents: use the ALFWorld teacher for ALFWorld, the WebShop teacher for WebShop, and the Search teacher for Search-QA. They expect the prompt / action formats produced by the environments in the ATOD repo.
109
+ - Checkpoint names encode the environment and the base model, e.g. `webshop_grpo_qwen3_4b` is the Qwen3-4B GRPO teacher for WebShop.
110
 
111
  ## Citation
112