Text Generation
Transformers
Safetensors
English
agent
reinforcement-learning
grpo
distillation
alfworld
webshop
search-r1
Instructions to use TanQT24/ATOD_ckpt with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use TanQT24/ATOD_ckpt with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="TanQT24/ATOD_ckpt")# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("TanQT24/ATOD_ckpt", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use TanQT24/ATOD_ckpt with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "TanQT24/ATOD_ckpt" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TanQT24/ATOD_ckpt", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/TanQT24/ATOD_ckpt
- SGLang
How to use TanQT24/ATOD_ckpt with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "TanQT24/ATOD_ckpt" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TanQT24/ATOD_ckpt", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "TanQT24/ATOD_ckpt" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "TanQT24/ATOD_ckpt", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use TanQT24/ATOD_ckpt with Docker Model Runner:
docker model run hf.co/TanQT24/ATOD_ckpt
Update model card: drop step numbers from checkpoint names
Browse files
README.md
CHANGED
|
@@ -32,12 +32,12 @@ Each subfolder contains a standard `transformers` / vLLM-loadable model director
|
|
| 32 |
|
| 33 |
| Environment | Teacher | Subfolder |
|
| 34 |
|---|---|---|
|
| 35 |
-
| ALFWorld | Qwen3-4B (GRPO
|
| 36 |
-
| ALFWorld | Qwen3-30B-A3B (GRPO
|
| 37 |
-
| WebShop | Qwen3-4B (GRPO
|
| 38 |
-
| WebShop | Qwen3-30B-A3B (GRPO
|
| 39 |
-
| Search-QA | Qwen3-4B (GRPO
|
| 40 |
-
| Search-QA | Qwen3-30B-A3B (GRPO
|
| 41 |
|
| 42 |
## Download
|
| 43 |
|
|
@@ -47,7 +47,7 @@ Download one checkpoint (recommended — the 30B-A3B models are large):
|
|
| 47 |
pip install -U "huggingface_hub[cli]"
|
| 48 |
|
| 49 |
hf download TanQT24/ATOD_ckpt \
|
| 50 |
-
--include "
|
| 51 |
--local-dir ~/ckpts/ATOD_ckpt
|
| 52 |
```
|
| 53 |
|
|
@@ -64,7 +64,7 @@ from huggingface_hub import snapshot_download
|
|
| 64 |
|
| 65 |
path = snapshot_download(
|
| 66 |
repo_id="TanQT24/ATOD_ckpt",
|
| 67 |
-
allow_patterns=["
|
| 68 |
local_dir="~/ckpts/ATOD_ckpt",
|
| 69 |
)
|
| 70 |
```
|
|
@@ -77,7 +77,7 @@ path = snapshot_download(
|
|
| 77 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 78 |
|
| 79 |
repo = "TanQT24/ATOD_ckpt"
|
| 80 |
-
sub = "
|
| 81 |
|
| 82 |
tokenizer = AutoTokenizer.from_pretrained(repo, subfolder=sub)
|
| 83 |
model = AutoModelForCausalLM.from_pretrained(
|
|
@@ -88,7 +88,7 @@ model = AutoModelForCausalLM.from_pretrained(
|
|
| 88 |
### vLLM
|
| 89 |
|
| 90 |
```bash
|
| 91 |
-
vllm serve ~/ckpts/ATOD_ckpt/
|
| 92 |
--served-model-name atod-teacher-alfworld-4b
|
| 93 |
```
|
| 94 |
|
|
@@ -98,7 +98,7 @@ In the [ATOD repo](https://github.com/TanQT24/ATOD), point `teacher_model_path`
|
|
| 98 |
|
| 99 |
```bash
|
| 100 |
student_model_path=Qwen/Qwen3-1.7B
|
| 101 |
-
teacher_model_path=~/ckpts/ATOD_ckpt/
|
| 102 |
```
|
| 103 |
|
| 104 |
Using these checkpoints lets you skip teacher GRPO training and run ATOD distillation directly.
|
|
@@ -106,7 +106,7 @@ Using these checkpoints lets you skip teacher GRPO training and run ATOD distill
|
|
| 106 |
## Notes
|
| 107 |
|
| 108 |
- Models are task-specific agents: use the ALFWorld teacher for ALFWorld, the WebShop teacher for WebShop, and the Search teacher for Search-QA. They expect the prompt / action formats produced by the environments in the ATOD repo.
|
| 109 |
-
- Checkpoint names encode the environment
|
| 110 |
|
| 111 |
## Citation
|
| 112 |
|
|
|
|
| 32 |
|
| 33 |
| Environment | Teacher | Subfolder |
|
| 34 |
|---|---|---|
|
| 35 |
+
| ALFWorld | Qwen3-4B (GRPO) | `alfworld_grpo_qwen3_4b/actor_hf` |
|
| 36 |
+
| ALFWorld | Qwen3-30B-A3B (GRPO) | `alfworld_grpo_qwen3_30ba3b/actor_hf` |
|
| 37 |
+
| WebShop | Qwen3-4B (GRPO) | `webshop_grpo_qwen3_4b/actor_hf` |
|
| 38 |
+
| WebShop | Qwen3-30B-A3B (GRPO) | `webshop_grpo_qwen3_30ba3b/actor_hf` |
|
| 39 |
+
| Search-QA | Qwen3-4B (GRPO) | `search_grpo_qwen3_4b/actor_hf` |
|
| 40 |
+
| Search-QA | Qwen3-30B-A3B (GRPO) | `search_grpo_qwen3_30ba3b/actor_hf` |
|
| 41 |
|
| 42 |
## Download
|
| 43 |
|
|
|
|
| 47 |
pip install -U "huggingface_hub[cli]"
|
| 48 |
|
| 49 |
hf download TanQT24/ATOD_ckpt \
|
| 50 |
+
--include "alfworld_grpo_qwen3_4b/*" \
|
| 51 |
--local-dir ~/ckpts/ATOD_ckpt
|
| 52 |
```
|
| 53 |
|
|
|
|
| 64 |
|
| 65 |
path = snapshot_download(
|
| 66 |
repo_id="TanQT24/ATOD_ckpt",
|
| 67 |
+
allow_patterns=["search_grpo_qwen3_4b/*"],
|
| 68 |
local_dir="~/ckpts/ATOD_ckpt",
|
| 69 |
)
|
| 70 |
```
|
|
|
|
| 77 |
from transformers import AutoModelForCausalLM, AutoTokenizer
|
| 78 |
|
| 79 |
repo = "TanQT24/ATOD_ckpt"
|
| 80 |
+
sub = "alfworld_grpo_qwen3_4b/actor_hf"
|
| 81 |
|
| 82 |
tokenizer = AutoTokenizer.from_pretrained(repo, subfolder=sub)
|
| 83 |
model = AutoModelForCausalLM.from_pretrained(
|
|
|
|
| 88 |
### vLLM
|
| 89 |
|
| 90 |
```bash
|
| 91 |
+
vllm serve ~/ckpts/ATOD_ckpt/alfworld_grpo_qwen3_4b/actor_hf \
|
| 92 |
--served-model-name atod-teacher-alfworld-4b
|
| 93 |
```
|
| 94 |
|
|
|
|
| 98 |
|
| 99 |
```bash
|
| 100 |
student_model_path=Qwen/Qwen3-1.7B
|
| 101 |
+
teacher_model_path=~/ckpts/ATOD_ckpt/alfworld_grpo_qwen3_4b/actor_hf
|
| 102 |
```
|
| 103 |
|
| 104 |
Using these checkpoints lets you skip teacher GRPO training and run ATOD distillation directly.
|
|
|
|
| 106 |
## Notes
|
| 107 |
|
| 108 |
- Models are task-specific agents: use the ALFWorld teacher for ALFWorld, the WebShop teacher for WebShop, and the Search teacher for Search-QA. They expect the prompt / action formats produced by the environments in the ATOD repo.
|
| 109 |
+
- Checkpoint names encode the environment and the base model, e.g. `webshop_grpo_qwen3_4b` is the Qwen3-4B GRPO teacher for WebShop.
|
| 110 |
|
| 111 |
## Citation
|
| 112 |
|