Hugging Face's logo

Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
Back to feed
sergiopaniego 
posted an update about 5 hours ago
Post
30
AsyncGRPOTrainer is now stable in TRL v1.18.0!

generation and training run at the same time on separate GPUs, instead of taking turns

we wrote up how to run it, what you can train with it and how it compares with GRPOTrainer: trl-lib/async-grpo-stable
In this post