🏗️ Building on HF

Sergio Paniego PRO

sergiopaniego

huggingface

·

https://sergiopaniego.github.io/

AI & ML interests

None yet

Recent Activity

posted an update about 7 hours ago

we just released a new blog "Training a coding agent using the OpenCode harness in remote HF sandboxes with TRL and OpenEnv" you can take a real coding agent (OpenCode), let it run its own tool loop against real coding problems, and train it with RL on the exact tokens it produced and every rollout runs in its own remote HF sandbox, so rollouts scale out beyond one machine the loop: - OpenCode owns its tool loop inside an OpenEnv sandbox - an in-sandbox proxy records the real token ids + logprobs, per turn - a hidden-test verifier scores the result, and that is the reward - TRL trains with AsyncGRPO, weights sync back to vLLM over NCCL blog + runnable example: https://huggingface.co/blog/sergiopaniego/trl-openenv-harness-training

published an article about 7 hours ago

Training a coding agent using the OpenCode harness in remote HF sandboxes with TRL and OpenEnv

updated a dataset about 13 hours ago

agents-course/final-certificates

View all activity

Organizations

New activity in hf-doc-build/doc-build 2 months ago

Add openenv/_versions.yml

#60 opened 2 months ago by

New activity in huggingface/documentation-images 2 months ago

Add agent-glossary blog images

#622 opened 2 months ago by

New activity in AdithyaSK/rl-environments-guide 3 months ago

Update app/src/content/chapters/introduction.mdx

#5 opened 3 months ago by

Update app/src/content/embeds/framework-cards.html

#4 opened 3 months ago by

Update app/src/content/chapters/framework-inventory.mdx

#3 opened 3 months ago by

Update app/src/content/chapters/observations.mdx

#2 opened 3 months ago by

Update app/src/content/chapters/framework-inventory.mdx

#1 opened 3 months ago by

New activity in agents-course/notebooks 3 months ago

fix: support Google Colab secrets for HF_TOKEN loading

#134 opened 3 months ago by

New activity in trl-lib/documentation-images 6 months ago

Upload 2 files

#4 opened 6 months ago by

New activity in trl-lib/documentation-images 8 months ago

Add logos as assets

#3 opened 8 months ago by

New activity in mistralai/Ministral-3-3B-Base-2512 8 months ago

Update README.md

#2 opened 8 months ago by

New activity in mistralai/Ministral-3-8B-Base-2512 8 months ago

Update README.md

#3 opened 8 months ago by

New activity in mistralai/Ministral-3-14B-Base-2512 8 months ago

Update README.md

#3 opened 8 months ago by

New activity in mistralai/Ministral-3-3B-Reasoning-2512 8 months ago

Update README.md

#3 opened 8 months ago by

New activity in mistralai/Ministral-3-8B-Reasoning-2512 8 months ago

Update README.md

#2 opened 8 months ago by

New activity in mistralai/Ministral-3-14B-Reasoning-2512 8 months ago

Update README.md

#2 opened 8 months ago by

New activity in mistralai/Ministral-3-3B-Instruct-2512 8 months ago

Update README.md

#5 opened 8 months ago by

New activity in mistralai/Ministral-3-8B-Instruct-2512 8 months ago

Update README.md

#2 opened 8 months ago by

New activity in mistralai/Ministral-3-14B-Instruct-2512 8 months ago

Update README.md

#6 opened 8 months ago by

New activity in ZhiyuanZeng/RLVE_Gym 8 months ago

Update pyproject.toml

#4 opened 8 months ago by