Post
19
A recent paper "Deep learning reveals antimicrobial peptides within prions" inspired me to curate a dataset of 🧬 sequences tagged 'prion' on the NCBI website. For a link to the paper and more information: scarysnake/prion-fasta
AI & ML interests
A one-year long research workshop on large language models: the Summer of Language Models 21 🌸
Recent Activity
View all activity
monsoon-nlp
posted an update about 6 hours ago
Post
1670
I present to you a new experimental open book.
https://github.com/stas00/python-cookbook
I took my dense Python cheatsheet that I have been honing for many years and use a lot daily and turned it into a book of recipes.
Is this useful?
This is, of course, free, like other open books.
https://github.com/stas00/python-cookbook
I took my dense Python cheatsheet that I have been honing for many years and use a lot daily and turned it into a book of recipes.
Is this useful?
This is, of course, free, like other open books.
Post
444
The Art of Debugging Open Free book is now available in pdf/epub and finally sports a book cover
https://github.com/stas00/the-art-of-debugging#ebook-versions-of-the-book
While a lot of the focus is on Unix/Python/Pytorch, the methodology chapter is applicable to any Software Debugging.
It currently sports 161 packed pages in 5 solid chapters and more coming...
https://github.com/stas00/the-art-of-debugging#ebook-versions-of-the-book
While a lot of the focus is on Unix/Python/Pytorch, the methodology chapter is applicable to any Software Debugging.
It currently sports 161 packed pages in 5 solid chapters and more coming...
- 7 replies
Post
137
In parallel we announce a new open source repo:
https://github.com/Snowflake-AI-Research/Arctic-Platform
This is the framework for very fast RL (and future other optimizations rolled into it)
It currently has all the code you need to use or integrate Arctic RL into RL frameworks, with SkyRL and Verl available and more framework integrations coming.
Please kindly spread the word! Thank you!
https://github.com/Snowflake-AI-Research/Arctic-Platform
This is the framework for very fast RL (and future other optimizations rolled into it)
It currently has all the code you need to use or integrate Arctic RL into RL frameworks, with SkyRL and Verl available and more framework integrations coming.
Please kindly spread the word! Thank you!
Post
3631
After many months of intense work the
Snowflake AI Research team is happy to present to you the new open source project: Arctic RL
https://snowflake.com/en/blog/engineering/arctic-rl-open-source-backend/
- Arctic RL integrates with VeRL and SkyRL today; enable ZoRRo with one config flag, no code changes required
- ZoRRo delivers up to 6x actor-update acceleration and a 3.5x end-to-end training speedup, reducing Arctic-Text2SQL-R2 training from ~5 days to ~36 hours on 32 H200 GPUs
- Arctic-Text2SQL-R2 achieved higher accuracy scores (48.7) than Gemini 3.1 Pro (47.9) and Claude 4.7 (47.3) on Snowflake's evaluated enterprise SQL benchmark under the tested conditions
- Two open source recipes ship with this release: a text-to-SQL recipe that improved BIRD dev accuracy from 59.92% to 70.35%, and a multi-hop QA recipe that improved average accuracy from 69.6% to 72.3%
Snowflake AI Research team is happy to present to you the new open source project: Arctic RL
https://snowflake.com/en/blog/engineering/arctic-rl-open-source-backend/
- Arctic RL integrates with VeRL and SkyRL today; enable ZoRRo with one config flag, no code changes required
- ZoRRo delivers up to 6x actor-update acceleration and a 3.5x end-to-end training speedup, reducing Arctic-Text2SQL-R2 training from ~5 days to ~36 hours on 32 H200 GPUs
- Arctic-Text2SQL-R2 achieved higher accuracy scores (48.7) than Gemini 3.1 Pro (47.9) and Claude 4.7 (47.3) on Snowflake's evaluated enterprise SQL benchmark under the tested conditions
- Two open source recipes ship with this release: a text-to-SQL recipe that improved BIRD dev accuracy from 59.92% to 70.35%, and a multi-hop QA recipe that improved average accuracy from 69.6% to 72.3%
- 4 replies
Post
140
PSA for DeepSpeed users - a long outstanding precision-related critical bug has been identified and fixed in https://github.com/deepspeedai/DeepSpeed/pull/8066 and a new release has been made.
The issue was about mixed precision mode downcasting buffers that had to be in fp32 - massively impacting correctness due to large static buffers - e.g. RoPE in Qwen3 models when using long sequence lengths 32K+.
Hopefully this fix brings Deepspeed to a close parity with FSDP2 which has been an issue since a long time.
You can still have the old behavior but you'd now need to manually configure it - by default the model's buffers will now remain in the original precision.
Please install deepspeed==0.19.2 which will do the right thing.
Thanks to Tunji Ruwase and Claude Opus 4.8 via Cursor for identifying and fixing the problem.
The issue was about mixed precision mode downcasting buffers that had to be in fp32 - massively impacting correctness due to large static buffers - e.g. RoPE in Qwen3 models when using long sequence lengths 32K+.
Hopefully this fix brings Deepspeed to a close parity with FSDP2 which has been an issue since a long time.
You can still have the old behavior but you'd now need to manually configure it - by default the model's buffers will now remain in the original precision.
Please install deepspeed==0.19.2 which will do the right thing.
Thanks to Tunji Ruwase and Claude Opus 4.8 via Cursor for identifying and fixing the problem.
why mt0-large is 1.3B while mt5-large is 780M?
1
#6 opened almost 2 years ago
by 
tansq
Geração de Texto
#63 opened 8 months ago
by 
alcidesmoreira1963
Adding Evaluation Results
#61 opened over 2 years ago
by 
leaderboard-pr-bot
Hosted inference API: 500 Internal Server Error returned
1
#4 opened almost 4 years ago
by 
MarkDeSouza
Adding Evaluation Results
#41 opened over 2 years ago
by leaderboard-pr-bot
Adding Evaluation Results
#42 opened about 2 years ago
by leaderboard-pr-bot
Add evaluation results on the mathemakitten--winobias_antistereotype_test config and test split of mathemakitten/winobias_antistereotype_test
1
#32 opened over 3 years ago
by 
autoevaluator
System Requirements
3
#38 opened over 3 years ago
by 
Robo0890
Request: DOI
3
#43 opened over 1 year ago
by 
ovv4thewin
espejelomar
posted an update 2 months ago
Post
4745
Sharing WorldForge with @abdelstark
It's an open-source Python project for evaluating and replaying robotics and world-model workflows.
The useful part is not only calling a model. WorldForge records the run, validates action shapes, translates outputs into actions, and keeps replay artifacts you can inspect later.
The current demo uses LeRobot + LeWorldModel on PushT through the official loader:
The harness also has replay-only paths for Cosmos-Policy and GR00T-style outputs, so you can inspect the provider contract from saved artifacts without keeping a GPU server online.
Try it:
Repo: https://github.com/AbdelStark/worldforge
Docs: https://abdelstark.github.io/worldforge/
Pre-1.0, MIT, and actively looking for contributors. Good areas:
- robotics provider adapters
- replay artifacts
- eval flows
- docs & first-run demos
Good first issues: https://github.com/AbdelStark/worldforge/contribute
If you're building robot policy evals or model adapters, would love a PR — or an issue describing what's missing.
It's an open-source Python project for evaluating and replaying robotics and world-model workflows.
The useful part is not only calling a model. WorldForge records the run, validates action shapes, translates outputs into actions, and keeps replay artifacts you can inspect later.
The current demo uses LeRobot + LeWorldModel on PushT through the official loader:
stable_worldmodel.policy.AutoCostModel("pusht/lewm")The harness also has replay-only paths for Cosmos-Policy and GR00T-style outputs, so you can inspect the provider contract from saved artifacts without keeping a GPU server online.
Try it:
pip install worldforge-aiuv run --extra harness worldforge-harness --flow robotics-compareRepo: https://github.com/AbdelStark/worldforge
Docs: https://abdelstark.github.io/worldforge/
Pre-1.0, MIT, and actively looking for contributors. Good areas:
- robotics provider adapters
- replay artifacts
- eval flows
- docs & first-run demos
Good first issues: https://github.com/AbdelStark/worldforge/contribute
If you're building robot policy evals or model adapters, would love a PR — or an issue describing what's missing.
Post
255
Good news! Ulysses Sequence Parallelism from the Snowflake AI Research and the Deepspeed teams has been integrated into
HuggingFace Trainer, Accelerate and TRL
For extensive details please see this writeup:
https://huggingface.co/blog/ulysses-sp
Thanks a lot to Kashif Rasul for helping make it happen. Also the others in the HF team who helped with integration.
HuggingFace Trainer, Accelerate and TRL
For extensive details please see this writeup:
https://huggingface.co/blog/ulysses-sp
Thanks a lot to Kashif Rasul for helping make it happen. Also the others in the HF team who helped with integration.
pretokenizer Regex issues?
8
#278 opened about 2 years ago
by 
hpcpony
Test PR
#286 opened 5 months ago
by 
FIRSTACCOUNT69
Test discussion
#287 opened 5 months ago
by FIRSTACCOUNT69