high-quality Chinese training datasets Collection a suite of high-quality Chinese datasets, used for pretraining, fine-tuning or preference alignment. And the models trained on these datasets. β’ 13 items β’ Updated May 22, 2025 β’ 25
Running on CPU Upgrade 295 The Synthetic Data Playbook: Generating Trillions of the Finest Tokens π 295 Explore synthetic data experiments on a bookshelf visualization
Running 287 The ultimate guide to RL environments: building and scaling them in the LLM era π 287 Building and scaling RL environments for LLM training
π LLM pretraining datasets Collection A collection of datasets for LLM pretraining β’ 9 items β’ Updated May 5, 2025 β’ 34
Running on CPU Upgrade Featured 3.41k The Smol Training Playbook π 3.41k The secrets to building world-class LLMs
Running 123 Unlocking On-Policy Distillation for Any Model Family π 123 Explore onβpolicy distillation visualizations for any model
Running on CPU Upgrade 14.2k Open LLM Leaderboard π 14.2k Track, rank and evaluate open LLMs and chatbots
[lecture artifacts] aligning open language models Collection artifacts referenced in the talk timeline! Slides: https://docs.google.com/presentation/d/1quMyI4BAx4rvcDfk8jjv063bmHg4RxZd9mhQloXpMn0/edit?usp=sharin β’ 63 items β’ Updated Apr 17, 2024 β’ 57
Running Agents Featured 255 Jupyter Agent 2 π 255 Generate a Jupyter notebook from a plainβtext task
Running Agents 321 Jupyter Agent π 321 Generate and run Jupyter notebooks from natural language prompts
laion/CLIP-ViT-B-32-laion2B-s34B-b79K Zero-Shot Image Classification β’ 0.2B β’ Updated Jan 22, 2025 β’ 5.28M β’ 157