-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper • 2406.14491 • Published • 96 -
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper • 2405.21060 • Published • 68 -
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Paper • 2405.20541 • Published • 24 -
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
Paper • 2406.01574 • Published • 55
Daeseong Kim
dkimds
·
AI & ML interests
RL, LLM, RLHF and so on.
Recent Activity
liked a model 4 days ago
upstage/Solar-Open2-250B upvoted a paper 11 months ago
Meta-Prompting: Enhancing Language Models with Task-Agnostic Scaffolding liked a dataset 12 months ago
HAERAE-HUB/K2-FeedbackOrganizations
None yet
-
Instruction Pre-Training: Language Models are Supervised Multitask Learners
Paper • 2406.14491 • Published • 96 -
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
Paper • 2405.21060 • Published • 68 -
Perplexed by Perplexity: Perplexity-Based Data Pruning With Small Reference Models
Paper • 2405.20541 • Published • 24 -
MMLU-Pro: A More Robust and Challenging Multi-Task Language Understanding Benchmark
Paper • 2406.01574 • Published • 55
models 19
dkimds/mt0-large-ia3
Updated
dkimds/peft-vit-base-patch16-224-in21k-lora
Updated
dkimds/bloomz-560-m-peft-method
Updated
dkimds/rl_course_vizdoom_health_gathering_supreme
Reinforcement Learning • Updated
dkimds/ppo-LunarLander-v2
Reinforcement Learning • Updated • 2
dkimds/a2c-PandaReachDense-v3
Reinforcement Learning • Updated
dkimds/ppo-SnowballTarget
Reinforcement Learning • Updated • 10
dkimds/ppo-Pyramids-Training
Reinforcement Learning • Updated • 2
dkimds/PixelCopter-PLE-v0
Updated
dkimds/Reinforce-CartPole-v1
Reinforcement Learning • Updated
datasets 0
None public yet