UIUC-SSAIL/Qwen3-4B-XPress-b16
0.6B ā¢ Updated ā¢ 26
AI & ML interests
None defined yet.
Recent Activity
View all activity
MinjiaĀ
published 3
models 5 days ago
ZhengVictorWangĀ
updated 3
models 5 days ago
MinjiaĀ
published 2
models about 1 month ago
ZhengVictorWangĀ
updated 2
models about 1 month ago
MinjiaĀ
updated a
Space about 2 months ago
MinjiaĀ
published a
Space about 2 months ago
MinjiaĀ
authored 8
papers over 1 year ago
Model Tells You What to Discard: Adaptive KV Cache Compression for LLMs
Paper ā¢ 2310.01801 ā¢ Published ā¢ 3
DeepSpeed4Science Initiative: Enabling Large-Scale Scientific Discovery through Sophisticated AI System Technologies
Paper ā¢ 2310.04610 ā¢ Published ā¢ 1
ZeRO-Offload: Democratizing Billion-Scale Model Training
Paper ā¢ 2101.06840 ā¢ Published ā¢ 1
Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native
Paper ā¢ 2401.12230 ā¢ Published ā¢ 2
DeepSpeed-Chat: Easy, Fast and Affordable RLHF Training of ChatGPT-like Models at All Scales
Paper ā¢ 2308.01320 ā¢ Published ā¢ 46
DeepSpeed-MoE: Advancing Mixture-of-Experts Inference and Training to Power Next-Generation AI Scale
Paper ā¢ 2201.05596 ā¢ Published ā¢ 2
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Paper ā¢ 2211.05100 ā¢ Published ā¢ 40
Random-LTD: Random and Layerwise Token Dropping Brings Efficient Training for Large-scale Transformers
Paper ā¢ 2211.11586 ā¢ Published ā¢ 1