moonshotai/Kimi-K3
Image-Text-to-Text • 2.8T • Updated • 99.2k • • 7.67k
Marko Tiosavljevic
magnetoid
AI & ML interests
None yet
Recent Activity
liked a model about 19 hours ago
moonshotai/Kimi-K3 published a bucket 24 days ago
magnetoid/new published a Space 24 days ago
magnetoid/spaceOrganizations
liked a
model about 19 hours ago
published a
bucket 24 days ago
published a
Space 24 days ago
liked a
model 4 months ago
upvoted an article 8 months ago
Article
**An Edge-First Generalized LLM LoRA Fine-Tuning Framework for Heterogeneous GPUs**
qvac
• • 17 liked a
model 8 months ago
liked a
Space 9 months ago
liked a
Space about 1 year ago
published a
Space about 1 year ago
liked a
model about 1 year ago
liked a
model over 1 year ago
reacted to csabakecskemeti's post with 🤗 over 1 year ago
Post
3015
Testing Training on AMD/ROCm the first time!
I've got my hands on an AMD Instinct MI100. It's about the same price used as a V100 but on paper has more TOPS (V100 14TOPS vs MI100 23TOPS) also the HBM has faster clock so the memory bandwidth is 1.2TB/s.
For quantized inference it's a beast (MI50 was also surprisingly fast)
For LORA training with this quick test I could not make the bnb config works so I'm running the FT on the fill size model.
Will share all the install, setup and setting I've learned in a blog post, together with the cooling shroud 3D design.
I've got my hands on an AMD Instinct MI100. It's about the same price used as a V100 but on paper has more TOPS (V100 14TOPS vs MI100 23TOPS) also the HBM has faster clock so the memory bandwidth is 1.2TB/s.
For quantized inference it's a beast (MI50 was also surprisingly fast)
For LORA training with this quick test I could not make the bnb config works so I'm running the FT on the fill size model.
Will share all the install, setup and setting I've learned in a blog post, together with the cooling shroud 3D design.
- 8 replies
liked a
model over 1 year ago
