Article
Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL
- +6
aminediroHF, qgallouedec, kashif, lewtun, edbeeching, albertvillanova, lvwerra, sergiopaniego
• • 43
Ayush Thakur
ayut
AI & ML interests
None yet
Recent Activity
upvoted an article 10 days ago
Shipping a Trillion Parameters With a Hub Bucket: Delta Weight Sync in TRL updated a dataset over 1 year ago
llm-scratch/wmt14-de-en-split liked a dataset over 1 year ago
ai4bharat/MILUOrganizations
upvoted an article 10 days ago
updated a
dataset over 1 year ago
liked a
dataset over 1 year ago
upvoted an article over 1 year ago
Article
Timm ❤️ Transformers: Use any timm model with transformers
- +3
ariG23498, rwightman, qubvel-hf, pcuenq, reach-vb
• • 56 liked a
Space over 1 year ago
liked 2
models over 1 year ago
upvoted a collection over 1 year ago
liked a
dataset almost 2 years ago
upvoted an article almost 2 years ago
Article
The Workflow of PEFT
ariG23498
• • 19 updated a
Space about 2 years ago
upvoted a paper over 2 years ago
updated a
model over 2 years ago
liked a
model over 2 years ago
liked a
dataset over 2 years ago
reacted to clem's post with ❤️ over 2 years ago
Post
Is synthetic data the future of AI? 🔥🔥🔥
@HugoLaurencon @Leyo & @VictorSanh are introducing HuggingFaceM4/WebSight , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
You can explore the dataset here: HuggingFaceM4/WebSight
What do you think?
@HugoLaurencon @Leyo & @VictorSanh are introducing HuggingFaceM4/WebSight , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
You can explore the dataset here: HuggingFaceM4/WebSight
What do you think?
- 12 replies
updated a
Space almost 3 years ago
updated a
Space about 3 years ago
updated a
model over 3 years ago