Hugging Face's logo
Mohamed Sadek Saadi's picture

Mohamed Sadek Saadi

yohoji
3 62
21world's profile picture Gargaz's profile picture jasoncorkill's profile picture
·

AI & ML interests

None yet

Recent Activity

upvoted an article 6 days ago
Live Human Feedback in the Training Loop: Aligning Diffusion Models with Real People
reacted to jasoncorkill's post with ❤️ about 2 months ago
Most public benchmarks collapse model performance into one broad preference signal. That makes it hard to understand which capabilities differentiate between models. It's also almost impossible to inspect the evidence behind it. So @RapidataAI is releasing Benchmark.AI. We started with an SVG generation benchmark including 42 models, 500 prompts, 1.9M+ human judgements, 300K+ match-ups. We evaluate models separately on Preference, Alignment and Coherence, while making the prompts, outputs, match-ups and methodology public. Full dataset: https://huggingface.co/datasets/Rapidata/svg-benchmark Full benchmark: https://www.benchmark.ai/svg Methodology feedback and benchmark suggestions very welcome!
reacted to jasoncorkill's post with 🚀 about 2 months ago
Most public benchmarks collapse model performance into one broad preference signal. That makes it hard to understand which capabilities differentiate between models. It's also almost impossible to inspect the evidence behind it. So @RapidataAI is releasing Benchmark.AI. We started with an SVG generation benchmark including 42 models, 500 prompts, 1.9M+ human judgements, 300K+ match-ups. We evaluate models separately on Preference, Alignment and Coherence, while making the prompts, outputs, match-ups and methodology public. Full dataset: https://huggingface.co/datasets/Rapidata/svg-benchmark Full benchmark: https://www.benchmark.ai/svg Methodology feedback and benchmark suggestions very welcome!
View all activity

Organizations

None yet