Spaces:
Running
Running
Commit History
-
Update DeepSeek logo, tooltip format, and category names
openhands +1: openhands1. Replace DeepSeek logo with official SVG from LobeHub 2. Update tooltip format to: {lm_name} (SDK {version}) - Average Score, Average Cost, Openness 3. Rename categories: - Bug Fixing -> Issue Resolution - App Creation -> Greenfield - Frontend Development -> Frontend - Test Generation -> Testing - Information Gathering (unchanged) 4. Update intro paragraph to mention all category names Co-authored-by: openhands <openhands@all-hands.dev>5778893 -
Fix table icons layout and add Qwen/MiniMax logos
openhands +1: openhands1. Fixed table icons to display horizontally using flex container 2. Added proper Qwen logo (purple star) replacing Alibaba logo 3. Added MiniMax logo (pink waveform) 4. Updated COMPANY_LOGO_MAP in both files Co-authored-by: openhands <openhands@all-hands.dev>72b86cb -
Multiple graph and table improvements
openhands +1: openhands- Removed 'Missing Cost Data' vertical divider line from graph - Added log scale to x-axis (cost) for better data visualization - Created custom SVG lock icons: blue open lock, red closed lock - Replaced lock emojis with custom SVG lock icons in tables - Made graph icons smaller for cleaner appearance - Moved model name labels higher above icons using annotations Co-authored-by: openhands <openhands@all-hands.dev>fcb3d0b -
Remove open/closed distinction from graph, use company logos as data points
openhands +1: openhands- Replaced colored markers (pink/yellow) with company logo images on scatter plots - Downloaded official logos from SimpleIcons CDN (Anthropic, Google, Meta, HuggingFace) - Created recognizable logos for OpenAI, Mistral, DeepSeek, Cohere, Moonshot - Updated graph legend to show 'Company Logos' instead of 'Model Openness' - Maintained invisible hover markers for tooltip functionality - Model names still labeled on Pareto frontier points - Tables still show company logos in first column Co-authored-by: openhands <openhands@all-hands.dev>b6ec318 -
Add company logos to graphs and tables, label frontier points with model names
openhands +1: openhands- Created SVG logo files for major AI companies (Anthropic, OpenAI, Google, Meta, Mistral, DeepSeek, xAI, Cohere, Alibaba, Moonshot) - Added company logo mapping based on model name patterns - Added Company logo column to both main leaderboard and benchmark tables - Added company logo images on scatter plots at each data point - Added model name labels to Pareto frontier points on graphs - Updated column widths to accommodate new Company column Co-authored-by: openhands <openhands@all-hands.dev>800e404
-
Add category workflow diagrams for 5 OpenHands Index categories
openhands +1: openhands- Bug Fixing: GitHub issue to validated fix workflow - App Creation: API spec to library implementation workflow - Frontend Development: UI requirements to web app workflow - Test Generation: Issue to test case generation workflow - Information Gathering: Question to synthesized answer workflow Each diagram shows 4-step process with benchmark names Co-authored-by: openhands <openhands@all-hands.dev>6324e5d -
Update UI: All-Hands-AI color scheme, agent version column names, and OpenHands logo
openhands +1: openhands- Apply All-Hands-AI color scheme (yellow accent, indigo links, beige background) - Change 'Agent' column to 'Agent Version' - Remove 'Submitter' column - Change 'Models Used' to 'Model' - Update mock data with version numbers (1.0.2, 1.0.1, etc.) - Replace logo with OpenHands branding Co-authored-by: openhands <openhands@all-hands.dev>0ee2099 -
Replace AstaBench logo with OpenHands logo
openhands7d37950 -
Initial OpenHands Index leaderboard based on ASTA Bench
openhands +1: openhands- Updated branding (title, README, logo) - Changed dataset references to OpenHands Index datasets - Modified agenteval.json to include 6 OpenHands datasets: * swe-bench * multi-swe-bench * swe-bench-multimodal * swt-bench * commit0 * gaia - Added mock data for initial testing Co-authored-by: openhands <openhands@all-hands.dev>085a012