Spaces:
Running
Running
Commit History
-
Show alternative agents in top nav
Graham Neubig81071cf
-
Hide Alternative Agents nav item
openhands +1: openhandsCo-authored-by: openhands <openhands@all-hands.dev>5a51d1c
-
Reduce left/right margins on mobile view
openhandsAdd responsive CSS media query for screens 768px and narrower that: - Reduces padding on #page-content-wrapper from 25px to 8px - Reduces padding on #intro-paragraph from 35px to 8px - Reduces padding on .nav-holder from 20px to 8px - Reduces padding on .gradio-container - Makes content full width (max-width: 100%) - Reduces table cell padding for better mobile display0f8031a
-
Fix dark mode modebar styling - transparent background with light gray icons
openhands +1: openhands- Make modebar, modebar-container, modebar-group, and modebar-btn backgrounds transparent - Style modebar icons to match the light gray text color (neutral-400) - Add hover state with slightly lighter color for better UX This fixes the ugly gray background that appeared when hovering over Plotly figures in dark mode. Co-authored-by: openhands <openhands@all-hands.dev>4f4a27d
-
Update intro text: remove 'standardized' from 'we need ways'
openhands +1: openhandsCo-authored-by: openhands <openhands@all-hands.dev>315feb4 -
Keep CSS font separate from Python constants
openhandsa87403b -
Consolidate font definitions into single source of truth
openhandsCreate constants.py with FONT_FAMILY and FONT_FAMILY_SHORT. All Python files now import and use these constants instead of hardcoded font values.acd5bf8 -
Change font to Arial for better readability
openhandsfaddaaf -
Remove asta/astabench references
openhands- Update utm_source from asta_leaderboard to openhands_index - Remove 'Asta' from toolset description - Update citation text to use openhands-index - Update legal disclaimer with OpenHands URL - Simplify README Hugging Face integration section - Delete unused agenteval_backup.json file Keep acknowledgement to AstaBench in about.py as it credits the source.35aa299 -
Update intro paragraph with new content
openhands- Remove pre-release notice - Add link to OpenHands Software Agent SDK - Minor wording improvements7abbbe1 -
Use CSS filter for dark mode chart background, leave logos untouched
openhandsApply invert filter to entire chart for dark mode background, but don't re-invert logos - they will be inverted along with the chart which should make them visible on the dark background.c52135c -
Remove all dark mode CSS filters for Plotly charts
openhandsThe filter-based inversion approach was causing logo visibility issues (e.g., kimi-k2-thinking logo not visible). Removing the filters entirely for a simpler, more reliable solution.cb0a3ed -
Fix dark mode logo visibility by simplifying CSS filters
openhandsRemoved the complex exclusion rules for OpenHands logos and simplified the CSS to apply the same re-inversion filter to all images in charts. This fixes logos like Moonshot/Kimi that weren't displaying correctly in dark mode due to color inversion issues.02e5603 -
Clean up unused code, files, and assets
openhandsRemoved unused Python code: - svg_to_data_uri() from leaderboard_transformer.py - create_svg_html() from ui_components.py - format_llm_base_with_html() from ui_components.py Consolidated duplicate code: - Renamed get_company_from_model_name to get_company_from_model in leaderboard_transformer.py - Removed duplicate COMPANY_LOGO_MAP and get_company_from_model from ui_components.py - ui_components.py and visualizations.py now import from leaderboard_transformer.py Removed unused files: - submission.py (submission functionality not exposed in app) - submission_utils.py (only used by submission.py) - generate_mock_jsonl.py (development utility) - tests/integration/test_submission.py (tests for removed submission code) Removed unused config: - CONTACT_DATASET and SUBMISSION_DATASET from config.py Removed unused CSS: - Submission page CSS section from content.py Removed 35 unused asset files: - Various legend SVGs (api-*, c-*, os-*, custom-*, standard-*, equivalent-*) - Category icons (…bb0cd90 -
Use JavaScript to swap OpenHands logos based on dark mode
openhands- Added logo_swap_script that uses MutationObserver to detect dark mode changes - JavaScript directly sets display:none on the appropriate logo - Simplified CSS to just remove filters from OpenHands logos - More reliable than CSS attribute selectors on Plotly images7962903 -
Fix CSS specificity for OpenHands logo in dark mode
openhands- Exclude OpenHands logos from the general image inversion rule - Use more specific selectors for dark logo to ensure filter: none applies - Dark logo now displays without inversion in dark modeee912b9 -
Use separate logos for light and dark mode in plots
openhands- Added get_openhands_logo_images() that returns both light and dark logos - Light mode uses openhands_logo_color_forwhite.png - Dark mode uses openhands_logo_color_forblack.png - CSS shows/hides appropriate logo based on .dark class - Dark mode logo doesn't get inverted (uses actual dark logo file)bc09902 -
Remove glow effect from all images in dark mode plots
openhands- Simplified CSS to just re-invert images without drop-shadow - Logos are now designed to be visible without the glow effectd9b12ec -
Fix logo glow and change Size chart to use total parameters
openhandsLogo glow fix: - Changed from URI fragment (#openhands-logo) to MIME parameter (openhands=logo) - MIME parameters are more reliably preserved in attribute selectors - Updated CSS selectors to match the new pattern Size chart fix: - Changed x-axis from active parameters to total parameters - Updated axis title to 'Parameters (Billions)' - Simplified hover text to show just 'Parameters' instead of 'Total/Active'4b2f07d -
Remove glow from OpenHands logo in dark mode plots
openhands- Add #openhands-logo fragment to logo data URIs for CSS targeting - Update CSS to exclude OpenHands logo from glow effect using :not() selector - Company logos still get the glow for visibility in dark mode - OpenHands branding logo renders cleanly without glow74f33aa -
Remove glow effect from OpenHands logo in dark mode
openhands +1: openhandsThe OpenHands logo is designed for dark backgrounds, so it doesn't need the circular glow effect that other company logos require for visibility. Co-authored-by: openhands <openhands@all-hands.dev>0e8d4cc -
Enable dark mode for Plotly charts with logo circle backgrounds
openhands +1: openhands- Add CSS filter-based dark mode support for all Plotly plots - Invert chart colors when Gradio dark mode is active - Re-invert company logo images to display correctly in dark mode - Add light gray circular glow behind company logos for visibility - Re-invert OpenHands branding logo and modebar icons Co-authored-by: openhands <openhands@all-hands.dev>c623c88
-
Revert category borders to #999 (medium grey)
openhands +1: openhandsCo-authored-by: openhands <openhands@all-hands.dev>eb54922 -
Change Winners header gradient from yellow-green to yellow-darker yellow
openhands +1: openhands- Use primary-600 (#DCC257) instead of green for gradient end color Co-authored-by: openhands <openhands@all-hands.dev>d3a0750 -
Force dark border on category headers with !important
openhands +1: openhandsCo-authored-by: openhands <openhands@all-hands.dev>783b63b -
Use darker border (#333) between categories in Winners table
openhands +1: openhands- Changed from #999 to #333 for more visible category separation Co-authored-by: openhands <openhands@all-hands.dev>8632836 -
Add dark border between category headers in Winners table
openhands +1: openhands- Match header borders (2px #999) with data row category separators Co-authored-by: openhands <openhands@all-hands.dev>ff230f5 -
Fix Winners by Category borders: dark between categories, light within
openhands +1: openhands- Light border (1px #eee) between score and model name within same category - Dark border (2px #999) between different categories Co-authored-by: openhands <openhands@all-hands.dev>ccae857 -
Winners by Category: put scores before names
openhands +1: openhands- Swap column order so score appears first, then model name - Update CSS styling for new column order Co-authored-by: openhands <openhands@all-hands.dev>24ff7a3 -
Make fonts consistent with Outfit across tables and charts
openhands +1: openhands- Update table cell fonts from Manrope to Outfit - Add global font setting to Plotly charts - Add openhands_mark_color_forwhite.png to assets Co-authored-by: openhands <openhands@all-hands.dev>0cdbc85 -
Align color scheme with OpenHands brand
openhands +1: openhands- Update primary accent from mint green to yellow (#FFE165) - Update secondary accent to green (#BCFF8C) - Update dark mode background to grey scale (#18191C) - Change font from Manrope to Outfit (OpenHands brand font) - Update CSS variables to match openhands-ui/tokens.css - Update chart colors (efficiency frontier, trend lines, hover labels) Co-authored-by: openhands <openhands@all-hands.dev>928e4af -
Refactor Winners by Category to single unified table
openhands +1: openhands- Changed from multiple category cards to a single horizontal table - Format: | [emoji] Category | Score | ... for each category - Display only model name (removed SDK version) - Deduplicate by model name, keeping highest score - Updated CSS for new table layout with responsive design Co-authored-by: openhands <openhands@all-hands.dev>4f4eb00 -
Add Winners by Category section to main page
openhands +1: openhands- Implemented new 'Winners by Category' section displaying top 5 systems for each benchmark category - Added functions get_winners_by_category() and create_winners_by_category_html() to ui_components.py - Created responsive grid layout with category cards showing: - Category icon and name header - Ranked table with medal emojis (🥇🥈🥉) for top 3 - Company logos for model providers - SDK version and model name - Category score - Added comprehensive CSS styles in content.py: - Light and dark mode support - Responsive grid for mobile devices - Hover effects for cards - Consistent styling with existing design system - Section placed directly after main leaderboard results Co-authored-by: openhands <openhands@all-hands.dev>c14a283 -
Fix dark mode link colors - use light grey (#cccccc) instead of dark grey
openhands +1: openhands- Add --color-primary-link-dark CSS variable - Add global dark mode link color rules - Fix .intro-link, .primary-link-button, .benchmark-main-subtitle in dark mode - Remove inline color style from About link Co-authored-by: openhands <openhands@all-hands.dev>9040dc0 -
Update Frontend description to use SWE-bench Multimodal (Verified)
openhands +1: openhands- Clarify that Frontend category uses the dev set of SWE-bench Multimodal - Note that it uses only problems verified as solveable by human review - Add links to the dataset and solveability annotations Co-authored-by: openhands <openhands@all-hands.dev>eb1e409
-
Add Download column for trajectory archives and increase table font size
openhands +1: openhandsChanges: - Add Download column to leaderboard table with download icon (⬇️) linking to trajectory archives - Preserve full_archive URLs from score data even when pydantic validation is used - Increase table font size from 14px to 15px for better readability - Add Download column documentation to tooltip descriptions Co-authored-by: openhands <openhands@all-hands.dev>b5317d7
-
Remove multi-swe-bench from OpenHands Index
openhands- Remove multi-swe-bench from benchmark mappings in simple_data_loader.py - Remove multi-swe-bench from generate_mock_jsonl.py - Update FRONTEND_DEVELOPMENT_DESCRIPTION to reference SWE-bench Multimodal (not Multi-SWE-bench) - Remove multi-swe-bench from about.py benchmark lists and acknowledgements - Update DATA_STRUCTURE.md to remove multi-swe-bench references - Keep 5 categories (Frontend uses swe-bench-multimodal, not multi-swe-bench)b978a6b
-
Change blue links and text to dark grey (#555555)
openhands +1: openhandsUpdated link colors in both CSS variables and Gradio theme to use dark grey instead of blue/indigo for better visual consistency. Co-authored-by: openhands <openhands@all-hands.dev>d68f190 -
Update DeepSeek logo, tooltip format, and category names
openhands +1: openhands1. Replace DeepSeek logo with official SVG from LobeHub 2. Update tooltip format to: {lm_name} (SDK {version}) - Average Score, Average Cost, Openness 3. Rename categories: - Bug Fixing -> Issue Resolution - App Creation -> Greenfield - Frontend Development -> Frontend - Test Generation -> Testing - Information Gathering (unchanged) 4. Update intro paragraph to mention all category names Co-authored-by: openhands <openhands@all-hands.dev>5778893 -
Update intro text to focus on motivation rather than metrics
openhands +1: openhandsSimplified the above-the-fold description to emphasize: - Why the index exists (need for standardized agent evaluation) - What it provides (aggregated performance + cost view) - Who benefits (developers and researchers) Moved detailed metric explanations to the About page. Co-authored-by: openhands <openhands@all-hands.dev>369c590
-
fix: Update Total cost description in intro to be sum, not average
openhands +1: openhandsThe previous sed command didn't work due to a unicode apostrophe character. Co-authored-by: openhands <openhands@all-hands.dev>6a5c447 -
docs: Update descriptive text to use Average Score and Total Cost
openhands +1: openhands- Changed 'Overall score' to 'Average score' in content.py and about.py - Changed 'Overall cost' to 'Total cost' in content.py and about.py - Updated Total cost description to reflect that it's a sum, not an average Co-authored-by: openhands <openhands@all-hands.dev>bb0f7af
-
Cleanup codebase: remove unused code, simplify data loading, and add pre-release notice
openhands +1: openhands- Remove unused github_data_loader.py (71 lines of dead code) - Clean up debug logging in app.py (replaced ~40 print statements with proper logger) - Remove scheduler code and APScheduler dependency from requirements.txt - Simplify simple_data_loader.py by removing old JSONL format fallback - Update setup_data.py to fetch data from results/ directory only - Update mock data to use new agent-centric directory structure - Add pre-release notice to main page intro paragraph Co-authored-by: openhands <openhands@all-hands.dev>855423e
-
Update UI: All-Hands-AI color scheme, agent version column names, and OpenHands logo
openhands +1: openhands- Apply All-Hands-AI color scheme (yellow accent, indigo links, beige background) - Change 'Agent' column to 'Agent Version' - Remove 'Submitter' column - Change 'Models Used' to 'Model' - Update mock data with version numbers (1.0.2, 1.0.1, etc.) - Replace logo with OpenHands branding Co-authored-by: openhands <openhands@all-hands.dev>0ee2099 -
Update category structure to OpenHands Index with 5 categories
openhands +1: openhands- Replace ASTA Bench scientific categories with OpenHands software engineering categories: - Bug Fixing (SWE-Bench, SWE-Bench-Multimodal) - App Creation (Commit0) - Frontend Development (Multi-SWE-Bench) - Test Generation (SWT-Bench) - Information Gathering (GAIA) - Update content.py category descriptions for coding agents - Update app.py routes to use new category pages - Add 5 new category page files - Update category_page_builder.py diagram mappings - Change 'four' to 'five' categories in intro - Change 'scientific agents' to 'coding agents' Co-authored-by: openhands <openhands@all-hands.dev>c56f232 -
Update categories to 5 software engineering domains
openhands +1: openhandsCategories: - Bug Fixing: SWE-Bench, SWE-Bench-Multimodal - App Creation: Commit0 - Frontend Development: Multi-SWE-Bench - Test Generation: SWT-Bench - Information Gathering: GAIA Changes: - Updated agenteval.json with new category tags - Rewrote category descriptions in content.py for coding agents - Updated intro paragraph (4 → 5 categories, scientific → coding agents) - Added URLs for each benchmark Co-authored-by: openhands <openhands@all-hands.dev>0db3899 -
Replace all AstaBench references with OpenHands Index
openhands- Updated branding across all files (about.py, content.py, etc.) - Rewrote about.py to focus on software engineering benchmarks - Updated descriptions to reflect OpenHands' focus on coding agents - Maintained original design and layout structure7904c2d -
Initial OpenHands Index leaderboard based on ASTA Bench
openhands +1: openhands- Updated branding (title, README, logo) - Changed dataset references to OpenHands Index datasets - Modified agenteval.json to include 6 OpenHands datasets: * swe-bench * multi-swe-bench * swe-bench-multimodal * swt-bench * commit0 * gaia - Added mock data for initial testing Co-authored-by: openhands <openhands@all-hands.dev>085a012