Spaces:
Running
Running
Commit History
-
Sync main_page.py from kosmonautical/openhands-index-paul
Verified signature6252817
-
Hide incomplete entries from home page charts by default
openhands0b126a8
-
Connect 'Mark systems by' selector to Evolution and Size charts
openhands +1: openhands- Update visualizations.py to import get_marker_icon and MARK_BY_DEFAULT - Add mark_by parameter to create_evolution_over_time_chart() - Add mark_by parameter to create_accuracy_by_size_chart() - Update main_page.py to connect mark_by_dropdown to all charts - Evolution and Size charts now update when mark_by selection changes Co-authored-by: openhands <openhands@all-hands.dev>d731ad4 -
Add 'Mark systems by' selector for scatter plot icons (Company/Openness/Country)
openhands +1: openhands- Add MARK_BY_CHOICES and MARK_BY_DEFAULT constants - Add country flag SVGs (US, China, France) - Add COUNTRY_FLAG_MAP and MODEL_COUNTRY_MAP for country detection - Add get_openness_icon() and get_country_from_model() functions - Add get_marker_icon() to select appropriate icon based on mark_by setting - Modify _plot_scatter_plotly() to accept mark_by parameter - Add mark_by_dropdown to UI in ui_components.py - Update update_display() to regenerate plots dynamically based on mark_by selection Co-authored-by: openhands <openhands@all-hands.dev>ed6e90d -
Fix logo glow and change Size chart to use total parameters
openhandsLogo glow fix: - Changed from URI fragment (#openhands-logo) to MIME parameter (openhands=logo) - MIME parameters are more reliably preserved in attribute selectors - Updated CSS selectors to match the new pattern Size chart fix: - Changed x-axis from active parameters to total parameters - Updated axis title to 'Parameters (Billions)' - Simplified hover text to show just 'Parameters' instead of 'Total/Active'4b2f07d -
Connect 'Show only open models' checkbox to Winners and Evolution sections
openhands- Modified create_leaderboard_display to return show_open_only_checkbox - Updated main_page.py to connect checkbox to Winners by Category and Evolution charts - Pre-generate both all and open-only versions of Winners HTML and Evolution plot - When checkbox is toggled, both sections now update to show only open models49f9739 -
Update 'Open Model Accuracy by Size' plot to match Cost/Performance style
openhands- Add Pareto efficiency frontier line (dashed yellow) - Use uniform logo sizes instead of parameter-based scaling - Show model name labels only for frontier points - Remove 'logo size indicates parameter count' annotation - Update description text to remove marker size reference3ad0e27
-
Add Winners by Category section to main page
openhands +1: openhands- Implemented new 'Winners by Category' section displaying top 5 systems for each benchmark category - Added functions get_winners_by_category() and create_winners_by_category_html() to ui_components.py - Created responsive grid layout with category cards showing: - Category icon and name header - Ranked table with medal emojis (🥇🥈🥉) for top 3 - Company logos for model providers - SDK version and model name - Category score - Added comprehensive CSS styles in content.py: - Light and dark mode support - Responsive grid for mobile devices - Hover effects for cards - Consistent styling with existing design system - Section placed directly after main leaderboard results Co-authored-by: openhands <openhands@all-hands.dev>c14a283 -
Add Evolution Over Time and Open Model Accuracy by Size visualizations
openhands +1: openhands- Add visualizations.py with two new chart functions: - create_evolution_over_time_chart: Line chart showing model performance evolution over release dates - create_accuracy_by_size_chart: Scatter plot showing accuracy vs parameter count for open-weights models - Update simple_data_loader.py to load new metadata fields (release_date, parameter_count_b, active_parameter_count_b) - Update main_page.py to display the new visualizations below the leaderboard - Update mock data with release dates and add sample open-weights models with parameter counts These visualizations will display data once the openhands-index-results PR with release_date and parameter_count fields is merged. Co-authored-by: openhands <openhands@all-hands.dev>a4b9436
-
UI cleanup and About page updates
openhands +1: openhands1. Removed legend box from graph (OpenHands/Pareto/Company Logos) 2. Combined Pareto, lock, and company logo columns into Language Model column 3. Removed dataset structure SVG image from main page 4. Updated Acknowledgements section - shortened AstaBench credit, added links to component benchmarks 5. Updated Citation to be for OpenHands Index with authors: Juan Michelini, Simon Rosenberg, Xingyao Wang, Graham Neubig Co-authored-by: openhands <openhands@all-hands.dev>6737ff3
-
Remove Test Set/Validation Set tabs, keep single results view
openhands +1: openhandsSimplified the UI by removing the dual tab structure (Test Set / Validation Set) and keeping only a single results display using the test set data. Co-authored-by: openhands <openhands@all-hands.dev>b8aea20
-
Replace all AstaBench references with OpenHands Index
openhands- Updated branding across all files (about.py, content.py, etc.) - Rewrote about.py to focus on software engineering benchmarks - Updated descriptions to reflect OpenHands' focus on coding agents - Maintained original design and layout structure7904c2d -
Revert homepage simplification - keep original design
openhands742f074 -
Optimize app loading: simplify home page to avoid expensive data loading at startup
openhandsbecc391 -
Initial OpenHands Index leaderboard based on ASTA Bench
openhands +1: openhands- Updated branding (title, README, logo) - Changed dataset references to OpenHands Index datasets - Modified agenteval.json to include 6 OpenHands datasets: * swe-bench * multi-swe-bench * swe-bench-multimodal * swt-bench * commit0 * gaia - Added mock data for initial testing Co-authored-by: openhands <openhands@all-hands.dev>085a012