Spaces:
Running
Running
Commit History
-
feat: Add open_weights to openness mapping
openhands +1: openhandsMaps the 'open_weights' value from openhands-index-results to the simplified 'open' display category. This ensures DeepSeek, Qwen, Kimi, and MiniMax models display correctly as open-source. Co-authored-by: openhands <openhands@all-hands.dev>55da48c
-
Simplify leaderboard to open vs closed models only
openhandsRemove agent tooling distinction from the leaderboard: - Simplified openness from 4 categories to 2: 'open' and 'closed' - Removed all 'tool_usage' references from data structures - Updated UI to remove Agent Tooling column and icons - Simplified scatter plots to use only 2 colors (open/closed) - Updated legends to show Model Openness instead of Agent Openness/Tooling - Regenerated mock data without tool_usage field - Added openness normalization to handle legacy values Files modified: - aliases.py: Simplified openness constants, removed tool usage - simple_data_loader.py: Added openness normalization, removed tool_usage loading - leaderboard_transformer.py: Removed Agent Tooling column, simplified color mapping - ui_components.py: Removed tooling icons/tooltips, simplified to openness only - generate_mock_jsonl.py: Removed tool_usage from mock data generationca754bb
-
Convert to JSONL data format and remove agent-eval dependency
openhands +1: openhands- Replace parquet files with JSONL for better readability and simplicity - Remove agent-eval library dependency to avoid secret requirements - Create simple_data_loader.py as lightweight replacement for LeaderboardViewer - Create submission_utils.py for submission handling functions - Simplify Dockerfile (no SSH keys or secrets needed) - Reduce requirements.txt to essential packages only - Generate mock data for all 6 benchmarks (swe-bench, multi-swe-bench, swe-bench-multimodal, swt-bench, commit0, gaia) - Update aliases.py to define constants locally - Fix imports in submission.py and test files Co-authored-by: openhands <openhands@all-hands.dev>1027cfb -
Initial OpenHands Index leaderboard based on ASTA Bench
openhands +1: openhands- Updated branding (title, README, logo) - Changed dataset references to OpenHands Index datasets - Modified agenteval.json to include 6 OpenHands datasets: * swe-bench * multi-swe-bench * swe-bench-multimodal * swt-bench * commit0 * gaia - Added mock data for initial testing Co-authored-by: openhands <openhands@all-hands.dev>085a012