Commit History
-
Show ACP agent results in the leaderboard (#11)
- Show ACP agent results in the leaderboard (bef7adee8f9654453b27b8d6be41b13e49431cbc) - Move alternative agents to a dedicated page (d7034b85ee14f6dc4445cc0379396ca6dd77c19d) - Show harness in scatter-plot hover on Alternative Agents page (f00a617b2ae09d13284067736bcd5479d30f26ed) - Add Alternative Agents page screenshot (55dc87fa37ef618d4a372d48ef29fd887951a7b6) - Add harness logo assets for Alternative Agents composite markers (6860223b90f3ee4aca8a66e95f57e3fc523a3a54) - Stack model + harness logos on Alternative Agents scatter (fb16d57ae9b3b8e401e09be3af5617febb4a0528) - Replace harness badge letters with generic pictograms (8a1c0edd35eff9780aa5ba987941514c278821f3) - Move harness logos to assets/harnesses/ with graceful missing-file fallback (282557d8a4eb676f672d6d36bf7f25ffb522140d) - Add harness logos for Claude Code, Codex CLI, Gemini CLI, OpenHands (e6877f36e0135f17611518da4254aeb3730482a3) Co-authored-by: Simon Rosenberg <simonrosenberg1@users.noreply.huggingface.co>6d3b657
-
Reduce cache TTL from 1 hour to 15 minutes for faster data refresh
openhands +1: openhandsCo-authored-by: openhands <openhands@all-hands.dev>da96293
-
Add periodic cache refresh for leaderboard data
openhands- Add background refresh scheduler that checks for new data every hour - Implement thread-safe caching with configurable TTL (CACHE_TTL_SECONDS env var) - Register cache clear callback to invalidate viewer cache when data refreshes - Add refresh_data_if_needed() function for on-demand refresh - Data is fetched from GitHub repo and cached, then periodically refreshed This ensures the leaderboard shows fresh data while maintaining good performance through caching.6bddf26
-
feat: Use pydantic schema models from openhands-index-results for validation
openhands +1: openhands- Keep full repo clone instead of just results/ directory - Import Metadata and ScoreEntry models from validate_schema.py - Validate agent data during loading with graceful fallback - Log validation errors to surface data quality issues This ensures data is validated against the same schema used by the results repo, catching invalid entries early. Co-authored-by: openhands <openhands@all-hands.dev>f0339f3
-
Add debug logging to track data loading on HuggingFace Space
openhands +1: openhands- Add data integrity check in setup_data.py - Add sample data logging in simple_data_loader.py - This will help identify where the zero scores are coming from Co-authored-by: openhands <openhands@all-hands.dev>044cdf4 -
Cleanup codebase: remove unused code, simplify data loading, and add pre-release notice
openhands +1: openhands- Remove unused github_data_loader.py (71 lines of dead code) - Clean up debug logging in app.py (replaced ~40 print statements with proper logger) - Remove scheduler code and APScheduler dependency from requirements.txt - Simplify simple_data_loader.py by removing old JSONL format fallback - Update setup_data.py to fetch data from results/ directory only - Update mock data to use new agent-centric directory structure - Add pre-release notice to main page intro paragraph Co-authored-by: openhands <openhands@all-hands.dev>855423e
-
Remove signal-based timeout (incompatible with HF Spaces)
openhands- signal.SIGALRM not available/working in HF Spaces environment - Rely on subprocess timeouts which work correctly - Add try-except blocks around data fetch/copy for better error handling - Simplify setup_mock_data() implementation9da8453 -
Add comprehensive error handling and timeout protection
openhands- Wrap setup_mock_data() in try-except in app.py to prevent crashes - Add 60-second timeout to data setup using signal.alarm() - Add verbose logging to stderr for debugging HF Space issues - Change logging level to INFO for better visibility - Print clear status messages at each step - Ensures app continues even if data setup fails87e9f6b -
Fix git clone hanging issue - prevent credential prompts
openhands- Add GIT_TERMINAL_PROMPT=0 to prevent git from prompting for credentials - Add stdin=subprocess.DEVNULL to block any input requests - Reduce timeout from 60s to 30s for faster failover - This fixes the app hanging on 'Loading...' when GitHub repo is empty671ebc9 -
Add enhanced debugging output for data setup
openhands- Add verbose logging to track data loading process - Try both relative and absolute paths for mock data - Display current working directory and file listings - Show which data source is being used (GitHub or mock) - Verify copied files after setup2176460 -
Fix data loading: fetch from GitHub with fallback to mock data
openhands- Add setup_data.py to fetch data from openhands-index-results GitHub repo - Falls back to mock data when GitHub repo is empty/unavailable - Copy data to expected extraction directory on app startup - Fixes JavaScript error: Cannot read properties of null - Data now loads correctly and tables render properlya63b4cf