Spaces:
Running
Running
Commit History
-
Add free Zen models: big-pickle, ring-2.6-1t-free, nemotron-3-super-free
Only free tier models that are Claude Code capable per opencode.ai Zen API. Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>04fcbd7 -
Speed up NIM provider with failure tracking and faster timeouts
- Add ModelHealthTracker for per-model failure tracking (30s TTL) - Faster timeouts: connect=10s, first_chunk=30s, fallback=20s - Auto model pre-checks health before attempting requests - Record failures on timeout/rate-limit for smart fallback - Skip unhealthy models in both router and services Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>a5ea640
-
Speed optimizations and enhanced auto-model fallback routing
- Connection pool tuning: increased max_connections (100→200), max_keepalive (20→50), reduced keepalive_expiry (30s→15s) - NIM concurrency: increased max_concurrency for better throughput - Faster timeouts: connect (30→15s), first_chunk (60→45s), fallback (60→30s) - Retry backoff: reduced base_delay (1→0.5s), max_delay (60→30s) - New trivial request fast-path for hi/ok/status checks - Auto model now routes to all 7 NIM models by default - Pre-flight rate limit check before trying each candidate - Timeout/transient errors trigger automatic fallback to next model - Import cleanup for httpx/asyncio at module level Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>ebba9d6 -
Performance optimizations for faster proxy routing
- Remove cleanup from hot path in session tracking - Skip _cleanup_old_sessions on every track_request call - Add track_request_async for contexts needing async guarantees - Add provider warmup on startup to eliminate cold-start penalty - Pre-establish HTTP connections before first request Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>49813da -
Display admin dashboard on root page
- Root "/" now shows admin dashboard instead of JSON - Uses same template as /admin endpoint - Auto-refresh every 10 seconds Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>1985e64 -
Track sessions by gateway client IP
- Add _get_client_ip() to detect gateway/proxy requests - Track sessions only when X-Forwarded-For, X-Real-IP, X-Client-IP, or Via headers present - Each unique client IP behind a gateway = one session - Direct connections are not tracked Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>f56589d -
Fix: use sync version of track_request to avoid SyntaxError
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>b5bd2a8 -
Fix: sessions tracking now works correctly in dashboard and JSON
- Added `track_request` calls in services.py for both single-model and fallback paths - Sessions now show in `/admin` and `/api/admin/sessions` - Added `/` root endpoint to show active sessions count Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>ef123a8 -
Add admin dashboard for session monitoring
- Create api/admin.py with /admin and /api/admin/sessions endpoints - Add Bootstrap-styled templates/admin.html dashboard - Auto-refresh every 10 seconds for real-time monitoring - Shows session info, provider load, and summary stats Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>f3220aa -
Add smart task-aware routing (Phase 1)
- core/model_capabilities.py: Model capability registry - core/task_detector.py: Detect task requirements from requests - core/chain_engine.py: Multi-model pipeline engine (placeholder) - api/model_router.py: Add resolve_with_task_awareness method Now 'auto' model can detect coding/reasoning and route to best model.4974012 -
Performance optimizations for proxy speed and shared sessions
- Per-provider rate limiting: Zen gets unlimited, NVIDIA NIM gets 40/min - Higher Zen concurrency: 4x max_concurrency for fast minimax model - Connection pool tuning: Keepalive connections for faster reuse - Session tracker: Fair resource sharing across Claude Code instances - Smart auto-routing: Prioritize Zen (no limits), then by load Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>cc3287d -
Remove groq/cerebras, add zen model
d6a1875 -
Deploy claude-code-nvidia proxy to Hugging Face Spaces
Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>0157ac7