Spaces:
Sleeping
Sleeping
Commit History
-
restore: return InferRoute Space to 100% pure original LLM gateway
7d479ad -
fix: upgrade Node.js base image to 20-alpine for Vite 8 compatibility
74fc8d0 -
feat: optimize Hugging Face Space Docker build and zero-config deployment
f307930
-
Fix Render deployment dependencies for Quant.ai and InferRoute
ce339c7 -
feat: platform ecosystem showcase and UI upgrade
fa81843
-
feat: add interactive academic documentation hub and Docker deployment config
aa2fa98
-
feat: Kubernetes-ready multi-provider LLM gateway v0.2.0
- Add Google Gemini adapter (gemini-1.5-flash/pro) with real SDK + mock mode - Add local Ollama adapter (llama3/mistral) via httpx /api/chat - Add Redis-backed circuit breaker (CLOSED/OPEN/HALF_OPEN state machine) - Upgrade router: SLO-aware (p50/p95/p99), sliding window percentiles, 4 backends - Upgrade cache: prefix-aware LRU + request deduplication via Redis pub/sub - Expand DB schema: provider, slo_met, dedup_hit, prefix_cache_hit, circuit_state - Add new metrics: SLO violations, CB state/trips, dedup hits, prefix cache hits - Add /v1/providers and /v1/routing/status endpoints - Add Dockerfile (multi-stage, non-root) and updated docker-compose.yml - Add 9 Kubernetes manifests (namespace/configmap/secret/deployment/service/hpa/redis/postgres/ingress) - Add circuit breaker unit tests (8 scenarios) - Add cache unit tests (8 scenarios) - Add SLO router unit tests (9 scenarios) - Add Gemini/Ollama adapter mock tests - Add Locust load test (4 user classes: Normal/Burst/Cost/Chaos) - Add …8a841b2