Spaces:
Paused
Paused
|
Download README.md from immahadi/FreeLLMAPI: direct link, hf CLI and curl.
- Browser
- Download file 1.34 kB
-
https://huggingface.co/spaces/immahadi/FreeLLMAPI/resolve/main/README.md
- Command line
-
hf download hf://spaces/immahadi/FreeLLMAPI/README.md
-
curl -L -o README.md https://huggingface.co/spaces/immahadi/FreeLLMAPI/resolve/main/README.md
1.34 kB
| title: OmniRoute | |
| emoji: 🔀 | |
| colorFrom: blue | |
| colorTo: indigo | |
| sdk: docker | |
| app_port: 7860 | |
| pinned: false | |
| # OmniRoute on Hugging Face Spaces | |
| OmniRoute is an open-source, production-grade AI gateway and intelligent multi-provider router with unified OpenAI-compatible endpoints, latency optimization, and automated failover. | |
| ## Deployment Specifications | |
| - **App & API Port**: `7860` (standard Hugging Face Docker port) | |
| - **Persistent Data Directory**: `/data` (SQLite database, configuration, and API keys) | |
| - **Cloud State Synchronization**: Automatically linked to dataset repository `userbymahadi/OmniRoute-storage` | |
| - **Upstream Repository**: [cheaper-inference/OmniRoute](https://github.com/cheaper-inference/OmniRoute) | |
| - **Official Docker Guide**: [OmniRoute DOCKER_GUIDE.md](https://github.com/cheaper-inference/OmniRoute/blob/release/v3.8.53/docs/guides/DOCKER_GUIDE.md) | |
| ## Persistence Architecture | |
| 1. **Hugging Face Hardware Persistent Storage**: If persistent storage is enabled in Space settings, `/data` is backed by dedicated volume storage. | |
| 2. **Dataset Synchronization Daemon**: When `HF_TOKEN` is configured as a Secret, the container synchronizes all state (`storage.sqlite`, `server.env`) to the private dataset `userbymahadi/OmniRoute-storage` at startup, every 5 minutes during runtime, and upon graceful shutdown. | |