FreeLLMAPI / README.md
MD Mahadi
Deploy OmniRoute gateway on Hugging Face Docker Space with dataset persistence
c7ba288
|
Raw History Blame Contribute Delete
1.34 kB
---
title: OmniRoute
emoji: 🔀
colorFrom: blue
colorTo: indigo
sdk: docker
app_port: 7860
pinned: false
---
# OmniRoute on Hugging Face Spaces
OmniRoute is an open-source, production-grade AI gateway and intelligent multi-provider router with unified OpenAI-compatible endpoints, latency optimization, and automated failover.
## Deployment Specifications
- **App & API Port**: `7860` (standard Hugging Face Docker port)
- **Persistent Data Directory**: `/data` (SQLite database, configuration, and API keys)
- **Cloud State Synchronization**: Automatically linked to dataset repository `userbymahadi/OmniRoute-storage`
- **Upstream Repository**: [cheaper-inference/OmniRoute](https://github.com/cheaper-inference/OmniRoute)
- **Official Docker Guide**: [OmniRoute DOCKER_GUIDE.md](https://github.com/cheaper-inference/OmniRoute/blob/release/v3.8.53/docs/guides/DOCKER_GUIDE.md)
## Persistence Architecture
1. **Hugging Face Hardware Persistent Storage**: If persistent storage is enabled in Space settings, `/data` is backed by dedicated volume storage.
2. **Dataset Synchronization Daemon**: When `HF_TOKEN` is configured as a Secret, the container synchronizes all state (`storage.sqlite`, `server.env`) to the private dataset `userbymahadi/OmniRoute-storage` at startup, every 5 minutes during runtime, and upon graceful shutdown.