Spaces:
Paused
Paused
|
Download README.md from immahadi/FreeLLMAPI: direct link, hf CLI and curl.
- Browser
- Download file 1.34 kB
-
https://huggingface.co/spaces/immahadi/FreeLLMAPI/resolve/main/README.md
- Command line
-
hf download hf://spaces/immahadi/FreeLLMAPI/README.md
-
curl -L -o README.md https://huggingface.co/spaces/immahadi/FreeLLMAPI/resolve/main/README.md
1.34 kB
metadata
title: OmniRoute
emoji: 🔀
colorFrom: blue
colorTo: indigo
sdk: docker
app_port: 7860
pinned: false
OmniRoute on Hugging Face Spaces
OmniRoute is an open-source, production-grade AI gateway and intelligent multi-provider router with unified OpenAI-compatible endpoints, latency optimization, and automated failover.
Deployment Specifications
- App & API Port:
7860(standard Hugging Face Docker port) - Persistent Data Directory:
/data(SQLite database, configuration, and API keys) - Cloud State Synchronization: Automatically linked to dataset repository
userbymahadi/OmniRoute-storage - Upstream Repository: cheaper-inference/OmniRoute
- Official Docker Guide: OmniRoute DOCKER_GUIDE.md
Persistence Architecture
- Hugging Face Hardware Persistent Storage: If persistent storage is enabled in Space settings,
/datais backed by dedicated volume storage. - Dataset Synchronization Daemon: When
HF_TOKENis configured as a Secret, the container synchronizes all state (storage.sqlite,server.env) to the private datasetuserbymahadi/OmniRoute-storageat startup, every 5 minutes during runtime, and upon graceful shutdown.