FreeLLMAPI / README.md
MD Mahadi
Deploy OmniRoute gateway on Hugging Face Docker Space with dataset persistence
c7ba288
|
Raw History Blame Contribute Delete
1.34 kB
metadata
title: OmniRoute
emoji: 🔀
colorFrom: blue
colorTo: indigo
sdk: docker
app_port: 7860
pinned: false

OmniRoute on Hugging Face Spaces

OmniRoute is an open-source, production-grade AI gateway and intelligent multi-provider router with unified OpenAI-compatible endpoints, latency optimization, and automated failover.

Deployment Specifications

  • App & API Port: 7860 (standard Hugging Face Docker port)
  • Persistent Data Directory: /data (SQLite database, configuration, and API keys)
  • Cloud State Synchronization: Automatically linked to dataset repository userbymahadi/OmniRoute-storage
  • Upstream Repository: cheaper-inference/OmniRoute
  • Official Docker Guide: OmniRoute DOCKER_GUIDE.md

Persistence Architecture

  1. Hugging Face Hardware Persistent Storage: If persistent storage is enabled in Space settings, /data is backed by dedicated volume storage.
  2. Dataset Synchronization Daemon: When HF_TOKEN is configured as a Secret, the container synchronizes all state (storage.sqlite, server.env) to the private dataset userbymahadi/OmniRoute-storage at startup, every 5 minutes during runtime, and upon graceful shutdown.