README / README.md
zhihuauk's picture
Update README.md
6c4e901 verified
|
Raw History Blame Contribute Delete
798 Bytes

VeloInfer

VeloInfer is building fast, reliable, and cost-efficient inference infrastructure for open-source AI models.

What we focus on

  • Low-latency and high-throughput LLM inference
  • OpenAI-compatible APIs
  • Streaming chat completions
  • GPU inference optimization
  • Model routing and scalable serving
  • Simple and transparent usage-based pricing

Hugging Face integration

We are preparing VeloInfer for integration with Hugging Face Inference Providers.

Our public API endpoints, supported model catalog, pricing, benchmarks, and documentation will be published after staging validation is complete.

Links

Status

Infrastructure and provider integration are currently under development.