File size: 798 Bytes
6c4e901 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 | # VeloInfer
VeloInfer is building fast, reliable, and cost-efficient inference infrastructure for open-source AI models.
## What we focus on
- Low-latency and high-throughput LLM inference
- OpenAI-compatible APIs
- Streaming chat completions
- GPU inference optimization
- Model routing and scalable serving
- Simple and transparent usage-based pricing
## Hugging Face integration
We are preparing VeloInfer for integration with Hugging Face Inference Providers.
Our public API endpoints, supported model catalog, pricing, benchmarks, and documentation will be published after staging validation is complete.
## Links
- GitHub: https://github.com/Zhihuauk
- Hugging Face: https://huggingface.co/VeloInfer
## Status
Infrastructure and provider integration are currently under development. |