Spaces:
Sleeping
Sleeping
Commit History
-
Add V2 API with HuggingFace streaming support
ming- Add V2 API endpoints with HuggingFace TextIteratorStreamer - Implement real-time token-by-token streaming via SSE - Add configurable HuggingFace model support (default: Phi-3-mini-4k-instruct) - Maintain V1 API compatibility - Android app only needs to change /api/v1/ to /api/v2/ - Add conditional warmup (V1 disabled, V2 enabled by default) - Add comprehensive tests for V2 API and HF streaming service - Update README with V2 documentation and Android client examples - Add accelerate package for better device mapping - All 116 tests pass (97 original + 19 new V2 tests)0b6e76d