README.md

metadata

title: Varsh LLM
emoji: 🤗
colorFrom: blue
colorTo: indigo
sdk: docker
app_port: 7860
pinned: false
license: apache-2.0
short_description: Qwen 2.5 Coder 7B API

Varsh LLM

Secure OpenAI-compatible API powered by Qwen 2.5 Coder 7B GGUF and llama.cpp.

API

POST /v1/chat/completions

Authentication:

Authorization: Bearer <varsshancoder>