llama-cpp / README.md
oki602960's picture
Update README.md
d3fff78 verified
|
Raw
History Blame Contribute Delete
867 Bytes
---
title: llama.cpp
emoji: 🐑
colorFrom: red
colorTo: red
sdk: docker
pinned: false
---
# Bielik-7B-Instruct OpenAI Compatible API
This Space provides an OpenAI-compatible API for the **Bielik-7B-Instruct-v0.1** model using `llama-cpp-python`.
## API Endpoint
The OpenAI compatible endpoint is available at:
`https://oki602960-bielik-api.hf.space/v1`
## Usage Example
You can use it with the OpenAI Python client:
```python
from openai import OpenAI
client = OpenAI(
base_url="https://oki602960-bielik-api.hf.space/v1",
api_key="sk-no-key-required"
)
response = client.chat.completions.create(
model="bielik",
messages=[{"role": "user", "content": "Cześć, jak się masz?"}]
)
print(response.choices[0].message.content)
```
## Model Information
- **Model**: Bielik-7B-Instruct-v0.1
- **Format**: GGUF (Q2_K)
- **Engine**: llama-cpp-python