llama-cpp / README.md
oki602960's picture
Update README.md
d3fff78 verified
|
Raw
History Blame Contribute Delete
867 Bytes
metadata
title: llama.cpp
emoji: 🐑
colorFrom: red
colorTo: red
sdk: docker
pinned: false

Bielik-7B-Instruct OpenAI Compatible API

This Space provides an OpenAI-compatible API for the Bielik-7B-Instruct-v0.1 model using llama-cpp-python.

API Endpoint

The OpenAI compatible endpoint is available at: https://oki602960-bielik-api.hf.space/v1

Usage Example

You can use it with the OpenAI Python client:

from openai import OpenAI

client = OpenAI(
    base_url="https://oki602960-bielik-api.hf.space/v1",
    api_key="sk-no-key-required"
)

response = client.chat.completions.create(
    model="bielik",
    messages=[{"role": "user", "content": "Cześć, jak się masz?"}]
)

print(response.choices[0].message.content)

Model Information

  • Model: Bielik-7B-Instruct-v0.1
  • Format: GGUF (Q2_K)
  • Engine: llama-cpp-python