Instructions to use ecloudtech/Erk-32B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use ecloudtech/Erk-32B with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="ecloudtech/Erk-32B")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("ecloudtech/Erk-32B")
model = AutoModelForCausalLM.from_pretrained("ecloudtech/Erk-32B", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use ecloudtech/Erk-32B with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "ecloudtech/Erk-32B"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/ecloudtech/Erk-32B

SGLang

How to use ecloudtech/Erk-32B with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "ecloudtech/Erk-32B" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "ecloudtech/Erk-32B" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "ecloudtech/Erk-32B",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use ecloudtech/Erk-32B with Docker Model Runner:
```
docker model run hf.co/ecloudtech/Erk-32B
```

Erk-32B

File size: 1,630 Bytes

9c90564

Erk-32B
Copyright (c) 2026 eCloud Yazılım Teknolojileri (eCloud Tech.)

This model is a derivative work of Qwen3-32B
(https://huggingface.co/Qwen/Qwen3-32B), Copyright (c) Alibaba Cloud,
licensed under the Apache License, Version 2.0. The base model's architecture,
tokenizer and chat format are unchanged; eCloud Tech. modified the weights by
continued pretraining on Turkish text (1.05B tokens, LoRA r=256), Turkish
instruction tuning (423M tokens) and an additional instruction round, then
merged the adapter at scale 0.75 and added a default identity system prompt to
the chat template. Details: OLCUM-PROTOKOLU.md.

Erk-32B is distributed under the Apache License, Version 2.0 (see LICENSE).

"Erk" and "eCloud Tech." are names and marks of eCloud Yazılım Teknolojileri.
This license does not grant permission to use them to endorse or promote
derived products without prior written permission, except as required for
reasonable and customary attribution.

--------------------------------------------------------------------------
Erk-32B
Telif (c) 2026 eCloud Yazılım Teknolojileri (eCloud Tech.)

Bu model, Apache Lisansı 2.0 ile dağıtılan Qwen3-32B'nin (Alibaba Cloud)
türev çalışmasıdır. Mimari, tokenizer ve sohbet biçimi tabandan gelir;
eCloud Tech. ağırlıkları Türkçe devam-eğitimi, talimat ayarı ve ek turla
değiştirmiş, adaptörü 0,75 ölçeğiyle birleştirmiş ve sohbet şablonuna
varsayılan kimlik istemi eklemiştir. Erk-32B, Apache Lisansı 2.0 ile dağıtılır.
"Erk" ve "eCloud Tech." adları eCloud Yazılım Teknolojileri'ne aittir; bu
lisans marka kullanım hakkı vermez.