Instructions to use SZLHOLDINGS/chaski with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use SZLHOLDINGS/chaski with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="SZLHOLDINGS/chaski")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("SZLHOLDINGS/chaski")
model = AutoModelForMultimodalLM.from_pretrained("SZLHOLDINGS/chaski", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=256)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use SZLHOLDINGS/chaski with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "SZLHOLDINGS/chaski"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SZLHOLDINGS/chaski",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/SZLHOLDINGS/chaski

SGLang

How to use SZLHOLDINGS/chaski with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "SZLHOLDINGS/chaski" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SZLHOLDINGS/chaski",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "SZLHOLDINGS/chaski" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SZLHOLDINGS/chaski",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use SZLHOLDINGS/chaski with Docker Model Runner:
```
docker model run hf.co/SZLHOLDINGS/chaski
```

chaski / README.md

Commit History

Oct 13 15 days ago

16:03
docs: publish Chaski card from szl-forge@cd66836ac2df83ecbebb101d40047a63ad3de463⁠

betterwithage

Verified signature
8bae866

Oct 4 24 days ago

18:31
docs: publish Chaski card from szl-forge@5daef16de6e0cfb55daf0ff86ba3281bac1fc821⁠

betterwithage

Verified signature
f4c8ca2

Oct 1 27 days ago

00:27
docs: publish Chaski card from szl-forge@e0a3d38de603148d13a3969a153235f066616a35⁠

betterwithage

Verified signature
e6f9a52

Sep 30 28 days ago

21:32
docs: publish Chaski card from szl-forge@72544fd0be1c8a312660c57d8460648c87df2d47⁠

betterwithage

Verified signature
70a125a

Sep 28 30 days ago

21:01
docs: publish Chaski card from szl-forge@a2480040b37e0ee2cc036eda175ccd096aefb93f⁠

betterwithage

Verified signature
d43654f
17:01
docs(card): estate audit 2026-09-25 — honest labels, dead links, metadata (#1)⁠

betterwithage

292ebdd

Sep 11

23:42
honesty: stamp NON-RELEASE / RESEARCH banner

betterwithage

Verified signature
d2790fc

Sep 6

11:54
docs: publish Chaski card from szl-forge@620f68b318a1757d8735f6a4d09cd1f42d68a136⁠

betterwithage

Verified signature
705a1c5

Sep 5

01:12
docs: publish Chaski card from szl-forge@c36ded6210296b1e943bb5eb368cde144ae7087a⁠

betterwithage

Verified signature
b39877c

Sep 4

17:25
honesty: stamp NON-RELEASE / RESEARCH banner

betterwithage

Verified signature
1de1588

Aug 30

23:29
fix: this is a merged finetune, not an adapter — plus unambiguous loading guidance⁠

betterwithage

Verified signature
a2adbec

Aug 29

04:27
atelier: one-of-one card — cut, silhouette, GitHub Python. YAML preserved.

betterwithage

Verified signature
50b4514

Aug 28

23:04
card: estate-banner-v2 + KANCHAY chips; KEEP Named-N fail; GPU UNAVAILABLE

betterwithage

Verified signature
6f021ec
19:01
card: Named-N method/N/date/file per INTI; still MEASURED fail not a pass

betterwithage

Verified signature
cca047a
19:00
card: hash eval_report.json; Named-N MEASURED 0/5 and 2/6, not a pass

betterwithage

Verified signature
d406eef
18:58
card: Named-N SNAPSHOT MEASURED fail on 1c55df8, not inherited by A11OY-MINI

betterwithage

Verified signature
9943a51
17:22
docs: drop roadmap tag; first sentence adapters+evals none-this-run; tensors untouched

betterwithage

Verified signature
1c55df8
17:15
docs: drop stray ROADMAP. line after YAML; tensors untouched

betterwithage

Verified signature
f8eb66d
17:13
docs(card): INTI copy contract — ROADMAP. first sentence (keep Messenger LLM one-line)

betterwithage

Verified signature
418c5a5
17:11
docs: restore Series A card; tensors AVAILABLE; evals ROADMAP; job 6a91bf10 COMPLETED

betterwithage

Verified signature
c7e8368
17:11
docs: attempt 5 COMPLETED, weights AVAILABLE, evals ROADMAP none-this-run

betterwithage

Verified signature
552517c
17:10
docs(card): INTI copy contract — ROADMAP. first sentence + roadmap tag

betterwithage

Verified signature
d31929e
17:08
docs(card): MEASURED attempt4 ERROR but adapters+merged on Hub

betterwithage

Verified signature
e3bcf6f
17:06
feat(adapter): Unsloth QLoRA Chaski Qwen3.5-0.8B (receiptagent pattern)

betterwithage

Verified signature
e3f2384
17:06
Training in progress, step 64

betterwithage

Verified signature
152ad88
17:02
docs: attempt 5 RUNNING 6a91bf10; attempt 4 ERROR after train, Trackio 404 ate upload

betterwithage

Verified signature
c7e4638
16:51
docs: add job_retry 6a91bb7c next to job_id

betterwithage

Verified signature
41da001
16:49
docs: jobs RUNNING attempt 4 6a91bb7c; attempt 3 completed no weights

betterwithage

Verified signature
542671b
16:49
docs: attempt 3 COMPLETED, weights UNAVAILABLE, attempt 4 upload_folder RUNNING

betterwithage

Verified signature
55f5aef
16:45
Attempt 3 RUNNING 6a91ba00; prior two FAILED; no lab load

betterwithage

Verified signature
dea7361
16:44
Recut: 6a91b8ba FAILED CastError; retry 6a91b990 jsonl-only; no lab load

betterwithage

Verified signature
fc8efac
16:43
docs: job id is 6a91ba00 RUNNING; 6a91b8ba and 6a91b990 MEASURED failed; keep CUTTING

betterwithage

Verified signature
72fb4f5
16:41
Remove Khipu MEASURED pin from Chaski; Jobs RUNNING only

betterwithage

Verified signature
bef153f
16:39
Jobs RUNNING 6a91b8ba under SZLHOLDINGS, still no weights

betterwithage

Verified signature
5be5fac
16:35
Series A: demo lab pin, Chaski still ROADMAP, base Qwen3.5-0.8B

betterwithage

Verified signature
a97b700
16:35
docs: pin base_model Qwen/Qwen3.5-0.8B (Apache license lock)

betterwithage

Verified signature
0698406
16:27
docs(card): Series A Chaski messenger LLM — Fall 2026 Original Cuts, ROADMAP

betterwithage

Verified signature
235d8e9

Commit History

Oct 13 15 days ago

docs: publish Chaski card from szl-forge@cd66836ac2df83ecbebb101d40047a63ad3de463⁠

Oct 4 24 days ago

docs: publish Chaski card from szl-forge@5daef16de6e0cfb55daf0ff86ba3281bac1fc821⁠

Oct 1 27 days ago

docs: publish Chaski card from szl-forge@e0a3d38de603148d13a3969a153235f066616a35⁠

Sep 30 28 days ago

docs: publish Chaski card from szl-forge@72544fd0be1c8a312660c57d8460648c87df2d47⁠

Sep 28 30 days ago

docs: publish Chaski card from szl-forge@a2480040b37e0ee2cc036eda175ccd096aefb93f⁠

docs(card): estate audit 2026-09-25 — honest labels, dead links, metadata (#1)⁠

Sep 11

honesty: stamp NON-RELEASE / RESEARCH banner

Sep 6

docs: publish Chaski card from szl-forge@620f68b318a1757d8735f6a4d09cd1f42d68a136⁠

Sep 5

docs: publish Chaski card from szl-forge@c36ded6210296b1e943bb5eb368cde144ae7087a⁠

Sep 4

honesty: stamp NON-RELEASE / RESEARCH banner

Aug 30

fix: this is a merged finetune, not an adapter — plus unambiguous loading guidance⁠

Aug 29

atelier: one-of-one card — cut, silhouette, GitHub Python. YAML preserved.

Aug 28

card: estate-banner-v2 + KANCHAY chips; KEEP Named-N fail; GPU UNAVAILABLE

card: Named-N method/N/date/file per INTI; still MEASURED fail not a pass

card: hash eval_report.json; Named-N MEASURED 0/5 and 2/6, not a pass

card: Named-N SNAPSHOT MEASURED fail on 1c55df8, not inherited by A11OY-MINI

docs: drop roadmap tag; first sentence adapters+evals none-this-run; tensors untouched

docs: drop stray ROADMAP. line after YAML; tensors untouched

docs(card): INTI copy contract — ROADMAP. first sentence (keep Messenger LLM one-line)

docs: restore Series A card; tensors AVAILABLE; evals ROADMAP; job 6a91bf10 COMPLETED

docs: attempt 5 COMPLETED, weights AVAILABLE, evals ROADMAP none-this-run

docs(card): INTI copy contract — ROADMAP. first sentence + roadmap tag

docs(card): MEASURED attempt4 ERROR but adapters+merged on Hub

feat(adapter): Unsloth QLoRA Chaski Qwen3.5-0.8B (receiptagent pattern)

Training in progress, step 64

docs: attempt 5 RUNNING 6a91bf10; attempt 4 ERROR after train, Trackio 404 ate upload

docs: add job_retry 6a91bb7c next to job_id

docs: jobs RUNNING attempt 4 6a91bb7c; attempt 3 completed no weights

docs: attempt 3 COMPLETED, weights UNAVAILABLE, attempt 4 upload_folder RUNNING

Attempt 3 RUNNING 6a91ba00; prior two FAILED; no lab load

Recut: 6a91b8ba FAILED CastError; retry 6a91b990 jsonl-only; no lab load

docs: job id is 6a91ba00 RUNNING; 6a91b8ba and 6a91b990 MEASURED failed; keep CUTTING

Remove Khipu MEASURED pin from Chaski; Jobs RUNNING only

Jobs RUNNING 6a91b8ba under SZLHOLDINGS, still no weights

Series A: demo lab pin, Chaski still ROADMAP, base Qwen3.5-0.8B

docs: pin base_model Qwen/Qwen3.5-0.8B (Apache license lock)

docs(card): Series A Chaski messenger LLM — Fall 2026 Original Cuts, ROADMAP