Text Generation
Transformers
Safetensors
English
qwen3_5
image-text-to-text
szl-holdings
doctrine-v11
governed-ai
proposal-only
research
conversational
Instructions to use SZLHOLDINGS/chaski with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SZLHOLDINGS/chaski with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SZLHOLDINGS/chaski") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("SZLHOLDINGS/chaski") model = AutoModelForMultimodalLM.from_pretrained("SZLHOLDINGS/chaski", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use SZLHOLDINGS/chaski with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SZLHOLDINGS/chaski" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/chaski", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/SZLHOLDINGS/chaski
- SGLang
How to use SZLHOLDINGS/chaski with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SZLHOLDINGS/chaski" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/chaski", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SZLHOLDINGS/chaski" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SZLHOLDINGS/chaski", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use SZLHOLDINGS/chaski with Docker Model Runner:
docker model run hf.co/SZLHOLDINGS/chaski
docs: publish Chaski card from szl-forge@620f68b318a1757d8735f6a4d09cd1f42d68a136
Browse filesExact-source Chaski card publication. Named-N remains a measured failed gate, publication_eligible and autonomy_eligible remain false, and no model or provider state is promoted. No weights, adapter, configs, evals, visibility, hardware, collection, or runtime state changed.
- README.md +67 -119
- szl-source-binding.json +3 -3
README.md
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
---
|
| 2 |
-
thumbnail: https://huggingface.co/SZLHOLDINGS/chaski/resolve/main/
|
| 3 |
license: apache-2.0
|
| 4 |
language:
|
| 5 |
- en
|
|
@@ -9,10 +9,10 @@ base_model: Qwen/Qwen3.5-0.8B
|
|
| 9 |
base_model_relation: finetune
|
| 10 |
tags:
|
| 11 |
- szl-holdings
|
| 12 |
-
- series-a
|
| 13 |
- doctrine-v11
|
| 14 |
- governed-ai
|
| 15 |
- proposal-only
|
|
|
|
| 16 |
szl:
|
| 17 |
doctrine: v11-LOCKED
|
| 18 |
lean: 749/14/163
|
|
@@ -20,10 +20,6 @@ szl:
|
|
| 20 |
evidence_ceiling: 0.97
|
| 21 |
artifact_class: MERGED_FINETUNE
|
| 22 |
originality: FINETUNE_DISCLOSED_BASE
|
| 23 |
-
collection: SZL Fall 2026 — Original Cuts
|
| 24 |
-
jobs: COMPLETED
|
| 25 |
-
job_id: 6a91bf1045686a1580c12105
|
| 26 |
-
job_namespace: SZLHOLDINGS
|
| 27 |
weights: AVAILABLE
|
| 28 |
evals: MEASURED
|
| 29 |
named_n:
|
|
@@ -37,16 +33,9 @@ szl:
|
|
| 37 |
report_sha256: 4d057eb9867285e69b00222be110bbb660330a96fe7b284a4d7f488268a13e05
|
| 38 |
report_bytes: 3996
|
| 39 |
report_commit: db71c243d0176bccff1ff087cd4dd57663bd6502
|
| 40 |
-
method: in-process greedy generate, messages[:-1], transformers 5.16.1 bf16 CPU,
|
| 41 |
-
load_in_4bit=False; live Chaski merged shard 1c55df8; PR 63 gates
|
| 42 |
publication_eligible: false
|
|
|
|
| 43 |
gpu: UNAVAILABLE
|
| 44 |
-
job_prior_error: 6a91bb7c984507d9db4ea0a4
|
| 45 |
-
job_completed_no_weights: 6a91ba00984507d9db4ea07f
|
| 46 |
-
job_prior_failed:
|
| 47 |
-
- 6a91b8ba984507d9db4ea071
|
| 48 |
-
- 6a91b990984507d9db4ea077
|
| 49 |
-
- 6a91bb7c984507d9db4ea0a4
|
| 50 |
---
|
| 51 |
|
| 52 |
<p align="center">
|
|
@@ -57,132 +46,91 @@ szl:
|
|
| 57 |
|
| 58 |
<p align="center"><em>The courier that cannot invent the dispatch.</em></p>
|
| 59 |
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
|
| 63 |
-
<img alt="Base: Qwen3.5-0.8B" src="https://img.shields.io/badge/base-Qwen3.5--0.8B-334155?style=flat-square"/>
|
| 64 |
-
<img alt="Doctrine v11-LOCKED" src="https://img.shields.io/badge/doctrine-v11--LOCKED-0f172a?style=flat-square"/>
|
| 65 |
-
<img alt="Named-N: MEASURED FAIL" src="https://img.shields.io/badge/Named--N-MEASURED%20FAIL-dc2626?style=flat-square"/>
|
| 66 |
-
</p>
|
| 67 |
-
|
| 68 |
-
<p align="center">
|
| 69 |
-
<code>KANCHAY</code> · Lean <code>749/14/163</code> · Λ = Conjecture 1 (advisory, never a theorem) · <a href="https://a-11-oy.com">a-11-oy.com</a>
|
| 70 |
-
</p>
|
| 71 |
-
|
| 72 |
-
---
|
| 73 |
|
| 74 |
-
|
| 75 |
-
> Later SKU `A11OY-MINI` inherits this failed parent. Not a product claim.
|
| 76 |
|
| 77 |
-
|
| 78 |
-
|
| 79 |
-
|
| 80 |
-
|
| 81 |
-
> `base_model_relation: finetune` / `artifact_class: MERGED_FINETUNE`. The card's own
|
| 82 |
-
> `originality: FINETUNE_DISCLOSED_BASE` already said so. No eval, weight or receipt
|
| 83 |
-
> claim is touched; the MEASURED failing gate below stands exactly as it was.
|
| 84 |
|
| 85 |
-
|
|
|
|
| 86 |
|
| 87 |
-
|
| 88 |
-
|
| 89 |
-
## The cut
|
| 90 |
-
|
| 91 |
-
Multimodal models narrate what they see. Chaski may only carry a payload the controller already signed. Vision without authorship.
|
| 92 |
-
|
| 93 |
-
A courier that cannot invent the dispatch. The oldest job in the Andes, as a LoRA.
|
| 94 |
-
|
| 95 |
-
| Leader | Take, then tweak |
|
| 96 |
|---|---|
|
| 97 |
-
|
|
| 98 |
-
|
|
| 99 |
-
|
|
| 100 |
-
|
| 101 |
-
|
| 102 |
-
|
| 103 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 104 |
|
| 105 |
-
##
|
| 106 |
-
|
| 107 |
-
Three loadable artifacts sit in this repository at once — a bare `from_pretrained` on the repo id is ambiguous. Be explicit about which one you want.
|
| 108 |
-
|
| 109 |
-
| Want | Load |
|
| 110 |
-
|---|---|
|
| 111 |
-
| the merged finetune | `AutoModelForCausalLM.from_pretrained("SZLHOLDINGS/chaski")` — resolves the merged shard via `model.safetensors.index.json` |
|
| 112 |
-
| the LoRA adapter on the stock base | base `Qwen/Qwen3.5-0.8B` + `PeftModel.from_pretrained(base, "SZLHOLDINGS/chaski")` |
|
| 113 |
-
| the Unsloth-base adapter | base `unsloth/...-bnb-4bit` + PEFT pointed at the `adapter-unsloth` subfolder |
|
| 114 |
-
|
| 115 |
-
Three sharp edges worth knowing before you debug them:
|
| 116 |
-
|
| 117 |
-
- **Both `config.json` and `adapter_config.json` live at the repo root.** With `peft` installed, some loader paths follow the adapter rather than the merged weights. Pass the path you mean rather than relying on precedence.
|
| 118 |
-
- **The merged shard has a non-standard filename**, `model.safetensors-00001-of-00001.safetensors` instead of the conventional `model-00001-of-00001.safetensors`. It resolves through the index file, but tooling that globs the conventional pattern will not find it.
|
| 119 |
-
- **`config.json` is `Qwen3_5ForConditionalGeneration` and carries a `vision_config`;** visual weights are present in the index. If you only want text, that tower still loads.
|
| 120 |
|
| 121 |
-
|
| 122 |
|
| 123 |
-
| | |
|
| 124 |
-
|---|---|
|
| 125 |
-
|
|
| 126 |
-
|
|
| 127 |
-
| **
|
| 128 |
-
| **Base** | `Qwen/Qwen3.5-0.8B` (Apache-2.0, 0.6B–2B lock). Not an Unsloth-default card. |
|
| 129 |
-
| **License** | `apache-2.0` |
|
| 130 |
-
| **HF Jobs** | Attempt 5 **COMPLETED** [`6a91bf1045686a1580c12105`](https://huggingface.co/jobs/SZLHOLDINGS/6a91bf1045686a1580c12105) (`report_to=none`). Tensors on Hub. |
|
| 131 |
-
| **Named-N** | MEASURED fail. `json_draft` **0/5**. `adversarial_refusal` **2/6**. Not a pass. |
|
| 132 |
-
| **Receipt** | `eval_report.json` 3996 bytes sha256 `4d057eb9867285e69b00222be110bbb660330a96fe7b284a4d7f488268a13e05` (commit `db71c24`) |
|
| 133 |
-
| **Method** | in-process greedy generate, `messages[:-1]`, transformers 5.16.1 bf16 CPU, `load_in_4bit=False`. Date 2026-08-28. File `eval_report.json`. PR 63. |
|
| 134 |
-
| **Quality** | ROADMAP (prose). Failed gate is not a publish. |
|
| 135 |
-
| **Status** | CUTTING |
|
| 136 |
-
| **Lab** | House CPU lab stays **Khipu GGUF**. Lab load forbidden for Chaski. |
|
| 137 |
-
| **Later SKU** | [`A11OY-MINI`](https://huggingface.co/SZLHOLDINGS/A11OY-MINI) GGUFs exist on that repo. They do **not** inherit this Named-N. Mini stays evals none-this-run. |
|
| 138 |
-
| **Sibling** | [`szl-receiptagent-qwen35-0.8b-v2`](https://huggingface.co/SZLHOLDINGS/szl-receiptagent-qwen35-0.8b-v2) |
|
| 139 |
|
| 140 |
-
|
|
|
|
|
|
|
| 141 |
|
| 142 |
-
|
|
|
|
|
|
|
| 143 |
|
| 144 |
-
|
| 145 |
-
|---|---|---|---|
|
| 146 |
-
| `json_draft` | 5 | **0/5** | MEASURED fail |
|
| 147 |
-
| `adversarial_refusal` | 6 | **2/6** | MEASURED fail |
|
| 148 |
|
| 149 |
-
|
|
|
|
| 150 |
|
| 151 |
-
`
|
|
|
|
| 152 |
|
| 153 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 154 |
|
| 155 |
-
|
| 156 |
-
|
| 157 |
-
|
| 158 |
-
-
|
| 159 |
-
- **5 COMPLETED `report_to=none`:** [`6a91bf1045686a1580c12105`](https://huggingface.co/jobs/SZLHOLDINGS/6a91bf1045686a1580c12105). Tensors now on Hub.
|
| 160 |
-
- **Trackio:** 404 `betterwithage/trackio-bucket`. No dashboard URL.
|
| 161 |
-
- **publication_eligible:** false
|
| 162 |
|
| 163 |
## Intended use
|
| 164 |
|
| 165 |
-
-
|
| 166 |
-
-
|
| 167 |
-
-
|
| 168 |
|
| 169 |
-
##
|
| 170 |
|
| 171 |
-
- Not an autonomous agent, executor, factual oracle, or
|
| 172 |
-
- Not a
|
| 173 |
-
- Not
|
| 174 |
-
- Not
|
| 175 |
-
-
|
| 176 |
-
- Not a VLM product card without a signed vision eval.
|
| 177 |
|
| 178 |
## Limitations
|
| 179 |
|
| 180 |
-
|
| 181 |
-
|
| 182 |
-
|
| 183 |
-
|
| 184 |
-
---
|
| 185 |
|
| 186 |
-
|
| 187 |
-
<sub><strong>Fashion rule.</strong> Silhouette from Qwen3 / Qwen3.5 instruct. Cut is original SZL. We do not republish someone else's tensors.</sub>
|
| 188 |
-
</p>
|
|
|
|
| 1 |
---
|
| 2 |
+
thumbnail: https://huggingface.co/SZLHOLDINGS/chaski/resolve/main/holo-banner.svg
|
| 3 |
license: apache-2.0
|
| 4 |
language:
|
| 5 |
- en
|
|
|
|
| 9 |
base_model_relation: finetune
|
| 10 |
tags:
|
| 11 |
- szl-holdings
|
|
|
|
| 12 |
- doctrine-v11
|
| 13 |
- governed-ai
|
| 14 |
- proposal-only
|
| 15 |
+
- research
|
| 16 |
szl:
|
| 17 |
doctrine: v11-LOCKED
|
| 18 |
lean: 749/14/163
|
|
|
|
| 20 |
evidence_ceiling: 0.97
|
| 21 |
artifact_class: MERGED_FINETUNE
|
| 22 |
originality: FINETUNE_DISCLOSED_BASE
|
|
|
|
|
|
|
|
|
|
|
|
|
| 23 |
weights: AVAILABLE
|
| 24 |
evals: MEASURED
|
| 25 |
named_n:
|
|
|
|
| 33 |
report_sha256: 4d057eb9867285e69b00222be110bbb660330a96fe7b284a4d7f488268a13e05
|
| 34 |
report_bytes: 3996
|
| 35 |
report_commit: db71c243d0176bccff1ff087cd4dd57663bd6502
|
|
|
|
|
|
|
| 36 |
publication_eligible: false
|
| 37 |
+
autonomy_eligible: false
|
| 38 |
gpu: UNAVAILABLE
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 39 |
---
|
| 40 |
|
| 41 |
<p align="center">
|
|
|
|
| 46 |
|
| 47 |
<p align="center"><em>The courier that cannot invent the dispatch.</em></p>
|
| 48 |
|
| 49 |
+
> **RESEARCH / NEGATIVE EVIDENCE. Failed qualification. Not flagship.**
|
| 50 |
+
> The current Named-N run failed both release gates. This card does not promote
|
| 51 |
+
> the model, its later SKUs, or any live endpoint.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 52 |
|
| 53 |
+
## Contract
|
|
|
|
| 54 |
|
| 55 |
+
Chaski is an SZL fine-tune of the disclosed Apache-2.0 base
|
| 56 |
+
[`Qwen/Qwen3.5-0.8B`](https://huggingface.co/Qwen/Qwen3.5-0.8B). It produces
|
| 57 |
+
proposal-only drafts behind a validating controller. The model does not execute
|
| 58 |
+
actions, authorize mutations, or convert uncertainty into a fact.
|
|
|
|
|
|
|
|
|
|
| 59 |
|
| 60 |
+
**No uniqueness claim is made.** The value of this artifact is its explicit
|
| 61 |
+
controller boundary, disclosed lineage, and retained negative evidence.
|
| 62 |
|
| 63 |
+
| Field | Verified statement |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 64 |
|---|---|
|
| 65 |
+
| Artifact | Merged fine-tune plus LoRA artifacts are present on the Hub repository |
|
| 66 |
+
| Parent/eval revision | `1c55df8652e9d0f7b84356b1e2d54849165ae884` |
|
| 67 |
+
| Base relation | `finetune`; `artifact_class: MERGED_FINETUNE` |
|
| 68 |
+
| Originality | `FINETUNE_DISCLOSED_BASE` |
|
| 69 |
+
| Publication eligibility | `false` |
|
| 70 |
+
| Autonomy eligibility | `false` |
|
| 71 |
+
| Lambda | Conjecture 1, advisory and never a theorem |
|
| 72 |
+
| Trust ceiling | `0.97` |
|
| 73 |
+
|
| 74 |
+
Canonical source:
|
| 75 |
+
[`szl-holdings/szl-forge/chaski/card`](https://github.com/szl-holdings/szl-forge/tree/main/chaski/card).
|
| 76 |
+
Exact publication source and asset hashes are recorded in
|
| 77 |
+
`szl-source-binding.json` on this model repository.
|
| 78 |
|
| 79 |
+
## Evaluation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 80 |
|
| 81 |
+
**Named-N: MEASURED FAIL.** The measured run on 2026-08-28 is a failed gate, not a passing benchmark.
|
| 82 |
|
| 83 |
+
| Probe | Result | Interpretation |
|
| 84 |
+
|---|---:|---|
|
| 85 |
+
| JSON draft | **0/5** | failed |
|
| 86 |
+
| Adversarial refusal | **2/6** | failed |
|
| 87 |
+
| Hallucinated citations | **0 observed in this bounded run** | not a general guarantee |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 88 |
|
| 89 |
+
Receipt: `eval_report.json`, 3996 bytes, SHA-256
|
| 90 |
+
`4d057eb9867285e69b00222be110bbb660330a96fe7b284a4d7f488268a13e05`,
|
| 91 |
+
source commit `db71c243d0176bccff1ff087cd4dd57663bd6502`.
|
| 92 |
|
| 93 |
+
Method: in-process greedy generation over `messages[:-1]`, Transformers 5.16.1,
|
| 94 |
+
bf16 CPU, `load_in_4bit=False`. This evidence does not transfer to
|
| 95 |
+
`A11OY-MINI`, another revision, another runtime, or another prompt set.
|
| 96 |
|
| 97 |
+
## Loading
|
|
|
|
|
|
|
|
|
|
| 98 |
|
| 99 |
+
The repository contains multiple loadable forms. Select the intended artifact
|
| 100 |
+
explicitly rather than relying on loader precedence.
|
| 101 |
|
| 102 |
+
```python
|
| 103 |
+
from transformers import AutoModelForCausalLM
|
| 104 |
|
| 105 |
+
model = AutoModelForCausalLM.from_pretrained(
|
| 106 |
+
"SZLHOLDINGS/chaski",
|
| 107 |
+
trust_remote_code=False,
|
| 108 |
+
)
|
| 109 |
+
```
|
| 110 |
|
| 111 |
+
For the LoRA path, load `Qwen/Qwen3.5-0.8B` first and attach the adapter with
|
| 112 |
+
PEFT. The root contains both `config.json` and `adapter_config.json`; callers
|
| 113 |
+
must verify which path their library selects. The merged shard uses a
|
| 114 |
+
non-standard filename resolved through its index.
|
|
|
|
|
|
|
|
|
|
| 115 |
|
| 116 |
## Intended use
|
| 117 |
|
| 118 |
+
- Proposal-only JSON drafts with `approvalRequired=true` and `executed=false`.
|
| 119 |
+
- Doctrine-faithful abstention and routing experiments.
|
| 120 |
+
- Research behind an independent validator and human approval boundary.
|
| 121 |
|
| 122 |
+
## Prohibited interpretation
|
| 123 |
|
| 124 |
+
- Not an autonomous agent, executor, factual oracle, or weapons system.
|
| 125 |
+
- Not a passing 5/5 or 6/6 release.
|
| 126 |
+
- Not evidence of a deployed Alloy endpoint.
|
| 127 |
+
- Not evidence that a later SKU inherits this evaluation.
|
| 128 |
+
- **Lab load forbidden for Chaski.**
|
|
|
|
| 129 |
|
| 130 |
## Limitations
|
| 131 |
|
| 132 |
+
Narrow curriculum, small bounded evaluation, CPU-only measured run, and failed
|
| 133 |
+
release gates. A new model or runtime revision requires a new immutable
|
| 134 |
+
evaluation receipt; this card cannot confer approval.
|
|
|
|
|
|
|
| 135 |
|
| 136 |
+
Doctrine v11 LOCKED. Λ = Conjecture 1. Owner: Stephen Lutar / SZL Holdings.
|
|
|
|
|
|
szl-source-binding.json
CHANGED
|
@@ -21,8 +21,8 @@
|
|
| 21 |
"source": {
|
| 22 |
"assets": {
|
| 23 |
"README.md": {
|
| 24 |
-
"bytes":
|
| 25 |
-
"sha256": "
|
| 26 |
},
|
| 27 |
"holo-banner.svg": {
|
| 28 |
"bytes": 1374,
|
|
@@ -30,7 +30,7 @@
|
|
| 30 |
}
|
| 31 |
},
|
| 32 |
"repository": "szl-holdings/szl-forge",
|
| 33 |
-
"revision": "
|
| 34 |
},
|
| 35 |
"target": {
|
| 36 |
"controlled_paths": [
|
|
|
|
| 21 |
"source": {
|
| 22 |
"assets": {
|
| 23 |
"README.md": {
|
| 24 |
+
"bytes": 4695,
|
| 25 |
+
"sha256": "fbd3f10904e5066adda55054ec88aca9002d79669c2d138935de2008a8db51d6"
|
| 26 |
},
|
| 27 |
"holo-banner.svg": {
|
| 28 |
"bytes": 1374,
|
|
|
|
| 30 |
}
|
| 31 |
},
|
| 32 |
"repository": "szl-holdings/szl-forge",
|
| 33 |
+
"revision": "620f68b318a1757d8735f6a4d09cd1f42d68a136"
|
| 34 |
},
|
| 35 |
"target": {
|
| 36 |
"controlled_paths": [
|