zils-lite-hs1

A body for the Zils d3-lite soup pool (Bittensor subnet 127): a fine-tune of Qwen/Qwen3.5-0.8B in the chassis layout, BF16, language weights trained, vision tower from the parent.

Start: the Zils house body vllm-sr/d3-lite (Apache-2.0). Uniform weight average of four fine-tunes of d3-lite: two full fine-tunes (soft cross-entropy + Brier, KL-anchor rows to the start, lr 4e-6, about 1.3 h each) and two LoRA r32 fine-tunes (one epoch, lr 1e-4, KL anchor 0.1).

Training data: exam-format decision items written with the public Zils authoring recipe (scripts/author_exam.py) by Claude Opus and by a local open model, from public training splits only, plus the public Zils relay teacher answers. No validator exam items and no public seed items were used. This repository holds weights only; check the source datasets' terms before reuse.

Downloads last month

-

Downloads are not tracked for this model. How to track
Safetensors
Model size
0.9B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Charlie320/zils-lite-hs1

Finetuned
(766)
this model