Osaurus

Ornith-1.0-9B ยท JANG_4M

Official OsaurusAI JANG_4M build of deepreinforce-ai/Ornith-1.0-9B (MIT) โ€” a vision-language model on a Qwen3.5 hybrid backbone. Mixed-precision affine (JANG_4M); runs on Apple Silicon via Osaurus.

  • ~6.3 GB (from ~18.8 GB bf16) bundle.
  • JANG_4M: 8-bit affine attention + 4-bit affine MLP (mixed precision, group-size 64); embeddings/head per-module; vision tower kept fp16.
  • Vision-language (image + text โ†’ text).

Architecture

Family qwen3_5 (dense, hybrid)
Text layers 32 โ€” 24 Gated-DeltaNet (linear-attention) + 8 full-attention
MoE / dims hidden 4096 ยท untied lm_head
Vision ViT tower (model.visual) preserved fp16
Cache hybrid (GDN state + KV for attention layers)
Parsers reasoning qwen3 ยท tools qwen

Running it

JANG bundles use the Qwen3.5 RMSNorm +1 scale_shift applied at runtime, so load them in Osaurus (or the vMLX runtime), which handles it automatically:

osaurus run OsaurusAI/Ornith-1.0-9B-JANG_4M

Note: a plain mlx_lm.generate will not be coherent on a JANG bundle โ€” it omits the +1 norm shift. Use the Osaurus / vMLX runtime (or vmlx_engine.loaders.load_jang), which applies it.

Provenance

  • Base: deepreinforce-ai/Ornith-1.0-9B ยฉ DeepReinforce โ€” MIT (Qwen3.5-based)
  • Quantization: Osaurus ยท JANG_4M (8-bit affine attention + 4-bit affine MLP, group-size 64; vision tower fp16) ยท eric@osaurus.ai
Downloads last month
44
Safetensors
Model size
9B params
Tensor type
U32
ยท
F16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for OsaurusAI/Ornith-1.0-9B-JANG_4M

Finetuned
(36)
this model