AI2Apps SSD-ready checkpoint

This is a byte-preserving storage-layout conversion of Vontra/Qwen3.8-Flash-Next-MLX-4bit at immutable revision de597762aa61387c89590a46582222a261ce0387. Original tensor values and quantization are retained. Original routed experts are externalized into the experts/ directory rather than duplicated in the backbone safetensors.

Requires an AI2Apps Runtime with explicit qwen4-exp-affine-q4-gate-up-fused-v1 support. This candidate is not a drop-in checkpoint for unmodified Transformers, mlx-lm or mlx-vlm. Do not use the backbone safetensors alone. The corresponding Runtime and model Package have not yet completed release acceptance. Full/Cached engine compatibility is recorded separately in the Runtime release receipt; the presence of a reversible tensor map alone is not an end-to-end engine guarantee.

  • ssd-checkpoint.json: format, provenance and file digests.
  • external-tensors.json: original tensor names and external byte locations.
  • source-tensor-sha256.json: original tensor payload digests verified during export.
  • model.safetensors.index.json: ordinary/vision/other retained tensor index.
  • experts/: complete routed expert payloads, with no re-quantization.

License: Qwen Community License 1.0.

See LICENSE and README.upstream.md for upstream terms and attribution. This storage format changes installation space and data access; it is not a new model training or a claim of improved model accuracy.

Downloads last month
42
Safetensors
Model size
57B params
Tensor type
BF16
路
U32
路
I64
路
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support