inference-optimization
/

Qwen3-0.6B-FP8_BLOCK

compressed-tensors

Model card Files Files and versions

No model card

Downloads last month: 283

Safetensors

Model size

0.6B params

Tensor type

BF16

·

F8_E4M3

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including inference-optimization/Qwen3-0.6B-FP8_BLOCK

Models in CI

Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories. • 44 items • Updated 4 days ago