Configuration Parsing Warning:In UNKNOWN_FILENAME: "quantization_config.config_groups.group_0.format" must be a string

FP8 static quantized model with compressored tensors. per-channel weight and per-tensor activation.

Safetensors

Model size

0.6B params

Tensor type

F32

F8_E4M3

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support