nm-testing
/

Llama-3.2-1B-Instruct-FP8-KV

compressed-tensors

Model card Files Files and versions

No model card

Downloads last month: 5,461

Safetensors

Model size

1B params

Tensor type

BF16

·

F8_E4M3

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Space using nm-testing/Llama-3.2-1B-Instruct-FP8-KV 1

Collection including nm-testing/Llama-3.2-1B-Instruct-FP8-KV

Models in CI

Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories. • 68 items • Updated Jul 30