nm-testing
/

Mixtral-8x7B-Instruct-v0.1-W8A16-quantized

compressed-tensors

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

This model is in CI, do not remove

Downloads last month: 21

Safetensors

Model size

47B params

Tensor type

I32

·

F16

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized

Models in CI

Models used in CI tests across llm-compressor, compressed-tensors, and vllm repositories. • 68 items • Updated Jul 30