RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 Text Generation • 71B • Updated Feb 12, 2025 • 3.55k • 33
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 Text Generation • 8B • Updated Jul 10 • 15.8k • 30
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 Text Generation • 406B • Updated Aug 19 • 94 • 11
RedHatAI/Meta-Llama-3.1-405B-Instruct-FP8-dynamic Text Generation • 406B • Updated Aug 19 • 2.85k • 15
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a8 Text Generation • 406B • Updated Aug 19 • 65 • 2
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8 Text Generation • 71B • Updated Aug 19 • 1.31k • 21
RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8 Text Generation • 8B • Updated Aug 19 • 8.36k • 20
RedHatAI/Meta-Llama-3.1-405B-Instruct-quantized.w8a16 Text Generation • 406B • Updated Aug 19 • 46 • 2