LoneStriker/Meta-Llama-3.1-70B-Instruct-6.0bpw-h6-exl2 Text Generation • Updated Jul 24, 2024 • 7 • 5
hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4 Text Generation • 71B • Updated Aug 7, 2024 • 3.49k • 23
hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4 Text Generation • 8B • Updated Aug 7, 2024 • 7.87k • 42
joshnader/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF Text Generation • 8B • Updated Jul 24, 2024 • 5.68k • 7
deven367/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF Text Generation • 8B • Updated Jul 24, 2024 • 360 • 1
RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a16 Text Generation • 71B • Updated 7 days ago • 121 • 5