relaxml/Llama-2-13b-chat-QTIP-2Bit
2B • Updated • 4
relaxml/Llama-2-7b-chat-QTIP-2Bit
1B • Updated • 5
• 1
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
105B • Updated • 5
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
80B • Updated • 6
• 1
relaxml/Llama-2-7b-QTIP-4Bit
2B • Updated • 15
• 2
relaxml/Llama-2-7b-QTIP-3Bit
1B • Updated • 11
• 1
relaxml/Llama-2-13b-QTIP-3Bit
3B • Updated • 6
relaxml/Llama-2-70b-QTIP-3Bit
13B • Updated • 6
• 1
relaxml/Llama-2-13b-QTIP-4Bit
4B • Updated • 5
relaxml/Llama-2-70b-QTIP-4Bit
18B • Updated • 9
relaxml/Llama-2-70b-QTIP-2Bit
9B • Updated • 8
relaxml/Llama-2-13b-QTIP-2Bit
2B • Updated • 6
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
3B • Updated • 12
• 2
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
2B • Updated • 19
relaxml/Llama-2-70b-chat-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 5
relaxml/Llama-2-13b-chat-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 4
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 3
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation
• 5B • Updated • 3
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation
• 1B • Updated • 6
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation
• 0.7B • Updated • 9
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 5
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 5
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 4
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation
• 4B • Updated • 4
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation
• 0.9B • Updated • 9
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation
• 0.6B • Updated • 68
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation
• 3B • Updated • 6
• 6
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation
• 0.7B • Updated • 10
• 1
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation
• 0.5B • Updated • 18
• 2
relaxml/Llama-2-70b-E8P-2Bit
Text Generation
• 3B • Updated • 9
• 3