relaxml/Llama-2-13b-chat-QTIP-2Bit
2B β’ Updated β’ 5
relaxml/Llama-2-7b-chat-QTIP-2Bit
1B β’ Updated β’ 6
β’ 1
relaxml/Llama-3.1-405B-Instruct-QTIP-4Bit
105B β’ Updated β’ 8
relaxml/Llama-3.1-405B-Instruct-QTIP-3Bit
80B β’ Updated β’ 9
β’ 1
relaxml/Llama-2-7b-QTIP-4Bit
2B β’ Updated β’ 14
β’ 2
relaxml/Llama-2-7b-QTIP-3Bit
1B β’ Updated β’ 20
β’ 1
relaxml/Llama-2-13b-QTIP-3Bit
3B β’ Updated β’ 7
relaxml/Llama-2-70b-QTIP-3Bit
13B β’ Updated β’ 19
β’ 1
relaxml/Llama-2-13b-QTIP-4Bit
4B β’ Updated β’ 6
relaxml/Llama-2-70b-QTIP-4Bit
18B β’ Updated β’ 6
relaxml/Llama-2-70b-QTIP-2Bit
9B β’ Updated β’ 41
relaxml/Llama-2-13b-QTIP-2Bit
2B β’ Updated β’ 12
relaxml/Llama-3.1-8b-Instruct-QTIP-4Bit
3B β’ Updated β’ 12
β’ 2
relaxml/Llama-3.1-8b-Instruct-QTIP-3Bit
2B β’ Updated β’ 12
relaxml/Llama-2-70b-chat-E8PRVQ-4Bit
Text Generation
β’ 5B β’ Updated β’ 16
relaxml/Llama-2-13b-chat-E8PRVQ-4Bit
Text Generation
β’ 1B β’ Updated β’ 17
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation
β’ 0.7B β’ Updated β’ 17
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation
β’ 5B β’ Updated β’ 33
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation
β’ 1B β’ Updated β’ 18
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation
β’ 0.7B β’ Updated β’ 21
relaxml/Llama-2-70b-chat-E8PRVQ-3Bit
Text Generation
β’ 4B β’ Updated β’ 22
relaxml/Llama-2-13b-chat-E8PRVQ-3Bit
Text Generation
β’ 0.9B β’ Updated β’ 18
relaxml/Llama-2-7b-chat-E8PRVQ-3Bit
Text Generation
β’ 0.6B β’ Updated β’ 15
relaxml/Llama-2-70b-E8PRVQ-3Bit
Text Generation
β’ 4B β’ Updated β’ 54
relaxml/Llama-2-13b-E8PRVQ-3Bit
Text Generation
β’ 0.9B β’ Updated β’ 19
relaxml/Llama-2-7b-E8PRVQ-3Bit
Text Generation
β’ 0.6B β’ Updated β’ 38
relaxml/Llama-2-70b-chat-E8P-2Bit
Text Generation
β’ 3B β’ Updated β’ 22
β’ 6
relaxml/Llama-2-13b-chat-E8P-2Bit
Text Generation
β’ 0.7B β’ Updated β’ 22
β’ 1
relaxml/Llama-2-7b-chat-E8P-2Bit
Text Generation
β’ 0.5B β’ Updated β’ 17
β’ 2
relaxml/Llama-2-70b-E8P-2Bit
Text Generation
β’ 3B β’ Updated β’ 53
β’ 3