Flint by Recursive, quantized using the oMLX v0.7.3.dev1 which brought further improvements to the oQ quantization.
-
chimpanzeetaxidriver/flint-oQ2e
Text Generation • 40B • Updated • 269 • 1 -
chimpanzeetaxidriver/flint-oQ2e-fp16
Text Generation • 40B • Updated • 353 • 2 -
chimpanzeetaxidriver/flint-oQ2.5e
Text Generation • 40B • Updated • 351 -
chimpanzeetaxidriver/flint-oQ2.5e-fp16
Text Generation • 40B • Updated • 341
