Lernex/Metis-1.6-Praxis
Text Generation • 3B • Updated • 8
Metis-1.6 post-trained reasoning and chat models (metis-chat/v1, <think> and direct modes, 131K context): Praxis (2.94B) and Logos (10.23B).
Note 2.94B (0.464B active/pass, 2 passes): BF16 reference, 6.16 GB
Note FP8 W8A8 for vLLM, SGLang and Dromos, 3.53 GB
Note NVFP4 W4A16 for Dromos, 2.01 GB
Note 10.23B (1.18B active/pass, 2 passes): BF16 reference, 20.80 GB
Note FP8 W8A8 for vLLM, SGLang and Dromos, 11.18 GB
Note NVFP4 W4A16 for Dromos, 6.57 GB
Note MLX 4-bit for Apple silicon, 2.0 GB
Note MLX 8-bit for Apple silicon, 3.2 GB
Note MLX 4-bit for Apple silicon, 6.6 GB
Note MLX 8-bit for Apple silicon, 11.1 GB
Note GGUF for llama.cpp, BF16 to IQ4_XS, with the imatrix
Note GGUF for llama.cpp, BF16 to IQ4_XS, with the imatrix