Instructions to use LocalMuseAI/mlx-flux2-klein-4b-aio-4bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use LocalMuseAI/mlx-flux2-klein-4b-aio-4bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download LocalMuseAI/mlx-flux2-klein-4b-aio-4bit --local-dir mlx-flux2-klein-4b-aio-4bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
File size: 864 Bytes
bfd8714 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 | {
"torch": "2.14.1",
"diffusers": "0.40.0",
"transformers": "5.18.0",
"probe": "256x256, sigma 1, seed 1729",
"tokenizerMatches": true,
"encoderBF16VsSwiftInt4": {
"relativeL2": 0.10351864565645792,
"cosine": 0.9951142753409989,
"maximumAbsoluteError": 576.0
},
"transformerBF16VsSwiftInt4": {
"relativeL2": 0.11453497637786403,
"cosine": 0.9934259424625762,
"maximumAbsoluteError": 1.0634765625
},
"transformerDequantizedVsSwiftInt4": {
"relativeL2": 0.009665547767124439,
"cosine": 0.9999533280974499,
"maximumAbsoluteError": 0.099609375
},
"vaeRestoredFP32VsSwiftFP32": {
"relativeL2": 2.549132232262252e-06,
"cosine": 0.9999999999967524,
"maximumAbsoluteError": 3.039836883544922e-06
},
"vaeBatchNormPreservedExactly": true,
"elapsedSeconds": 135.06487279199973,
"passed": true
}
|