BWU Local LLM Models
Collection
current models i am using • 7 items • Updated • 1
How to use brainworkup/Darwin-4B-David-oQ8e with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download brainworkup/Darwin-4B-David-oQ8e --local-dir Darwin-4B-David-oQ8e
This model was quantized using oQ (oMLX v0.6.0.dev1) mixed-precision quantization.
8-bit