Instructions to use caslca/gte-modernbert-base-mlx-8bit with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use caslca/gte-modernbert-base-mlx-8bit with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download caslca/gte-modernbert-base-mlx-8bit --local-dir gte-modernbert-base-mlx-8bit
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit History
24 days ago
-
8-bit MLX affine quantization (Premisa)
Verified signature62b1272