Feature Extraction
GGUF
llama.cpp
embeddings
multimodal
vision
audio
image-feature-extraction
audio-feature-extraction
Instructions to use MirrorNeuronLab/embeddinggemma-2-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use MirrorNeuronLab/embeddinggemma-2-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible embeddings server: llama serve -hf MirrorNeuronLab/embeddinggemma-2-GGUF:Q4_K_M --embeddings
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible embeddings server: llama serve -hf MirrorNeuronLab/embeddinggemma-2-GGUF:Q4_K_M --embeddings
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible embeddings server: ./build/bin/llama serve -hf MirrorNeuronLab/embeddinggemma-2-GGUF:Q4_K_M --embeddings
- Llama new
- LM Studio
- Jan
- Ollama
How to use MirrorNeuronLab/embeddinggemma-2-GGUF with Ollama:
ollama run hf.co/MirrorNeuronLab/embeddinggemma-2-GGUF:Q4_K_M
- Unsloth Desktop
- Docker Model Runner
How to use MirrorNeuronLab/embeddinggemma-2-GGUF with Docker Model Runner:
docker model run hf.co/MirrorNeuronLab/embeddinggemma-2-GGUF:Q4_K_M
- Lemonade
How to use MirrorNeuronLab/embeddinggemma-2-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull MirrorNeuronLab/embeddinggemma-2-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.embeddinggemma-2-GGUF-Q4_K_M
List all available models
lemonade list
- Atomic Chat
Download SHA256SUMS from MirrorNeuronLab/embeddinggemma-2-GGUF: direct link, hf CLI and curl.
- Browser
- Download file 1.95 kB
-
https://huggingface.co/MirrorNeuronLab/embeddinggemma-2-GGUF/resolve/main/SHA256SUMS
- Command line
-
hf download hf://MirrorNeuronLab/embeddinggemma-2-GGUF/SHA256SUMS
-
curl -L -o SHA256SUMS https://huggingface.co/MirrorNeuronLab/embeddinggemma-2-GGUF/resolve/main/SHA256SUMS
1.95 kB
| 4cf00e98dded8779b234ba8d2356ce03ef5360f69632bd81f0f10c4c944b89d9 .gitattributes | |
| 19ee2fd9f0440f865f43bbdb052cb159e9156e5d1df0a5ef60159a5dce7008f4 GGUF_AUDIT.json | |
| cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30 LICENSE | |
| cffa1796862050596e7e071b181883485b8c32de9da54fed01fcf14933806656 PROVENANCE.json | |
| 6293911192eb907c3e962e4ec83ea1e095e83d1aa6bfc3c3d7a7ac2f44c5f3a7 PUBLISHED_VALIDATION.json | |
| 9a589e59698084274f1456d993fa9b5f30f698bac7980f9873806c1188cd9a76 README.md | |
| 3a30564979129978d26ad4c1160fab0a04173e76a9fdf1c1f572bab4dc3055e4 SOURCE_SHA256SUMS | |
| 1ac5fe21d24f3d310372a52ecd5d91ba7ad002559e53804967b0b7c0c913f09b TIMINGS.json | |
| 0a1e1e46a434406b06b5c2b4484cfe05aa5b0f5ef704caaee92e0c50d58a73dc VALIDATION.json | |
| d610afe26dd783739275646d51d4d85b4167820fd051600696d7a49e6f68609f embeddinggemma-2-Q4_K_M.gguf | |
| 0531309472a6bc6f4b146c3736eee7795ec9db1903c25490d3c937490cef6dd8 mmproj-embeddinggemma-2-Q8_0.gguf | |
| a192756b5f6e0fe77e57596ff5a723bbaf16ab16e5817e0588a3144b8f69e2da reproduce/logs/requirements-lock.txt | |
| c61b7c2e3c2c73d1f2e1b910e1b10a74716bc04511c85f8bec0ed0541cb5e5da reproduce/scripts/audit_gguf.py | |
| 9591828d8b0bfa92da1725c2dc27c2bc01e8b6a47cb7402afa6c26ed3c114f6d reproduce/scripts/convert_compatible.py | |
| 8a2336055793f9398523f9a3f97c0cef5e37e08b8a16674e2ba7a9ea1346eacb reproduce/scripts/download_source.py | |
| cf87edf345e6c1219c67f4053666814a7e55c2080d4ffea53bec0eb4d4cf6c59 reproduce/scripts/reproduce.sh | |
| 727f566dec90b50ff3f6c7a3db0c1a84eb7d6085521f69eaa843d7cc35088a08 reproduce/scripts/run_step.py | |
| 896ede8b40952e6dff8f2538e3e58bd460dc1de174bd664a8c5a44409e2cf1c3 reproduce/scripts/start_validation_runner.sh | |
| 14d4965f07340f7343281f6e54cabf3088a3b45d1149dc195a7bdc9a46367e94 reproduce/scripts/validate_bf16.py | |
| 510a92196328acf88ab0498dd1382efb3636ae40c5387689c0b0779336dc7844 reproduce/scripts/validate_dmr.py | |
| 9317c991823f589960258b4c6fba6ba4cabaebe6a649e9051161c09ca3149c28 reproduce/scripts/validation_common.py | |