Image-Text-to-Text
ExecuTorch
Safetensors
GGUF
English
Korean
gemma4
android
qnn
speculative-decoding
dflash2
quantized
imatrix
conversational
Instructions to use RoundRobin237/Gemma4-E2B-Dflash2-Android with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M # Run inference directly in the terminal: llama cli -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M # Run inference directly in the terminal: llama cli -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Use Docker
docker model run hf.co/RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
- Llama new
- LM Studio
- Jan
- vLLM
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "RoundRobin237/Gemma4-E2B-Dflash2-Android" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "RoundRobin237/Gemma4-E2B-Dflash2-Android", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
- Ollama
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with Ollama:
ollama run hf.co/RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
- Unsloth Desktop
- Pi
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @earendil-works/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with Docker Model Runner:
docker model run hf.co/RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
- Lemonade
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Run and chat with the model
lemonade run user.Gemma4-E2B-Dflash2-Android-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use RoundRobin237/Gemma4-E2B-Dflash2-Android with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "RoundRobin237/Gemma4-E2B-Dflash2-Android:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
Download files.json from RoundRobin237/Gemma4-E2B-Dflash2-Android: direct link, hf CLI and curl.
- Browser
- Download file 6.75 kB
-
https://huggingface.co/RoundRobin237/Gemma4-E2B-Dflash2-Android/resolve/main/files.json
- Command line
-
hf download hf://RoundRobin237/Gemma4-E2B-Dflash2-Android/files.json
-
curl -L -o files.json https://huggingface.co/RoundRobin237/Gemma4-E2B-Dflash2-Android/resolve/main/files.json
6.75 kB
| { | |
| "model_name": "Gemma4-E2B-Dflash2-Android", | |
| "repository": "RoundRobin237/Gemma4-E2B-Dflash2-Android", | |
| "files": [ | |
| { | |
| "path": "original-bf16/model.safetensors", | |
| "bytes": 10246621918, | |
| "sha256": "2db5482b20d746879bb3ef79b5203e9075a2e2b98f54ec7c2f281c1477ddc550" | |
| }, | |
| { | |
| "path": "original-bf16/config.json", | |
| "bytes": 4954, | |
| "sha256": "1b28f3d2c3100f6c594754b81107428bd7b822a7f48272ca681dae9d2ec38330" | |
| }, | |
| { | |
| "path": "original-bf16/generation_config.json", | |
| "bytes": 208, | |
| "sha256": "d4226bbe3117d2d253ba4609720ba82c6c4ce4627a9a6ae05387c78983ac03de" | |
| }, | |
| { | |
| "path": "original-bf16/processor_config.json", | |
| "bytes": 1689, | |
| "sha256": "32bdf45d2ad4cc29a0822ddd157a182de76644f0419a6228d151495256e9813c" | |
| }, | |
| { | |
| "path": "original-bf16/tokenizer.json", | |
| "bytes": 32169626, | |
| "sha256": "cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f" | |
| }, | |
| { | |
| "path": "original-bf16/tokenizer_config.json", | |
| "bytes": 3082, | |
| "sha256": "9f4fec4b1dc6ecddf8f4a92e9caea5971c0e67d81309f3f9066a2bee8c362633" | |
| }, | |
| { | |
| "path": "original-bf16/chat_template.jinja", | |
| "bytes": 18569, | |
| "sha256": "0a2c8073c878ab1da004bee933a998606537bbb62016310352c7285c3f01c5b5" | |
| }, | |
| { | |
| "path": "q4-gguf/gemma-4-E2B-it-Q4_K_M.gguf", | |
| "bytes": 3106738272, | |
| "sha256": "740185b21d22ceb83a11c3aa62ad5842ef32c70f6096d756bbee85a1e4ec34b8" | |
| }, | |
| { | |
| "path": "npu/gemma4-e2b-dflash2-vision-verify-2k.pte", | |
| "bytes": 3361310336, | |
| "sha256": "6475a64ba4c82a85dd635bde40cc51ece8effe47366565a1c6e58d48862cdbba" | |
| }, | |
| { | |
| "path": "npu/io-contract.vision.json", | |
| "bytes": 9834, | |
| "sha256": "ff0d7696fcf6146dd3823aa3fc30188de9ab89cc39e956f30a84eba4a26593f2" | |
| }, | |
| { | |
| "path": "tokenizer/gemma4-e2b-vision-vocab.gguf", | |
| "bytes": 15784064, | |
| "sha256": "cab51c971431716cbee2cc9e0e508acd57a18e998cecdb6fd1466c375059ca93" | |
| }, | |
| { | |
| "path": "npu/cpu-body-fp32.bin", | |
| "bytes": 36327406, | |
| "sha256": "c5c8041ee084fbb319f8d6d2987efe47207a7c9ee051cefed215466467d6c73d" | |
| }, | |
| { | |
| "path": "npu/embedding-cpu-fp32.pte", | |
| "bytes": 402654336, | |
| "sha256": "009fd99eded656aecd6d9624cdc8cf4fcdcc2e5463073bf627a6097aa4b78221" | |
| }, | |
| { | |
| "path": "npu/head-cpu-int8.bin", | |
| "bytes": 101711888, | |
| "sha256": "08ee78145df712d8658a6401df294f5b81786f5f0c872358c5b07a20e7701b76" | |
| }, | |
| { | |
| "path": "npu/selector-cpu-fp32.bin", | |
| "bytes": 67158040, | |
| "sha256": "6e634054185fafd05f2db07b3363a088ac382d6105ef9f821e030934f0c9830a" | |
| }, | |
| { | |
| "path": "npu/active-vocabulary.u32", | |
| "bytes": 21684, | |
| "sha256": "e6a4aab3893725158aea29a728132132e45ae3dbf694f7117814c600f880aea9" | |
| }, | |
| { | |
| "path": "npu/draft-manifest.json", | |
| "bytes": 3982, | |
| "sha256": "2dd76cb8b267007970b6d9870fdded2e71abb2a575e757059379ddbfd48cc6b3" | |
| }, | |
| { | |
| "path": "tokenizer/config.json", | |
| "bytes": 4954, | |
| "sha256": "1b28f3d2c3100f6c594754b81107428bd7b822a7f48272ca681dae9d2ec38330" | |
| }, | |
| { | |
| "path": "tokenizer/tokenizer.json", | |
| "bytes": 32169626, | |
| "sha256": "cc8d3a0ce36466ccc1278bf987df5f71db1719b9ca6b4118264f45cb627bfe0f" | |
| }, | |
| { | |
| "path": "tokenizer/tokenizer_config.json", | |
| "bytes": 3082, | |
| "sha256": "9f4fec4b1dc6ecddf8f4a92e9caea5971c0e67d81309f3f9066a2bee8c362633" | |
| }, | |
| { | |
| "path": "tokenizer/chat_template.jinja", | |
| "bytes": 18569, | |
| "sha256": "0a2c8073c878ab1da004bee933a998606537bbb62016310352c7285c3f01c5b5" | |
| }, | |
| { | |
| "path": "tokenizer/gemma4-e2b-tokenizer.gguf", | |
| "bytes": 15783335, | |
| "sha256": "6c76c488f73d72c96681bfa6b48508207c6c18b91dec403151a929b23e4e1cd7" | |
| }, | |
| { | |
| "path": ".gitattributes", | |
| "bytes": 357, | |
| "sha256": "fc0e80df66f1475a97a781101dbe792bdac21325764841f77cda6d83cfd60db6" | |
| }, | |
| { | |
| "path": "benchmark.json", | |
| "bytes": 14828, | |
| "sha256": "49aa153b0422f4596981354af88864289d67d221fb50d1c6d20c51f79398df32" | |
| }, | |
| { | |
| "path": "device.json", | |
| "bytes": 1165, | |
| "sha256": "804cea727e784fe3391ab32f0f45a8002f9253a7dbf52dd10f6be0386a164d49" | |
| }, | |
| { | |
| "path": "dflash2-lineage.json", | |
| "bytes": 2082, | |
| "sha256": "977fbd7d9a8d2c0e65afb67e647a0188bc22c841c167aac436a47b63cc3b62aa" | |
| }, | |
| { | |
| "path": "external-assets.json", | |
| "bytes": 678, | |
| "sha256": "5ab2eedbceed08ba2b0a2a4e6e8bf734667ea4bd508532c3ef0371c11ceb0252" | |
| }, | |
| { | |
| "path": "LICENSE", | |
| "bytes": 11358, | |
| "sha256": "cfc7749b96f63bd31c3c42b5c471bf756814053e847c10f3eb003417bc523d30" | |
| }, | |
| { | |
| "path": "licenses/DFlash-MIT.txt", | |
| "bytes": 1082, | |
| "sha256": "d0e9f2ae12e7600a20f988cc6248944bce867006b67f19ce3c129bcfa206188b" | |
| }, | |
| { | |
| "path": "licenses/ExecuTorch-BSD-3-Clause.txt", | |
| "bytes": 1774, | |
| "sha256": "c58707ea5d5c0ee17af7e16f1377e4d31ad1533492ab0bf9b87ebd9f718f9e7b" | |
| }, | |
| { | |
| "path": "licenses/llama.cpp-MIT.txt", | |
| "bytes": 1099, | |
| "sha256": "bcd8ec749126d45cb06737d0690295d73df4b6e7e194205bcf91190368f27285" | |
| }, | |
| { | |
| "path": "licenses/RaInfer-MIT.txt", | |
| "bytes": 1065, | |
| "sha256": "bd5754c00418e9f5aeef02b27bc0476188f9175664b3f9b2811c46c9e4207b5e" | |
| }, | |
| { | |
| "path": "NOTICE", | |
| "bytes": 1626, | |
| "sha256": "135973d8bd3c10594214e591fc81a90ece39b44dad6826e6aad364e678635785" | |
| }, | |
| { | |
| "path": "provenance.json", | |
| "bytes": 2454, | |
| "sha256": "4929493c9c82f23aa4f3ae9a5b4cae21da341d15aae2e61a212c7a03b3cbe662" | |
| }, | |
| { | |
| "path": "quantization.json", | |
| "bytes": 2028, | |
| "sha256": "38c0603293c511a433ade5e83276225f80e9ee3430842ad1959f6065c9ff5d5a" | |
| }, | |
| { | |
| "path": "README.ko.md", | |
| "bytes": 15762, | |
| "sha256": "08d99dbff7f5698daf43de65a274de5856016f44c7b851312256972337eb4596" | |
| }, | |
| { | |
| "path": "README.md", | |
| "bytes": 16858, | |
| "sha256": "ca262a041f61d18fb8a64860afbf4e874b65e4356e9c48567e13a65076295058" | |
| }, | |
| { | |
| "path": "vision-device-check.json", | |
| "bytes": 13312, | |
| "sha256": "c53438f3bd80c540570994ad0506d12c51f97aa2f51e1f7bdb561eca218cd38e" | |
| }, | |
| { | |
| "path": "vision-pc-check.json", | |
| "bytes": 1593, | |
| "sha256": "cf1fac41ab1010561636529cb43622b5bd5b995b01728baa1a1e2f4599cb8cc8" | |
| }, | |
| { | |
| "path": "vision-status.json", | |
| "bytes": 972, | |
| "sha256": "8e7627ea4a72f5c14a2db38c1e60f01e5746c797fe300bc7b42863d8790a7e58" | |
| } | |
| ] | |
| } | |