Instructions to use google/gemma-4-E4B-it-qat-w4a16-ct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use google/gemma-4-E4B-it-qat-w4a16-ct with Transformers:
# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("google/gemma-4-E4B-it-qat-w4a16-ct") model = AutoModelForMultimodalLM.from_pretrained("google/gemma-4-E4B-it-qat-w4a16-ct", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Raise per-image vision soft-token budget from 280 to 1120
#4 opened 16 days ago
by
lucianommartins
vLLM optimized version for 26B-A4B model
1
#1 opened about 2 months ago
by
gaurangblaze