How to use google/gemma-4-12B-it-assistant with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("google/gemma-4-12B-it-assistant") model = AutoModelForCausalLM.from_pretrained("google/gemma-4-12B-it-assistant", device_map="auto")
