Transformers How to use ZhankuiHe/gemma4gen with Transformers:
# pip install -U transformers accelerate
# Load model directly
from transformers import LocalLLM4GenModule
model = LocalLLM4GenModule.from_pretrained("ZhankuiHe/gemma4gen", device_map="auto") 
