Instructions to use FastFlowLM/Gemma4-12B-IT-NPU2 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use FastFlowLM/Gemma4-12B-IT-NPU2 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("FastFlowLM/Gemma4-12B-IT-NPU2") model = AutoModelForMultimodalLM.from_pretrained("FastFlowLM/Gemma4-12B-IT-NPU2", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Is it possible to add assistant model?
👀 1
#1 opened about 1 month ago
by
Crandel