Instructions to use Hyper-AI/gemma-4-E4B-it-fp8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Hyper-AI/gemma-4-E4B-it-fp8 with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("Hyper-AI/gemma-4-E4B-it-fp8") model = AutoModelForMultimodalLM.from_pretrained("Hyper-AI/gemma-4-E4B-it-fp8", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Update README.md
Verified signature9f35947 -
Update README.md
Verified signature**lightvl Developed by Myself is a lightweight Vision-Language Model (VLM) quantization toolkit supporting FP8, INT8, FP8-Block. It integrates with vLLM for high-throughput inference and supports Qwen3-VL, Qwen3.5, InternVL-Chat, and Gemma-4 models.** **fast quant your model step by step:** 1、 pip3 install lightvl 2、 lightvl YOUR_HF_MODEL_PATH 3、 the output quant model path is YOUR_HF_MODEL_PATH-fp8ec17479
-
Update README.md
Verified signaturee47bb3c -
Update README.md
Verified signature027973f -
Upload folder using huggingface_hub
Verified signature57f9e3a -
initial commit
Verified signature08bf9b5