mixed-quant-epi
Per-layer mixed quantization evaluated by EPI -- accuracy vs energy Pareto frontier
Placeholder -- full content coming soon. See the GitHub repo for current work.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Franzabner/mixed-quant-epi", device_map="auto")