How to use chopratejas/kompress-v2-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="chopratejas/kompress-v2-base")
# pip install -U transformers accelerate # Load model directly from transformers import HeadroomCompressorV2 model = HeadroomCompressorV2.from_pretrained("chopratejas/kompress-v2-base", device_map="auto")
adelin-vroom