Mtrini-27B-Tellus-IQ2_XS-Imatrix
This repository contains the importance matrix and calibration data used for the Mtrini-27B-Tellus IQ2_XS quantization.
CompiwerAI — Building AI For Everyone.
Files
Importance Matrix
Mtrini-27B-Tellus-IQ2_XS.imatrix
Importance information used during IQ2_XS quantization.
Calibration Dataset
mtrini-calibration-large.txt
Calibration text used to generate the importance matrix.
Calibration Configuration
| Property | Value |
|---|---|
| Context size | 512 |
| Threads | 20 |
| Chunks | 32 |
| Calibration PPL | ~2.4629 ± 0.04545 |
| Importance entries | 496 |
Quantization Pipeline
- Mtrini-27B-Tellus merged model
- F16 GGUF conversion
- Calibration dataset preparation
- Importance-matrix generation
- IQ2_XS quantization
- GGUF validation
Related Models
- IQ2_XS:
CompiwerAI/Mtrini-27B-Tellus-IQ2_XS - F16:
CompiwerAI/Mtrini-27B-Tellus-GGUF - Merged:
CompiwerAI/Mtrini-27B-Tellus-Merged
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support