Text Classification
Transformers
Safetensors
English
manta
feature-extraction
medical
decision-model
classification
calibration
multimodal
vision
radiology
pathology
clinical-text
custom_code
Instructions to use gevaertlab/MANTA-27B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use gevaertlab/MANTA-27B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-classification", model="gevaertlab/MANTA-27B", trust_remote_code=True)# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("gevaertlab/MANTA-27B", trust_remote_code=True, device_map="auto") - Notebooks
- Google Colab
- Kaggle
Out-of-domain calibration
#1
by motazalqaoud - opened
Really nice that the card splits in-domain and out-of-domain results. Reading A.1, the gap to liquid-d1-ultra is about 17 points in domain (87.8 vs 71.2) but about 1 point on the 9 out-of-domain sets (70.6 vs 69.3), and ECE-15 goes from 0.021 to 0.109 there while liquid-d1-ultra stays at 0.035. Since the in-domain sets are held-out groups of sources MANTA trained on, I'd guess that's where most of the headline gap comes from. Have you tried something like temperature scaling on a small sample from a new dataset? That out-of-domain calibration seems like the number that matters most for anyone trying it on their own data.