ModernBERT-base - a Mattia2700 Collection

Mattia2700 's Collections

SmolLM-135M & SmolLM-135M-Instruct

SmolLM-360M & SmolLM-360M-Instruct

Llama-3.2-1B & Llama-3.2-1B-Instruct

SmolLM-1.7B & SmolLM-1.7B-Instruct

mt5-small & flan-t5-small (different sizes)

mt5-base & flan-t5-base (different sizes)

mt5-large & flan-t5-large (different sizes)

ModernBERT-base

ModernBERT-large

ModernBERT-base

updated May 8, 2025

Mattia2700/ModernBERT-base_AllDataSources_0.0002_cosine_512_flattening

Fill-Mask • 0.1B • Updated Feb 25, 2025 • 23
Mattia2700/ModernBERT-base_AllDataSources_0.0002_constant_512_flattening

Fill-Mask • 0.1B • Updated Feb 25, 2025 • 12
Mattia2700/ModernBERT-base_AllDataSources_5e-05_constant_512_flattening

Fill-Mask • 0.1B • Updated Feb 25, 2025 • 15
Mattia2700/ModernBERT-base_ClinicalWhole_0.0002_constant_512_flattening

Fill-Mask • 0.1B • Updated Feb 24, 2025 • 8
Mattia2700/ModernBERT-base_ClinicalWhole_0.0002_cosine_512_flattening

Fill-Mask • 0.1B • Updated Feb 24, 2025 • 6
Mattia2700/ModernBERT-base_ClinicalWhole_5e-05_constant_512_flattening

Fill-Mask • 0.1B • Updated Feb 25, 2025 • 16