answerdotai
/

ModernBERT-large

Model card Files Files and versions

ModernBERT-large / tokenizer_config.json

Commit History

Set tokenizer "model_max_length" property to 8192 (#9)

45bb465
verified

NohTow commited on Jan 15, 2025

undo last commit

4bbcbf4
verified

bclavie commited on Jan 11, 2025

Add `"add_prefix_space": true,`; this allows for much stronger token-level performance (e.g. NER, ColBERT) (#10)

d1d612e
verified

tomaarsen HF Staff commited on Jan 11, 2025

Update tokenizer: Set lstrip=True for [MASK]

b1cadbc

Tom Aarsen commited on Dec 17, 2024

Upload ModernBERT-large model

dca61cc

Tom Aarsen commited on Dec 11, 2024