NandiBERT-150M / tokenization_nandi_encoder.py

Commit History

Yesterday

  1. Tokenizer adds word spaces for is_split_into_words; 146M encoder params; transformers_version in config⁠

    Verified signature
    77824b1

2 days ago

  1. Add final checkpoint (model, config, tokenizer, remote code)

    Verified signature
    577b04c