hinglish-embed-small / tokenizer.json

Commit History

Today

  1. Fix tokenizer for transformers.js (add_prefix_space; Python tokenization unchanged), add model_quantized.onnx, score ranges in card

    Verified signature
    bff3d54
  2. Add config, tokenizer, model card and training code

    Verified signature
    e43c1da