How to use HCKLab/BiBert-NSP with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("HCKLab/BiBert-NSP") model = AutoModel.from_pretrained("HCKLab/BiBert-NSP", device_map="auto")
cb2bec8
1
2
3
4
5
6
7
8
{ "[CLS]": 102, "[MASK]": 104, "[PAD]": 0, "[SEP]": 103, "[UNK]": 101 }
