Instructions to use nornor02/CustomTokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nornor02/CustomTokenizer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="nornor02/CustomTokenizer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("nornor02/CustomTokenizer") model = AutoModelForMaskedLM.from_pretrained("nornor02/CustomTokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit History
-
Model save
5e3fe48 -
Training in progress, step 5000
45e33a5 -
Training in progress, step 4500
b816a32 -
Training in progress, step 4000
637efbf -
Training in progress, step 3500
389b2b4 -
Training in progress, step 3000
c5448cc -
Training in progress, step 2500
40ce2b7 -
Training in progress, step 2000
daa41eb -
Training in progress, step 1500
ec95b6a -
Training in progress, step 1000
bf40bab -
Training in progress, step 500
784e96f -
Model save
f593deb -
Training in progress, step 2500
1c7073a -
Training in progress, step 2000
27bb946 -
Training in progress, step 1500
f68a2fc -
Training in progress, step 1000
9b605f5 -
Training in progress, step 500
075ba5b
-
Model save
23fa044 -
Training in progress, step 2500
101084f -
Training in progress, step 2000
fccac68 -
Training in progress, step 1500
9277088 -
Training in progress, step 1000
9379fa9 -
Training in progress, step 500
ec342d7 -
Model save
0b97a52 -
Training in progress, step 2500
c811560 -
Training in progress, step 2000
e614e83 -
Training in progress, step 1500
b4e0819 -
Training in progress, step 1000
d074b75 -
Training in progress, step 500
25f9771 -
Model save
4ad450f -
Training in progress, step 1000
801d927 -
Training in progress, step 500
c1909da
-
Model save
d059bfc -
Training in progress, step 1000
35275d0 -
Training in progress, step 500
bf730c6 -
initial commit
0161115