Instructions to use nornor02/CustomTokenizer with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nornor02/CustomTokenizer with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="nornor02/CustomTokenizer")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("nornor02/CustomTokenizer") model = AutoModelForMaskedLM.from_pretrained("nornor02/CustomTokenizer", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Training in progress, step 3500
Browse files
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 328693404
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:211760a3c1abebc88991fa337b5dcb424a6ff76570c4b9f59dfecce244c49a3b
|
| 3 |
size 328693404
|
runs/Jan10_01-30-15_e28f27bc0ed8/events.out.tfevents.1704850216.e28f27bc0ed8.6087.0
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:61dd061a70a19e208b504db09cbde0aec1e14e165ffd6092893c666e7e795fb7
|
| 3 |
+
size 5517
|