Hugging Face's logo

DrDavis
/
PythonProject1

Model card Files
xet
 Community
PythonProject1 / .venv /transformers /utils /test_module /custom_tokenization.py
DrDavis's picture
DrDavis
Upload folder using huggingface_hub
17c6d62 verified
Raw
History Blame Contribute Delete
88 Bytes
from transformers import BertTokenizer
class CustomTokenizer(BertTokenizer):
 pass