multimodal / transformers /utils /test_module /custom_tokenization.py
Li
add transformers
455a40f
Raw
History Blame Contribute Delete
88 Bytes
from transformers import BertTokenizer
class CustomTokenizer(BertTokenizer):
pass