Create tokenizer.json

611e778 verified over 1 year ago

143 Bytes

Invalid JSON:Unexpected token 'r', "from transf"... is not valid JSON

	from transformers import BertTokenizer

	tokenizer = BertTokenizer.from_pretrained('bert-base-uncased')
	tokenizer.save_pretrained('./hf_model')