PowerMachine
/

BiGRU_T_version

Model card Files Files and versions

BiGRU_T_version / src /bigru_t /tokenizer /__init__.py

PowerMachine's picture

Upload folder using huggingface_hub

3275441 verified 2 months ago

Raw History Blame Contribute Delete

74 Bytes

	"""BBPE Tokenizer (reaproveitado do source flexnet/bbpe_tokenizer.py)."""