Xerv-AI
/

CRAYON-tokenizer

Text Generation

hardware-accelerated

double-array-trie

Model card Files Files and versions

CRAYON-tokenizer / src /crayon /resources /dat /__init__.py

Phase-Technologies's picture

Phase-Technologies

Upload folder using huggingface_hub

708f4a3 verified 4 months ago

Raw History Blame Contribute Delete

40 Bytes

	"""
	Binary vocabulary data package.
	"""