ardauzunoglu
/

caesar-cipher-tokenizer

Model card Files Files and versions

caesar-cipher-tokenizer / token_mapping.txt

ardauzunoglu's picture

Upload Caesar cipher tokenizer

c819ef3 verified about 2 months ago

Raw History Blame Contribute Delete

109 Bytes

	Token ID
	<pad> 0
	<s> 1
	</s> 2
	<unk> 3
	0 4
	1 5
	2 6
	3 7
	4 8
	5 9
	6 10
	7 11
	8 12
	9 13
	EQUALS 14
	CAESAR 15
	END 16