Hugging Face's logo

Spaces:
zeguru
/
tiny-transformers
Running on Zero

App Files Community
tiny-transformers / checkpoints /qa_tokenizer.json
zeguru's picture
zeguru
Upload folder using huggingface_hub
1717c0c verified
Raw History Blame Contribute Delete
1.33 kB
{
"version": 1,
"stoi": {
"<PAD>": 0,
"<UNK>": 1,
"<CLS>": 2,
"<SEP>": 3,
" ": 4,
"\"": 5,
"$": 6,
"%": 7,
"&": 8,
"'": 9,
"(": 10,
")": 11,
"+": 12,
",": 13,
"-": 14,
".": 15,
"/": 16,
"0": 17,
"1": 18,
"2": 19,
"3": 20,
"4": 21,
"5": 22,
"6": 23,
"7": 24,
"8": 25,
"9": 26,
":": 27,
";": 28,
"<": 29,
">": 30,
"?": 31,
"A": 32,
"B": 33,
"C": 34,
"D": 35,
"E": 36,
"F": 37,
"G": 38,
"H": 39,
"I": 40,
"J": 41,
"K": 42,
"L": 43,
"M": 44,
"N": 45,
"O": 46,
"P": 47,
"Q": 48,
"R": 49,
"S": 50,
"T": 51,
"U": 52,
"V": 53,
"W": 54,
"X": 55,
"Z": 56,
"[": 57,
"]": 58,
"a": 59,
"b": 60,
"c": 61,
"d": 62,
"e": 63,
"f": 64,
"g": 65,
"h": 66,
"i": 67,
"j": 68,
"k": 69,
"l": 70,
"m": 71,
"n": 72,
"o": 73,
"p": 74,
"q": 75,
"r": 76,
"s": 77,
"t": 78,
"u": 79,
"v": 80,
"w": 81,
"x": 82,
"y": 83,
"z": 84,
"ä": 85,
"å": 86,
"ö": 87,
"ũ": 88,
"ə": 89,
"ɛ": 90,
"ɲ": 91,
"ˈ": 92,
"–": 93,
"—": 94,
"’": 95,
"“": 96,
"”": 97
}
}