Elliotte
/

Hubert-base-superb

Automatic Speech Recognition

Transformers

PyTorch

TensorBoard

hubert

Generated from Trainer

Model card Files Files and versions

xet

Metrics Training metrics Community

Hubert-base-superb / tokenizer_config.json

Elliotte

add tokenizer

62e2250 over 4 years ago

Raw History Blame

236 Bytes

{
  "bos_token": "<s>",
  "do_lower_case": false,
  "eos_token": "</s>",
  "pad_token": "[PAD]",
  "replace_word_delimiter_char": " ",
  "tokenizer_class": "Wav2Vec2CTCTokenizer",
  "unk_token": "[UNK]",
  "word_delimiter_token": "|"
}

	{
	"bos_token": "<s>",
	"do_lower_case": false,
	"eos_token": "</s>",
	"pad_token": "[PAD]",
	"replace_word_delimiter_char": " ",
	"tokenizer_class": "Wav2Vec2CTCTokenizer",
	"unk_token": "[UNK]",
	"word_delimiter_token": "\|"
	}