goethe0101
/

GWP_Model

PEFT

PyTorch

gpt_neox

Model card Files Files and versions

xet

Community

GWP_Model / tokenizer_config.json

goethe0101

Create tokenizer_config.json

279463c over 3 years ago

Raw History Blame Contribute Delete

166 Bytes

{
    "name_or_path": "goethe0101/GWP_Model",
    "eos_token": "<|endoftext|>",
    "pad_token": "<|endoftext|>",
    "tokenizer_class": "PreTrainedTokenizerFast"
  }

	{
	"name_or_path": "goethe0101/GWP_Model",
	"eos_token": "<\|endoftext\|>",
	"pad_token": "<\|endoftext\|>",
	"tokenizer_class": "PreTrainedTokenizerFast"
	}