matthoffner
/

santacoder-metal

Text Generation

code

Model card Files Files and versions

xet

Community

santacoder-metal / gpt_bigcode-santacoder-q3f16_0 /params /tokenizer_config.json

matthoffner

Upload 25 files

7b38f15 over 3 years ago

Raw History Blame Contribute Delete

159 Bytes

{
  "errors": "replace",
  "tokenizer_class": "GPT2TokenizerFast",
  "bos_token": "<|endoftext|>",
  "eos_token": "<|endoftext|>",
  "model_max_length": 2048
}

	{
	"errors": "replace",
	"tokenizer_class": "GPT2TokenizerFast",
	"bos_token": "<\|endoftext\|>",
	"eos_token": "<\|endoftext\|>",
	"model_max_length": 2048
	}