Fix config: lm_head is NOT tied (checkpoint stores two distinct 65x128 tensors; model.py never ties). Set tie_word_embeddings=false to match the artifact.

ea61a00 verified 17 days ago

Raw History Blame Contribute Delete

240 Bytes

	{
	"architectures": [
	"CharGPT"
	],
	"model_type": "charlm",
	"vocab_size": 65,
	"block_size": 128,
	"n_layer": 6,
	"n_head": 4,
	"n_embd": 128,
	"tie_word_embeddings": false,
	"n_params": 1216000,
	"torch_dtype": "float32"
	}