SentinelAI / config.json
Uchiha80971's picture
Upload 9 files
46ceb0d verified
Raw History Blame Contribute Delete
450 Bytes
{
"model_type": "sentinel_custom",
"architectures": [
"SentinelModel"
],
"vocab_size": 7053,
"hidden_size": 768,
"num_layers": 12,
"num_heads": 12,
"intermediate_size": 3072,
"max_position_embeddings": 768,
"dropout": 0.1,
"pad_token_id": 0,
"unk_token_id": 1,
"bos_token_id": 2,
"eos_token_id": 3,
"note": "Custom PyTorch architecture; not directly loadable via AutoModelForCausalLM without custom modeling code."
}