Hugging Face's logo

thobuiq
/
teamtrack-ai

Text Generation
Transformers
TensorBoard
Safetensors
mistral
trl
dpo
Generated from Trainer
text-generation-inference
4-bit precision
gptq
Model card Files
xet
 Metrics Community
thobuiq commited on
Commit
a4978dc
·
verified ·
1 Parent(s): 737c0bf

Update config.json

Browse files
Files changed (1) hide show
  1. config.json +2 -2
config.json CHANGED
@@ -1,6 +1,6 @@
1
  {
2
  "architectures": [
3
- "LlamaForCausalLM"
4
  ],
5
  "bos_token_id": 1,
6
  "eos_token_id": 2,
@@ -9,7 +9,7 @@
9
  "initializer_range": 0.02,
10
  "intermediate_size": 28672,
11
  "max_position_embeddings": 8192,
12
- "model_type": "llama",
13
  "num_attention_heads": 64,
14
  "num_hidden_layers": 80,
15
  "num_key_value_heads": 8,
 
1
  {
2
  "architectures": [
3
+ "MistralForCausalLM"
4
  ],
5
  "bos_token_id": 1,
6
  "eos_token_id": 2,
 
9
  "initializer_range": 0.02,
10
  "intermediate_size": 28672,
11
  "max_position_embeddings": 8192,
12
+ "model_type": "mistral",
13
  "num_attention_heads": 64,
14
  "num_hidden_layers": 80,
15
  "num_key_value_heads": 8,