Hugging Face's logo

mkychsu
/
semiconductor_graph_preflexor_grpo_2

Transformers
Safetensors
Generated from Trainer
trl
grpo
Model card Files
xet
 Community
mkychsu commited on
Commit
c698e4b
·
verified ·
1 Parent(s): 3c15b4f

Training in progress, step 5

Browse files
Files changed (4) hide show
  1. README.md +1 -1
  2. adapter_config.json +3 -3
  3. adapter_model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -26,7 +26,7 @@ print(output["generated_text"])
26
 
27
  ## Training procedure
28
 
29
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/micdonald/huggingface/runs/qfwqdmwf)
30
 
31
 
32
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
 
26
 
27
  ## Training procedure
28
 
29
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/micdonald/huggingface/runs/qqfj6wii)
30
 
31
 
32
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
adapter_config.json CHANGED
@@ -29,13 +29,13 @@
29
  "rank_pattern": {},
30
  "revision": null,
31
  "target_modules": [
32
- "down_proj",
33
- "gate_proj",
34
  "k_proj",
35
  "v_proj",
 
 
36
  "o_proj",
37
  "up_proj",
38
- "q_proj"
39
  ],
40
  "target_parameters": null,
41
  "task_type": "CAUSAL_LM",
 
29
  "rank_pattern": {},
30
  "revision": null,
31
  "target_modules": [
 
 
32
  "k_proj",
33
  "v_proj",
34
+ "gate_proj",
35
+ "q_proj",
36
  "o_proj",
37
  "up_proj",
38
+ "down_proj"
39
  ],
40
  "target_parameters": null,
41
  "task_type": "CAUSAL_LM",
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:610c7bab5a487aa767ac30cbcc95b910b4ca2230604630b296a4d9c5e1df6478
3
  size 167832240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fff9a8e641e5b0ab637102c21e34e55163a5a66d43a89fcc2b4bf28ad2b4a978
3
  size 167832240
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1cc71461d6b89bd923963f6e06757d6a70852e69b10550ab618da9e9e445e8f6
3
  size 7160
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97b6eb820218888ed8f1192bac086ef7b9af4160a50c38a0b019334405217bc0
3
  size 7160