brikdavies
/

deepscaleR

Reinforcement Learning

Model card Files Files and versions

deepscaleR / gdpo_lambda0.3 /final_adapter

85.3 MB

Ctrl+K

Ctrl+K

1 contributor

History: 1 commit

brikdavies's picture

Add gdpo_lambda0.3/final_adapter

011af3c verified 6 months ago

README.md

5.25 kB
Add gdpo_lambda0.3/final_adapter 6 months ago
adapter_config.json

1.07 kB
Add gdpo_lambda0.3/final_adapter 6 months ago
adapter_model.safetensors

73.9 MB
xet

Add gdpo_lambda0.3/final_adapter 6 months ago
chat_template.jinja

2.25 kB
Add gdpo_lambda0.3/final_adapter 6 months ago
tokenizer.json

11.4 MB
xet

Add gdpo_lambda0.3/final_adapter 6 months ago
tokenizer_config.json

367 Bytes
Add gdpo_lambda0.3/final_adapter 6 months ago
training_args.bin
Detected Pickle imports (10)
- "transformers.trainer_utils.SchedulerType",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.training_args.OptimizerNames",
- "accelerate.state.PartialState",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy",
- "trl.trainer.grpo_config.GRPOConfig",
- "transformers.trainer_pt_utils.AcceleratorConfig"
How to fix it?
7.12 kB
xet

Add gdpo_lambda0.3/final_adapter 6 months ago