scenegraph_image_captioning_vi

This model is a fine-tuned version of facebook/mbart-large-50 on an unknown dataset. It achieves the following results on the evaluation set:

• Loss: 3.1815
• Bleu4: 16.1492

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 3e-05
• train_batch_size: 48
• eval_batch_size: 48
• seed: 42
• gradient_accumulation_steps: 2
• total_train_batch_size: 96
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 350
• num_epochs: 30

Training results

Training Loss	Epoch	Step	Bleu4	Validation Loss
3.5137	1.0	3083	11.8025	3.4747
3.3145	2.0	6166	13.309	3.3252
3.1957	3.0	9249	14.2144	3.2632
3.1449	4.0	12332	14.8718	3.2247
3.1078	5.0	15415	15.1815	3.1963
3.0352	6.0	18498	15.2137	3.1796
3.0147	7.0	21581	15.7702	3.1697
2.971	8.0	24664	16.0201	3.1662
2.9144	9.0	27747	16.1495	3.1623
2.9037	10.0	30830	16.0747	3.1611
2.9178	11.0	33913	16.2077	3.1575
2.8687	12.0	36996	16.1345	3.1594
2.8426	13.0	40079	16.2958	3.1618
2.8058	14.0	43162	16.2391	3.1639
2.814	15.0	46245	16.341	3.1722
2.782	16.0	49328	3.1683	16.0129
2.7853	17.0	52411	3.1772	16.1951
2.7313	18.0	55494	3.1846	16.0554
2.7525	19.0	58577	3.1876	16.0271
2.7183	20.0	61660	3.1815	16.1492

Framework versions

• Transformers 4.51.0
• Pytorch 2.11.0+cu128
• Datasets 4.0.0
• Tokenizers 0.21.4