QuimBallester commited on
Commit
52d7668
·
verified ·
1 Parent(s): 1fc470c

End of training

Browse files
Files changed (1) hide show
  1. README.md +13 -11
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  library_name: transformers
3
- license: apache-2.0
4
- base_model: distilbert/distilbert-base-uncased
5
  tags:
6
  - generated_from_trainer
7
  metrics:
@@ -16,10 +16,10 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # question_focus_model
18
 
19
- This model is a fine-tuned version of [distilbert/distilbert-base-uncased](https://huggingface.co/distilbert/distilbert-base-uncased) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.6955
22
- - Accuracy: 0.5455
23
 
24
  ## Model description
25
 
@@ -38,20 +38,22 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 2e-05
42
- - train_batch_size: 16
43
- - eval_batch_size: 16
44
  - seed: 42
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
- - num_epochs: 2
 
48
 
49
  ### Training results
50
 
51
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
52
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
53
- | No log | 1.0 | 3 | 0.6953 | 0.5455 |
54
- | No log | 2.0 | 6 | 0.6955 | 0.5455 |
 
55
 
56
 
57
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
+ license: mit
4
+ base_model: facebook/bart-large-mnli
5
  tags:
6
  - generated_from_trainer
7
  metrics:
 
16
 
17
  # question_focus_model
18
 
19
+ This model is a fine-tuned version of [facebook/bart-large-mnli](https://huggingface.co/facebook/bart-large-mnli) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.6996
22
+ - Accuracy: 0.3636
23
 
24
  ## Model description
25
 
 
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
+ - learning_rate: 1e-05
42
+ - train_batch_size: 4
43
+ - eval_batch_size: 4
44
  - seed: 42
45
  - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
46
  - lr_scheduler_type: linear
47
+ - lr_scheduler_warmup_steps: 100
48
+ - num_epochs: 3
49
 
50
  ### Training results
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
53
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
54
+ | 0.6978 | 1.0 | 10 | 0.6996 | 0.3636 |
55
+ | 0.6806 | 2.0 | 20 | 0.7070 | 0.3636 |
56
+ | 0.5973 | 3.0 | 30 | 0.7446 | 0.4545 |
57
 
58
 
59
  ### Framework versions