Hugging Face's logo

liambyrne
/
distilbert-stackoverflow

Text Classification
Transformers
PyTorch
distilbert
Generated from Trainer
text-embeddings-inference
Model card Files
xet
 Community
1
liambyrne commited on
Commit
f721ef5
·
1 Parent(s): 7b204a1

End of training

Browse files
Files changed (1) hide show
  1. README.md +4 -5
README.md CHANGED
@@ -17,7 +17,7 @@ should probably proofread and complete it, then remove this comment. -->
17
 
18
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 0.5049
21
  - Accuracy: 0.8070
22
 
23
  ## Model description
@@ -43,19 +43,18 @@ The following hyperparameters were used during training:
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
- - num_epochs: 2
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
- | 0.3989 | 1.0 | 3125 | 0.5230 | 0.8070 |
53
- | 0.3816 | 2.0 | 6250 | 0.5049 | 0.8070 |
54
 
55
 
56
  ### Framework versions
57
 
58
  - Transformers 4.32.0
59
- - Pytorch 2.1.0+cu118
60
  - Datasets 2.15.0
61
  - Tokenizers 0.13.3
 
17
 
18
  This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 0.1701
21
  - Accuracy: 0.8070
22
 
23
  ## Model description
 
43
  - seed: 42
44
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
45
  - lr_scheduler_type: linear
46
+ - num_epochs: 1
47
 
48
  ### Training results
49
 
50
  | Training Loss | Epoch | Step | Validation Loss | Accuracy |
51
  |:-------------:|:-----:|:----:|:---------------:|:--------:|
52
+ | 0.1452 | 1.0 | 6250 | 0.1701 | 0.8070 |
 
53
 
54
 
55
  ### Framework versions
56
 
57
  - Transformers 4.32.0
58
+ - Pytorch 2.1.0+cu121
59
  - Datasets 2.15.0
60
  - Tokenizers 0.13.3