Instructions to use dandankim/distilbert-token-classifier with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use dandankim/distilbert-token-classifier with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="dandankim/distilbert-token-classifier")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("dandankim/distilbert-token-classifier") model = AutoModelForTokenClassification.from_pretrained("dandankim/distilbert-token-classifier", device_map="auto") - Notebooks
- Google Colab
- Kaggle
dandankim/token_classifier2
Browse files- README.md +19 -15
- model.safetensors +1 -1
- runs/Feb27_12-28-58_a77c74cb9061/events.out.tfevents.1740659341.a77c74cb9061.868.0 +3 -0
- runs/Feb27_12-28-58_a77c74cb9061/events.out.tfevents.1740659486.a77c74cb9061.868.1 +3 -0
- runs/Feb27_12-34-56_a77c74cb9061/events.out.tfevents.1740659697.a77c74cb9061.868.2 +3 -0
- runs/Feb27_12-36-18_a77c74cb9061/events.out.tfevents.1740659779.a77c74cb9061.868.3 +3 -0
- runs/Feb27_12-36-51_a77c74cb9061/events.out.tfevents.1740659812.a77c74cb9061.868.4 +3 -0
- runs/Feb27_12-37-48_a77c74cb9061/events.out.tfevents.1740659868.a77c74cb9061.868.5 +3 -0
- runs/Feb27_12-38-06_a77c74cb9061/events.out.tfevents.1740659886.a77c74cb9061.868.6 +3 -0
- runs/Feb27_12-44-26_a77c74cb9061/events.out.tfevents.1740660266.a77c74cb9061.868.7 +3 -0
- runs/Feb27_12-45-41_a77c74cb9061/events.out.tfevents.1740660341.a77c74cb9061.868.8 +3 -0
- runs/Feb27_13-03-02_a77c74cb9061/events.out.tfevents.1740661383.a77c74cb9061.868.12 +3 -0
- runs/Feb27_13-03-35_a77c74cb9061/events.out.tfevents.1740661415.a77c74cb9061.868.13 +3 -0
- training_args.bin +1 -1
README.md
CHANGED
|
@@ -21,11 +21,11 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 21 |
|
| 22 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
|
| 23 |
It achieves the following results on the evaluation set:
|
| 24 |
-
- Loss: 0.
|
| 25 |
-
- Precision: 0.
|
| 26 |
-
- Recall: 0.
|
| 27 |
-
- F1: 0.
|
| 28 |
-
- Accuracy: 0.
|
| 29 |
|
| 30 |
## Model description
|
| 31 |
|
|
@@ -44,28 +44,32 @@ More information needed
|
|
| 44 |
### Training hyperparameters
|
| 45 |
|
| 46 |
The following hyperparameters were used during training:
|
| 47 |
-
- learning_rate:
|
| 48 |
-
- train_batch_size:
|
| 49 |
-
- eval_batch_size:
|
| 50 |
- seed: 42
|
| 51 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 52 |
- lr_scheduler_type: linear
|
| 53 |
-
-
|
|
|
|
| 54 |
|
| 55 |
### Training results
|
| 56 |
|
| 57 |
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
| 58 |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
| 59 |
-
| 0.
|
| 60 |
-
| 0.
|
| 61 |
-
| 0.
|
| 62 |
-
| 0.
|
| 63 |
-
| 0.
|
|
|
|
|
|
|
|
|
|
| 64 |
|
| 65 |
|
| 66 |
### Framework versions
|
| 67 |
|
| 68 |
- Transformers 4.48.3
|
| 69 |
- Pytorch 2.5.1+cu124
|
| 70 |
-
- Datasets 3.3.
|
| 71 |
- Tokenizers 0.21.0
|
|
|
|
| 21 |
|
| 22 |
This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
|
| 23 |
It achieves the following results on the evaluation set:
|
| 24 |
+
- Loss: 0.0738
|
| 25 |
+
- Precision: 0.9657
|
| 26 |
+
- Recall: 0.9761
|
| 27 |
+
- F1: 0.9709
|
| 28 |
+
- Accuracy: 0.9845
|
| 29 |
|
| 30 |
## Model description
|
| 31 |
|
|
|
|
| 44 |
### Training hyperparameters
|
| 45 |
|
| 46 |
The following hyperparameters were used during training:
|
| 47 |
+
- learning_rate: 2e-05
|
| 48 |
+
- train_batch_size: 16
|
| 49 |
+
- eval_batch_size: 16
|
| 50 |
- seed: 42
|
| 51 |
- optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
|
| 52 |
- lr_scheduler_type: linear
|
| 53 |
+
- lr_scheduler_warmup_ratio: 0.1
|
| 54 |
+
- num_epochs: 10
|
| 55 |
|
| 56 |
### Training results
|
| 57 |
|
| 58 |
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
| 59 |
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
| 60 |
+
| 0.898 | 1.0 | 149 | 0.1613 | 0.8995 | 0.8729 | 0.8860 | 0.9637 |
|
| 61 |
+
| 0.1161 | 2.0 | 298 | 0.0749 | 0.9682 | 0.9501 | 0.9591 | 0.9790 |
|
| 62 |
+
| 0.0717 | 3.0 | 447 | 0.0762 | 0.9723 | 0.9630 | 0.9676 | 0.9814 |
|
| 63 |
+
| 0.0412 | 4.0 | 596 | 0.0661 | 0.9699 | 0.9694 | 0.9697 | 0.9845 |
|
| 64 |
+
| 0.0295 | 5.0 | 745 | 0.0630 | 0.9596 | 0.9739 | 0.9667 | 0.9835 |
|
| 65 |
+
| 0.0262 | 6.0 | 894 | 0.0658 | 0.9696 | 0.9732 | 0.9714 | 0.9851 |
|
| 66 |
+
| 0.0191 | 7.0 | 1043 | 0.0695 | 0.9696 | 0.9707 | 0.9702 | 0.9846 |
|
| 67 |
+
| 0.0165 | 8.0 | 1192 | 0.0738 | 0.9657 | 0.9761 | 0.9709 | 0.9845 |
|
| 68 |
|
| 69 |
|
| 70 |
### Framework versions
|
| 71 |
|
| 72 |
- Transformers 4.48.3
|
| 73 |
- Pytorch 2.5.1+cu124
|
| 74 |
+
- Datasets 3.3.2
|
| 75 |
- Tokenizers 0.21.0
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 265516156
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b21e75c082fe70716c9e78e7ac9075627dd6dcc9c27b08c05ece728bd4287d78
|
| 3 |
size 265516156
|
runs/Feb27_12-28-58_a77c74cb9061/events.out.tfevents.1740659341.a77c74cb9061.868.0
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:504d8f8b54c845418ecc4cd908468d939e3904ee3c1f9a4d1562b68aa2322f55
|
| 3 |
+
size 91863
|
runs/Feb27_12-28-58_a77c74cb9061/events.out.tfevents.1740659486.a77c74cb9061.868.1
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d60779ff20c358352ea09f99c49254601f0d45453dfb2456913a2df7820ea8b
|
| 3 |
+
size 560
|
runs/Feb27_12-34-56_a77c74cb9061/events.out.tfevents.1740659697.a77c74cb9061.868.2
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:95fd0536193efd03eec176f247744729d248330ed5bbd85477a3c2c6ea63b0e9
|
| 3 |
+
size 33629
|
runs/Feb27_12-36-18_a77c74cb9061/events.out.tfevents.1740659779.a77c74cb9061.868.3
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:062cab65e53ef8d6dc54276c2062e9d1a8a39b18839d5251073370f943947639
|
| 3 |
+
size 7973
|
runs/Feb27_12-36-51_a77c74cb9061/events.out.tfevents.1740659812.a77c74cb9061.868.4
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8c837a4cbc0f94a8962d6b85c1e6009a2c55ec9557b8f3f3041d8b8fd172b2b2
|
| 3 |
+
size 12713
|
runs/Feb27_12-37-48_a77c74cb9061/events.out.tfevents.1740659868.a77c74cb9061.868.5
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:6fa6b573e8b90eeab015c68d8fc4d5bd12e7b44bf4de7131c4226cdde8d3f917
|
| 3 |
+
size 5855
|
runs/Feb27_12-38-06_a77c74cb9061/events.out.tfevents.1740659886.a77c74cb9061.868.6
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d603c96f7f44b3b2ed34f592c0bf84c56cd4faace013b28494a1897892949a9
|
| 3 |
+
size 28415
|
runs/Feb27_12-44-26_a77c74cb9061/events.out.tfevents.1740660266.a77c74cb9061.868.7
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9db4508729d19d1f98953ec44a0a63c0592221553eac15b293eb11ee6f0928bd
|
| 3 |
+
size 10688
|
runs/Feb27_12-45-41_a77c74cb9061/events.out.tfevents.1740660341.a77c74cb9061.868.8
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:5dc50c91ea37b814fecc597a2ea3911095e8e7ff98fd85f55fb81684e53be967
|
| 3 |
+
size 14829
|
runs/Feb27_13-03-02_a77c74cb9061/events.out.tfevents.1740661383.a77c74cb9061.868.12
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7f19e7db9d8cce5660439d19145c28542250d72abc2173c84719460038f416a8
|
| 3 |
+
size 7162
|
runs/Feb27_13-03-35_a77c74cb9061/events.out.tfevents.1740661415.a77c74cb9061.868.13
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:95cd5fbbf4e40ced25db1912e53bc49c8c425457a2477cf97c1ac6f7f948675a
|
| 3 |
+
size 14829
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 5368
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:7787e2f7d843089369530f9da3cbba46eb271f002f6deb2d26ddbced101d2372
|
| 3 |
size 5368
|