Instructions to use Theoreticallyhugo/longformer-one-step with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Theoreticallyhugo/longformer-one-step with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="Theoreticallyhugo/longformer-one-step")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("Theoreticallyhugo/longformer-one-step") model = AutoModelForTokenClassification.from_pretrained("Theoreticallyhugo/longformer-one-step", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Training in progress, epoch 1
Browse files- config.json +12 -12
- model.safetensors +1 -1
- training_args.bin +1 -1
config.json
CHANGED
|
@@ -6,18 +6,18 @@
|
|
| 6 |
"attention_mode": "longformer",
|
| 7 |
"attention_probs_dropout_prob": 0.1,
|
| 8 |
"attention_window": [
|
| 9 |
-
|
| 10 |
-
|
| 11 |
-
|
| 12 |
-
|
| 13 |
-
|
| 14 |
-
|
| 15 |
-
|
| 16 |
-
|
| 17 |
-
|
| 18 |
-
|
| 19 |
-
|
| 20 |
-
|
| 21 |
],
|
| 22 |
"bos_token_id": 0,
|
| 23 |
"eos_token_id": 2,
|
|
|
|
| 6 |
"attention_mode": "longformer",
|
| 7 |
"attention_probs_dropout_prob": 0.1,
|
| 8 |
"attention_window": [
|
| 9 |
+
700,
|
| 10 |
+
700,
|
| 11 |
+
700,
|
| 12 |
+
700,
|
| 13 |
+
700,
|
| 14 |
+
700,
|
| 15 |
+
700,
|
| 16 |
+
700,
|
| 17 |
+
700,
|
| 18 |
+
700,
|
| 19 |
+
700,
|
| 20 |
+
700
|
| 21 |
],
|
| 22 |
"bos_token_id": 0,
|
| 23 |
"eos_token_id": 2,
|
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 592330980
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4586c95aa9bce865d4c7ff6cbbb0fd2c4cc5dd4ca370581fcc8b60ae6fedf25c
|
| 3 |
size 592330980
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4664
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4ab3f9bd817a01f5e51f9e3657c89b3b0ebe24c08154f4cf0ccfb3867646eb86
|
| 3 |
size 4664
|