Instructions to use nornor02/working with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use nornor02/working with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="nornor02/working")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("nornor02/working") model = AutoModelForMaskedLM.from_pretrained("nornor02/working", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Training in progress, step 1000
Browse files- model.safetensors +1 -1
- runs/Jan17_14-32-52_ac16d127abb2/events.out.tfevents.1705501976.ac16d127abb2.27.0 +2 -2
- wandb/debug-internal.log +44 -0
- wandb/run-20240117_143308-ccq17kwy/files/output.log +2 -0
- wandb/run-20240117_143308-ccq17kwy/files/wandb-summary.json +1 -1
- wandb/run-20240117_143308-ccq17kwy/logs/debug-internal.log +44 -0
model.safetensors
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 328693404
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eb1d95bde9ef98230ef1ec9c8ca1f9f9866b58fe46e777a022a516fc80069b65
|
| 3 |
size 328693404
|
runs/Jan17_14-32-52_ac16d127abb2/events.out.tfevents.1705501976.ac16d127abb2.27.0
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:50fdd73637bd5181050b56d054576dc464b03804570ec2474eea15f95fa2d59d
|
| 3 |
+
size 4679
|
wandb/debug-internal.log
CHANGED
|
@@ -112,3 +112,47 @@
|
|
| 112 |
2024-01-17 14:35:12,960 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/config.yaml
|
| 113 |
2024-01-17 14:35:14,134 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 114 |
2024-01-17 14:35:17,382 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 112 |
2024-01-17 14:35:12,960 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/config.yaml
|
| 113 |
2024-01-17 14:35:14,134 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 114 |
2024-01-17 14:35:17,382 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 115 |
+
2024-01-17 14:35:19,140 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 116 |
+
2024-01-17 14:35:22,383 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 117 |
+
2024-01-17 14:35:24,142 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 118 |
+
2024-01-17 14:35:27,384 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 119 |
+
2024-01-17 14:35:29,143 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 120 |
+
2024-01-17 14:35:32,385 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 121 |
+
2024-01-17 14:35:34,145 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 122 |
+
2024-01-17 14:35:37,385 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 123 |
+
2024-01-17 14:35:39,037 DEBUG SenderThread:100 [sender.py:send():382] send: stats
|
| 124 |
+
2024-01-17 14:35:39,146 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 125 |
+
2024-01-17 14:35:43,038 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 126 |
+
2024-01-17 14:35:44,147 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 127 |
+
2024-01-17 14:35:48,039 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 128 |
+
2024-01-17 14:35:49,148 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 129 |
+
2024-01-17 14:35:53,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 130 |
+
2024-01-17 14:35:54,149 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 131 |
+
2024-01-17 14:35:58,041 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 132 |
+
2024-01-17 14:35:59,151 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 133 |
+
2024-01-17 14:36:03,041 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 134 |
+
2024-01-17 14:36:04,152 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 135 |
+
2024-01-17 14:36:08,042 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 136 |
+
2024-01-17 14:36:09,038 DEBUG SenderThread:100 [sender.py:send():382] send: stats
|
| 137 |
+
2024-01-17 14:36:09,153 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 138 |
+
2024-01-17 14:36:14,039 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 139 |
+
2024-01-17 14:36:14,153 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 140 |
+
2024-01-17 14:36:19,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 141 |
+
2024-01-17 14:36:19,160 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 142 |
+
2024-01-17 14:36:24,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 143 |
+
2024-01-17 14:36:24,165 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 144 |
+
2024-01-17 14:36:29,041 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 145 |
+
2024-01-17 14:36:29,167 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 146 |
+
2024-01-17 14:36:33,219 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: partial_history
|
| 147 |
+
2024-01-17 14:36:33,220 DEBUG SenderThread:100 [sender.py:send():382] send: history
|
| 148 |
+
2024-01-17 14:36:33,221 DEBUG SenderThread:100 [sender.py:send_request():409] send_request: summary_record
|
| 149 |
+
2024-01-17 14:36:33,223 INFO SenderThread:100 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
|
| 150 |
+
2024-01-17 14:36:33,991 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/wandb-summary.json
|
| 151 |
+
2024-01-17 14:36:34,223 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 152 |
+
2024-01-17 14:36:34,279 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 153 |
+
2024-01-17 14:36:37,993 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/output.log
|
| 154 |
+
2024-01-17 14:36:39,038 DEBUG SenderThread:100 [sender.py:send():382] send: stats
|
| 155 |
+
2024-01-17 14:36:39,289 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 156 |
+
2024-01-17 14:36:40,039 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 157 |
+
2024-01-17 14:36:44,289 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 158 |
+
2024-01-17 14:36:45,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
wandb/run-20240117_143308-ccq17kwy/files/output.log
CHANGED
|
@@ -1,4 +1,6 @@
|
|
| 1 |
You're using a PreTrainedTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
|
|
|
|
|
|
|
| 2 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 3 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 4 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
|
|
|
| 1 |
You're using a PreTrainedTokenizerFast tokenizer. Please note that with a fast tokenizer, using the `__call__` method is faster than using a method to encode the text followed by a call to the `pad` method to get a padded encoding.
|
| 2 |
+
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 3 |
+
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 4 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
| 5 |
warnings.warn('Was asked to gather along dimension 0, but all '
|
| 6 |
/opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
|
wandb/run-20240117_143308-ccq17kwy/files/wandb-summary.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"train/loss": 2.
|
|
|
|
| 1 |
+
{"train/loss": 2.0732, "train/learning_rate": 1.6153846153846154e-05, "train/epoch": 76.92, "train/global_step": 1000, "_timestamp": 1705502193.2191129, "_runtime": 204.72459888458252, "_step": 1}
|
wandb/run-20240117_143308-ccq17kwy/logs/debug-internal.log
CHANGED
|
@@ -112,3 +112,47 @@
|
|
| 112 |
2024-01-17 14:35:12,960 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/config.yaml
|
| 113 |
2024-01-17 14:35:14,134 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 114 |
2024-01-17 14:35:17,382 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 112 |
2024-01-17 14:35:12,960 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/config.yaml
|
| 113 |
2024-01-17 14:35:14,134 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 114 |
2024-01-17 14:35:17,382 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 115 |
+
2024-01-17 14:35:19,140 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 116 |
+
2024-01-17 14:35:22,383 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 117 |
+
2024-01-17 14:35:24,142 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 118 |
+
2024-01-17 14:35:27,384 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 119 |
+
2024-01-17 14:35:29,143 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 120 |
+
2024-01-17 14:35:32,385 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 121 |
+
2024-01-17 14:35:34,145 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 122 |
+
2024-01-17 14:35:37,385 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 123 |
+
2024-01-17 14:35:39,037 DEBUG SenderThread:100 [sender.py:send():382] send: stats
|
| 124 |
+
2024-01-17 14:35:39,146 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 125 |
+
2024-01-17 14:35:43,038 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 126 |
+
2024-01-17 14:35:44,147 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 127 |
+
2024-01-17 14:35:48,039 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 128 |
+
2024-01-17 14:35:49,148 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 129 |
+
2024-01-17 14:35:53,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 130 |
+
2024-01-17 14:35:54,149 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 131 |
+
2024-01-17 14:35:58,041 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 132 |
+
2024-01-17 14:35:59,151 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 133 |
+
2024-01-17 14:36:03,041 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 134 |
+
2024-01-17 14:36:04,152 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 135 |
+
2024-01-17 14:36:08,042 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 136 |
+
2024-01-17 14:36:09,038 DEBUG SenderThread:100 [sender.py:send():382] send: stats
|
| 137 |
+
2024-01-17 14:36:09,153 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 138 |
+
2024-01-17 14:36:14,039 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 139 |
+
2024-01-17 14:36:14,153 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 140 |
+
2024-01-17 14:36:19,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 141 |
+
2024-01-17 14:36:19,160 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 142 |
+
2024-01-17 14:36:24,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 143 |
+
2024-01-17 14:36:24,165 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 144 |
+
2024-01-17 14:36:29,041 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 145 |
+
2024-01-17 14:36:29,167 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 146 |
+
2024-01-17 14:36:33,219 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: partial_history
|
| 147 |
+
2024-01-17 14:36:33,220 DEBUG SenderThread:100 [sender.py:send():382] send: history
|
| 148 |
+
2024-01-17 14:36:33,221 DEBUG SenderThread:100 [sender.py:send_request():409] send_request: summary_record
|
| 149 |
+
2024-01-17 14:36:33,223 INFO SenderThread:100 [sender.py:_save_file():1403] saving file wandb-summary.json with policy end
|
| 150 |
+
2024-01-17 14:36:33,991 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/wandb-summary.json
|
| 151 |
+
2024-01-17 14:36:34,223 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 152 |
+
2024-01-17 14:36:34,279 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 153 |
+
2024-01-17 14:36:37,993 INFO Thread-12 :100 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240117_143308-ccq17kwy/files/output.log
|
| 154 |
+
2024-01-17 14:36:39,038 DEBUG SenderThread:100 [sender.py:send():382] send: stats
|
| 155 |
+
2024-01-17 14:36:39,289 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 156 |
+
2024-01-17 14:36:40,039 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|
| 157 |
+
2024-01-17 14:36:44,289 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: keepalive
|
| 158 |
+
2024-01-17 14:36:45,040 DEBUG HandlerThread:100 [handler.py:handle_request():146] handle_request: status_report
|