Instructions to use versae/roberta-base-ncc-512b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use versae/roberta-base-ncc-512b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="versae/roberta-base-ncc-512b")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("versae/roberta-base-ncc-512b") model = AutoModelForMaskedLM.from_pretrained("versae/roberta-base-ncc-512b", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Saving weights and logs of step 156000
Browse files- events.out.tfevents.1642691672.t1v-n-00e295a4-w-0.2612942.0.v2 +2 -2
- flax_model.msgpack +1 -1
- wandb/run-20220120_151428-zjqubvsf/files/output.log +2 -2
- wandb/run-20220120_151428-zjqubvsf/files/wandb-summary.json +1 -1
- wandb/run-20220120_151428-zjqubvsf/logs/debug-internal.log +2 -2
- wandb/run-20220120_151428-zjqubvsf/run-zjqubvsf.wandb +2 -2
events.out.tfevents.1642691672.t1v-n-00e295a4-w-0.2612942.0.v2
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:fd6baafbb08693183bd408d3486a3a20b39463a25fbe09da3ce2b54edf3041f9
|
| 3 |
+
size 23147484
|
flax_model.msgpack
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 498796983
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:d148f92fe270d5f799c2cad9e2f6f95bebce35d28d8a7ab875c0095df3ecf93d
|
| 3 |
size 498796983
|
wandb/run-20220120_151428-zjqubvsf/files/output.log
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b8c8abefe53688f944c10ae49cc64eb0328bf69e4c19962f208f1ec9379ac3dd
|
| 3 |
+
size 30258628
|
wandb/run-20220120_151428-zjqubvsf/files/wandb-summary.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"global_step":
|
|
|
|
| 1 |
+
{"global_step": 156000, "_timestamp": 1642966546.884801, "train_time": 7179223.0, "train_learning_rate": 6.1716291384072974e-06, "_runtime": 274878, "_step": 310234, "train_loss": 1.5842206478118896, "eval_accuracy": 0.732329249382019, "eval_loss": 1.2029333114624023}
|
wandb/run-20220120_151428-zjqubvsf/logs/debug-internal.log
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9d68bb8bad3657ac1fcd5b82d4f7f7a0610fe04c3e56023fb9ea8d21c6a65b39
|
| 3 |
+
size 127023121
|
wandb/run-20220120_151428-zjqubvsf/run-zjqubvsf.wandb
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f8eb124e8c28aad0e9513640706db184ddfe8bfd88c8a8a13e97bb6611a27ffa
|
| 3 |
+
size 149831110
|