Instructions to use versae/roberta-base-ncc-512b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use versae/roberta-base-ncc-512b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="versae/roberta-base-ncc-512b")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("versae/roberta-base-ncc-512b") model = AutoModelForMaskedLM.from_pretrained("versae/roberta-base-ncc-512b", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Saving weights and logs of step 137000
Browse files- events.out.tfevents.1642691672.t1v-n-00e295a4-w-0.2612942.0.v2 +2 -2
- flax_model.msgpack +1 -1
- wandb/run-20220120_151428-zjqubvsf/files/output.log +2 -2
- wandb/run-20220120_151428-zjqubvsf/files/wandb-summary.json +1 -1
- wandb/run-20220120_151428-zjqubvsf/logs/debug-internal.log +2 -2
- wandb/run-20220120_151428-zjqubvsf/run-zjqubvsf.wandb +2 -2
events.out.tfevents.1642691672.t1v-n-00e295a4-w-0.2612942.0.v2
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:79c72a3583e19f9ca4709ae7ae2a534b25a864a0acd460d6068587b0f86800a9
|
| 3 |
+
size 20312456
|
flax_model.msgpack
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 498796983
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:caba99e4a88f5fdeb9cd3391a5f2ffeae210a650f5ca91db05887cfb4f3d20aa
|
| 3 |
size 498796983
|
wandb/run-20220120_151428-zjqubvsf/files/output.log
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:649734fe02d963da39362630ca3bd8f4ca9fafab23ec22b4ab82518c1911fa67
|
| 3 |
+
size 20979248
|
wandb/run-20220120_151428-zjqubvsf/files/wandb-summary.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"global_step":
|
|
|
|
| 1 |
+
{"global_step": 137000, "_timestamp": 1642932908.325906, "train_time": 5888961.0, "train_learning_rate": 2.3802200303180143e-05, "_runtime": 241240, "_step": 272291, "train_loss": 1.64174485206604, "eval_accuracy": 0.7302728295326233, "eval_loss": 1.2148007154464722}
|
wandb/run-20220120_151428-zjqubvsf/logs/debug-internal.log
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:77fe4548542c9093f6976147a38f3b0c0b3a500b493f1f7aebd380800ea32bfb
|
| 3 |
+
size 111500410
|
wandb/run-20220120_151428-zjqubvsf/run-zjqubvsf.wandb
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b2f40331f2d05d9d06a6ae2a1fd936072b23ce11cd237676ba7d02e9fe9d5277
|
| 3 |
+
size 124927206
|