Upload folder using huggingface_hub

sft/checkpoint-900/README.md

@@ -0,0 +1,206 @@
+---
+base_model: Itau-Unibanco/NorBERTo-base
+library_name: peft
+tags:
+- base_model:adapter:Itau-Unibanco/NorBERTo-base
+- lora
+- transformers
+---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]
+### Framework versions
+
+- PEFT 0.20.0

sft/checkpoint-900/adapter_config.json

@@ -0,0 +1,46 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Itau-Unibanco/NorBERTo-base",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "monteclora_config": null,
+  "peft_type": "LORA",
+  "peft_version": "0.20.0",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "Wo",
+    "Wqkv",
+    "Wi"
+  ],
+  "target_parameters": null,
+  "task_type": "FEATURE_EXTRACTION",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false,
+  "velora_config": null
+}

sft/checkpoint-900/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa6452c598bf09450dc4e6e4e42cfd12950bcb51e453f9fc3edc3a6ce7543675
+size 13538528

sft/checkpoint-900/optimizer.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af1b00c0ac195915ad6b7e72e9086334ffe07c5d80bd76698e47821767e15812
+size 27204427

sft/checkpoint-900/rng_state_0.pth

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ee4a89b3891f7a9dab98e3702364bef8984c152254eb9035f3d6484087a8597d
+size 14917

sft/checkpoint-900/scaler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:13f18f445aef18c0b4d129c12238b4ac9fdd0fb8dd7a1529aa9caf8d7316aa5a
+size 1383

sft/checkpoint-900/scheduler.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:af971e16398decb2c0aefcb1e7073347522d1100c3af60b916b8c9667ea4b433
+size 1465

sft/checkpoint-900/sft/adapter_config.json

@@ -0,0 +1,50 @@
+{
+  "alora_invocation_tokens": null,
+  "alpha_pattern": {},
+  "arrow_config": null,
+  "auto_mapping": null,
+  "base_model_name_or_path": "Itau-Unibanco/NorBERTo-base",
+  "bias": "none",
+  "corda_config": null,
+  "ensure_weight_tying": false,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0.05,
+  "lora_ga_config": null,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": [
+    "classifier",
+    "classifier",
+    "score"
+  ],
+  "monteclora_config": null,
+  "peft_type": "LORA",
+  "peft_version": "0.20.0",
+  "qalora_group_size": 16,
+  "r": 16,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "Wo",
+    "Wqkv",
+    "Wi"
+  ],
+  "target_parameters": null,
+  "task_type": "SEQ_CLS",
+  "trainable_token_indices": null,
+  "use_bdlora": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false,
+  "velora_config": null
+}

sft/checkpoint-900/sft/adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:081626efa896966a0e2d16f6f0addb9aa4b266855f69b0dc41f0ea93d2edebdd
+size 13547940

sft/checkpoint-900/tokenizer_config.json

@@ -0,0 +1,19 @@
+{
+  "backend": "tokenizers",
+  "bos_token": "[CLS]",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "[SEP]",
+  "is_local": false,
+  "local_files_only": false,
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "padding_side": "right",
+  "tokenizer_class": "TokenizersBackend",
+  "truncation_side": "right",
+  "unk_token": "[UNK]"
+}

sft/checkpoint-900/trainer_state.json

@@ -0,0 +1,514 @@
+{
+  "best_global_step": null,
+  "best_metric": null,
+  "best_model_checkpoint": null,
+  "epoch": 1.0204139495321802,
+  "eval_steps": 150,
+  "global_step": 900,
+  "is_hyper_param_search": false,
+  "is_local_process_zero": true,
+  "is_world_process_zero": true,
+  "log_history": [
+    {
+      "epoch": 0.01701162461015027,
+      "grad_norm": 116.99359893798828,
+      "learning_rate": 4.666666666666667e-06,
+      "loss": 39.077762858072916,
+      "step": 15
+    },
+    {
+      "epoch": 0.03402324922030054,
+      "grad_norm": 114.67162322998047,
+      "learning_rate": 9.666666666666667e-06,
+      "loss": 37.629154459635416,
+      "step": 30
+    },
+    {
+      "epoch": 0.05103487383045081,
+      "grad_norm": 78.71202850341797,
+      "learning_rate": 1.4666666666666668e-05,
+      "loss": 36.40402018229167,
+      "step": 45
+    },
+    {
+      "epoch": 0.06804649844060108,
+      "grad_norm": 77.94384002685547,
+      "learning_rate": 1.9666666666666666e-05,
+      "loss": 35.03992513020833,
+      "step": 60
+    },
+    {
+      "epoch": 0.08505812305075135,
+      "grad_norm": 69.6011734008789,
+      "learning_rate": 2.466666666666667e-05,
+      "loss": 34.81482747395833,
+      "step": 75
+    },
+    {
+      "epoch": 0.10206974766090161,
+      "grad_norm": 74.6609878540039,
+      "learning_rate": 2.9666666666666672e-05,
+      "loss": 33.83201497395833,
+      "step": 90
+    },
+    {
+      "epoch": 0.11908137227105188,
+      "grad_norm": 73.47967529296875,
+      "learning_rate": 3.466666666666667e-05,
+      "loss": 34.1611328125,
+      "step": 105
+    },
+    {
+      "epoch": 0.13609299688120216,
+      "grad_norm": 57.3227424621582,
+      "learning_rate": 3.966666666666667e-05,
+      "loss": 33.17495524088542,
+      "step": 120
+    },
+    {
+      "epoch": 0.15310462149135243,
+      "grad_norm": 41.92803955078125,
+      "learning_rate": 4.466666666666667e-05,
+      "loss": 33.14850056966146,
+      "step": 135
+    },
+    {
+      "epoch": 0.1701162461015027,
+      "grad_norm": 57.70565414428711,
+      "learning_rate": 4.966666666666667e-05,
+      "loss": 33.152496337890625,
+      "step": 150
+    },
+    {
+      "epoch": 0.1701162461015027,
+      "eval_accuracy": 0.519298245614035,
+      "eval_loss": 1.9665578603744507,
+      "eval_macro_f1": 0.43657905964809113,
+      "eval_runtime": 7.6538,
+      "eval_samples_per_second": 74.472,
+      "eval_steps_per_second": 9.407,
+      "step": 150
+    },
+    {
+      "epoch": 0.18712787071165296,
+      "grad_norm": 63.17024612426758,
+      "learning_rate": 4.940323955669225e-05,
+      "loss": 31.66871541341146,
+      "step": 165
+    },
+    {
+      "epoch": 0.20413949532180323,
+      "grad_norm": 73.78040313720703,
+      "learning_rate": 4.8763853367433935e-05,
+      "loss": 31.002229817708333,
+      "step": 180
+    },
+    {
+      "epoch": 0.2211511199319535,
+      "grad_norm": 46.99962615966797,
+      "learning_rate": 4.812446717817562e-05,
+      "loss": 31.49439900716146,
+      "step": 195
+    },
+    {
+      "epoch": 0.23816274454210376,
+      "grad_norm": 59.367454528808594,
+      "learning_rate": 4.748508098891731e-05,
+      "loss": 30.110245768229166,
+      "step": 210
+    },
+    {
+      "epoch": 0.25517436915225405,
+      "grad_norm": 65.87191009521484,
+      "learning_rate": 4.6845694799659e-05,
+      "loss": 31.120613606770835,
+      "step": 225
+    },
+    {
+      "epoch": 0.2721859937624043,
+      "grad_norm": 54.601192474365234,
+      "learning_rate": 4.620630861040069e-05,
+      "loss": 30.689495849609376,
+      "step": 240
+    },
+    {
+      "epoch": 0.2891976183725546,
+      "grad_norm": 85.62554931640625,
+      "learning_rate": 4.5566922421142375e-05,
+      "loss": 28.9639892578125,
+      "step": 255
+    },
+    {
+      "epoch": 0.30620924298270485,
+      "grad_norm": 55.505699157714844,
+      "learning_rate": 4.492753623188406e-05,
+      "loss": 29.698612467447916,
+      "step": 270
+    },
+    {
+      "epoch": 0.3232208675928551,
+      "grad_norm": 48.24406051635742,
+      "learning_rate": 4.428815004262575e-05,
+      "loss": 28.051249186197918,
+      "step": 285
+    },
+    {
+      "epoch": 0.3402324922030054,
+      "grad_norm": 83.22586822509766,
+      "learning_rate": 4.364876385336744e-05,
+      "loss": 27.165751139322918,
+      "step": 300
+    },
+    {
+      "epoch": 0.3402324922030054,
+      "eval_accuracy": 0.6140350877192983,
+      "eval_loss": 1.7097147703170776,
+      "eval_macro_f1": 0.5762605966740592,
+      "eval_runtime": 3.4179,
+      "eval_samples_per_second": 166.769,
+      "eval_steps_per_second": 21.066,
+      "step": 300
+    },
+    {
+      "epoch": 0.35724411681315565,
+      "grad_norm": 60.6512451171875,
+      "learning_rate": 4.300937766410913e-05,
+      "loss": 27.327327473958334,
+      "step": 315
+    },
+    {
+      "epoch": 0.3742557414233059,
+      "grad_norm": 75.39328002929688,
+      "learning_rate": 4.2369991474850815e-05,
+      "loss": 28.38462931315104,
+      "step": 330
+    },
+    {
+      "epoch": 0.3912673660334562,
+      "grad_norm": 60.53544235229492,
+      "learning_rate": 4.17306052855925e-05,
+      "loss": 28.571195475260417,
+      "step": 345
+    },
+    {
+      "epoch": 0.40827899064360645,
+      "grad_norm": 66.51234436035156,
+      "learning_rate": 4.109121909633419e-05,
+      "loss": 27.315740966796874,
+      "step": 360
+    },
+    {
+      "epoch": 0.4252906152537567,
+      "grad_norm": 71.48542785644531,
+      "learning_rate": 4.045183290707588e-05,
+      "loss": 26.424430338541665,
+      "step": 375
+    },
+    {
+      "epoch": 0.442302239863907,
+      "grad_norm": 65.96041107177734,
+      "learning_rate": 3.981244671781757e-05,
+      "loss": 26.818721516927084,
+      "step": 390
+    },
+    {
+      "epoch": 0.45931386447405725,
+      "grad_norm": 96.44197082519531,
+      "learning_rate": 3.9173060528559255e-05,
+      "loss": 27.456418863932292,
+      "step": 405
+    },
+    {
+      "epoch": 0.4763254890842075,
+      "grad_norm": 74.46075439453125,
+      "learning_rate": 3.8533674339300943e-05,
+      "loss": 27.342032877604165,
+      "step": 420
+    },
+    {
+      "epoch": 0.4933371136943578,
+      "grad_norm": 98.2132339477539,
+      "learning_rate": 3.789428815004263e-05,
+      "loss": 27.26170654296875,
+      "step": 435
+    },
+    {
+      "epoch": 0.5103487383045081,
+      "grad_norm": 66.33806610107422,
+      "learning_rate": 3.725490196078432e-05,
+      "loss": 26.62706298828125,
+      "step": 450
+    },
+    {
+      "epoch": 0.5103487383045081,
+      "eval_accuracy": 0.6473684210526316,
+      "eval_loss": 1.612095832824707,
+      "eval_macro_f1": 0.6036091764418378,
+      "eval_runtime": 3.4226,
+      "eval_samples_per_second": 166.541,
+      "eval_steps_per_second": 21.037,
+      "step": 450
+    },
+    {
+      "epoch": 0.5273603629146584,
+      "grad_norm": 59.41883087158203,
+      "learning_rate": 3.661551577152601e-05,
+      "loss": 25.6656494140625,
+      "step": 465
+    },
+    {
+      "epoch": 0.5443719875248086,
+      "grad_norm": 86.57988739013672,
+      "learning_rate": 3.5976129582267696e-05,
+      "loss": 25.688761393229168,
+      "step": 480
+    },
+    {
+      "epoch": 0.5613836121349589,
+      "grad_norm": 87.54814147949219,
+      "learning_rate": 3.5336743393009384e-05,
+      "loss": 26.806388346354165,
+      "step": 495
+    },
+    {
+      "epoch": 0.5783952367451092,
+      "grad_norm": 65.40018463134766,
+      "learning_rate": 3.469735720375107e-05,
+      "loss": 25.533500162760415,
+      "step": 510
+    },
+    {
+      "epoch": 0.5954068613552594,
+      "grad_norm": 65.12799072265625,
+      "learning_rate": 3.405797101449276e-05,
+      "loss": 26.228350830078124,
+      "step": 525
+    },
+    {
+      "epoch": 0.6124184859654097,
+      "grad_norm": 65.55587768554688,
+      "learning_rate": 3.341858482523445e-05,
+      "loss": 26.634810384114584,
+      "step": 540
+    },
+    {
+      "epoch": 0.62943011057556,
+      "grad_norm": 68.18641662597656,
+      "learning_rate": 3.2779198635976136e-05,
+      "loss": 25.533231608072917,
+      "step": 555
+    },
+    {
+      "epoch": 0.6464417351857102,
+      "grad_norm": 80.25837707519531,
+      "learning_rate": 3.2139812446717824e-05,
+      "loss": 24.925142415364583,
+      "step": 570
+    },
+    {
+      "epoch": 0.6634533597958605,
+      "grad_norm": 58.9185905456543,
+      "learning_rate": 3.150042625745951e-05,
+      "loss": 24.743680826822917,
+      "step": 585
+    },
+    {
+      "epoch": 0.6804649844060108,
+      "grad_norm": 59.13557815551758,
+      "learning_rate": 3.08610400682012e-05,
+      "loss": 25.899686686197917,
+      "step": 600
+    },
+    {
+      "epoch": 0.6804649844060108,
+      "eval_accuracy": 0.6421052631578947,
+      "eval_loss": 1.5752904415130615,
+      "eval_macro_f1": 0.6148540921288014,
+      "eval_runtime": 3.4091,
+      "eval_samples_per_second": 167.201,
+      "eval_steps_per_second": 21.12,
+      "step": 600
+    },
+    {
+      "epoch": 0.697476609016161,
+      "grad_norm": 63.18887710571289,
+      "learning_rate": 3.0221653878942884e-05,
+      "loss": 25.722517903645834,
+      "step": 615
+    },
+    {
+      "epoch": 0.7144882336263113,
+      "grad_norm": 81.7510757446289,
+      "learning_rate": 2.9582267689684573e-05,
+      "loss": 24.722237141927085,
+      "step": 630
+    },
+    {
+      "epoch": 0.7314998582364616,
+      "grad_norm": 59.331199645996094,
+      "learning_rate": 2.894288150042626e-05,
+      "loss": 25.852589925130207,
+      "step": 645
+    },
+    {
+      "epoch": 0.7485114828466118,
+      "grad_norm": 82.33928680419922,
+      "learning_rate": 2.830349531116795e-05,
+      "loss": 25.581608072916666,
+      "step": 660
+    },
+    {
+      "epoch": 0.7655231074567621,
+      "grad_norm": 73.93915557861328,
+      "learning_rate": 2.7664109121909637e-05,
+      "loss": 24.140205891927085,
+      "step": 675
+    },
+    {
+      "epoch": 0.7825347320669124,
+      "grad_norm": 88.01911926269531,
+      "learning_rate": 2.7024722932651325e-05,
+      "loss": 25.460465494791666,
+      "step": 690
+    },
+    {
+      "epoch": 0.7995463566770626,
+      "grad_norm": 74.82182312011719,
+      "learning_rate": 2.6385336743393013e-05,
+      "loss": 25.53566691080729,
+      "step": 705
+    },
+    {
+      "epoch": 0.8165579812872129,
+      "grad_norm": 53.480384826660156,
+      "learning_rate": 2.57459505541347e-05,
+      "loss": 24.06074422200521,
+      "step": 720
+    },
+    {
+      "epoch": 0.8335696058973632,
+      "grad_norm": 62.765567779541016,
+      "learning_rate": 2.510656436487639e-05,
+      "loss": 25.66954142252604,
+      "step": 735
+    },
+    {
+      "epoch": 0.8505812305075134,
+      "grad_norm": 61.93996047973633,
+      "learning_rate": 2.4467178175618073e-05,
+      "loss": 25.64231160481771,
+      "step": 750
+    },
+    {
+      "epoch": 0.8505812305075134,
+      "eval_accuracy": 0.6666666666666666,
+      "eval_loss": 1.4923547506332397,
+      "eval_macro_f1": 0.634289650129149,
+      "eval_runtime": 3.4068,
+      "eval_samples_per_second": 167.313,
+      "eval_steps_per_second": 21.134,
+      "step": 750
+    },
+    {
+      "epoch": 0.8675928551176637,
+      "grad_norm": 88.9131851196289,
+      "learning_rate": 2.382779198635976e-05,
+      "loss": 25.273152669270832,
+      "step": 765
+    },
+    {
+      "epoch": 0.884604479727814,
+      "grad_norm": 103.49991607666016,
+      "learning_rate": 2.318840579710145e-05,
+      "loss": 25.633394368489583,
+      "step": 780
+    },
+    {
+      "epoch": 0.9016161043379642,
+      "grad_norm": 71.47494506835938,
+      "learning_rate": 2.2549019607843138e-05,
+      "loss": 24.569466145833335,
+      "step": 795
+    },
+    {
+      "epoch": 0.9186277289481145,
+      "grad_norm": 84.61474609375,
+      "learning_rate": 2.1909633418584826e-05,
+      "loss": 24.982352701822915,
+      "step": 810
+    },
+    {
+      "epoch": 0.9356393535582648,
+      "grad_norm": 106.77224731445312,
+      "learning_rate": 2.1270247229326514e-05,
+      "loss": 23.428892008463542,
+      "step": 825
+    },
+    {
+      "epoch": 0.952650978168415,
+      "grad_norm": 64.02266693115234,
+      "learning_rate": 2.06308610400682e-05,
+      "loss": 23.625968424479165,
+      "step": 840
+    },
+    {
+      "epoch": 0.9696626027785653,
+      "grad_norm": 83.47174835205078,
+      "learning_rate": 1.999147485080989e-05,
+      "loss": 24.876424153645832,
+      "step": 855
+    },
+    {
+      "epoch": 0.9866742273887156,
+      "grad_norm": 68.72810363769531,
+      "learning_rate": 1.9352088661551578e-05,
+      "loss": 23.115681966145832,
+      "step": 870
+    },
+    {
+      "epoch": 1.00340232492203,
+      "grad_norm": 52.63280487060547,
+      "learning_rate": 1.8712702472293266e-05,
+      "loss": 23.462247721354167,
+      "step": 885
+    },
+    {
+      "epoch": 1.0204139495321802,
+      "grad_norm": 54.332237243652344,
+      "learning_rate": 1.8073316283034954e-05,
+      "loss": 25.237931315104166,
+      "step": 900
+    },
+    {
+      "epoch": 1.0204139495321802,
+      "eval_accuracy": 0.6631578947368421,
+      "eval_loss": 1.4844019412994385,
+      "eval_macro_f1": 0.6347159169539845,
+      "eval_runtime": 3.3664,
+      "eval_samples_per_second": 169.319,
+      "eval_steps_per_second": 21.388,
+      "step": 900
+    }
+  ],
+  "logging_steps": 15,
+  "max_steps": 1323,
+  "num_input_tokens_seen": 0,
+  "num_train_epochs": 2,
+  "save_steps": 150,
+  "stateful_callbacks": {
+    "TrainerControl": {
+      "args": {
+        "should_epoch_stop": false,
+        "should_evaluate": false,
+        "should_log": false,
+        "should_save": true,
+        "should_training_stop": false
+      },
+      "attributes": {}
+    }
+  },
+  "total_flos": 2158851237347328.0,
+  "train_batch_size": 2,
+  "trial_name": null,
+  "trial_params": null
+}

sft/checkpoint-900/training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:431f527e8e25692d63cf56b44304ae3623b3a431e67ee30079803765d5382b32
+size 5201