checkpoint .
Browse files- model.pt +1 -1
- qa_log.json +76 -0
- run_log.json +20 -0
- state.json +1 -1
model.pt
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 4011627411
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:45ba1579de54785ba62190180c6218861ae59a4702c0551648e61319b26fe8ec
|
| 3 |
size 4011627411
|
qa_log.json
CHANGED
|
@@ -454,5 +454,81 @@
|
|
| 454 |
"answer": "\nWhat do we do?\n\nNow, let's create something we can do. Imagine you are writing a book about your favorite articles, sipping coffee, and enjoying your favorite book. Now, let's say you think that every book you write is unique! That's the primary reason why you"
|
| 455 |
}
|
| 456 |
]
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 457 |
}
|
| 458 |
]
|
|
|
|
| 454 |
"answer": "\nWhat do we do?\n\nNow, let's create something we can do. Imagine you are writing a book about your favorite articles, sipping coffee, and enjoying your favorite book. Now, let's say you think that every book you write is unique! That's the primary reason why you"
|
| 455 |
}
|
| 456 |
]
|
| 457 |
+
},
|
| 458 |
+
{
|
| 459 |
+
"step": 1300,
|
| 460 |
+
"stage": "pretrain",
|
| 461 |
+
"answers": [
|
| 462 |
+
{
|
| 463 |
+
"prompt": "Explain how photosynthesis works.",
|
| 464 |
+
"answer": " Science is part of a larger process of photosynthesis, which is the process of photosynthesis. By using photosynthesis to survive on the planet, the sun heats up the planet and weakens its environment.\nIt is the same activity that photosynthesis does not happen, but rather has inherited it from the ground \u2013 that is"
|
| 465 |
+
},
|
| 466 |
+
{
|
| 467 |
+
"prompt": "What is the capital of France and why is it important?",
|
| 468 |
+
"answer": " The kingdom of Poland has been mandated by the end of the 19th century and was withdrawn by the fall of the 19th century. There has been a long and complex and unprecedented struggle for the final political, economic and political issues, which were based on the teachings of the G"
|
| 469 |
+
},
|
| 470 |
+
{
|
| 471 |
+
"prompt": "Write a short story about a robot learning to paint.",
|
| 472 |
+
"answer": " The presenter wants to share a story about a different type of animal they could use to become a robot. How do they get up to the construction of that robot? How does the robot learn? How do they learn? \u2018Have I ever had an amazing pile of plastic shells to share. What do"
|
| 473 |
+
},
|
| 474 |
+
{
|
| 475 |
+
"prompt": "How do you reverse a linked list in Python?",
|
| 476 |
+
"answer": " Or how do we create a novel name with someone?\n- What does a major name of the name \"Aidonic gene\" (as I am a diagnostic surgeon)?\n- What are some types of a particular gene?\n- What are the numbers of the gene, with or without?"
|
| 477 |
+
},
|
| 478 |
+
{
|
| 479 |
+
"prompt": "What caused World War I?",
|
| 480 |
+
"answer": "\nWhat is the victim of the Syndrome? What kinds of manifestations are they?\nHow is the perpetrator of the witness? Is the victim, character, or disability? Is the victim of the witness? Is the victim of the accused victim? If the victim of the witness was a victim of the"
|
| 481 |
+
},
|
| 482 |
+
{
|
| 483 |
+
"prompt": "Summarize the plot of Romeo and Juliet.",
|
| 484 |
+
"answer": " He will describe five hero William Shakespeare. As one of Arthur\u2019s greatest he holds, Juliet, the first son of her, was an Oscar, a proto-bargewright, who speaks of the first king. He was a god of power and good reason, who should have been the first"
|
| 485 |
+
},
|
| 486 |
+
{
|
| 487 |
+
"prompt": "If a train travels 60 mph for 3 hours, how far does it go?",
|
| 488 |
+
"answer": "\n- To train 20 mph to 30 mph (60 mph)\n- To train 20 mph at 17:30 UTC\n- To train 20 mph to 30:00 UTC\n- To train 20 mile video\n"
|
| 489 |
+
},
|
| 490 |
+
{
|
| 491 |
+
"prompt": "What is the difference between machine learning and deep learning?",
|
| 492 |
+
"answer": " Maybe we need to do a part of it, what is the difference between machine learning and deep learning? What are the differences between machine learning and deep learning?\nBy the age of 2, we talked about the neural networks of brain cells, at the heart of the brain. Our brain is"
|
| 493 |
+
}
|
| 494 |
+
]
|
| 495 |
+
},
|
| 496 |
+
{
|
| 497 |
+
"step": 1400,
|
| 498 |
+
"stage": "pretrain",
|
| 499 |
+
"answers": [
|
| 500 |
+
{
|
| 501 |
+
"prompt": "Explain how photosynthesis works.",
|
| 502 |
+
"answer": " This process changes the backbone of the organic fibers, which can help us understand the faster and more complex processes involving the growth of the complex fibres.\n\nSection 6: Creating Your Own Miniature\nUse your imagination and create your own miniinetiques. Phase 3 includes interconnected layers of cells"
|
| 503 |
+
},
|
| 504 |
+
{
|
| 505 |
+
"prompt": "What is the capital of France and why is it important?",
|
| 506 |
+
"answer": " Chapter 10: Understanding the Power of Substance Management and Economics\n\nHave you ever wondered how people talk to different people? Or maybe the bus rang loud in the night? Or maybe you've seen pictures on TV and radio show making systems that tell us what happens with the trains? Maybe"
|
| 507 |
+
},
|
| 508 |
+
{
|
| 509 |
+
"prompt": "Write a short story about a robot learning to paint.",
|
| 510 |
+
"answer": " He discusses Google Docs to show us how they can become part of the more-efficient and lightweight robot in the perfect, sleek and smaller world.\n\n**Step 3: Gather Digging Materials**\nBegin with some fun sketching techniques to create your very own fast robot:\n\n*"
|
| 511 |
+
},
|
| 512 |
+
{
|
| 513 |
+
"prompt": "How do you reverse a linked list in Python?",
|
| 514 |
+
"answer": "\nThe aim of this course is to provide you with a comprehensive understanding of the basic concepts, techniques, and applications of Python.\nTo install Python, you can import it in your Python script and install it using pip:\n```python\nimport numpy as np\n```\nNow that you have"
|
| 515 |
+
},
|
| 516 |
+
{
|
| 517 |
+
"prompt": "What caused World War I?",
|
| 518 |
+
"answer": "\nAmerican War II.\nThe Battle of World War II.\nItalian War II.\nThe War of World War II.\nThe Battle of World War I.\nThe Battle of World War II.\nThe Battle of World War II.\nThe Battle of World War II.\nThe"
|
| 519 |
+
},
|
| 520 |
+
{
|
| 521 |
+
"prompt": "Summarize the plot of Romeo and Juliet.",
|
| 522 |
+
"answer": "\n\nAs this story progresses, many authors and writers study Juliet (and they're privileged) on the issue of his childhood mortality. As a result, many readers consider them part of a larger story, starting to resist the temptation of solving problems. This encounter demonstrates us that the best way to overcome"
|
| 523 |
+
},
|
| 524 |
+
{
|
| 525 |
+
"prompt": "If a train travels 60 mph for 3 hours, how far does it go?",
|
| 526 |
+
"answer": "\nThe mission\u2019s main goal was to produce the team with a half-life job test. The pilot rate in each experiment was to get a sample of the same unit of data to provide the test results. The pilot test had a sampling tool for each experiment and the total performance was performed to"
|
| 527 |
+
},
|
| 528 |
+
{
|
| 529 |
+
"prompt": "What is the difference between machine learning and deep learning?",
|
| 530 |
+
"answer": "\nHow is it like that?\nHow can I learn faster or heal my problem?\nHow can I learn more quickly?\nHow can I learn faster?\nHow can I learn faster than I?\nHow quickly does my problem learn?\nIt takes time. I'll guide you through"
|
| 531 |
+
}
|
| 532 |
+
]
|
| 533 |
}
|
| 534 |
]
|
run_log.json
CHANGED
|
@@ -118,5 +118,25 @@
|
|
| 118 |
"grad_norm": 0.538,
|
| 119 |
"lr": 0.000297924570028149,
|
| 120 |
"tok_per_s": 36662
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 121 |
}
|
| 122 |
]
|
|
|
|
| 118 |
"grad_norm": 0.538,
|
| 119 |
"lr": 0.000297924570028149,
|
| 120 |
"tok_per_s": 36662
|
| 121 |
+
},
|
| 122 |
+
{
|
| 123 |
+
"stage": "pretrain",
|
| 124 |
+
"step": 1300,
|
| 125 |
+
"tokens": 681574400,
|
| 126 |
+
"wall_s": 18600.7,
|
| 127 |
+
"loss": 3.6969,
|
| 128 |
+
"grad_norm": 0.43,
|
| 129 |
+
"lr": 0.0002972902881379466,
|
| 130 |
+
"tok_per_s": 36642
|
| 131 |
+
},
|
| 132 |
+
{
|
| 133 |
+
"stage": "pretrain",
|
| 134 |
+
"step": 1400,
|
| 135 |
+
"tokens": 734003200,
|
| 136 |
+
"wall_s": 20023.5,
|
| 137 |
+
"loss": 3.9048,
|
| 138 |
+
"grad_norm": 0.373,
|
| 139 |
+
"lr": 0.0002965724687870983,
|
| 140 |
+
"tok_per_s": 36657
|
| 141 |
}
|
| 142 |
]
|
state.json
CHANGED
|
@@ -1 +1 @@
|
|
| 1 |
-
{"stage": "pretrain", "step":
|
|
|
|
| 1 |
+
{"stage": "pretrain", "step": 1400, "tokens": 734003200, "d": 1088, "pattern": "AASSSSSSSSSSSSAA", "vocab": 49152}
|