Asilarkness commited on
Commit
b703262
·
verified ·
1 Parent(s): 9f18d9d

checkpoint .

Browse files
Files changed (4) hide show
  1. model.pt +1 -1
  2. qa_log.json +76 -0
  3. run_log.json +20 -0
  4. state.json +1 -1
model.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e1b07a7ace2707d47b38e61e18d6c65e4448a5f65ace0fde3976f7b56d22c726
3
  size 4011627411
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed97afe3fd0c7836058b6ee33ce6687198ab18469c692c339deab712dd393f6f
3
  size 4011627411
qa_log.json CHANGED
@@ -378,5 +378,81 @@
378
  "answer": "\nWhat is the relationship between technology and media?\nYou\u2019re wondering how things can be talked. It\u2019s the way we use technology and math \u2013 you\u2019re looking at what happens when we\u2019re getting to work and learn how to use technology.\nThat\u2019s the beginning of"
379
  }
380
  ]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
381
  }
382
  ]
 
378
  "answer": "\nWhat is the relationship between technology and media?\nYou\u2019re wondering how things can be talked. It\u2019s the way we use technology and math \u2013 you\u2019re looking at what happens when we\u2019re getting to work and learn how to use technology.\nThat\u2019s the beginning of"
379
  }
380
  ]
381
+ },
382
+ {
383
+ "step": 1100,
384
+ "stage": "pretrain",
385
+ "answers": [
386
+ {
387
+ "prompt": "Explain how photosynthesis works.",
388
+ "answer": " Each hole tells its own composition and texture.\n\nImagine having a small pebble solution! That's what life is \u2013 it's kind of like confusing stones out of pots!\n\nHere's a cool thing out: Which are proteins that look like? Well, let's look at a simple"
389
+ },
390
+ {
391
+ "prompt": "What is the capital of France and why is it important?",
392
+ "answer": "\nJoya Javier Javier Canadian has been the director of the Dutch Foreign Security (VRIF) and has been an opponent of the United States with the intention to manufacture its own tools and direct control. As the USORE Alliance has given it the name of the US SECIF to the US"
393
+ },
394
+ {
395
+ "prompt": "Write a short story about a robot learning to paint.",
396
+ "answer": "\n- Air-impaired, self-paced, or aggressive.\n- Help your parachute to lift base.\n- After a few seconds (to avoid some accidents and trigger the rotation on other wheels), read IAS and Space at the rover's office.\n- A deceptively sized"
397
+ },
398
+ {
399
+ "prompt": "How do you reverse a linked list in Python?",
400
+ "answer": "\n\nLet's dive right into the fascinating world of SQL and SQL.\n\nFirstly, let's talk about the crucial issues in code.\n\nBefore we begin, let's get familiar with the basics. NumPy is a special library that combines elements from various fields, including cognitive-physics,"
401
+ },
402
+ {
403
+ "prompt": "What caused World War I?",
404
+ "answer": "\nHow is the mid-19th century English language used in the mid-10th century. During the World War I, we used the term \"the Iliad in the World \u2013 one of the earliest Greek empires\". In this sense, we always rely on the Greek word \"ars\""
405
+ },
406
+ {
407
+ "prompt": "Summarize the plot of Romeo and Juliet.",
408
+ "answer": " It takes time to find the term \"N\" important and important to identify with our math. Published by the National Foundation for the Advancement of Science.\n-- Henry Lecky\nOne of the key players that is talking about what\u2019s going on is the capacity of the game to get"
409
+ },
410
+ {
411
+ "prompt": "If a train travels 60 mph for 3 hours, how far does it go?",
412
+ "answer": "\nWith the end of the track, when you cross through the window, your contacts and your rear poles connected to the front of your mountage. When you drive across the trap, your legs are securely anchored, like a large body of cardboard. Your face has to stand either to your knees and"
413
+ },
414
+ {
415
+ "prompt": "What is the difference between machine learning and deep learning?",
416
+ "answer": " By understanding the different types of books of literature, you can gain a greater understanding of how various words are used to explore different aspects of life. **Unit: Understanding Post-\u00abveillance:** One common type of leave data or search focuses on the various ways in which statistical techniques can be used"
417
+ }
418
+ ]
419
+ },
420
+ {
421
+ "step": 1200,
422
+ "stage": "pretrain",
423
+ "answers": [
424
+ {
425
+ "prompt": "Explain how photosynthesis works.",
426
+ "answer": "\n\u201cIt\u2019s so exciting that we have to advance up it,\u201d explained Kohn, a professor of biochemistry at the University of Cambridge, and one of the labs in the lab.\nIn the lab, scientists are studying plants and developing new tools to probe their rhythms, which is the technology"
427
+ },
428
+ {
429
+ "prompt": "What is the capital of France and why is it important?",
430
+ "answer": " No, it is through history, and it is not as complete as it's equal. And as the Darchists have put over the image in a more secure and more ignorant and confused context, it is less so with numerical and more typical.\nHow actually does this happen? The term in"
431
+ },
432
+ {
433
+ "prompt": "Write a short story about a robot learning to paint.",
434
+ "answer": "\n\n* **Las:** Humans gather to create brains, talk about patterns, and help them learn to digest and share. They also learn about different kinds of shapes and structures, such as doll forms, and rules.\n\n**Why Choose a Trotme**\nHere are some fun"
435
+ },
436
+ {
437
+ "prompt": "How do you reverse a linked list in Python?",
438
+ "answer": " And you have to verify that the number of pages in the graph is as large as 52 bytes (any log is around 7 bytes). If you want to specify a table that represents the number of pages in the graph, you must write it using your own name. That's the way"
439
+ },
440
+ {
441
+ "prompt": "What caused World War I?",
442
+ "answer": " (a) War caused by Soviet occupation and political instability.\nThe European War\nWhat warfare was, and why did it spread through the Americas?\nTo what extent, the development of new forts and empires was certainly a key factor; China also made large islands, roads, and towns. Middle"
443
+ },
444
+ {
445
+ "prompt": "Summarize the plot of Romeo and Juliet.",
446
+ "answer": "\nIn this study, we examined the impact of a high-fat, low-fat, and avoid the impacts of the misness of the relationship between Christian and Christian teachers. This feedback is considered during the AARP account of the 1990 Annual Meeting, which outlines the differences between"
447
+ },
448
+ {
449
+ "prompt": "If a train travels 60 mph for 3 hours, how far does it go?",
450
+ "answer": " That's how.\nIf you want to ride for $1, how much you can ride then, you can train the train or train, and you can train by running over the train without any trains. You can move on the train or train off the train.\nThe train travels via each"
451
+ },
452
+ {
453
+ "prompt": "What is the difference between machine learning and deep learning?",
454
+ "answer": "\nWhat do we do?\n\nNow, let's create something we can do. Imagine you are writing a book about your favorite articles, sipping coffee, and enjoying your favorite book. Now, let's say you think that every book you write is unique! That's the primary reason why you"
455
+ }
456
+ ]
457
  }
458
  ]
run_log.json CHANGED
@@ -98,5 +98,25 @@
98
  "grad_norm": 0.435,
99
  "lr": 0.0002989410554090198,
100
  "tok_per_s": 36669
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
101
  }
102
  ]
 
98
  "grad_norm": 0.435,
99
  "lr": 0.0002989410554090198,
100
  "tok_per_s": 36669
101
+ },
102
+ {
103
+ "stage": "pretrain",
104
+ "step": 1100,
105
+ "tokens": 576716800,
106
+ "wall_s": 15737.7,
107
+ "loss": 3.9573,
108
+ "grad_norm": 0.607,
109
+ "lr": 0.0002984749354163635,
110
+ "tok_per_s": 36645
111
+ },
112
+ {
113
+ "stage": "pretrain",
114
+ "step": 1200,
115
+ "tokens": 629145600,
116
+ "wall_s": 17160.5,
117
+ "loss": 3.957,
118
+ "grad_norm": 0.538,
119
+ "lr": 0.000297924570028149,
120
+ "tok_per_s": 36662
121
  }
122
  ]
state.json CHANGED
@@ -1 +1 @@
1
- {"stage": "pretrain", "step": 1000, "tokens": 524288000, "d": 1088, "pattern": "AASSSSSSSSSSSSAA", "vocab": 49152}
 
1
+ {"stage": "pretrain", "step": 1200, "tokens": 629145600, "d": 1088, "pattern": "AASSSSSSSSSSSSAA", "vocab": 49152}