Asilarkness commited on
Commit
074f563
·
verified ·
1 Parent(s): 4a7a039

checkpoint .

Browse files
Files changed (4) hide show
  1. model.pt +1 -1
  2. qa_log.json +76 -0
  3. run_log.json +20 -0
  4. state.json +1 -1
model.pt CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6ef8f36f97104e91751c51b0e58d5849cef31a58c5c6c1dc112d70edfbc89380
3
  size 4011627411
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f626964e9b089f1b917097d72e7decb17f260840ad9c7cd11e5c9c1fcca4a8a
3
  size 4011627411
qa_log.json CHANGED
@@ -150,5 +150,81 @@
150
  "answer": " Join Challism, does Forest, provides a significant role in larger education, and fosters increasing farm languages, providing jobs to operate a comprehensive abilities that human freedom is to violate the national world.\nHoda, an indicator of high-release education, is a major educational commitment to a student discrimination in"
151
  }
152
  ]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
153
  }
154
  ]
 
150
  "answer": " Join Challism, does Forest, provides a significant role in larger education, and fosters increasing farm languages, providing jobs to operate a comprehensive abilities that human freedom is to violate the national world.\nHoda, an indicator of high-release education, is a major educational commitment to a student discrimination in"
151
  }
152
  ]
153
+ },
154
+ {
155
+ "step": 500,
156
+ "stage": "pretrain",
157
+ "answers": [
158
+ {
159
+ "prompt": "Explain how photosynthesis works.",
160
+ "answer": "\nby The Review of Amazination: Finland\nOnline History of E-100-13\nI will have been built on legal order to examine how the people\u2019s dignity is.\nThe \"Shitzer\" law is in a government.\nGazi, A. 5"
161
+ },
162
+ {
163
+ "prompt": "What is the capital of France and why is it important?",
164
+ "answer": "\nBut what will be from over the midst of the people and the nation?\n\u201cKnowing is the eternal attitude of the naturalism)\n(1:1) who has to go on ground the circumstances and take the sides to the bast of Representatives.\n(13051)"
165
+ },
166
+ {
167
+ "prompt": "Write a short story about a robot learning to paint.",
168
+ "answer": "\nConfectioning is a defining translation of the Russian \"The painting\" series of a cathedral.\nProfessor the popular literary method\nProvining an entire belief in the seventeenth century are mainly by the\nasful duties of the Church in the period of the Greek\n acres of Guanya and Ann"
169
+ },
170
+ {
171
+ "prompt": "How do you reverse a linked list in Python?",
172
+ "answer": "\nDo you know that something in your area?\nAn example: There are over 3,000 states, and those who have spashes and peach is considered among food patterns.\n\"Public Age:\n\"I think we don't eat acne health measures and it's vital for"
173
+ },
174
+ {
175
+ "prompt": "What caused World War I?",
176
+ "answer": "\nSupp and Conditions\nWhat We developments in the topic of the National Health, Department of Technology, and the World Health of Education\nThe work of a human own vaccine being linked to the US from 56 percent of the 28.6 million patients owned by the household. The premature"
177
+ },
178
+ {
179
+ "prompt": "Summarize the plot of Romeo and Juliet.",
180
+ "answer": "\n\n\"The act also came by a different screen in the original room. One such is a testicular one of the most powerful proteins that are the source of the cells from the earth. The plane is just frozen and has the energy in this place of an 600\u00b0C.2"
181
+ },
182
+ {
183
+ "prompt": "If a train travels 60 mph for 3 hours, how far does it go?",
184
+ "answer": " That\u2019s a teenager fortune!\nObPersian:\n- The swyteen or fay is 13 /1,000-2093 - -1 Jul 2, 1905.\n- The boat has two days of the earth but"
185
+ },
186
+ {
187
+ "prompt": "What is the difference between machine learning and deep learning?",
188
+ "answer": "\n (1401-07)\nYou are experimenting \"It's important to find in the world of the world?\"\nand the claims in the conditions of the cave. These rescue measures can sometimes be found in the study, particularly in the German settlers, from the associated land in"
189
+ }
190
+ ]
191
+ },
192
+ {
193
+ "step": 600,
194
+ "stage": "pretrain",
195
+ "answers": [
196
+ {
197
+ "prompt": "Explain how photosynthesis works.",
198
+ "answer": " In addition to designs, there are three types.\nAnapynirj test is a good idea. The reason this is to use a short distance resolution to the bar when there is no more required. When the current is a minimum space, it is fairly visible than the same way. However"
199
+ },
200
+ {
201
+ "prompt": "What is the capital of France and why is it important?",
202
+ "answer": "\nThe aim of this argument is by the ear of the moon - the next Sabbath, a two-year-old hero, and a dark civilisation. There are three major people, described in the Roman Empire by the Bronze Age. It is the fifth and third century of the Civil War. Its"
203
+ },
204
+ {
205
+ "prompt": "Write a short story about a robot learning to paint.",
206
+ "answer": "\nIf you're to start with a library that will be very suitable for this, then it might be more useful for an authentic set of statistical information.\nThe purpose of the game is to use the following is:\n- Your computer may be 3-8 or 15 minutes."
207
+ },
208
+ {
209
+ "prompt": "How do you reverse a linked list in Python?",
210
+ "answer": " Or there is the most important crops?\nOf some other types of people, we rely on problems such as seceritol, cross-Point and truck. We often use some of these important features.\nYou may get more to a clean-up piece or stick to a larger card, and"
211
+ },
212
+ {
213
+ "prompt": "What caused World War I?",
214
+ "answer": "\n... my hours, I went me. I I am lucky, much like thinking about the FDA.\nIn a time, the problem was there. I have the wrong thing to ignore. They had to work with it. The more I was hung, and there were almost no energy to work"
215
+ },
216
+ {
217
+ "prompt": "Summarize the plot of Romeo and Juliet.",
218
+ "answer": "\nThe Original Intelligence of the Dragon\n- E-D printing is used in the 1999 series of the 5th century. It was a 1m, 208 table, 59-64, non-pixal text, and 4"
219
+ },
220
+ {
221
+ "prompt": "If a train travels 60 mph for 3 hours, how far does it go?",
222
+ "answer": "\nSz it will be in a flame, and when it moves, it is still preferable to pads, and there is still the best way to replace the salt, vudd, which is the chemical difference.\nIn fact, it is common, because it does not need its potential right to"
223
+ },
224
+ {
225
+ "prompt": "What is the difference between machine learning and deep learning?",
226
+ "answer": " This is how people are shocked and are around for the day, and why are those words of decision-making?\nWhat are the causes of the problem? Does the student have to do with the problem to deal out the correct problem?\nAs part of the study, the researchers thought that this"
227
+ }
228
+ ]
229
  }
230
  ]
run_log.json CHANGED
@@ -38,5 +38,25 @@
38
  "grad_norm": 1.089,
39
  "lr": 0.00023939999999999996,
40
  "tok_per_s": 36738
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
41
  }
42
  ]
 
38
  "grad_norm": 1.089,
39
  "lr": 0.00023939999999999996,
40
  "tok_per_s": 36738
41
+ },
42
+ {
43
+ "stage": "pretrain",
44
+ "step": 500,
45
+ "tokens": 262144000,
46
+ "wall_s": 7148.0,
47
+ "loss": 4.8949,
48
+ "grad_norm": 0.888,
49
+ "lr": 0.0002994,
50
+ "tok_per_s": 36674
51
+ },
52
+ {
53
+ "stage": "pretrain",
54
+ "step": 600,
55
+ "tokens": 314572800,
56
+ "wall_s": 8570.8,
57
+ "loss": 4.904,
58
+ "grad_norm": 0.96,
59
+ "lr": 0.00029995826888796654,
60
+ "tok_per_s": 36703
61
  }
62
  ]
state.json CHANGED
@@ -1 +1 @@
1
- {"stage": "pretrain", "step": 400, "tokens": 209715200, "d": 1088, "pattern": "AASSSSSSSSSSSSAA", "vocab": 49152}
 
1
+ {"stage": "pretrain", "step": 600, "tokens": 314572800, "d": 1088, "pattern": "AASSSSSSSSSSSSAA", "vocab": 49152}