Replace selected medium Sample 1 with seed 2 sample 125; preserve Sample 2
Browse files
iclr-debug-medium-speed-full-decay-20260918-v1/decoder-mstok/evaluation/step-26000/selected-samples/medium-selected-samples-step26000.json
CHANGED
|
@@ -6,19 +6,19 @@
|
|
| 6 |
"tf32_allowed": false,
|
| 7 |
"samples": [
|
| 8 |
{
|
| 9 |
-
"seed":
|
| 10 |
-
"index":
|
| 11 |
-
"text": "
|
| 12 |
"prompt": "",
|
| 13 |
"token_count": 256,
|
| 14 |
"scored_tokens": 255,
|
| 15 |
-
"gen_ppl":
|
| 16 |
-
"entropy_nats": 4.
|
| 17 |
-
"source_file": "/home/ishank/mstok-results/iclr-debug-medium-speed-full-decay-20260918-v1/decoder-mstok/evaluation/step-26000/random-seed-
|
| 18 |
-
"text_sha256": "
|
| 19 |
"replacement_characters": 0,
|
| 20 |
-
"adjacent_word_repetition": 0.
|
| 21 |
-
"repeated_4gram_fraction": 0
|
| 22 |
},
|
| 23 |
{
|
| 24 |
"seed": 4,
|
|
@@ -36,6 +36,19 @@
|
|
| 36 |
"repeated_4gram_fraction": 0.004950495049504955
|
| 37 |
}
|
| 38 |
],
|
| 39 |
-
"selection_note": "Curated
|
| 40 |
-
"score_source": "/home/ishank/mstok-results/medium-sample-scores-step26000-20260919.json"
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
}
|
|
|
|
| 6 |
"tf32_allowed": false,
|
| 7 |
"samples": [
|
| 8 |
{
|
| 9 |
+
"seed": 2,
|
| 10 |
+
"index": 125,
|
| 11 |
+
"text": " code that works. This is why so does US author provide an example of a concept for the value type.\n\nThere is no explanation as to or given an object which can read the only value or value one of the functions. It is argument to read about whether answer is related to the first case which refers to to and the answer if it is the then certainly related. But it is not clear whether it was a way to put a argument by a object which is written, in order to get written together in order to not remove them.\n\nAnother important thing is that the best type of question is the object. For example, if it is important to remember this is an item in the type of list timei.e., an actual element which requires the, in order to produce the actual scale of the sequence, the same type of item can be done. This is whether it's one or the one queue between the and the part of one, which can be addressed, and is better remembered. In this case there are no questions about this argument: something something are wrong, which means that, at the same end of on same thing, the same type of item is going to use. This is because.'t't find that good that's a simple",
|
| 12 |
"prompt": "",
|
| 13 |
"token_count": 256,
|
| 14 |
"scored_tokens": 255,
|
| 15 |
+
"gen_ppl": 58.0941047668457,
|
| 16 |
+
"entropy_nats": 4.326089171303893,
|
| 17 |
+
"source_file": "/home/ishank/mstok-results/iclr-debug-medium-speed-full-decay-20260918-v1/decoder-mstok/evaluation/step-26000/random-seed-2.samples.json",
|
| 18 |
+
"text_sha256": "1d1171d39e0f6cffc42e938ff7c2180b6589478a5780d7b0805eee097d4fa714",
|
| 19 |
"replacement_characters": 0,
|
| 20 |
+
"adjacent_word_repetition": 0.008888888888888889,
|
| 21 |
+
"repeated_4gram_fraction": 0.008968609865470878
|
| 22 |
},
|
| 23 |
{
|
| 24 |
"seed": 4,
|
|
|
|
| 36 |
"repeated_4gram_fraction": 0.004950495049504955
|
| 37 |
}
|
| 38 |
],
|
| 39 |
+
"selection_note": "Curated examples, not representative random draws. Sample 1 was replaced after reviewing 93 exact-256-token candidates without Unicode replacement characters, prioritizing topic continuity and fewer malformed word fragments over the original PPL range. Both retain conspicuous grammatical and semantic errors; not fluent prose.",
|
| 40 |
+
"score_source": "/home/ishank/mstok-results/medium-sample-scores-step26000-20260919.json",
|
| 41 |
+
"replacement_history": [
|
| 42 |
+
{
|
| 43 |
+
"sample_number": 1,
|
| 44 |
+
"previous_seed": 0,
|
| 45 |
+
"previous_index": 70,
|
| 46 |
+
"previous_gen_ppl": 76.85733032226562,
|
| 47 |
+
"previous_text_sha256": "c5f49753a454c2ab3d8bc7f6284be40204d03b032743eb05497128c6da44ddb6",
|
| 48 |
+
"new_seed": 2,
|
| 49 |
+
"new_index": 125,
|
| 50 |
+
"previous_hf_commit": "bdcd2eb9e5e3082030239053062d89b282651e76",
|
| 51 |
+
"sample_2_unchanged": true
|
| 52 |
+
}
|
| 53 |
+
]
|
| 54 |
}
|
iclr-debug-medium-speed-full-decay-20260918-v1/decoder-mstok/evaluation/step-26000/selected-samples/medium-selected-samples-step26000.tex
CHANGED
|
@@ -2,17 +2,17 @@
|
|
| 2 |
% Supplied true level-zero code: these are NOT unconditional samples.
|
| 3 |
% Individual PPL: GPT-2 large, FP32, TF32 disabled.
|
| 4 |
\noindent
|
| 5 |
-
% Checkpoint 26000; seed
|
| 6 |
\begin{minipage}[t]{0.49\linewidth}
|
| 7 |
\begin{tcolorbox}[samplestyle, colback=white, colframe=black]
|
| 8 |
\scriptsize\linespread{1.06}\selectfont
|
| 9 |
\spheading{black}{Sample 1}{%
|
| 10 |
-
\textbf{Gen.\ PPL:}
|
| 11 |
-
\noindent
|
| 12 |
|
| 13 |
-
|
| 14 |
|
| 15 |
-
|
| 16 |
\end{tcolorbox}
|
| 17 |
\end{minipage}\hfill
|
| 18 |
% Checkpoint 26000; seed 4; zero-based sample index 55; 256 tokens.
|
|
@@ -49,4 +49,3 @@ Once you only face a target at the same time, you can still face it on the groun
|
|
| 49 |
\end{minipage}
|
| 50 |
\par\smallskip
|
| 51 |
{\scriptsize Selected 256-token outputs from \name-med.\ (step 26,000), conditioned on the true level-zero code. Generated wording is unchanged.}
|
| 52 |
-
|
|
|
|
| 2 |
% Supplied true level-zero code: these are NOT unconditional samples.
|
| 3 |
% Individual PPL: GPT-2 large, FP32, TF32 disabled.
|
| 4 |
\noindent
|
| 5 |
+
% Checkpoint 26000; seed 2; zero-based sample index 125; 256 tokens.
|
| 6 |
\begin{minipage}[t]{0.49\linewidth}
|
| 7 |
\begin{tcolorbox}[samplestyle, colback=white, colframe=black]
|
| 8 |
\scriptsize\linespread{1.06}\selectfont
|
| 9 |
\spheading{black}{Sample 1}{%
|
| 10 |
+
\textbf{Gen.\ PPL:} 58.09}
|
| 11 |
+
\noindent code that works. This is why so does US author provide an example of a concept for the value type.
|
| 12 |
|
| 13 |
+
There is no explanation as to or given an object which can read the only value or value one of the functions. It is argument to read about whether answer is related to the first case which refers to to and the answer if it is the then certainly related. But it is not clear whether it was a way to put a argument by a object which is written, in order to get written together in order to not remove them.
|
| 14 |
|
| 15 |
+
Another important thing is that the best type of question is the object. For example, if it is important to remember this is an item in the type of list timei.e., an actual element which requires the, in order to produce the actual scale of the sequence, the same type of item can be done. This is whether it's one or the one queue between the and the part of one, which can be addressed, and is better remembered. In this case there are no questions about this argument: something something are wrong, which means that, at the same end of on same thing, the same type of item is going to use. This is because.'t't find that good that's a simple
|
| 16 |
\end{tcolorbox}
|
| 17 |
\end{minipage}\hfill
|
| 18 |
% Checkpoint 26000; seed 4; zero-based sample index 55; 256 tokens.
|
|
|
|
| 49 |
\end{minipage}
|
| 50 |
\par\smallskip
|
| 51 |
{\scriptsize Selected 256-token outputs from \name-med.\ (step 26,000), conditioned on the true level-zero code. Generated wording is unchanged.}
|
|
|