diff --git a/README.md b/README.md
index aca70a2e5e0aa9096e8ce379564d959b8a6adaa4..e3ff411b1de8225965fe35e9b795f7595832394b 100644
--- a/README.md
+++ b/README.md
@@ -34,6 +34,7 @@ and implementation notes; additional directories will accompany later lectures.
 | 3 | Flow matching, diffusion, and guidance for ESM-2 residue embeddings | [Guide](lecture_3/README.md) · [Flow matching](lecture_3/esm2_flow_guidance.py) · [Diffusion](lecture_3/esm2_diffusion_guidance.py) |
 | 4 | Discrete diffusion, masked and uniform corruption, block generation, and guidance | [Guide](lecture_4/README.md) · [Training and generation](lecture_4/run.py) · [Slide code map](lecture_4/SLIDE_CODE_MAP.md) |
 | 5 | Discrete flow matching, Dirichlet and Fisher paths, Gumbel-Softmax, rectification, and multi-objective generation | [Guide](lecture_5/README.md) · [Training and generation](lecture_5/run.py) · [Slide code map](lecture_5/SLIDE_CODE_MAP.md) |
+| 6 | Continuous, latent, categorical, posterior, expanding, and strong stochastic flow maps | [Guide](lecture_6/README.md) · [Training and generation](lecture_6/run.py) · [Slide code map](lecture_6/SLIDE_CODE_MAP.md) |
 
 ## Installation
 
@@ -41,7 +42,7 @@ Use Python 3.11, or another compatible Python version at least 3.10, in a new
 virtual environment. The shared `requirements.txt` pins PyTorch 2.9.1,
 TorchVision 0.24.1, and Transformers 4.57.6. Lecture 2 uses PyTorch and
 TorchVision; Lecture 3 also uses Transformers. Lectures 4 and 5 use PyTorch,
-NumPy, and SciPy. Their lecture folders also provide minimal requirements.
+NumPy, and SciPy. Lecture 6 uses PyTorch and NumPy. These lecture folders also provide minimal requirements.
 
 ```bash
 git clone https://huggingface.co/ChatterjeeLab/CIS6270
@@ -144,6 +145,29 @@ Both folders include numerical examples, mathematical tests, and saved results
 from seeded CPU runs. The guides explain finite endpoint approximations and
 classroom simplifications for each method.
 
+## Lecture 6 - Flow Maps
+
+Learn finite-time motion after the local flows from Lecture 5. The new folder
+contains 16 complete examples covering flow-map matching and self-distillation,
+consistency, Shortcut, MeanFlow, learned latent representations, Flow Map
+Language Models, Categorical and Discrete Flow Maps, Diamond Maps, Meta Flow
+Maps, Expanding Flow Maps, and Strong Stochastic Flow Maps.
+
+```bash
+python lecture_6/run.py --method self-distill --out lecture_6/outputs/self-distill
+python lecture_6/run.py --mode sample --out lecture_6/outputs/self-distill --sample-steps 1
+python lecture_6/run_all.py --quick
+```
+
+The [Lecture 6 guide](lecture_6/README.md) includes all method commands,
+training objectives, data formats, and numerical assumptions. The
+[slide code map](lecture_6/SLIDE_CODE_MAP.md) links implementations to the
+[Flow Maps presentation](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit).
+[Source notes](lecture_6/SOURCES.md) identify the exact papers and inspected
+author-code revisions, including differences between paper pseudocode and
+released implementations. [Verified examples](lecture_6/verified_examples/README.md)
+contain actual training logs, generated samples, and checkpoint-reload checks.
+
 ## Repository organization
 
 | Location | Contents |
@@ -153,6 +177,7 @@ classroom simplifications for each method.
 | [`lecture_3/`](https://huggingface.co/ChatterjeeLab/CIS6270/tree/main/lecture_3) | ESM-2 flow and diffusion guidance scripts, sequence data, guide, and mathematical notes |
 | [`lecture_4/`](https://huggingface.co/ChatterjeeLab/CIS6270/tree/main/lecture_4) | Seven discrete diffusion and guidance examples, synthetic DNA, slide code map, and verified outputs |
 | [`lecture_5/`](https://huggingface.co/ChatterjeeLab/CIS6270/tree/main/lecture_5) | Eight discrete and simplex flow examples, synthetic DNA, slide code map, and verified outputs |
+| [`lecture_6/`](https://huggingface.co/ChatterjeeLab/CIS6270/tree/main/lecture_6) | Sixteen flow-map implementations, text data, mathematical notes, slide links, and verified outputs |
 | [`tests/`](https://huggingface.co/ChatterjeeLab/CIS6270/tree/main/tests) | Offline checks for the Lecture 3 examples |
 
 Installation instructions and the lecture index are maintained at the
@@ -165,6 +190,7 @@ references accompany the corresponding code.
 python -m unittest discover -s tests -v
 python -m unittest discover -s lecture_4/tests -v
 python -m unittest discover -s lecture_5/tests -v
+python -m unittest discover -s lecture_6/tests -v
 ```
 
 The Lecture 3 unit tests cover property annotations, scalarization weights, reward
@@ -172,7 +198,10 @@ gradients, DDPM schedule indexing, and constrained decoding.
 
 Lecture 4 tests check reverse KL losses and guidance calculations. Lecture 5
 tests check the master equation, Fisher geometry, Gumbel path derivatives, and
-MH detailed balance. Run a short end-to-end check of every method from its
+MH detailed balance. Lecture 6 checks map identities and JVPs, categorical
+teachers, GLASS conditioning, reward gradients, insertion clocks, and Brownian
+composition. Its end-to-end runner also verifies checkpoint reloads.
+Run a short end-to-end check of every method from its
 lecture folder with `python run_all.py --quick`.
 
 ## License
diff --git a/lecture_6/.gitignore b/lecture_6/.gitignore
new file mode 100644
index 0000000000000000000000000000000000000000..5ad7551fe653514b4e5b44f00060a99bc9c2dd86
--- /dev/null
+++ b/lecture_6/.gitignore
@@ -0,0 +1,4 @@
+__pycache__/
+.venv/
+outputs/
+*.pt
diff --git a/lecture_6/MATHEMATICS.md b/lecture_6/MATHEMATICS.md
new file mode 100644
index 0000000000000000000000000000000000000000..cbdaee8a45f85595852f273a875e3f87d460d7ef
--- /dev/null
+++ b/lecture_6/MATHEMATICS.md
@@ -0,0 +1,225 @@
+# From the lecture equations to the running code
+
+The [slide code map](SLIDE_CODE_MAP.md) supplies the corresponding slide links.
+Unless stated otherwise, time zero denotes Gaussian noise and time one denotes
+data. All expectations below are population quantities; the training code uses
+finite minibatches and learned approximations.
+
+## We first learn the motion at one time
+
+For a noise sample $X_0$ and a data sample $X_1$, construct
+
+$$I_t=(1-t)X_0+tX_1,\qquad \dot I_t=X_1-X_0.$$
+
+Here $I_t$ is the sampled interpolant and $t$ is its progress from noise to data.
+Regressing the displacement against the noisy state learns
+
+$$b_t(x)=\mathbb E[X_1-X_0\mid I_t=x].$$
+
+`interpolate` constructs the pair; `diagonal_loss` performs the regression.
+The conditional-mean field transports the same one-time marginals as the
+interpolant. Individual interpolant lines generally differ from its ODE paths.
+
+## Now predict the destination over an interval
+
+$$F_{s,t}(x)=x+(t-s)v_{s,t}(x).$$
+
+$s$ is the start, $t$ is the arrival time, and $v_{s,t}$ is the average velocity
+along that ODE trajectory. `finite_map` uses this residual parameterization,
+which gives $F_{s,s}(x)=x$ exactly. The diagonal average $v_{s,s}$ must still be
+trained to equal $b_s$.
+
+For $\dot x=x$, the exact map is $e^{t-s}x$. From $x=1$ over a unit interval,
+the average velocity is $e-1\approx1.71828$. The residual update reaches
+$2.71828$, while one Euler step using the initial velocity reaches only $2$.
+`numerical_examples.py` trains this scalar map and reports its actual error.
+
+## The ODE supplies three finite-interval identities
+
+$$\partial_t F_{s,t}(x)=b_t(F_{s,t}(x)),$$
+
+$$\partial_sF_{s,t}(x)+J_xF_{s,t}(x)b_s(x)=0,$$
+
+$$F_{s,t}(x)=F_{u,t}(F_{s,u}(x)).$$
+
+The first changes the destination time. The second advances the start along the
+same path, leaving the destination fixed. The third splits the interval at an
+intermediate time $u$. `lagrangian_residual` and `eulerian_residual` use JVPs;
+`semigroup_loss` evaluates the direct and split paths.
+
+The identity map satisfies composition for every interval but has zero velocity.
+This is why composition needs the diagonal anchor. A detached target also
+changes the optimization: only the student branch receives its gradient.
+
+## Shortcut and MeanFlow choose particular targets
+
+Shortcut learns a velocity for a longer interval from two shorter intervals:
+
+$$v_{s,s+2d}(x)\approx\operatorname{sg}\left[
+\tfrac12 v_{s,s+d}(x)+\tfrac12 v_{s+d,s+2d}(x+d\,v_{s,s+d}(x))\right].$$
+
+$d$ is the half-step length. The second prediction receives the moved state.
+`shortcut_loss` samples dyadic lengths and builds that detached target.
+
+MeanFlow uses the opposite clock. Its $z_t=(1-t)X_{\rm data}+tX_{\rm noise}$
+has data at zero and noise at one. For $r\leq t$,
+
+$$z_r=z_t-(t-r)u(z_t,r,t),$$
+
+$$u=v-(t-r)(\partial_tu+J_zu\,v).$$
+
+$v=X_{\rm noise}-X_{\rm data}$ is the conditional training velocity.
+`meanflow_loss` evaluates the JVP in direction $(v,0,1)$ for inputs $(z,r,t)$,
+then detaches the complete right-hand target. The sampler retains the minus sign.
+
+## A latent representation changes the coordinates
+
+For encoder $E$, decoder $D$, and data distribution $p$, fit a map to $E_\#p$.
+Generation is $D(F_{0,1}(Z_0))$. The code first trains an autoencoder and freezes
+it; a stored mean and standard deviation normalize its latent coordinates.
+`train_latent` saves the encoder, decoder, normalization, and map together.
+
+For an $L_D$-Lipschitz decoder, the distributional error is bounded by latent
+transport error multiplied by $L_D$, plus reconstruction error. The code
+reports reconstruction MSE separately; it does not assert a measured global
+Lipschitz constant or equate that MSE with a Wasserstein distance.
+
+## Categorical maps constrain their predictions
+
+For one-hot endpoints, the posterior mean denoiser $D_s(x)$ lies on the
+probability simplex. The noisy state $x$ may lie outside it. The finite map is
+
+$$F_{s,t}(x)=\frac{1-t}{1-s}x+\frac{t-s}{1-s}\psi_{s,t}(x),$$
+
+where $\psi_{s,t}$ is the two-time softmax prediction. `categorical_map` implements
+this expression. At $s=.25,t=.75$, state $(-.2,.6,1.1)$ and prediction
+$(.1,.7,.2)$ produce $(0,2/3,.5)$; the intermediate state is not normalized.
+
+Composition induces
+
+$$q=\gamma\psi_{s,u}(x)+(1-\gamma)\psi_{u,t}(F_{s,u}(x)),\qquad
+\gamma=\frac{(1-t)(u-s)}{(1-u)(t-s)}.$$
+
+At $(s,u,t)=(0,.5,.75)$, the weight is $1/3$. Combining predictions $(.8,.2)$
+and $(.2,.8)$ gives $(.4,.6)$. `composition_target` builds this probability-valued
+target; a detached KL objective has logit gradient $p_{\rm student}-q$.
+
+The decoding clock is $\tau(t)=1-\frac{V}{V-1}P_e(t)$, with vocabulary size $V$
+and single-token corruption error $P_e$. `DecodingClock` numerically inverts it.
+Endpoint enforcement prevents floating-point accuracy saturation from stopping
+the sampler before physical time one.
+
+## Categorical and discrete consistency constrain different residuals
+
+Categorical ECLD combines endpoint agreement with the time derivative of the
+finite denoiser. With $\eta=(t-s)/(1-s)$, the scaled Lagrangian residual is
+
+$$r=\psi_{s,t}-\psi_{t,t}(F_{s,t})+(1-t)\eta\partial_t\psi_{s,t}.$$
+
+The endpoint term can vanish while the derivative term remains nonzero. The
+implementation includes both and follows the released code's finite weights.
+
+For Discrete Flow Maps, write $\psi=\operatorname{softmax}(z)$ and center the
+arrival-time logit derivative:
+
+$$\delta_k=\partial_tz_k-\sum_j\psi_j\partial_tz_j,\qquad
+c=\frac{(t-s)(1-t)}{1-s}.$$
+
+The Lagrangian teacher is
+
+$$T_{\rm LSD}=\operatorname{softmax}\left[z_{t,t}(F_{s,t})-\log(1+c\delta)\right].$$
+
+For the Eulerian teacher, replace the derivative with
+$D_sz=\partial_sz+J_xz\,b_s$, center it in the same way, and use
+
+$$T_{\rm ESD}=\operatorname{softmax}\left[z_{s,s}-
+\log\left(1-\frac{(1-s)(t-s)}{1-t}\delta\right)\right].$$
+
+`corrected_logit_teacher` computes both versions. Log arguments must be positive;
+the code records its stabilization frequency so that violations remain visible.
+
+## Posterior maps need a second noise draw
+
+Meta training constructs
+
+$$I_t=(1-t)X_0+tX_1,\qquad \bar I_s=(1-s)\bar X_0+sX_1,$$
+
+with independent $X_0,\bar X_0$. The outer observation $(t,I_t)$ stays fixed
+while the inner map advances from $s$ to its target time. At that fixed context,
+the shared $X_1$ has exactly the desired posterior distribution.
+
+Diamond distillation obtains the corresponding conditional velocity through
+GLASS. For two independent observations, the likelihood precisions add:
+
+$$\Lambda=\frac{s^2}{(1-s)^2}+\frac{t^2}{(1-t)^2},\qquad
+S=\Lambda^{-1}\left[\frac{s\bar x}{(1-s)^2}+\frac{tx}{(1-t)^2}\right].$$
+
+The equivalent linear-interpolant time is
+$t^*=\sqrt\Lambda/(1+\sqrt\Lambda)$. Evaluating the original denoiser at
+$(t^*,t^*S)$ supplies the posterior mean conditioned on both observations.
+`glass_denoiser` is checked against an independent Gaussian conditioning formula.
+
+## Posterior samples make reward averages computable
+
+For reward $r$ and conditional samples $Z_k$,
+
+$$\widehat V_t(x)=\log\left(\frac1K\sum_{k=1}^K e^{r(Z_k)}\right),\qquad
+\widehat D_t^r(x)=\sum_k\operatorname{softmax}(r(Z))_k Z_k.$$
+
+`posterior_value` differentiates through the learned conditional samples.
+`guided_samples` uses $(\widehat D_t^r(x)-x)/(1-t)$ as the guided velocity.
+The ratio is biased at finite $K$, even with an exact conditional sampler.
+
+For Meta fine-tuning, let $d=b_{\rm student}-b_{\rm base}$, $w=e^{r(Z)}$, and
+$a=g_t^2/2$. The detached surrogate is
+
+$$\ell=\left\|d+(w-1)\operatorname{sg}(d)-a\operatorname{sg}(\nabla_xw)\right\|^2.$$
+
+Its expected gradient in $d$ is $2\mathbb E[wd-a\nabla_xw]$. Squaring $wd-a\nabla w$
+without that stop-gradient placement introduces an extra weight. The test suite
+checks this distinction directly. For the linear path, $a=(1-t)/t$; the optional
+training demonstration therefore excludes the singular initial time.
+
+## Expansion gives each new token its own clock
+
+A token born at $b_i$ has local time
+
+$$\tau_i(t)=\max\left(0,\frac{t-b_i}{1-b_i}\right),\qquad
+\frac{d\tau_i}{dt}=\frac1{1-b_i}\quad(t>b_i).$$
+
+`local_clock` and `local_map` preserve this information during transport.
+`insert_tokens` keeps token order, inserted noise, and birth metadata aligned.
+The linear insertion CDF gives conditional birth fraction
+$\rho_{s,t}=(t-s)/(1-s)$. Predicted remaining gap means are converted into
+interval means using this factor.
+
+The count divergence is
+
+$$\phi(a,b)=b-a+a\log(a/b),\qquad b>0,$$
+
+where $a$ is a realized count and $b$ is the predicted mean. Its population
+minimum is $b=\mathbb E[a]$. The zero-count branch is implemented with a finite
+autodiff expression. Sampling uses bounded binomial proposals and reports
+counts removed by global budget capping.
+
+## Strong maps must retain the same driving path
+
+For an interval of length $h$, the first two Brownian integrals satisfy
+
+$$I_0\sim\mathcal N(0,h),\qquad I_1\sim\mathcal N(0,h/3),\qquad I_0\perp I_1.$$
+
+For left/right subintervals of lengths $h_L,h_R$, Chen composition is
+
+$$I_0=I_0^L+I_0^R,$$
+
+$$I_1=\frac{h_LI_1^L+h_RI_1^R-h_RI_0^L+h_LI_0^R}{h_L+h_R}.$$
+
+With equal halves, $(I_0^L,I_1^L)=(.2,.04)$ and
+$(I_0^R,I_1^R)=(-.1,-.02)$ combine into $(.1,-.14)$.
+`chen_two` and `aggregate_tree` ensure the direct and split maps refer to that
+same history. Independent coarse noise would compare different sample paths.
+
+The SSFM objective combines a short stochastic matching step with same-noise
+composition. The reported strong error compares the learned result to a fine
+Euler-Maruyama trajectory using the same increments. Terminal variance checks
+the marginal separately; matching variance cannot establish pathwise accuracy.
diff --git a/lecture_6/README.md b/lecture_6/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..491dcaa529c3335e98f8b3c2851667739b345123
--- /dev/null
+++ b/lecture_6/README.md
@@ -0,0 +1,225 @@
+# CIS 6270 - Lecture 6 - Flow Maps
+
+Course hub: [ChatterjeeLab/CIS6270](https://huggingface.co/ChatterjeeLab/CIS6270).
+Slides: [Lecture 6 - Flow Maps](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit).
+Previous lecture: [Discrete Flow Matching](../lecture_5/README.md).
+
+Lecture 5 learned how a distribution moves locally. Here we learn the motion over
+an entire time interval. The examples progress from continuous flow maps to
+latent representations, categorical text, posterior maps, expanding states,
+and maps driven by a shared Brownian path.
+
+This folder contains **16 complete training and generation examples**, with
+checkpoint loading, data, mathematical checks, and saved execution results.
+The code uses small PyTorch networks and inspectable datasets. Each method's
+objective and sampler are implemented here; the large image and language
+benchmark runs from the papers require their original architectures, datasets,
+and training budgets. [SOURCES.md](SOURCES.md) records the exact papers, inspected
+author-code revisions, and differences from those implementations.
+
+## Train a velocity, then learn a finite map
+
+Use Python 3.11 or later. The minimal requirements retain the course's PyTorch
+2.9.1 baseline. All examples run on CPU; `--device cuda` selects an available GPU.
+The data require no downloads.
+
+From the course repository root:
+
+```bash
+cd lecture_6
+python -m venv .venv
+source .venv/bin/activate
+python -m pip install -r requirements.txt
+
+python run.py --method flow-matching --sample-steps 32 --out outputs/flow-matching
+python run.py --method self-distill --out outputs/self-distill
+python run.py --mode sample --out outputs/self-distill --sample-steps 1
+```
+
+The first command fits the conditional-mean velocity and integrates it with
+Heun's method. The second trains a two-time map using a diagonal velocity loss
+and a detached composition target. The third loads its checkpoint and generates
+in one map evaluation. The baseline uses two velocity evaluations per Heun step;
+finite maps use one evaluation per step.
+
+Training writes `checkpoint.pt`, `config.json`, `losses.json`, `report.json`, and
+`samples.txt`. A teacher or autoencoder stage also writes `teacher_losses.json`.
+Generation-only mode reads model architecture and vocabulary from the checkpoint
+and writes `resampled.txt` and `sample_report.json`, preserving training records.
+The checkpoint contains the inference state, not optimizer state for resuming
+training. `--mode train` saves training records without generating samples.
+
+## Run every method in the same structure as Lectures 4 and 5
+
+```bash
+python run_all.py --quick
+python run_all.py
+python -m unittest discover -s tests -v
+python numerical_examples.py --output outputs/numerical
+```
+
+`--quick` performs 20 optimization steps per method and verifies execution and
+checkpoint reloading. The regular command uses 1,000 steps per training stage.
+Both run every method and require seeded generated samples to agree exactly
+after checkpoint reload. The quick run measures execution correctness; inspect
+the longer run's losses and sample metrics when discussing learned behavior.
+
+| Method | Training | Generation |
+| --- | --- | --- |
+| `flow-matching` | Conditional displacement regression on a linear interpolant | Heun integration of the learned diagonal velocity |
+| `fmm-lagrangian` | Train a velocity teacher, then match the map's arrival-time derivative to the teacher | Residual finite-time maps |
+| `fmm-eulerian` | Train a velocity teacher, then match the start-time directional derivative to zero | Residual finite-time maps |
+| `self-distill` | Diagonal flow matching and EMA two-subinterval composition targets | One or more direct map updates |
+| `consistency` | Endpoint consistency along short Heun-solved teacher intervals, with the diagonal anchor | One endpoint prediction |
+| `shortcut` | Conditional flow matching and two-half-step average-velocity targets on dyadic intervals | One or more shortcuts |
+| `meanflow` | Backward average-velocity target with a directional JVP and detached adaptive weights | Backward updates from noise at time one to data at zero |
+| `latent` | Train a 3D-to-2D autoencoder, freeze it, standardize its encodings, then train a flow map | Latent map followed by the saved decoder |
+| `fmlm` | Diagonal token CE and weighted progressive denoiser consistency | Warped-time affine categorical maps, followed by argmax |
+| `categorical` | Diagonal CE and endpoint consistency plus temporal-derivative energy | The same categorical map parameterization |
+| `discrete-lsd` | Diagonal CE and Lagrangian logit-corrected KL teacher | Categorical finite-time maps |
+| `discrete-esd` | Diagonal CE and Eulerian directional-JVP logit teacher | Categorical finite-time maps |
+| `diamond` | Distill a GLASS posterior velocity built from an analytic Gaussian-mixture denoiser | Conditional posterior samples, differentiable value estimates, and reward steering |
+| `meta` | Independent inner and outer noise with a shared data endpoint, diagonal regression, and conditional composition | Posterior samples and reward-weighted posterior-mean steering |
+| `expanding` | Local-clock token CE, compatible-canvas composition, and remaining/interval gap-count losses | Learned binomial gap insertion, budget capping, and local-clock transport |
+| `ssfm` | OU drift anchoring, small-step stochastic matching, and same-noise composition | Strong maps using consistently aggregated Brownian coefficients |
+
+Each method also has its own entry point:
+
+```bash
+python examples/fmm_lagrangian.py
+python examples/fmm_eulerian.py
+python examples/consistency.py
+python examples/shortcut.py
+python examples/meanflow.py --sample-steps 1
+python examples/latent.py --teacher-steps 2000
+python examples/fmlm.py --sample-steps 1
+python examples/categorical.py
+python examples/discrete_lsd.py
+python examples/discrete_esd.py
+python examples/diamond.py --posterior-steps 4 --particles 64
+python examples/meta.py --finetune-steps 300
+python examples/expanding.py --sample-steps 4
+python examples/ssfm.py --sample-steps 4
+python examples/ssfm.py --ssfm-target paper --lr 0.0001 --train-steps 2000 --out outputs/ssfm-paper
+```
+
+The common options are `--train-steps`, `--teacher-steps`, `--batch-size`,
+`--width`, `--lr`, `--seed`, `--samples`, `--sample-steps`, and `--out`.
+`--teacher-steps` controls the teacher or autoencoder stage where one exists.
+Run `python run.py --help` for the remaining options. The `consistency` example
+always makes one endpoint prediction. SSFM requires a power-of-two sampling
+step count so its finite Brownian tree supports every requested partition.
+
+## Change one component at a time
+
+`lecture_core.py` exposes the functions used in the slide walkthroughs.
+`common.py` contains networks, data handling, optimization, and reference
+distributions. Each method family has a separate implementation file.
+
+| File | Responsibility |
+| --- | --- |
+| `continuous.py` | Diagonal, Lagrangian, Eulerian, semigroup, Shortcut, MeanFlow, and latent training |
+| `categorical.py` | Affine probability-valued maps, inverse decoding clock, ECLD, and logit teachers |
+| `posterior.py` | GLASS fusion, conditional map training, posterior values, importance correction, and reward fine-tuning |
+| `expanding.py` | Birth times, compaction, gap labels, count losses, and expansion/transport sampling |
+| `stochastic.py` | Brownian integrals, Chen composition, OU training, and strong-error evaluation |
+| `numerical_examples.py` | The lecture's numerical examples, including the trained exponential-flow example |
+| `SLIDE_CODE_MAP.md` | Stable links from every code slide and major method to the implementation |
+| `MATHEMATICS.md` | Equations, variable definitions, and the meaning of each loss |
+| `verified_examples/` | Actual seeded training logs, generated samples, and verification reports |
+
+The small sequence MLP receives the entire sequence. Its per-position output
+can therefore depend on every input position. The variable-length network also
+receives padding masks and birth-time metadata. Replacing these backbones with
+transformers does not require changing the displayed map identities.
+
+## Data and evaluation
+
+The continuous examples use four 2D Gaussians with known centers and variance.
+Reports include nearest-center distance, mode fractions, mode entropy, and exact
+target log density. These metrics describe different aspects of the samples;
+high mode entropy alone does not establish sample fidelity.
+
+`data/phrases.txt` contains correlated four-token phrases such as `red circle
+moves left`. `data/variable_text.txt` contains two-, four-, and five-token
+versions. Reports record token entropy, unique fraction, training-support
+fraction, and lengths. These tiny-data statistics are not LM1B/OWT perplexity or
+large-language-model evaluations. The split is a seeded 80/20 split of examples;
+the small grammar intentionally appears in both splits.
+
+Custom fixed-length text can be supplied with `--data my_phrases.txt`.
+The expanding example also accepts variable-length lines, up to 32 tokens.
+Continuous methods accept `--data points.csv`, with two finite numeric columns
+and no header. Diamond, Meta, and SSFM retain their specified reference
+distributions so their analytic diagnostics remain valid. See [data/README.md](data/README.md).
+
+## Numerical and theorem boundaries
+
+- **Continuous maps.** The diagonal is exactly the identity as a map, while its
+  predicted average velocity is trained by flow matching. Interpolant samples
+  are not individual ODE trajectories. Diagonal regression has an irreducible
+  conditional-variance floor, so raw training loss need not approach zero.
+- **Teacher distillation.** The finite-map teachers are learned in a separate
+  first stage. This retains teacher approximation error. The fixed MLP, bounded
+  interval sampling, and loss weights are classroom choices.
+- **Consistency and Shortcut.** Endpoint consistency is a compact
+  flow-matching-clock teaching implementation. Shortcut uses dyadic interval
+  lengths, a continuous start-time sample, EMA targets, and a separate diagonal
+  loss. The authors' large-image code has additional schedules and clipping.
+- **MeanFlow.** Data are at time zero and noise at one. The directional JVP uses
+  the conditional training velocity, and the entire corrected target is
+  detached. Seventy-five percent of training examples use equal times. Uniform
+  time sampling replaces the author's default logit-normal schedule.
+- **Latent maps.** This section demonstrates a learned representation and
+  decoder. It does not claim a separate canonical paper named Latent Flow Maps.
+  Reconstruction error and latent transport error are reported separately.
+- **Categorical maps.** Only the predicted denoiser lies on the simplex during
+  the trajectory. The final step reaches time one exactly; argmax is an explicit
+  decoding approximation for an imperfect model. We use Gaussian quadrature
+  for the decoding clock. Categorical ECLD uses the released code's bounded
+  endpoint-plus-time-energy objective, with an EMA endpoint target. Detached KL
+  and CE have the same student gradient; they log different scalar values.
+- **Discrete logit teachers.** The logarithmic correction requires positive
+  denominators. The implementation clamps them at 0.05 and logs the affected
+  fraction. This changes the teacher away from the exact solution; softmax
+  alone cannot repair an invalid logarithm. Differential objectives stay below
+  terminal time 0.97. No unreported gradient surgery is applied.
+- **Diamond and Meta.** The two noises are independent and share a clean
+  endpoint. Diamond uses an exact, evaluable mixture denoiser as its GLASS
+  teacher; Meta learns directly from samples. Posterior diagnostics compare
+  both means and variances. Finite importance estimates and reward-weighted
+  posterior means have self-normalization bias. The weighted-Diamond companion
+  uses an explicit full-support Gaussian proposal with a known density.
+- **Meta fine-tuning.** `--finetune-steps` runs and saves the detached surrogate
+  from Equation 43. It uses a bounded coordinate reward and the analytic base
+  mixture drift. Training is restricted to outer times 0.05 through 0.85;
+  extending the learned drift outside that interval is extrapolation.
+- **Expanding maps.** The data use a linear birth CDF. The network predicts
+  remaining gap means and interval means through the conditional insertion
+  factor. Binomial proposals and global budget capping approximate a joint count
+  law; a mean alone does not identify that law. A finite sampling jump introduces
+  new coordinates at its start, then transports them. Training compares routes
+  on a shared destination canvas with compatible noise and local clocks.
+  These are explicit finite-step choices, not a proof of exact conditional-law
+  recovery by the fitted network. Empty generated sequences remain visible in
+  the reports; the sampler does not silently replace them.
+- **Strong stochastic maps.** The example is an additive-noise OU SDE with a
+  known diffusion coefficient. It uses the first two Legendre integrals and a
+  learned average drift. Default `official-code` targets detach an EMA split
+  prediction; `--ssfm-target paper` detaches the direct prediction, as in the
+  lecture's pseudocode. Both reuse exactly the same Brownian history. The
+  reference is a fine Euler-Maruyama solve on that history, so its residual
+  discretization error is retained. No claim is made for multiplicative noise
+  or exact pathwise recovery with only two coefficients. The optional paper
+  orientation remained inaccurate in the recorded experiments, including the
+  lower-learning-rate recipe above; see the explicit sensitivity results in
+  `verified_examples/README.md`. Use the default released-code orientation for
+  the successful OU demonstration.
+
+## Read the saved results with the implementation
+
+[verified_examples/README.md](verified_examples/README.md) records the executed
+environment, commands, and metrics. Checkpoints are generated locally and are
+excluded from this folder's Git history, matching Lectures 4 and 5. The saved
+text/JSON records let students inspect a complete run before training their own
+models. The [slide code map](SLIDE_CODE_MAP.md) connects that run to the lecture.
diff --git a/lecture_6/SLIDE_CODE_MAP.md b/lecture_6/SLIDE_CODE_MAP.md
new file mode 100644
index 0000000000000000000000000000000000000000..adfc59e431436215688fa6f33abeccb2f4970173
--- /dev/null
+++ b/lecture_6/SLIDE_CODE_MAP.md
@@ -0,0 +1,36 @@
+# Lecture 6 slide-to-code map
+
+These links use stable native slide identifiers. Each code slide connects to the same functions used by the training runner.
+
+| Code walkthrough | Slide | Implementation |
+| --- | --- | --- |
+| The map takes the state and both times as inputs | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u038_b0) | `common.finite_map`, `continuous.diagonal_loss`, `continuous.semigroup_loss`, `numerical_examples.train_scalar` |
+| The two losses connect local motion to a longer move | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u039_b0) | `common.finite_map`, `continuous.diagonal_loss`, `continuous.semigroup_loss`, `numerical_examples.train_scalar` |
+| A JVP computes that correction without forming a Jacobian | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u051_b0) | `continuous.meanflow_loss` |
+| Softmax constrains the prediction before the map is applied | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u080_b0) | `categorical.categorical_map`, `categorical.composition_target`, `categorical.probability_kl` |
+| The target combines probabilities from two different states | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u081_b0) | `categorical.categorical_map`, `categorical.composition_target`, `categorical.probability_kl` |
+| We can differentiate through the posterior samples | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u122_b0) | `posterior.posterior_samples`, `posterior.posterior_value` |
+| The stop-gradient placement is essential in this fine-tuning loss | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u139_b0) | `posterior.fine_tune_surrogate`, `posterior.train_reward_drift` |
+| Keep the count, noise, and clock updates together | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u168_b0) | `expanding.bounded_counts`, `expanding.insert_tokens`, `expanding.local_clock` |
+| Sampling and combining two coefficients is only a few lines | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u198_b0) | `stochastic.sample_coefficients`, `stochastic.chen_two`, `stochastic.train_stochastic` |
+| The consistency update compares those two routes | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u199_b0) | `stochastic.sample_coefficients`, `stochastic.chen_two`, `stochastic.train_stochastic` |
+
+## Method sections
+
+| Lecture section | First slide | Code |
+| --- | --- | --- |
+| From velocities to finite motion | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u001_b0) | [continuous.py](continuous.py) |
+| Learning the identities | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u025_b0) | [continuous.py](continuous.py) |
+| Related finite-step formulations | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u041_b0) | [continuous.py](continuous.py) |
+| MeanFlow and the direction of time | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u047_b0) | [continuous.py](continuous.py) |
+| Flow maps in learned latent spaces | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u054_b0) | [posterior.py](posterior.py) |
+| Flow Map Language Models | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u060_b0) | [categorical.py](categorical.py) |
+| Categorical Flow Maps | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u083_b0) | [categorical.py](categorical.py) |
+| Discrete Flow Maps and logit consistency | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u093_b0) | [categorical.py](categorical.py) |
+| Diamond Maps and posterior lookahead | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u103_b0) | [posterior.py](posterior.py) |
+| Meta Flow Maps | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u125_b0) | [posterior.py](posterior.py) |
+| Expanding Flow Maps | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u143_b0) | [expanding.py](expanding.py) |
+| Strong Stochastic Flow Maps | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u173_b0) | [stochastic.py](stochastic.py) |
+| Connecting the formulations | [Open](https://docs.google.com/presentation/d/1wfLAazqYveMoyvdy0y5ILeionp7eUjcPgxu-5QFlWwI/edit#slide=id.fm6_u206_b0) | [stochastic.py](stochastic.py) |
+
+The exponential-flow code slides use the exact scalar drift `b(x)=x`; the generative runners use learned fields on a Gaussian mixture. The scalar training experiment remains in `numerical_examples.py`. The SSFM consistency code slide corresponds to `--ssfm-target paper`; the default follows the released code orientation, described in `SOURCES.md`.
diff --git a/lecture_6/SOURCES.md b/lecture_6/SOURCES.md
new file mode 100644
index 0000000000000000000000000000000000000000..52719e3c4ebbd039a317108909c6e7088bc72cdc
--- /dev/null
+++ b/lecture_6/SOURCES.md
@@ -0,0 +1,97 @@
+# Primary papers and author-code checks
+
+The teaching implementations were written for this course. Upstream training files were inspected to check objectives and conventions; their code is not vendored here. Small networks, synthetic data, and explicit numerical choices make the methods runnable on CPU. Inspection date: 2026-09-13.
+
+## Flow Map Matching
+
+[Paper](https://arxiv.org/abs/2406.07507v2). Class methods: `fmm-lagrangian, fmm-eulerian`.
+
+[Inspected author source](https://github.com/nmboffi/flow-maps/blob/2f115a07fa9073553193e4b265dfc303827af2b0/py/common/losses.py), revision `2f115a07fa90`.
+
+Frozen learned velocity teachers; residual-map JVPs; small MLP and bounded time range.
+
+## How to build a consistency model: Learning flow maps via self-distillation
+
+[Paper](https://arxiv.org/abs/2505.18825v2). Class methods: `self-distill`.
+
+[Inspected author source](https://github.com/nmboffi/flow-maps/blob/2f115a07fa9073553193e4b265dfc303827af2b0/py/common/losses.py), revision `2f115a07fa90`.
+
+Diagonal regression plus an EMA progressive target, normalized by a floored interval length. Learned uncertainty weights are omitted.
+
+## One Step Diffusion via Shortcut Models
+
+[Paper](https://arxiv.org/abs/2410.12557v3). Class methods: `shortcut`.
+
+[Inspected author source](https://github.com/kvfrans/shortcut-models/blob/601004348667094e1b71f30942199759412d4432/targets_shortcut.py), revision `601004348667`.
+
+Two half-step average target and dyadic intervals retained. Continuous start-time sampling and small MLP replace image-specific schedules and clipping.
+
+## Mean Flows for One-step Generative Modeling
+
+[Paper](https://arxiv.org/abs/2505.13447). Class methods: `meanflow`.
+
+[Inspected author source](https://github.com/Gsunshine/meanflow/blob/d70cb55d298ee03c53bf6da67bec281082e4e2d9/meanflow.py), revision `d70cb55d298e`.
+
+Backward clock, conditional-velocity JVP, detached target, adaptive loss, and 75% diagonal proportion retained. Uniform time sampling; no class guidance.
+
+## Flow Map Language Models: One-step Language Modeling via Continuous Denoising
+
+[Paper](https://arxiv.org/abs/2602.16813v3). Class methods: `fmlm`.
+
+[Inspected author source](https://github.com/david3684/flm/blob/a1918d5164e5038e37d0b7a4fb2010ce75b863b3/algo.py), revision `a1918d5164e5`.
+
+PSD denoiser target and Gaussian decoding clock retained. Independent clean-data diagonal supervision; EMA targets; quadrature lookup and MLP replace full language architecture.
+
+## Categorical Flow Maps
+
+[Paper](https://arxiv.org/abs/2602.12233v1). Class methods: `categorical`.
+
+[Inspected author source](https://github.com/olsdavis/semicat/blob/558602a0fa722514e4a6012f5c46a8ae178b3068/semicat/models/semicat.py), revision `558602a0fa72`.
+
+Released ECLD endpoint CE plus sum-of-squares time energy. Detached-target KL has identical student gradient. EMA target replaces the current network target.
+
+## Discrete Flow Maps
+
+[Paper](https://arxiv.org/abs/2604.09784v1). Class methods: `discrete-lsd, discrete-esd`.
+
+Derived from the paper. The linked project page has a placeholder Code link, so no author implementation was verified. Positive log denominators are explicitly clamped and counted; no gradient surgery.
+
+## Diamond Maps: Stochastic Flow Maps
+
+[Paper](https://arxiv.org/abs/2602.05993). Class methods: `diamond`.
+
+[Inspected author source](https://github.com/PeterHolderrieth/diamond_maps/blob/d30f65c75a169a2ed624f146b2770aeef882543a/posterior_diamond_maps/py/common/losses.py), revision `d30f65c75a16`.
+
+GLASS conditional velocity and Lagrangian posterior distillation. Exact Gaussian-mixture denoiser replaces a pretrained image teacher. Weighted posterior recovery uses an explicit Gaussian proposal with a known density.
+
+## Meta Flow Maps enable scalable reward alignment
+
+[Paper](https://arxiv.org/abs/2601.14430v2). Class methods: `meta`.
+
+[Inspected author source](https://github.com/adh1s/mfm/blob/53c0f60db695cad88bbace8fb26469614e9e7d7d/src/mfm/losses/losses.py), revision `53c0f60db695`.
+
+Data training with independent inner/outer noises and a shared endpoint; conditional semigroup objective. Optional Equation 43 fine-tuning also checked against src/mfm/losses/finetune.py.
+
+## Expanding Flow Maps
+
+[Paper](https://arxiv.org/abs/2607.21585v1). Class methods: `expanding`.
+
+[Inspected author source](https://github.com/sophtang/ExpandingFlowMaps/blob/4defc1ff168d12526d85b551bea78150b9aec605/README.md), revision `4defc1ff168d`.
+
+Paper Algorithms 2-4 and local-clock equations. The inspected repository contains README and artwork only. Classroom implementation includes a shared lifted canvas, remaining/interval count heads, explicit local clocks, and budget-capped binomial insertions.
+
+## Strong Stochastic Flow Maps
+
+[Paper](https://arxiv.org/abs/2606.01086v1). Class methods: `ssfm`.
+
+[Inspected author source](https://github.com/sammccallum/ssfm/blob/24b563620a8ee61c683d791fe802b56668f98f9b/ssfm/losses.py), revision `24b563620a8e`.
+
+First two Legendre integrals, Chen composition, known diffusion, small-step matching. The released loss detaches an EMA split target; paper Algorithm 1 detaches the direct target. Both orientations are selectable. OU replaces image/molecular experiments; no learned uncertainty weights.
+
+## Supporting lecture demonstrations
+
+`flow-matching` supplies the local velocity baseline. `consistency` demonstrates endpoint consistency on a learned flow teacher using the forward clock and a residual endpoint parameterization; it is not a reproduction of the original EDM consistency training system. `latent` demonstrates the encoder/map/decoder construction and does not attribute it to a separate paper called Latent Flow Maps. `numerical_examples.py` retains the lecture’s scalar ODE experiment and exact arithmetic checks.
+
+## Version and result scope
+
+Paper links retain the lecture versions when supplied. Author repositories may have advanced after those paper versions. The source revision above records exactly what was inspected. The lecture’s paper figures and benchmark values remain in the slide deck; the files under `verified_examples/` contain newly executed course examples, with their own data, compute settings, and metrics. No reported FID, generative perplexity, or biological benchmark is reproduced by these CPU teaching runs.
diff --git a/lecture_6/categorical.py b/lecture_6/categorical.py
new file mode 100644
index 0000000000000000000000000000000000000000..fd0ee80622a9347c6a5af65df6d884ce6929fa61
--- /dev/null
+++ b/lecture_6/categorical.py
@@ -0,0 +1,145 @@
+"""Simplex-valued mean denoisers for Flow Map Language Models and discrete maps.
+
+The state is Gaussian-noised one-hot text and can be outside the simplex.
+Only the softmax endpoint prediction is a probability vector.
+"""
+import math
+
+import torch
+from torch.nn import functional as F
+
+from common import SequenceNet, draw_batch, ema_copy, interpolate, optimize, time_like
+
+
+def categorical_map(model, x, s, t):
+    s, t = time_like(s, x), time_like(t, x)
+    probability = model(x, s, t).softmax(-1)
+    h = ((t - s) / (1 - s)).unsqueeze(-1)
+    return x + h * (probability - x), probability
+
+
+def composition_target(model, x, s, u, t):
+    mid, p1 = categorical_map(model, x, s, u)
+    _, p2 = categorical_map(model, mid, u, t)
+    gamma = ((1 - t) * (u - s) / ((1 - u) * (t - s))).unsqueeze(-1)
+    return gamma * p1 + (1 - gamma) * p2
+
+
+def probability_kl(logits, target):
+    return F.kl_div(logits.log_softmax(-1), target, reduction='none').sum(-1).mean()
+
+
+class DecodingClock:
+    """Inverse of the FMLM decoding-accuracy clock for isotropic Gaussian noise.
+
+    P(correct) = E_Z[Phi(Z + t/(1-t))^(V-1)]. Gaussian quadrature gives a
+    deterministic lookup. Endpoint values are exact. No empirical vocabulary
+    frequency estimate is mixed into this corruption-only clock.
+    """
+    def __init__(self, vocab, device='cpu'):
+        import numpy as np
+        nodes, weights = np.polynomial.hermite.hermgauss(64)
+        self.t = torch.linspace(0, .999, 1001, device=device)
+        z = torch.as_tensor(nodes * math.sqrt(2), device=device, dtype=torch.float64)
+        w = torch.as_tensor(weights / math.sqrt(math.pi), device=device, dtype=torch.float64)
+        snr = (self.t / (1 - self.t)).double()
+        cdf = .5 * (1 + torch.erf((z[None] + snr[:, None]) / math.sqrt(2)))
+        accuracy = (cdf.pow(vocab - 1) * w).sum(-1)
+        tau = ((vocab * accuracy - 1) / (vocab - 1)).clamp(0, 1).float()
+        self.tau = torch.cummax(tau, 0).values
+        self.tau[0], self.tau[-1], self.t[-1] = 0., 1., 1.
+
+    def inverse(self, tau):
+        indices = torch.searchsorted(self.tau, tau.contiguous()).clamp(1, len(self.tau)-1)
+        low, high = self.tau[indices-1], self.tau[indices]
+        alpha = (tau-low) / (high-low).clamp_min(1e-7)
+        result = self.t[indices-1] + alpha * (self.t[indices]-self.t[indices-1])
+        # Finite precision can saturate the lookup before t=1. Enforce the
+        # mathematical endpoint so generation actually reaches the simplex.
+        return torch.where(tau>=1,torch.ones_like(result),torch.where(tau<=0,torch.zeros_like(result),result))
+
+
+def corrected_logit_teacher(model, teacher, x, s, t, kind, floor=.05):
+    """Lagrangian/Eulerian logit teachers and explicit domain stabilization.
+
+    At an exact solution the denominators are positive. Unconverged networks
+    can violate that domain. We clamp to floor and report the changed fraction.
+    These clamped off-solution targets are an explicit numerical approximation.
+    """
+    if kind == 'discrete-lsd':
+        logits, dz = torch.func.jvp(lambda end: model(x, s, end),
+                                   (t,), (torch.ones_like(t),))
+        p = logits.softmax(-1)
+        delta = dz - (p * dz).sum(-1, keepdim=True)
+        coefficient = ((t-s) * (1-t) / (1-s)).unsqueeze(-1)
+        denominator = 1 + coefficient * delta
+        with torch.no_grad():
+            y, _ = categorical_map(teacher, x, s, t)
+            base_logits = teacher(y, t, t)
+    else:
+        with torch.no_grad():
+            p0 = teacher(x, s, s).softmax(-1)
+            velocity = (p0 - x) / (1-s).unsqueeze(-1)
+            base_logits = teacher(x, s, s)
+        logits, dz = torch.func.jvp(lambda z, start: model(z, start, t),
+                                   (x, s), (velocity, torch.ones_like(s)))
+        p = logits.softmax(-1)
+        delta = dz - (p * dz).sum(-1, keepdim=True)
+        coefficient = ((1-s)*(t-s)/(1-t)).unsqueeze(-1)
+        denominator = 1 - coefficient * delta
+    target = (base_logits - denominator.clamp_min(floor).log()).softmax(-1).detach()
+    return logits, target, (denominator.detach() < floor).float().mean()
+
+
+def train_categorical(method, ids, vocab, args):
+    model = SequenceNet(ids.shape[1], len(vocab), args.width).to(ids.device)
+    teacher = ema_copy(model)
+    clock = DecodingClock(len(vocab), ids.device)
+
+    def objective(step):
+        batch = draw_batch(ids, args.batch_size)
+        clean = F.one_hot(batch, len(vocab)).float()
+        ordered = clock.inverse(torch.rand(len(batch), 2, device=ids.device)).sort(-1).values
+        # Stay away from singular coefficients in differential teacher targets.
+        s, t = (.97 * ordered).split(1, -1)
+        t = torch.maximum(t, s + 1e-4)
+        x, _ = interpolate(clean, s)
+        diagonal = F.cross_entropy(model(x, s, s).flatten(0, 1), batch.flatten())
+        logits = model(x, s, t)
+        extra = {}
+        if method == 'fmlm':
+            with torch.no_grad():
+                target = composition_target(teacher, x, s, (s+t)/2, t)
+            finite = probability_kl(logits, target)
+        elif method == 'categorical':
+            y, _ = categorical_map(model, x, s, t)
+            with torch.no_grad():
+                endpoint = teacher(y.detach(), t, t).softmax(-1)
+            ec = probability_kl(logits, endpoint)
+            _, dt = torch.func.jvp(lambda end: model(x, s, end).softmax(-1),
+                                   (t,), (torch.ones_like(t),))
+            eta = ((t-s)/(1-s)).unsqueeze(-1)
+            temporal = (eta * dt).square().flatten(1).sum(-1).mean()
+            # Released ECLD implementation: CE + sum-of-squares time energy.
+            # Detached-target KL has the same student gradient as its CE term.
+            finite = ec + temporal
+            extra = {'endpoint_kl': ec, 'temporal_derivative': temporal}
+        else:
+            logits, target, fraction = corrected_logit_teacher(model, teacher, x, s, t, method)
+            finite = probability_kl(logits, target)
+            extra = {'denominator_clamp_fraction': fraction}
+        weight = min(1., (step + 1) / max(1, args.train_steps // 4))
+        return diagonal + weight * finite, {'diagonal_ce': diagonal, 'finite': finite, **extra}
+
+    logs = optimize(model, objective, args.train_steps, args.lr, teacher)
+    return model, {'model': model.state_dict(), 'length': ids.shape[1], 'vocab': vocab}, logs
+
+
+@torch.no_grad()
+def sample_categorical(model, count, steps, device):
+    clock = DecodingClock(model.vocab, device)
+    grid = clock.inverse(torch.linspace(0, 1, steps+1, device=device))
+    x = torch.randn(count, model.length, model.vocab, device=device)
+    for s, t in zip(grid[:-1], grid[1:]):
+        x, _ = categorical_map(model, x, s, t)
+    return x.argmax(-1)
diff --git a/lecture_6/common.py b/lecture_6/common.py
new file mode 100644
index 0000000000000000000000000000000000000000..59650c512f0e0006e32c873ac69148d784646030
--- /dev/null
+++ b/lecture_6/common.py
@@ -0,0 +1,207 @@
+"""Shared networks, data, and optimization for CIS 6270 Lecture 6.
+
+The small MLPs keep time derivatives and all training steps visible. Sequence
+networks receive the whole padded sequence, so predictions can depend on other
+positions. No pretrained checkpoint or dataset download is required.
+"""
+import copy
+import json
+import math
+import random
+from pathlib import Path
+
+import numpy as np
+import torch
+from torch import nn
+from torch.nn import functional as F
+
+
+def seed_all(seed, threads=1):
+    random.seed(seed)
+    np.random.seed(seed)
+    torch.manual_seed(seed)
+    torch.set_num_threads(threads)
+
+
+def mlp(inputs, outputs, width):
+    return nn.Sequential(nn.Linear(inputs, width), nn.SiLU(),
+                         nn.Linear(width, width), nn.SiLU(),
+                         nn.Linear(width, outputs))
+
+
+def time_like(t, x):
+    """One scalar time per batch member, shape [B,1]."""
+    t = torch.as_tensor(t, dtype=x.dtype, device=x.device)
+    if t.numel() == 1:
+        return t.expand(len(x), 1)
+    return t.reshape(len(x), 1)
+
+
+class MapNet(nn.Module):
+    def __init__(self, dim=2, width=64, context_dim=0):
+        super().__init__()
+        self.net = mlp(dim + 2 + context_dim, dim, width)
+
+    def forward(self, x, s, t, context=None):
+        inputs = [x, time_like(s, x), time_like(t, x)]
+        if context is not None:
+            inputs.append(context)
+        return self.net(torch.cat(inputs, -1))
+
+
+class SequenceNet(nn.Module):
+    def __init__(self, length, vocab, width=64):
+        super().__init__()
+        self.length, self.vocab = length, vocab
+        self.net = mlp(length * vocab + 2, length * vocab, width)
+
+    def forward(self, x, s, t):
+        inputs = torch.cat([x.flatten(1), time_like(s, x), time_like(t, x)], -1)
+        return self.net(inputs).reshape(-1, self.length, self.vocab)
+
+
+def finite_map(model, x, s, t, context=None):
+    """F(s,t,x) = x + (t-s) v(s,t,x), including exact F(s,s,x)=x."""
+    s, t = time_like(s, x), time_like(t, x)
+    return x + (t - s) * model(x, s, t, context)
+
+
+def ordered_times(x, ceiling=.98):
+    times = ceiling * torch.rand(len(x), 2, device=x.device, dtype=x.dtype)
+    s, t = times.sort(-1).values.split(1, -1)
+    return s, t, (s + t) / 2
+
+
+def draw_batch(data, count):
+    return data[torch.randint(len(data), (count,), device=data.device)]
+
+
+def interpolate(data, time, noise=None):
+    noise = torch.randn_like(data) if noise is None else noise
+    t = time.reshape(len(data), *([1] * (data.ndim - 1)))
+    return (1 - t) * noise + t * data, data - noise
+
+
+def ema_copy(model):
+    result = copy.deepcopy(model).eval()
+    result.requires_grad_(False)
+    return result
+
+
+@torch.no_grad()
+def update_ema(ema, model, decay=.99):
+    for p, q in zip(ema.parameters(), model.parameters()):
+        p.lerp_(q, 1 - decay)
+
+
+def optimize(model, objective, steps, lr=1e-3, ema=None):
+    optimizer = torch.optim.Adam(model.parameters(), lr=lr)
+    logs = []
+    for step in range(steps):
+        loss, details = objective(step)
+        if not torch.isfinite(loss):
+            raise FloatingPointError(f'Nonfinite loss at step {step}: {details}')
+        optimizer.zero_grad(set_to_none=True)
+        loss.backward()
+        norm = torch.nn.utils.clip_grad_norm_(model.parameters(), 10.)
+        if not torch.isfinite(norm):
+            raise FloatingPointError(f'Nonfinite gradient at step {step}')
+        optimizer.step()
+        if ema is not None:
+            update_ema(ema, model)
+        logs.append({'step': step, 'loss': float(loss.detach()),
+                     **{k: float(torch.as_tensor(v).detach()) for k, v in details.items()}})
+    return logs
+
+
+CENTERS = torch.tensor([[-1.5, -1.5], [-1.5, 1.5], [1.5, -1.5], [1.5, 1.5]])
+DATA_STD = .22
+
+
+def mixture_data(n, generator=None):
+    ids = torch.randint(4, (n,), generator=generator)
+    return CENTERS[ids] + DATA_STD * torch.randn(n, 2, generator=generator)
+
+
+def mixture_posterior(x, t):
+    """Exact p(X1 | (1-t)X0+tX1=x) for the four Gaussian mixture.
+
+    Return component probabilities, conditional means, scalar variances.
+    This analytic oracle is used for diagnostics and the GLASS example.
+    """
+    t = time_like(t, x)
+    a = 1 - t
+    variance = a.square() + (t * DATA_STD).square()
+    centers = CENTERS.to(x)
+    delta = x[:, None, :] - t[:, None, :] * centers
+    logits = -delta.square().sum(-1) / (2 * variance)
+    prob = logits.softmax(-1)
+    gain = t * DATA_STD**2 / variance
+    means = centers + gain[:, None, :] * delta
+    posterior_variance = DATA_STD**2 * a.square() / variance
+    return prob, means, posterior_variance
+
+
+def exact_denoiser(x, t):
+    p, means, _ = mixture_posterior(x, t)
+    return (p[..., None] * means).sum(1)
+
+
+def exact_velocity(x, t):
+    t = time_like(t, x)
+    # Direct conditional velocity avoids cancellation at t=1.
+    a = 1 - t
+    variance = a.square() + (t * DATA_STD).square()
+    centers = CENTERS.to(x)
+    delta = x[:, None] - t[:, None] * centers
+    weights = (-delta.square().sum(-1) / (2 * variance)).softmax(-1)
+    component_velocity = centers + ((t * DATA_STD**2 - a) / variance)[:, None] * delta
+    return (weights[..., None] * component_velocity).sum(1)
+
+
+def mixture_metrics(samples):
+    x = samples.detach().cpu()
+    distances = (x[:, None] - CENTERS).square().sum(-1)
+    counts = torch.bincount(distances.argmin(-1), minlength=4).float()
+    p = counts / len(x)
+    logp = torch.logsumexp(-distances / (2 * DATA_STD**2), -1)
+    logp -= math.log(4 * 2 * math.pi * DATA_STD**2)
+    return {'finite_samples': bool(torch.isfinite(x).all()),
+            'mean_distance_to_center': float(distances.min(-1).values.sqrt().mean()),
+            'mode_fractions': p.tolist(), 'mode_entropy': float(-(p * p.clamp_min(1e-12).log()).sum()),
+            'mean_target_log_density': float(logp.mean())}
+
+
+def load_text(path, variable=False):
+    lines = [x.strip().split() for x in Path(path).read_text().splitlines() if x.strip()]
+    if len(lines) < 2:
+        raise ValueError('Text data need at least two nonempty lines.')
+    vocab = sorted(set(word for line in lines for word in line))
+    lengths = torch.tensor([len(x) for x in lines])
+    if not variable and len(set(lengths.tolist())) != 1:
+        raise ValueError('Fixed-length methods require equal tokens per line; use expanding otherwise.')
+    if lengths.max() > 32:
+        raise ValueError('Teaching MLP supports up to 32 positions.')
+    ids = {word: i for i, word in enumerate(vocab)}
+    encoded = torch.zeros(len(lines), int(lengths.max()), dtype=torch.long)
+    for i, line in enumerate(lines):
+        encoded[i, :len(line)] = torch.tensor([ids[word] for word in line])
+    return encoded, lengths, vocab
+
+
+def text_metrics(ids, vocab, lengths=None, reference=None):
+    lengths = [ids.shape[1]] * len(ids) if lengths is None else lengths.tolist()
+    texts = [' '.join(vocab[j] for j in row[:length]) for row, length in zip(ids.tolist(), lengths)]
+    flat = [j for row, length in zip(ids.tolist(), lengths) for j in row[:length]]
+    counts = torch.bincount(torch.tensor(flat, dtype=torch.long), minlength=len(vocab)).float()
+    p = counts / counts.sum().clamp_min(1)
+    metrics = {'unique_fraction': len(set(texts)) / len(texts),
+               'token_entropy': float(-(p * p.clamp_min(1e-12).log()).sum()),
+               'mean_length': sum(lengths) / len(lengths), 'empty_fraction': lengths.count(0) / len(lengths)}
+    if reference is not None:
+        metrics['training_support_fraction'] = sum(x in reference for x in texts) / len(texts)
+    return texts, metrics
+
+
+def write_json(path, value):
+    Path(path).write_text(json.dumps(value, indent=2, allow_nan=False) + '\n')
diff --git a/lecture_6/continuous.py b/lecture_6/continuous.py
new file mode 100644
index 0000000000000000000000000000000000000000..e0e3b49aa4819dc65946ea73c2ee926385f23648
--- /dev/null
+++ b/lecture_6/continuous.py
@@ -0,0 +1,183 @@
+"""Flow matching, finite-map identities, Shortcut, MeanFlow, and latent maps.
+
+# %% 1. Learn local motion before learning an interval.
+All times run noise -> data except MeanFlow, whose original backward clock
+r <= t runs data at zero -> noise at one during training.
+"""
+import torch
+from torch import nn
+from torch.nn import functional as F
+
+from common import (MapNet, draw_batch, ema_copy, finite_map, interpolate, mlp,
+                    optimize, ordered_times, time_like)
+
+
+def diagonal_loss(model, data):
+    t = torch.rand(len(data), 1, device=data.device)
+    x, displacement = interpolate(data, t)
+    return F.mse_loss(model(x, t, t), displacement)
+
+
+def lagrangian_residual(model, velocity, x, s, t):
+    # d_t F(s,t,x) = b(t,F(s,t,x)). JVP differentiates only arrival time.
+    y, dt = torch.func.jvp(lambda end: finite_map(model, x, s, end),
+                         (t,), (torch.ones_like(t),))
+    return dt - velocity(y.detach(), t).detach()
+
+
+def eulerian_residual(model, velocity, x, s, t):
+    # (d_s + b_s dot grad_x)F = 0. No full Jacobian is materialized.
+    direction = velocity(x, s).detach()
+    _, residual = torch.func.jvp(lambda z, start: finite_map(model, z, start, t),
+                               (x, s), (direction, torch.ones_like(s)))
+    return residual
+
+
+def semigroup_loss(model, teacher, x, s, t, context=None):
+    u = (s + t) / 2
+    with torch.no_grad():
+        mid = finite_map(teacher, x, s, u, context)
+        target = finite_map(teacher, mid, u, t, context)
+    prediction = finite_map(model, x, s, t, context)
+    return ((prediction - target) / (t - s).clamp_min(.05)).square().mean()
+
+
+def meanflow_loss(model, data):
+    # %% 2. Average backward velocity satisfies u = v - (t-r) D_t u.
+    noise = torch.randn_like(data)
+    r, t, _ = ordered_times(data, 1.)
+    # Include diagonal examples with nonzero probability, as in the paper.
+    r = torch.where(torch.rand_like(r) < .75, t, r)
+    z = (1 - t) * data + t * noise
+    v = noise - data
+    average, derivative = torch.func.jvp(model, (z, r, t),
+        (v, torch.zeros_like(r), torch.ones_like(t)))
+    target = (v - (t - r) * derivative).detach()
+    residual = (average - target).square().mean(-1)
+    # Detached adaptive weighting controls large self-distillation residuals.
+    weight = (residual.detach() + .01).pow(-.5)
+    return (weight * residual).mean(), {'mse': residual.mean()}
+
+
+def shortcut_loss(model, teacher, data):
+    t = torch.rand(len(data), 1, device=data.device)
+    x, v = interpolate(data, t)
+    diag = F.mse_loss(model(x, t, t), v)
+    # d is the half-step. Learn the 2d shortcut from two d shortcuts.
+    powers = torch.randint(1, 6, (len(data), 1), device=data.device)
+    d = 2. ** (-powers)
+    start = torch.rand_like(d) * (1 - 2 * d)
+    x, _ = interpolate(data, start)
+    with torch.no_grad():
+        first = teacher(x, start, start + d)
+        second = teacher(x + d * first, start + d, start + 2 * d)
+        target = .5 * (first + second)
+    finite = F.mse_loss(model(x, start, start + 2 * d), target)
+    return diag + finite, {'diagonal': diag, 'shortcut': finite}
+
+
+def train_continuous(method, data, args):
+    model = MapNet(data.shape[1], args.width).to(data)
+    teacher_logs = []
+    teacher = None
+    if method in {'fmm-lagrangian', 'fmm-eulerian', 'consistency'}:
+        teacher = MapNet(data.shape[1], args.width).to(data)
+        teacher_logs = optimize(teacher, lambda _: (diagonal_loss(teacher, draw_batch(data, args.batch_size)), {}),
+                                args.teacher_steps, args.lr)
+        teacher.requires_grad_(False)
+        model.load_state_dict(teacher.state_dict())
+    ema = ema_copy(model)
+
+    def objective(step):
+        batch = draw_batch(data, args.batch_size)
+        if method == 'meanflow':
+            return meanflow_loss(model, batch)
+        if method == 'shortcut':
+            return shortcut_loss(model, ema, batch)
+        diag = diagonal_loss(model, batch)
+        if method == 'flow-matching':
+            return diag, {'diagonal': diag}
+        s, t, _ = ordered_times(batch)
+        x, _ = interpolate(batch, s)
+        if method == 'fmm-lagrangian':
+            finite = lagrangian_residual(model, lambda z, a: teacher(z, a, a), x, s, t).square().mean()
+        elif method == 'fmm-eulerian':
+            finite = eulerian_residual(model, lambda z, a: teacher(z, a, a), x, s, t).square().mean()
+        elif method == 'consistency':
+            # Endpoint consistency distillation on teacher-solved short intervals.
+            # At t=1 the residual endpoint parametrization is exactly identity.
+            t = (s + .1).clamp_max(1.)
+            with torch.no_grad():
+                y = integrate_velocity(lambda z, a: teacher(z, a, a), x, s, t, 4)
+                target = finite_map(ema, y, t, torch.ones_like(t))
+            finite = F.mse_loss(finite_map(model, x, s, torch.ones_like(s)), target)
+        else:
+            finite = semigroup_loss(model, ema, x, s, t)
+        weight = min(1., (step + 1) / max(1, args.train_steps // 5))
+        return diag + weight * finite, {'diagonal': diag, 'finite': finite}
+
+    logs = optimize(model, objective, args.train_steps, args.lr, ema)
+    # Use the trained student; EMA supplies fixed bootstrap targets during training.
+    state = {'model': model.state_dict(), 'dim': data.shape[1]}
+    if teacher is not None:
+        state['teacher'] = teacher.state_dict()
+    return model, state, logs, teacher_logs
+
+
+@torch.no_grad()
+def integrate_velocity(velocity, x, s, t, steps):
+    """Heun integration of a velocity, also supports batch-specific time bounds."""
+    s, t = time_like(s, x), time_like(t, x)
+    h = (t - s) / steps
+    for i in range(steps):
+        a = s + i * h
+        k1 = velocity(x, a)
+        k2 = velocity(x + h * k1, a + h)
+        x = x + h * .5 * (k1 + k2)
+    return x
+
+
+@torch.no_grad()
+def sample_continuous(model, method, noise, steps):
+    if method == 'flow-matching':
+        return integrate_velocity(lambda z, a: model(z, a, a), noise, 0., 1., steps)
+    if method == 'consistency':
+        return finite_map(model, noise, 0., 1.)
+    x = noise
+    for i in range(steps):
+        if method == 'meanflow':
+            t, r = 1 - i / steps, 1 - (i + 1) / steps
+            x = x - (t - r) * model(x, r, t)
+        else:
+            x = finite_map(model, x, i / steps, (i + 1) / steps)
+    return x
+
+
+class Autoencoder(nn.Module):
+    def __init__(self, width):
+        super().__init__()
+        self.encoder = mlp(3, 2, width)
+        self.decoder = mlp(2, 3, width)
+
+
+def embed_surface(x):
+    return torch.cat([x, .3 * (x[:, :1].square() - x[:, 1:].square())], -1)
+
+
+def train_latent(data, args):
+    # %% 3. First fit the representation, then freeze it while fitting its flow.
+    surface = embed_surface(data)
+    ae = Autoencoder(args.width).to(data)
+    def objective(_):
+        batch = draw_batch(surface, args.batch_size)
+        reconstruction = ae.decoder(ae.encoder(batch))
+        return F.mse_loss(reconstruction, batch), {}
+    ae_logs = optimize(ae, objective, args.teacher_steps, args.lr)
+    ae.requires_grad_(False)
+    with torch.no_grad():
+        z = ae.encoder(surface)
+        mean, std = z.mean(0), z.std(0).clamp_min(.05)
+        z = (z - mean) / std
+    model, state, logs, _ = train_continuous('self-distill', z, args)
+    state.update({'autoencoder': ae.state_dict(), 'latent_mean': mean, 'latent_std': std})
+    return model, ae, state, logs, ae_logs
diff --git a/lecture_6/data/README.md b/lecture_6/data/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..5a228d477cf851b50054c6768dd229f1f74af43b
--- /dev/null
+++ b/lecture_6/data/README.md
@@ -0,0 +1,34 @@
+# Data for Lecture 6
+
+`phrases.txt` and `variable_text.txt` were generated deterministically with Python
+`random.Random(6270)`. Each contains 640 examples. Their vocabulary describes
+colored shapes and directions; no external dataset is needed.
+
+| Color | Shape | Direction |
+| --- | --- | --- |
+| red | circle | left |
+| blue | square | right |
+| green | triangle | up |
+| gold | star | down |
+
+The fixed-length corpus has four tokens per line. The variable-length corpus
+uses `COLOR SHAPE`, `COLOR SHAPE moves DIRECTION`, or the latter followed by
+`slowly` or `twice`. The color, shape, and direction remain correlated. This
+makes invalid independent combinations easy to inspect.
+
+Training uses a seeded shuffle and 80/20 example split. The grammar has a small
+support, so examples repeat and both partitions contain the same grammar.
+Training-support fraction measures membership in this small support; it is
+not a test of open-ended language generalization.
+
+For a custom corpus, supply a UTF-8 text file with one whitespace-tokenized
+sequence per line. Fixed-length methods require equal token counts. The
+expanding method accepts variable lengths up to 32. Vocabulary and maximum
+length are saved in the checkpoint, so sampling does not need the original file.
+
+The continuous dataset is sampled from four equally weighted Gaussians centered
+at `(−1.5,−1.5)`, `(−1.5,1.5)`, `(1.5,−1.5)`, and `(1.5,1.5)`, with coordinate
+standard deviation 0.22. The latent example embeds these points on
+`(x, y, 0.3(x²−y²))` before learning its autoencoder. SSFM uses analytic
+Ornstein-Uhlenbeck marginals with initial variance one, drift `−x`, and diffusion
+coefficient 0.7.
diff --git a/lecture_6/data/phrases.txt b/lecture_6/data/phrases.txt
new file mode 100644
index 0000000000000000000000000000000000000000..73a16f2eceba5a3178ce49355f20136f45c000c3
--- /dev/null
+++ b/lecture_6/data/phrases.txt
@@ -0,0 +1,640 @@
+green triangle moves up
+gold star moves down
+green triangle moves up
+gold star moves down
+blue square moves right
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+gold star moves down
+blue square moves right
+red circle moves left
+gold star moves down
+green triangle moves up
+red circle moves left
+red circle moves left
+green triangle moves up
+green triangle moves up
+green triangle moves up
+red circle moves left
+red circle moves left
+green triangle moves up
+green triangle moves up
+red circle moves left
+gold star moves down
+red circle moves left
+red circle moves left
+gold star moves down
+gold star moves down
+red circle moves left
+red circle moves left
+red circle moves left
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+blue square moves right
+red circle moves left
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle moves up
+red circle moves left
+green triangle moves up
+blue square moves right
+red circle moves left
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+green triangle moves up
+red circle moves left
+red circle moves left
+red circle moves left
+gold star moves down
+gold star moves down
+red circle moves left
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+red circle moves left
+blue square moves right
+green triangle moves up
+blue square moves right
+blue square moves right
+gold star moves down
+green triangle moves up
+red circle moves left
+green triangle moves up
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+red circle moves left
+green triangle moves up
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+red circle moves left
+green triangle moves up
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+green triangle moves up
+green triangle moves up
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+blue square moves right
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+gold star moves down
+red circle moves left
+green triangle moves up
+red circle moves left
+green triangle moves up
+gold star moves down
+blue square moves right
+red circle moves left
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+blue square moves right
+red circle moves left
+gold star moves down
+green triangle moves up
+green triangle moves up
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+red circle moves left
+red circle moves left
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+blue square moves right
+red circle moves left
+gold star moves down
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+blue square moves right
+gold star moves down
+gold star moves down
+green triangle moves up
+red circle moves left
+green triangle moves up
+green triangle moves up
+red circle moves left
+red circle moves left
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+blue square moves right
+green triangle moves up
+blue square moves right
+red circle moves left
+gold star moves down
+blue square moves right
+green triangle moves up
+red circle moves left
+red circle moves left
+gold star moves down
+green triangle moves up
+blue square moves right
+red circle moves left
+gold star moves down
+green triangle moves up
+gold star moves down
+red circle moves left
+blue square moves right
+red circle moves left
+blue square moves right
+green triangle moves up
+blue square moves right
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+blue square moves right
+green triangle moves up
+blue square moves right
+blue square moves right
+blue square moves right
+green triangle moves up
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+red circle moves left
+blue square moves right
+red circle moves left
+red circle moves left
+gold star moves down
+gold star moves down
+green triangle moves up
+red circle moves left
+gold star moves down
+red circle moves left
+red circle moves left
+gold star moves down
+gold star moves down
+gold star moves down
+red circle moves left
+green triangle moves up
+gold star moves down
+green triangle moves up
+blue square moves right
+gold star moves down
+green triangle moves up
+red circle moves left
+green triangle moves up
+red circle moves left
+green triangle moves up
+green triangle moves up
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+blue square moves right
+red circle moves left
+green triangle moves up
+blue square moves right
+red circle moves left
+green triangle moves up
+gold star moves down
+red circle moves left
+red circle moves left
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+blue square moves right
+red circle moves left
+gold star moves down
+red circle moves left
+blue square moves right
+red circle moves left
+gold star moves down
+green triangle moves up
+blue square moves right
+gold star moves down
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+red circle moves left
+gold star moves down
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+red circle moves left
+red circle moves left
+blue square moves right
+green triangle moves up
+red circle moves left
+red circle moves left
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+green triangle moves up
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+red circle moves left
+green triangle moves up
+blue square moves right
+blue square moves right
+green triangle moves up
+red circle moves left
+green triangle moves up
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+green triangle moves up
+blue square moves right
+red circle moves left
+gold star moves down
+red circle moves left
+red circle moves left
+gold star moves down
+blue square moves right
+green triangle moves up
+red circle moves left
+green triangle moves up
+green triangle moves up
+green triangle moves up
+gold star moves down
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle moves up
+green triangle moves up
+blue square moves right
+red circle moves left
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+red circle moves left
+red circle moves left
+red circle moves left
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+blue square moves right
+blue square moves right
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+gold star moves down
+green triangle moves up
+gold star moves down
+gold star moves down
+blue square moves right
+gold star moves down
+blue square moves right
+gold star moves down
+gold star moves down
+gold star moves down
+blue square moves right
+gold star moves down
+green triangle moves up
+gold star moves down
+blue square moves right
+gold star moves down
+blue square moves right
+red circle moves left
+gold star moves down
+green triangle moves up
+green triangle moves up
+green triangle moves up
+red circle moves left
+green triangle moves up
+blue square moves right
+blue square moves right
+green triangle moves up
+gold star moves down
+green triangle moves up
+red circle moves left
+gold star moves down
+gold star moves down
+blue square moves right
+red circle moves left
+red circle moves left
+blue square moves right
+blue square moves right
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+gold star moves down
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+red circle moves left
+blue square moves right
+blue square moves right
+green triangle moves up
+green triangle moves up
+gold star moves down
+green triangle moves up
+green triangle moves up
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+red circle moves left
+red circle moves left
+gold star moves down
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+green triangle moves up
+blue square moves right
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+red circle moves left
+green triangle moves up
+blue square moves right
+blue square moves right
+green triangle moves up
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+gold star moves down
+blue square moves right
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+green triangle moves up
+green triangle moves up
+green triangle moves up
+blue square moves right
+gold star moves down
+green triangle moves up
+gold star moves down
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+gold star moves down
+green triangle moves up
+gold star moves down
+red circle moves left
+red circle moves left
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+red circle moves left
+green triangle moves up
+red circle moves left
+green triangle moves up
+blue square moves right
+red circle moves left
+green triangle moves up
+gold star moves down
+green triangle moves up
+green triangle moves up
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+green triangle moves up
+green triangle moves up
+blue square moves right
+red circle moves left
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
+red circle moves left
+green triangle moves up
+blue square moves right
+red circle moves left
+red circle moves left
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+green triangle moves up
+red circle moves left
+green triangle moves up
+red circle moves left
+red circle moves left
+blue square moves right
+red circle moves left
+red circle moves left
+red circle moves left
+gold star moves down
+red circle moves left
+green triangle moves up
+green triangle moves up
+green triangle moves up
+red circle moves left
+gold star moves down
+gold star moves down
+gold star moves down
+red circle moves left
+gold star moves down
+green triangle moves up
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+red circle moves left
+gold star moves down
+green triangle moves up
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
+red circle moves left
+green triangle moves up
+green triangle moves up
+red circle moves left
+red circle moves left
+gold star moves down
+blue square moves right
+red circle moves left
+gold star moves down
+gold star moves down
+blue square moves right
+red circle moves left
+blue square moves right
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+blue square moves right
+green triangle moves up
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+gold star moves down
+blue square moves right
+red circle moves left
+red circle moves left
+blue square moves right
+red circle moves left
+green triangle moves up
+red circle moves left
+red circle moves left
+red circle moves left
+gold star moves down
+green triangle moves up
+gold star moves down
+red circle moves left
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
diff --git a/lecture_6/data/variable_text.txt b/lecture_6/data/variable_text.txt
new file mode 100644
index 0000000000000000000000000000000000000000..7eb78e7b02d9510af0ea0f701ddf2fabcc54edda
--- /dev/null
+++ b/lecture_6/data/variable_text.txt
@@ -0,0 +1,640 @@
+green triangle moves up
+gold star moves down twice
+green triangle moves up
+gold star
+blue square moves right
+gold star
+green triangle
+red circle moves left twice
+blue square
+green triangle moves up slowly
+gold star moves down twice
+gold star moves down slowly
+red circle moves left
+blue square moves right slowly
+blue square moves right twice
+red circle moves left
+gold star moves down slowly
+blue square moves right twice
+red circle
+gold star moves down
+green triangle
+red circle
+red circle moves left twice
+green triangle moves up twice
+green triangle moves up
+green triangle moves up slowly
+red circle
+red circle moves left slowly
+green triangle
+green triangle
+red circle moves left twice
+gold star moves down twice
+red circle moves left twice
+red circle
+gold star moves down
+gold star moves down
+red circle
+red circle moves left slowly
+red circle moves left
+blue square moves right twice
+red circle moves left slowly
+blue square
+gold star
+blue square moves right twice
+red circle moves left
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle
+red circle
+green triangle moves up slowly
+blue square moves right
+red circle
+green triangle moves up slowly
+red circle moves left
+blue square moves right slowly
+green triangle
+green triangle moves up slowly
+green triangle moves up slowly
+red circle moves left slowly
+red circle moves left slowly
+red circle moves left slowly
+gold star moves down
+gold star
+red circle moves left
+gold star moves down
+blue square moves right slowly
+blue square moves right
+red circle moves left
+red circle
+blue square moves right twice
+green triangle moves up slowly
+blue square moves right slowly
+blue square
+gold star moves down
+green triangle moves up slowly
+red circle moves left
+green triangle
+gold star
+gold star moves down
+gold star moves down slowly
+gold star moves down twice
+blue square moves right
+gold star moves down
+red circle moves left
+red circle
+green triangle
+gold star moves down
+blue square moves right slowly
+gold star
+red circle moves left
+red circle moves left slowly
+red circle
+green triangle moves up slowly
+blue square moves right
+red circle moves left twice
+blue square moves right twice
+gold star moves down
+gold star moves down twice
+red circle moves left twice
+green triangle moves up slowly
+green triangle
+gold star moves down twice
+red circle moves left
+green triangle moves up slowly
+green triangle moves up
+blue square
+green triangle
+gold star moves down
+green triangle moves up twice
+green triangle moves up slowly
+blue square
+red circle moves left slowly
+blue square moves right twice
+gold star
+blue square moves right
+blue square
+blue square
+red circle
+blue square moves right
+blue square moves right
+blue square moves right slowly
+gold star moves down
+red circle
+green triangle moves up slowly
+gold star moves down
+red circle moves left
+green triangle moves up
+red circle moves left
+green triangle moves up
+gold star
+blue square moves right
+red circle
+green triangle moves up
+red circle moves left twice
+blue square
+green triangle
+gold star
+gold star moves down twice
+gold star
+green triangle moves up
+gold star
+blue square moves right slowly
+blue square
+blue square
+red circle
+gold star moves down slowly
+green triangle moves up
+green triangle
+red circle moves left
+blue square moves right slowly
+gold star moves down
+gold star
+gold star moves down twice
+gold star moves down slowly
+gold star moves down slowly
+gold star moves down
+red circle moves left
+red circle
+blue square moves right
+blue square moves right slowly
+blue square
+gold star
+blue square
+red circle
+blue square moves right
+gold star moves down slowly
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star
+blue square moves right slowly
+green triangle moves up twice
+red circle moves left slowly
+blue square moves right slowly
+green triangle moves up twice
+gold star moves down
+gold star
+green triangle moves up slowly
+blue square
+red circle moves left slowly
+gold star
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+blue square
+gold star moves down
+gold star moves down
+green triangle moves up twice
+red circle moves left
+green triangle
+green triangle
+red circle moves left slowly
+red circle moves left
+gold star moves down slowly
+red circle moves left
+red circle moves left twice
+green triangle moves up slowly
+blue square moves right
+green triangle moves up slowly
+blue square
+red circle moves left twice
+gold star
+blue square
+green triangle
+red circle moves left slowly
+red circle
+gold star moves down slowly
+green triangle
+blue square moves right
+red circle
+gold star
+green triangle moves up twice
+gold star moves down twice
+red circle
+blue square moves right slowly
+red circle moves left slowly
+blue square
+green triangle
+blue square moves right
+green triangle moves up twice
+green triangle moves up slowly
+gold star moves down
+blue square
+blue square moves right
+blue square moves right
+green triangle
+blue square moves right slowly
+blue square moves right slowly
+blue square
+green triangle moves up slowly
+blue square moves right
+green triangle moves up
+red circle moves left slowly
+blue square moves right slowly
+green triangle
+red circle
+blue square moves right
+gold star moves down twice
+gold star moves down
+red circle moves left
+red circle moves left slowly
+blue square moves right slowly
+red circle
+red circle moves left
+gold star
+gold star moves down slowly
+green triangle moves up
+red circle moves left
+gold star moves down twice
+red circle moves left
+red circle moves left slowly
+gold star moves down
+gold star moves down slowly
+gold star
+red circle moves left twice
+green triangle
+gold star moves down slowly
+green triangle
+blue square moves right
+gold star moves down slowly
+green triangle moves up twice
+red circle
+green triangle
+red circle moves left twice
+green triangle
+green triangle moves up slowly
+blue square moves right
+red circle
+blue square
+gold star moves down
+gold star
+blue square
+blue square moves right slowly
+red circle moves left
+red circle moves left slowly
+blue square moves right
+green triangle moves up
+green triangle moves up
+blue square moves right
+red circle moves left twice
+green triangle moves up
+blue square moves right twice
+red circle
+green triangle
+gold star moves down twice
+red circle
+red circle moves left
+blue square moves right
+gold star moves down twice
+red circle moves left slowly
+red circle moves left slowly
+blue square moves right
+red circle moves left
+gold star moves down
+red circle moves left slowly
+blue square
+red circle moves left twice
+gold star moves down
+green triangle
+blue square
+gold star moves down
+gold star moves down
+gold star
+green triangle moves up
+gold star moves down
+red circle moves left
+gold star moves down
+blue square
+red circle
+green triangle
+green triangle moves up
+gold star moves down
+green triangle moves up slowly
+gold star moves down
+green triangle moves up twice
+red circle
+blue square
+red circle moves left twice
+red circle moves left slowly
+blue square moves right
+green triangle moves up
+red circle moves left
+red circle
+gold star moves down
+green triangle moves up slowly
+gold star
+green triangle moves up
+green triangle moves up
+gold star moves down slowly
+red circle
+red circle moves left
+green triangle moves up twice
+red circle
+green triangle moves up
+blue square moves right
+blue square moves right slowly
+green triangle moves up slowly
+red circle moves left
+green triangle moves up twice
+green triangle moves up slowly
+blue square moves right slowly
+green triangle moves up slowly
+gold star moves down twice
+blue square
+green triangle moves up
+green triangle moves up slowly
+blue square moves right twice
+red circle moves left slowly
+gold star moves down
+red circle moves left twice
+red circle moves left slowly
+gold star moves down twice
+blue square moves right
+green triangle moves up
+red circle moves left
+green triangle moves up
+green triangle
+green triangle
+gold star
+green triangle moves up
+gold star moves down
+blue square moves right twice
+blue square moves right slowly
+green triangle
+green triangle moves up slowly
+blue square moves right twice
+red circle
+red circle moves left slowly
+blue square moves right twice
+blue square
+red circle
+red circle moves left
+red circle moves left
+red circle moves left
+blue square moves right twice
+green triangle moves up slowly
+blue square moves right slowly
+gold star moves down slowly
+blue square moves right
+blue square
+blue square moves right slowly
+green triangle moves up
+red circle moves left
+blue square moves right slowly
+gold star
+green triangle moves up
+gold star moves down slowly
+gold star moves down
+blue square
+gold star moves down
+blue square moves right slowly
+gold star moves down twice
+gold star moves down twice
+gold star moves down slowly
+blue square
+gold star moves down
+green triangle
+gold star moves down twice
+blue square moves right slowly
+gold star moves down
+blue square moves right
+red circle moves left twice
+gold star moves down
+green triangle
+green triangle
+green triangle
+red circle
+green triangle
+blue square
+blue square moves right
+green triangle moves up slowly
+gold star moves down
+green triangle moves up
+red circle
+gold star
+gold star moves down
+blue square moves right twice
+red circle moves left
+red circle
+blue square moves right
+blue square moves right twice
+gold star moves down
+gold star moves down twice
+blue square moves right
+blue square moves right twice
+gold star
+blue square
+gold star moves down slowly
+gold star moves down slowly
+red circle moves left
+red circle moves left
+blue square moves right
+blue square moves right
+green triangle moves up twice
+green triangle moves up
+gold star moves down
+green triangle moves up
+green triangle moves up
+green triangle
+blue square moves right slowly
+green triangle moves up slowly
+gold star moves down
+red circle
+red circle moves left twice
+gold star moves down twice
+gold star
+gold star
+blue square moves right twice
+blue square moves right twice
+green triangle moves up
+gold star moves down
+blue square moves right twice
+green triangle moves up slowly
+gold star moves down slowly
+gold star moves down
+blue square moves right twice
+blue square moves right
+blue square moves right slowly
+gold star moves down twice
+red circle moves left twice
+blue square
+green triangle moves up twice
+green triangle
+green triangle
+blue square moves right
+gold star moves down twice
+blue square moves right
+gold star
+red circle moves left twice
+blue square moves right
+green triangle moves up
+green triangle
+green triangle moves up
+green triangle moves up
+gold star
+blue square moves right
+red circle
+green triangle moves up
+blue square moves right twice
+blue square moves right slowly
+green triangle moves up
+green triangle
+red circle
+blue square
+green triangle moves up
+red circle moves left
+blue square
+gold star
+gold star
+blue square moves right
+blue square moves right slowly
+red circle
+gold star
+blue square
+green triangle
+blue square moves right
+green triangle moves up
+gold star moves down twice
+green triangle moves up
+green triangle moves up slowly
+green triangle
+blue square moves right
+gold star moves down slowly
+green triangle
+gold star
+red circle moves left
+blue square moves right
+gold star moves down
+gold star
+red circle moves left twice
+gold star moves down twice
+green triangle moves up slowly
+gold star moves down
+red circle moves left
+red circle moves left slowly
+blue square moves right twice
+gold star moves down
+green triangle moves up slowly
+blue square
+red circle moves left twice
+green triangle moves up twice
+red circle moves left
+green triangle
+blue square
+red circle
+green triangle
+gold star moves down twice
+green triangle moves up twice
+green triangle
+gold star moves down
+green triangle moves up
+blue square moves right twice
+green triangle
+red circle
+green triangle moves up twice
+green triangle moves up
+gold star moves down
+red circle moves left
+green triangle moves up twice
+green triangle
+gold star
+green triangle moves up twice
+blue square moves right slowly
+green triangle
+green triangle moves up
+green triangle moves up
+blue square
+red circle moves left
+blue square moves right twice
+red circle
+green triangle
+green triangle moves up
+red circle
+green triangle moves up twice
+blue square moves right slowly
+red circle moves left slowly
+red circle moves left twice
+green triangle moves up slowly
+gold star moves down slowly
+blue square moves right
+blue square moves right twice
+red circle
+green triangle moves up slowly
+red circle
+green triangle
+red circle moves left slowly
+red circle
+blue square moves right slowly
+red circle moves left slowly
+red circle
+red circle moves left twice
+gold star
+red circle moves left twice
+green triangle moves up twice
+green triangle moves up
+green triangle moves up
+red circle
+gold star moves down slowly
+gold star
+gold star
+red circle
+gold star moves down twice
+green triangle moves up
+green triangle
+blue square
+green triangle moves up slowly
+gold star moves down
+gold star
+green triangle
+gold star
+red circle moves left
+gold star moves down
+green triangle
+blue square moves right slowly
+red circle moves left
+green triangle moves up
+green triangle moves up slowly
+red circle moves left
+green triangle moves up twice
+green triangle moves up
+red circle moves left twice
+red circle moves left
+gold star moves down twice
+blue square moves right
+red circle moves left twice
+gold star
+gold star
+blue square
+red circle
+blue square
+blue square
+blue square moves right twice
+red circle moves left
+blue square moves right slowly
+blue square moves right slowly
+green triangle
+blue square moves right slowly
+green triangle moves up twice
+blue square
+gold star moves down
+gold star moves down twice
+blue square moves right
+red circle
+red circle moves left twice
+blue square moves right twice
+red circle moves left
+green triangle moves up slowly
+red circle
+red circle moves left
+red circle moves left twice
+gold star moves down slowly
+green triangle moves up twice
+gold star moves down
+red circle
+blue square
+red circle
+green triangle
+green triangle
diff --git a/lecture_6/examples/categorical.py b/lecture_6/examples/categorical.py
new file mode 100644
index 0000000000000000000000000000000000000000..6d2d03b25da05cb26c6073fd26485e62b3013925
--- /dev/null
+++ b/lecture_6/examples/categorical.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete categorical training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'categorical', *sys.argv[1:]])
diff --git a/lecture_6/examples/consistency.py b/lecture_6/examples/consistency.py
new file mode 100644
index 0000000000000000000000000000000000000000..bb0297d5886d96e2cbda850f77580a792aa898fa
--- /dev/null
+++ b/lecture_6/examples/consistency.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete consistency training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'consistency', *sys.argv[1:]])
diff --git a/lecture_6/examples/diamond.py b/lecture_6/examples/diamond.py
new file mode 100644
index 0000000000000000000000000000000000000000..47a9835aad9e90f405a463c6a4d6e8e3386f136d
--- /dev/null
+++ b/lecture_6/examples/diamond.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete diamond training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'diamond', *sys.argv[1:]])
diff --git a/lecture_6/examples/discrete_esd.py b/lecture_6/examples/discrete_esd.py
new file mode 100644
index 0000000000000000000000000000000000000000..a4ed0e4c930b151f72c7f2c005915d4fbb0f116f
--- /dev/null
+++ b/lecture_6/examples/discrete_esd.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete discrete-esd training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'discrete-esd', *sys.argv[1:]])
diff --git a/lecture_6/examples/discrete_lsd.py b/lecture_6/examples/discrete_lsd.py
new file mode 100644
index 0000000000000000000000000000000000000000..e5efe11236e63d6cfa58c34ca3dbc792b14a2ce9
--- /dev/null
+++ b/lecture_6/examples/discrete_lsd.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete discrete-lsd training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'discrete-lsd', *sys.argv[1:]])
diff --git a/lecture_6/examples/expanding.py b/lecture_6/examples/expanding.py
new file mode 100644
index 0000000000000000000000000000000000000000..45822d3c22715cb948be713240e06c64745b334b
--- /dev/null
+++ b/lecture_6/examples/expanding.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete expanding training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'expanding', *sys.argv[1:]])
diff --git a/lecture_6/examples/flow_matching.py b/lecture_6/examples/flow_matching.py
new file mode 100644
index 0000000000000000000000000000000000000000..37d43941670493963b672e97d92c54e688ec68ca
--- /dev/null
+++ b/lecture_6/examples/flow_matching.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete flow-matching training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'flow-matching', *sys.argv[1:]])
diff --git a/lecture_6/examples/fmlm.py b/lecture_6/examples/fmlm.py
new file mode 100644
index 0000000000000000000000000000000000000000..f970b0e64f22eb58a34abd57fcb53064dad714ef
--- /dev/null
+++ b/lecture_6/examples/fmlm.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete fmlm training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'fmlm', *sys.argv[1:]])
diff --git a/lecture_6/examples/fmm_eulerian.py b/lecture_6/examples/fmm_eulerian.py
new file mode 100644
index 0000000000000000000000000000000000000000..22099957c4d58ea5db40eb524a2aed3108f56543
--- /dev/null
+++ b/lecture_6/examples/fmm_eulerian.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete fmm-eulerian training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'fmm-eulerian', *sys.argv[1:]])
diff --git a/lecture_6/examples/fmm_lagrangian.py b/lecture_6/examples/fmm_lagrangian.py
new file mode 100644
index 0000000000000000000000000000000000000000..d42ae727efdfecf8577f583a4e42ee0eb8040f2a
--- /dev/null
+++ b/lecture_6/examples/fmm_lagrangian.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete fmm-lagrangian training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'fmm-lagrangian', *sys.argv[1:]])
diff --git a/lecture_6/examples/latent.py b/lecture_6/examples/latent.py
new file mode 100644
index 0000000000000000000000000000000000000000..5b57c05aab7fd082eb050a73a75deda2c715cde0
--- /dev/null
+++ b/lecture_6/examples/latent.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete latent training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'latent', *sys.argv[1:]])
diff --git a/lecture_6/examples/meanflow.py b/lecture_6/examples/meanflow.py
new file mode 100644
index 0000000000000000000000000000000000000000..39867b02e3af7b45a53bc92802d47b4aa2294b62
--- /dev/null
+++ b/lecture_6/examples/meanflow.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete meanflow training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'meanflow', *sys.argv[1:]])
diff --git a/lecture_6/examples/meta.py b/lecture_6/examples/meta.py
new file mode 100644
index 0000000000000000000000000000000000000000..7b49369834e9bc1607d55e70f27124d8848cdb77
--- /dev/null
+++ b/lecture_6/examples/meta.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete meta training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'meta', *sys.argv[1:]])
diff --git a/lecture_6/examples/self_distill.py b/lecture_6/examples/self_distill.py
new file mode 100644
index 0000000000000000000000000000000000000000..609d36bb1ad1b50c6df3aa3aead32f1ec7eb0b9b
--- /dev/null
+++ b/lecture_6/examples/self_distill.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete self-distill training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'self-distill', *sys.argv[1:]])
diff --git a/lecture_6/examples/shortcut.py b/lecture_6/examples/shortcut.py
new file mode 100644
index 0000000000000000000000000000000000000000..4eeb2bcfc2f5399499407c1f174d6417772182fa
--- /dev/null
+++ b/lecture_6/examples/shortcut.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete shortcut training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'shortcut', *sys.argv[1:]])
diff --git a/lecture_6/examples/ssfm.py b/lecture_6/examples/ssfm.py
new file mode 100644
index 0000000000000000000000000000000000000000..0fcb46dd6fd1dc064683a531b736f90f4fd4ba38
--- /dev/null
+++ b/lecture_6/examples/ssfm.py
@@ -0,0 +1,8 @@
+#!/usr/bin/env python3
+"""Run the complete ssfm training and sampling example."""
+import sys
+from pathlib import Path
+sys.path.insert(0, str(Path(__file__).resolve().parents[1]))
+from run import main
+if __name__ == '__main__':
+    main(['--method', 'ssfm', *sys.argv[1:]])
diff --git a/lecture_6/expanding.py b/lecture_6/expanding.py
new file mode 100644
index 0000000000000000000000000000000000000000..cb25f4143318c74bf8fe0eceeb0aa0f181e4ac21
--- /dev/null
+++ b/lecture_6/expanding.py
@@ -0,0 +1,192 @@
+"""Expanding Flow Maps on variable-length text with learned gap insertions.
+
+Based on paper Algorithms 2-4. The state carries birth times alongside token
+coordinates. Finite transport uses local clocks on a shared destination canvas.
+The insertion head learns both remaining-count and interval-count expectations.
+"""
+import torch
+from torch import nn
+from torch.nn import functional as F
+
+from common import ema_copy, mlp, optimize
+
+
+class ExpandingNet(nn.Module):
+    def __init__(self, length, vocab, width):
+        super().__init__()
+        self.length, self.vocab = length, vocab
+        # Every token contributes state, two local clocks, birth, and active mask.
+        self.denoiser = mlp(length * (vocab+4), length*vocab, width)
+        self.insertion = mlp(length*(vocab+2)+2, length+1, width)
+
+    def predict(self, x, local_s, local_t, births, mask):
+        features = torch.cat([x, local_s[..., None], local_t[..., None],
+                              births[..., None], mask[..., None].to(x)], -1)
+        return self.denoiser(features.flatten(1)).reshape(-1, self.length, self.vocab)
+
+    def counts(self, x, births, mask, s, t, diagonal=False):
+        features = torch.cat([x, births[..., None], mask[..., None].to(x)], -1).flatten(1)
+        features = torch.cat([features, s, t], -1)
+        remaining = F.softplus(self.insertion(features)) + 1e-5
+        # Linear birth CDF: rho=(t-s)/(1-s). The diagonal predicts the
+        # remaining count; off-diagonal predictions include the interval factor.
+        return remaining if diagonal else (t-s)/(1-s)*remaining
+
+
+def local_clock(t, births):
+    return ((t-births)/(1-births)).clamp(0, 1)
+
+
+def local_map(model, x, a, b, births, mask):
+    p = model.predict(x, a, b, births, mask).softmax(-1)
+    eta = ((b-a)/(1-a).clamp_min(1e-6))[..., None]
+    y = (x + eta*(p-x)) * mask[..., None]
+    return y, p
+
+
+def gap_counts(active_indices, born_indices, length):
+    """Assign each missing index to a gap while retaining original token order."""
+    result = torch.zeros(len(active_indices)+1, device=active_indices.device)
+    if len(born_indices):
+        gap = torch.searchsorted(active_indices, born_indices)
+        result.scatter_add_(0, gap, torch.ones_like(gap, dtype=result.dtype))
+    return result
+
+
+def compact(full, births, selected, max_length):
+    x = full.new_zeros(max_length, full.shape[-1])
+    b = births.new_zeros(max_length)
+    mask = torch.zeros(max_length, dtype=torch.bool, device=full.device)
+    n = len(selected)
+    x[:n], b[:n], mask[:n] = full[selected], births[selected], True
+    return x, b, mask
+
+
+def count_divergence(target, mean):
+    # Poisson NLL up to target-only constants. Finite at target=0.
+    # Avoid xlogy(0,0)'s undefined intermediate derivative in autodiff.
+    return mean - target + target * (target.clamp_min(1e-12).log()-mean.log())
+
+
+def expansion_batch(ids, lengths, vocab, batch_size):
+    index = torch.randint(len(ids), (batch_size,), device=ids.device)
+    fields = {k: [] for k in ['xs','bs','ms','xe','be','me','ys','ye','missing','interval','gapmask']}
+    pairs = (.96*torch.rand(batch_size, 2, device=ids.device)).sort(-1).values
+    s, t = pairs[:, :1], pairs[:, 1:]
+    t = torch.maximum(t, s+1e-4)
+    L = ids.shape[1]
+    for j, row in enumerate(index):
+        n = int(lengths[row])
+        clean = F.one_hot(ids[row, :n], vocab).float()
+        births = .999*torch.rand(n, device=ids.device)
+        noise = torch.randn_like(clean)
+        clock = local_clock(s[j], births)
+        full = (1-clock[:, None])*noise+clock[:, None]*clean
+        active = torch.where(births <= s[j])[0]
+        later = torch.where(births <= t[j])[0]
+        xs, bs, ms = compact(full, births, active, L)
+        xe, be, me = compact(full, births, later, L)
+        ys, _, _ = compact(clean, births, active, L)
+        ye, _, _ = compact(clean, births, later, L)
+        missing = full.new_zeros(L+1)
+        interval = full.new_zeros(L+1)
+        gm = torch.arange(L+1, device=ids.device) <= len(active)
+        missing[gm] = gap_counts(active, torch.where(births>s[j])[0], n)
+        interval[gm] = gap_counts(active, torch.where((births>s[j]) & (births<=t[j]))[0], n)
+        for k, value in zip(fields, [xs,bs,ms,xe,be,me,ys,ye,missing,interval,gm]):
+            fields[k].append(value)
+    return {k: torch.stack(v) for k,v in fields.items()}, s, t
+
+
+def train_expanding(ids, lengths, vocab, args):
+    model = ExpandingNet(ids.shape[1], len(vocab), args.width).to(ids.device)
+    teacher = ema_copy(model)
+    def objective(step):
+        b, s, t = expansion_batch(ids, lengths, len(vocab), args.batch_size)
+        a = local_clock(s, b['bs'])
+        logits = model.predict(b['xs'], a, a, b['bs'], b['ms'])
+        ce = -(b['ys']*logits.log_softmax(-1)).sum(-1)
+        diagonal = (ce*b['ms']).sum()/b['ms'].sum().clamp_min(1)
+        # Lift both paths to the same destination canvas, with the same noise.
+        la, lb = local_clock(s,b['be']), local_clock(t,b['be'])
+        lu = local_clock((s+t)/2,b['be'])
+        with torch.no_grad():
+            middle, p1 = local_map(teacher,b['xe'],la,lu,b['be'],b['me'])
+            _, p2 = local_map(teacher,middle,lu,lb,b['be'],b['me'])
+            gamma = ((1-lb)*(lu-la)/((1-lu)*(lb-la)).clamp_min(1e-6)).clamp(0,1)
+            target = gamma[...,None]*p1+(1-gamma[...,None])*p2
+        logits = model.predict(b['xe'],la,lb,b['be'],b['me'])
+        kl = F.kl_div(logits.log_softmax(-1),target,reduction='none').sum(-1)
+        finite = (kl*b['me']).sum()/b['me'].sum().clamp_min(1)
+        m = model.counts(b['xs'],b['bs'],b['ms'],s,s,diagonal=True)
+        interval = model.counts(b['xs'],b['bs'],b['ms'],s,t)
+        count = count_divergence(b['missing'],m)+count_divergence(b['interval'],interval)
+        insertion = (count*b['gapmask']).sum()/b['gapmask'].sum()
+        ramp = min(1.,(step+1)/max(1,args.train_steps//4))
+        return diagonal+ramp*finite+insertion, {'diagonal_ce':diagonal,'finite':finite,'insertion':insertion}
+    logs = optimize(model,objective,args.train_steps,args.lr,teacher)
+    return model, {'model':model.state_dict(),'length':ids.shape[1],'vocab':vocab}, logs
+
+
+def bounded_counts(means, budget):
+    """Independent binomial proposals, then left-to-right joint budget capping.
+
+    Before capping, each proposal has its predicted mean after [0,budget]
+    clipping. Conditional means alone do not determine the joint count law.
+    """
+    if budget == 0:
+        return torch.zeros_like(means, dtype=torch.long), 0
+    raw = torch.distributions.Binomial(budget, probs=means.clamp(0,budget)/budget).sample().long()
+    kept = raw.clone()
+    remaining = budget
+    for i in range(len(kept)):
+        kept[i] = min(int(kept[i]),remaining)
+        remaining -= int(kept[i])
+    return kept, int((raw-kept).sum())
+
+
+def insert_tokens(state, births, counts, noise, birth_time):
+    pieces, times, offset = [], [], 0
+    for gap, count in enumerate(counts.tolist()):
+        if count:
+            pieces.append(noise[offset:offset+count])
+            times.append(births.new_full((count,),birth_time))
+            offset += count
+        if gap < len(state):
+            pieces.append(state[gap:gap+1]); times.append(births[gap:gap+1])
+    if offset != len(noise):
+        raise ValueError('Noise rows must match insertion counts.')
+    if not pieces:
+        return state, births
+    return torch.cat(pieces),torch.cat(times)
+
+
+@torch.no_grad()
+def sample_expanding(model,count,steps,device):
+    result = torch.zeros(count,model.length,dtype=torch.long,device=device)
+    lengths = torch.zeros(count,dtype=torch.long,device=device)
+    capped = 0
+    traces = []
+    for j in range(count):
+        x = torch.zeros(0,model.vocab,device=device)
+        births = torch.zeros(0,device=device)
+        trace = [0]
+        for k in range(steps):
+            s,t = k/steps,(k+1)/steps
+            padded,bt,mask = compact(x,births,torch.arange(len(x),device=device),model.length)
+            start,end = torch.tensor([[s]],device=device),torch.tensor([[t]],device=device)
+            means = model.counts(padded[None],bt[None],mask[None],start,end)[0,:len(x)+1]
+            counts,discarded = bounded_counts(means,model.length-len(x));capped+=discarded
+            noise = torch.randn(int(counts.sum()),model.vocab,device=device)
+            # Finite expand-then-transport convention: new coordinates enter at s.
+            x,births = insert_tokens(x,births,counts,noise,s)
+            if len(x):
+                padded,bt,mask=compact(x,births,torch.arange(len(x),device=device),model.length)
+                y,_=local_map(model,padded[None],local_clock(start,bt[None]),
+                              local_clock(end,bt[None]),bt[None],mask[None])
+                x=y[0,:len(x)]
+            trace.append(len(x))
+        lengths[j]=len(x)
+        if len(x):result[j,:len(x)]=x.argmax(-1)
+        traces.append(trace)
+    return result,lengths,{'capped_proposed_insertions':capped,'length_trajectories':traces}
diff --git a/lecture_6/lecture_core.py b/lecture_6/lecture_core.py
new file mode 100644
index 0000000000000000000000000000000000000000..195e1b55f42065d1870aa945ba224e2fcffb335b
--- /dev/null
+++ b/lecture_6/lecture_core.py
@@ -0,0 +1,14 @@
+"""Stable imports connecting the lecture's code walkthroughs to full methods.
+
+Implementation lives in the named modules so training and sampling use the
+same functions demonstrated on the slides. See SLIDE_CODE_MAP.md.
+"""
+from common import finite_map
+from continuous import (diagonal_loss,lagrangian_residual,eulerian_residual,
+                        semigroup_loss,meanflow_loss,shortcut_loss)
+from categorical import (categorical_map,composition_target,corrected_logit_teacher,
+                         probability_kl,DecodingClock)
+from posterior import (glass_denoiser,posterior_samples,posterior_value,
+                       fine_tune_surrogate,weighted_diamond_samples)
+from expanding import (local_clock,local_map,count_divergence,bounded_counts,insert_tokens)
+from stochastic import chen_two,sample_coefficients
diff --git a/lecture_6/numerical_examples.py b/lecture_6/numerical_examples.py
new file mode 100644
index 0000000000000000000000000000000000000000..d9be9ffcfb6229e59240fe7d33f79a462fb4648f
--- /dev/null
+++ b/lecture_6/numerical_examples.py
@@ -0,0 +1,187 @@
+"""CIS 6270 Lecture 6. Small, reproducible flow-map teaching experiments.
+
+Run: python numerical_examples.py --output outputs/numerical
+Dependencies: Python 3.11+, numpy, torch.
+The toy experiments validate the lecture mathematics. They do not reproduce
+the large-scale training or benchmark claims of the cited papers.
+"""
+import argparse, json, math, pathlib
+import numpy as np
+import torch
+from torch import nn
+from torch.nn import functional as F
+
+def flow(model, x, s, t):
+    """Residual map with an exactly identity diagonal."""
+    return x + (t-s)*model(torch.cat([x,s,t],dim=-1))
+
+def train_scalar(output, iterations=6000):
+    """Self-distill the flow of dx/dt=x, using diagonal and composition only."""
+    torch.manual_seed(6270)
+    torch.set_num_threads(2)
+    model=nn.Sequential(nn.Linear(3,64),nn.SiLU(),nn.Linear(64,64),nn.SiLU(),nn.Linear(64,1))
+    opt=torch.optim.Adam(model.parameters(),lr=1e-3)
+    history=[]
+    for step in range(iterations):
+        # Broad state coverage includes states reached by the split map.
+        x=6*torch.rand(256,1)-3
+        times=torch.rand(256,2).sort(dim=-1).values
+        s,t=times[:,:1],times[:,1:]
+        u=s+(t-s)*torch.rand_like(s)
+        diagonal=model(torch.cat([x,s,s],dim=-1))
+        diag_loss=(diagonal-x).square().mean()
+        with torch.no_grad():
+            target=flow(model,flow(model,x,s,u),u,t)
+        prediction=flow(model,x,s,t)
+        # Normalize the interval residual to prevent tiny intervals dominating
+        # the count of nearly zero-error examples. Keep a finite floor.
+        cons_loss=((prediction-target)/(t-s).clamp_min(0.1)).square().mean()
+        loss=diag_loss + (0 if step<500 else 1)*cons_loss
+        opt.zero_grad();loss.backward();opt.step()
+        if step%500==0:history.append({'step':step,'diagonal':diag_loss.item(),'composition':cons_loss.item()})
+    with torch.no_grad():
+        x=torch.linspace(-1.5,1.5,501)[:,None]
+        s=torch.zeros_like(x);t=torch.ones_like(x);u=0.5*t
+        pred=flow(model,x,s,t);truth=x*math.e
+        split=flow(model,flow(model,x,s,u),u,t)
+        rmse=(pred-truth).square().mean().sqrt().item()
+        composition_rmse=(pred-split).square().mean().sqrt().item()
+        np.savez(output/'scalar_predictions.npz',x=x.numpy().ravel(),pred=pred.numpy().ravel(),truth=truth.numpy().ravel())
+    torch.save(model.state_dict(),output/'scalar_map_weights.pt')
+    return {'endpoint_rmse':rmse,'composition_rmse':composition_rmse,'iterations':iterations,'history':history}
+
+def categorical_map(net,x,s,t):
+    psi=net(x,s,t).softmax(dim=-1)
+    h=(t-s)/(1-s)
+    return (1-h)*x+h*psi,psi
+
+def check_categorical():
+    x=torch.tensor([-.2,.6,1.1],dtype=torch.float64)
+    psi=torch.tensor([.1,.7,.2],dtype=torch.float64)
+    y=(1/3)*x+(2/3)*psi
+    assert torch.allclose(y,torch.tensor([0,2/3,.5],dtype=torch.float64))
+    target=(1/3)*torch.tensor([.8,.2])+(2/3)*torch.tensor([.2,.8])
+    assert torch.allclose(target,torch.tensor([.4,.6]))
+    logits=torch.tensor([.2,-.1],requires_grad=True)
+    loss=F.kl_div(logits.log_softmax(-1),target,reduction='sum')
+    loss.backward()
+    assert torch.allclose(logits.grad,logits.softmax(-1)-target,atol=1e-7)
+    return {'mapped_state':y.tolist(),'state_sum':y.sum().item(),'target':target.tolist()}
+
+def check_meanflow_jvp():
+    # Exact backward average for dz/dt=z. Stay off diagonal for this check.
+    def exact_average(z,r,t):
+        h=t-r
+        return z*(-torch.expm1(-h))/h
+    z=torch.tensor([[1.7]],dtype=torch.float64)
+    r=torch.tensor([[.2]],dtype=torch.float64)
+    t=torch.tensor([[.8]],dtype=torch.float64)
+    value,derivative=torch.func.jvp(exact_average,(z,r,t),(z,torch.zeros_like(r),torch.ones_like(t)))
+    target=z-(t-r)*derivative
+    assert torch.allclose(value,target,atol=1e-10)
+    return {'average':value.item(),'identity_residual':(value-target).abs().item()}
+
+def posterior_value_demo():
+    # Prior Z~N(0,1), observation x=beta*Z+alpha*eps.
+    # Reward r(Z)=c*Z gives an analytic log moment-generating function.
+    torch.manual_seed(13)
+    alpha,beta,c=.7,.6,.4
+    x=torch.tensor(.3,dtype=torch.float64,requires_grad=True)
+    gain=beta/(alpha**2+beta**2)
+    variance=alpha**2/(alpha**2+beta**2)
+    eps=torch.randn(100000,dtype=torch.float64)
+    z=gain*x+math.sqrt(variance)*eps
+    logw=c*z
+    estimate=torch.logsumexp(logw,0)-math.log(len(eps))
+    gradient=torch.autograd.grad(estimate,x)[0]
+    exact=c*gain*x.detach()+.5*c*c*variance
+    exact_gradient=c*gain
+    assert abs(gradient.item()-exact_gradient)<1e-10
+    assert abs(estimate.item()-exact.item())<.006
+    return {'estimated_value':estimate.item(),'exact_value':exact.item(),'gradient':gradient.item(),'exact_gradient':exact_gradient}
+
+def sample_gap_counts(means,remaining_budget):
+    """Paper-style bounded proposals followed by left-to-right budget capping.
+
+    These proposals match the per-gap means before joint truncation. They are
+    not asserted to identify the full conditional count law from means alone.
+    """
+    counts=[];remaining=int(remaining_budget)
+    for mean in means:
+        if remaining_budget==0:count=0
+        else:
+            prob=float(torch.as_tensor(mean).clamp(0,remaining_budget))/remaining_budget
+            count=int(torch.distributions.Binomial(remaining_budget,probs=prob).sample())
+        count=min(count,remaining);counts.append(count);remaining-=count
+    return torch.tensor(counts,dtype=torch.long)
+
+def insert_by_gap(state,old_birth_times,counts,new_noise,birth_time):
+    """Insert ordered noise rows into the n+1 gaps and preserve clock alignment."""
+    assert len(counts)==len(state)+1
+    pieces=[];clocks=[];offset=0
+    for gap,count in enumerate(counts.tolist()):
+        if count:
+            pieces.append(new_noise[offset:offset+count]);offset+=count
+            clocks.append(torch.full((count,),float(birth_time)))
+        if gap<len(state):
+            pieces.append(state[gap:gap+1]);clocks.append(old_birth_times[gap:gap+1])
+    assert offset==len(new_noise)
+    return torch.cat(pieces),torch.cat(clocks)
+
+def check_expansion():
+    state=torch.tensor([[1.,0.],[0.,1.]])
+    births=torch.tensor([0.,.2]);counts=torch.tensor([1,0,1])
+    noise=torch.tensor([[-.2,.4],[.3,-.1]])
+    expanded,bt=insert_by_gap(state,births,counts,noise,.5)
+    local=(.75-bt)/(1-bt)
+    assert expanded.shape==(4,2)
+    assert torch.allclose(bt,torch.tensor([.5,0.,.2,.5]))
+    assert torch.allclose(local,torch.tensor([.5,.75,.6875,.5]))
+    return {'birth_times':bt.tolist(),'local_times':local.tolist(),'expected_insertions':((.75-.25)/(1-.25))*3}
+
+def chen_two(left,right,hL,hR):
+    h=hL+hR
+    return torch.stack([left[...,0]+right[...,0],
+        (hL*left[...,1]+hR*right[...,1]-hR*left[...,0]+hL*right[...,0])/h],dim=-1)
+
+def check_brownian():
+    left=torch.tensor([.2,.04]);right=torch.tensor([-.1,-.02])
+    coarse=chen_two(left,right,.5,.5)
+    assert torch.allclose(coarse,torch.tensor([.1,-.14]))
+    direct=1+.5+.8*coarse[0]
+    split=(1+.25+.8*left[0])+.25+.8*right[0]
+    assert torch.allclose(direct,split)
+    torch.manual_seed(17)
+    scale=torch.tensor([.5,1/6]).sqrt()
+    L=torch.randn(200000,2)*scale;R=torch.randn(200000,2)*scale
+    C=chen_two(L,R,.5,.5)
+    covariance=torch.cov(C.T)
+    assert torch.allclose(covariance,torch.diag(torch.tensor([1.,1/3])),atol=.012)
+    # Exact polynomial restriction identities, tested over unequal intervals.
+    hL,hR=.3,.7
+    q=torch.linspace(0,1,100,dtype=torch.float64)
+    global_left=2*(hL*q)/(hL+hR)-1
+    local_left=(hL/(hL+hR))*(2*q-1)-hR/(hL+hR)
+    assert torch.allclose(global_left,local_left,atol=1e-12)
+    return {'coarse_coefficients':coarse.tolist(),'same_noise_endpoint':direct.item(),'empirical_covariance':covariance.tolist()}
+
+def check_meta_gradient():
+    d=torch.tensor(.3,requires_grad=True)
+    w=torch.tensor([1.,4.]);grad_w=torch.tensor([.2,.8]);a=.5
+    residual=d+(w-1)*d.detach()-a*grad_w
+    residual.square().mean().backward()
+    expected=2*(w*d.detach()-a*grad_w).mean()
+    assert torch.allclose(d.grad,expected)
+    return {'surrogate_gradient':d.grad.item(),'estimating_equation_gradient':expected.item()}
+
+def main():
+    parser=argparse.ArgumentParser();parser.add_argument('--output',default='results');parser.add_argument('--iterations',type=int,default=6000)
+    args=parser.parse_args();out=pathlib.Path(args.output);out.mkdir(parents=True,exist_ok=True)
+    results={'torch_version':torch.__version__,'categorical':check_categorical(),'meanflow_jvp':check_meanflow_jvp(),
+        'posterior_value':posterior_value_demo(),'expansion':check_expansion(),'brownian':check_brownian(),'meta_gradient':check_meta_gradient()}
+    results['scalar_training']=train_scalar(out,args.iterations)
+    (out/'checks.json').write_text(json.dumps(results,indent=2))
+    print(json.dumps({k:v for k,v in results.items() if k!='scalar_training'},indent=2))
+    print('Scalar endpoint RMSE',results['scalar_training']['endpoint_rmse'])
+    print('Scalar composition RMSE',results['scalar_training']['composition_rmse'])
+if __name__=='__main__':main()
diff --git a/lecture_6/posterior.py b/lecture_6/posterior.py
new file mode 100644
index 0000000000000000000000000000000000000000..c786858c0ee36bc52743b8ad615bd27ac9f8a694
--- /dev/null
+++ b/lecture_6/posterior.py
@@ -0,0 +1,179 @@
+"""Posterior Diamond Maps, data-trained Meta Flow Maps, and reward steering.
+
+There are two independent noise draws and a shared clean endpoint. The inner
+time evolves while the outer observation and outer time remain fixed.
+"""
+import math
+
+import torch
+from torch.nn import functional as F
+
+from common import (MapNet, draw_batch, ema_copy, exact_denoiser, exact_velocity,
+                    finite_map, interpolate, mixture_posterior, optimize,
+                    ordered_times, time_like)
+from continuous import semigroup_loss
+
+
+def glass_denoiser(inner, s, outer, t):
+    """Fuse independent Gaussian observations by adding their precisions.
+
+    inner=s*X1+(1-s)*eps, outer=t*X1+(1-t)*eps'. The sufficient
+    statistic S has noise variance 1/precision. Convert it to the original
+    linear schedule t*=sqrt(precision)/(1+sqrt(precision)), then denoise.
+    """
+    precision = (s / (1-s)).square() + (t / (1-t)).square()
+    safe = precision.clamp_min(1e-12)
+    statistic = (s * inner / (1-s).square() + t * outer / (1-t).square()) / safe
+    ratio = safe.sqrt()
+    effective_time = ratio / (1 + ratio)
+    value = exact_denoiser(effective_time * statistic, effective_time)
+    return torch.where(precision > 1e-12, value, torch.zeros_like(value))
+
+
+def glass_velocity(inner, s, outer, t):
+    return (glass_denoiser(inner, s, outer, t) - inner) / (1-s)
+
+
+def posterior_context(outer, t):
+    return torch.cat([outer, time_like(t, outer)], -1)
+
+
+def train_posterior(method, data, args):
+    model = MapNet(2, args.width, context_dim=3).to(data)
+    teacher = ema_copy(model)
+
+    def objective(step):
+        clean = draw_batch(data, args.batch_size)
+        outer_t = .94 * torch.rand(len(clean), 1, device=data.device)
+        outer, _ = interpolate(clean, outer_t)
+        context = posterior_context(outer, outer_t)
+        s, t, _ = ordered_times(clean, .97)
+        # Independent inner noise; reusing the outer noise changes the posterior.
+        inner, displacement = interpolate(clean, s)
+        if method == 'diamond':
+            diagonal_target = glass_velocity(inner, s, outer, outer_t).detach()
+        else:
+            diagonal_target = displacement
+        diagonal = F.mse_loss(model(inner, s, s, context), diagonal_target)
+        if method == 'diamond':
+            y, derivative = torch.func.jvp(lambda end: finite_map(model, inner, s, end, context),
+                                          (t,), (torch.ones_like(t),))
+            target = glass_velocity(y.detach(), t, outer, outer_t).detach()
+            finite = F.mse_loss(derivative, target)
+        else:
+            finite = semigroup_loss(model, teacher, inner, s, t, context)
+        weight = min(1., (step+1) / max(1, args.train_steps//4))
+        return diagonal + weight * finite, {'diagonal': diagonal, 'finite': finite}
+
+    logs = optimize(model, objective, args.train_steps, args.lr, teacher)
+    return model, {'model': model.state_dict(), 'dim': 2}, logs
+
+
+def posterior_samples(model, outer, t, count, steps=1, noise=None):
+    context = posterior_context(outer, t)
+    context = context[:, None].expand(-1, count, -1).reshape(-1, 3)
+    x = torch.randn(len(outer)*count, 2, device=outer.device) if noise is None else noise.reshape(-1, 2)
+    for i in range(steps):
+        x = finite_map(model, x, i/steps, (i+1)/steps, context)
+    return x.reshape(len(outer), count, 2)
+
+
+def reward(x, strength=1.):
+    """Bounded differentiable preference for positive first coordinates."""
+    return strength * torch.tanh(x[..., 0])
+
+
+def posterior_value(model, x, t, particles=32, strength=1., steps=1):
+    samples = posterior_samples(model, x, t, particles, steps)
+    log_weights = reward(samples, strength)
+    value = torch.logsumexp(log_weights, -1) - math.log(particles)
+    weighted_mean = (log_weights.softmax(-1)[..., None] * samples).sum(1)
+    return value, weighted_mean, samples
+
+
+def fine_tune_surrogate(delta, weights, grad_weights, coefficient):
+    """Equation 43 of Meta Flow Maps. Both Monte Carlo terms are detached.
+
+    d/d(delta) E[loss] = 2 E[w*delta - coefficient*grad(w)].
+    Differentiating (w*delta - coefficient*grad(w))^2 instead adds a wrong w.
+    """
+    residual = delta + (weights.detach()-1) * delta.detach() - coefficient * grad_weights.detach()
+    return residual.square().mean()
+
+
+def train_reward_drift(posterior, data, args):
+    posterior.requires_grad_(False)
+    drift = MapNet(2, args.width).to(data)
+    def objective(_):
+        clean = draw_batch(data, args.batch_size)
+        t = .05 + .8 * torch.rand(len(clean), 1, device=data.device)
+        x, _ = interpolate(clean, t)
+        x.requires_grad_(True)
+        endpoint = posterior_samples(posterior, x, t, 1, args.posterior_steps)[:, 0]
+        w = reward(endpoint, args.reward_strength).exp().unsqueeze(-1)
+        grad_w = torch.autograd.grad(w.sum(), x)[0]
+        baseline = exact_velocity(x, t).detach()
+        delta = drift(x.detach(), t, t) - baseline
+        # Linear interpolant's compatible probability-flow correction g^2/2=(1-t)/t.
+        # Use t>=.05 to avoid singular coefficients in this demonstration.
+        coefficient = (1-t) / t
+        loss = fine_tune_surrogate(delta, w, grad_w, coefficient)
+        return loss, {'mean_weight': w.mean()}
+    logs = optimize(drift, objective, args.finetune_steps, args.lr)
+    return drift, logs
+
+
+@torch.no_grad()
+def guided_samples(model, count, steps, particles, strength, posterior_steps=1):
+    """Derivative-free reward-weighted posterior mean in the linear flow drift.
+
+    v*(x,t)=(E_reward[X1|x,t]-x)/(1-t). It equals the compatible
+    probability-flow correction for an exact posterior. Finite learned maps
+    and self-normalized Monte Carlo introduce approximation and ratio bias.
+    """
+    x = torch.randn(count, 2, device=next(model.parameters()).device)
+    h = 1/steps
+    for i in range(steps):
+        t = torch.full((count, 1), i/steps, device=x.device)
+        _, mean, _ = posterior_value(model, x, t, particles, strength, posterior_steps)
+        x = x + h * (mean-x) / (1-t)
+    return x
+
+
+def weighted_diamond_samples(outer, t, particles=128):
+    """Exact tractable demonstration of weighted Diamond proposal correction.
+
+    Proposal q=N(0,4I) has evaluable density and full support. Reweight with
+    p1(z)*p_t(outer|z)/q(z), then resample. This supplies an independent
+    check of posterior recovery without assuming an arbitrary learned map's
+    Jacobian density is known. Finite self-normalized importance sampling is biased.
+    """
+    from common import CENTERS, DATA_STD
+    t = time_like(t, outer)
+    z = 2 * torch.randn(len(outer), particles, 2, device=outer.device)
+    delta = z[:, :, None] - CENTERS.to(z)
+    lp = torch.logsumexp(-delta.square().sum(-1)/(2*DATA_STD**2), -1)
+    lp -= math.log(4 * 2 * math.pi * DATA_STD**2)
+    noise = (outer[:, None]-t[:, None]*z)/(1-t[:, None])
+    likelihood = -.5*noise.square().sum(-1) - 2*(1-t).log()
+    lq = -z.square().sum(-1)/8 - math.log(8*math.pi)
+    weights = (lp + likelihood - lq).softmax(-1)
+    mean = (weights[..., None]*z).sum(1)
+    indices = torch.multinomial(weights, 1)
+    selected = z.gather(1, indices[..., None].expand(-1, -1, 2))[:, 0]
+    return selected, mean, 1/weights.square().sum(-1)
+
+
+@torch.no_grad()
+def posterior_diagnostics(model, steps=1):
+    device = next(model.parameters()).device
+    x = torch.tensor([[0., 0.], [1., -.5], [-1., 1.]], device=device)
+    t = torch.tensor([[.15], [.5], [.8]], device=device)
+    p, means, var = mixture_posterior(x, t)
+    exact_mean = (p[..., None]*means).sum(1)
+    exact_variance = (p[..., None]*(var[:, None]+means.square())).sum(1)-exact_mean.square()
+    samples = posterior_samples(model, x, t, 512, steps)
+    mean, variance = samples.mean(1), samples.var(1)
+    return {'posterior_mean_rmse': float((mean-exact_mean).square().mean().sqrt()),
+            'posterior_variance_rmse': float((variance-exact_variance).square().mean().sqrt()),
+            'posterior_reference_mean': exact_mean.tolist(), 'posterior_estimated_mean': mean.tolist()}
diff --git a/lecture_6/requirements.txt b/lecture_6/requirements.txt
new file mode 100644
index 0000000000000000000000000000000000000000..2ff91cf64bf30e5bad4befa43e72caecc5516759
--- /dev/null
+++ b/lecture_6/requirements.txt
@@ -0,0 +1,3 @@
+# Match the course's PyTorch baseline; torch.func.jvp is required.
+torch==2.9.1
+numpy>=1.24,<3
diff --git a/lecture_6/run.py b/lecture_6/run.py
new file mode 100644
index 0000000000000000000000000000000000000000..e6fad4b2ff044eb63c11a066613e06d395fa8579
--- /dev/null
+++ b/lecture_6/run.py
@@ -0,0 +1,245 @@
+#!/usr/bin/env python3
+"""Train, save, reload, and sample the Lecture 6 flow-map methods."""
+import argparse
+import json
+import platform
+import time
+from pathlib import Path
+
+import torch
+from torch.nn import functional as F
+
+from common import (MapNet, SequenceNet, interpolate, load_text, mixture_data,
+                    mixture_metrics, seed_all, text_metrics, write_json)
+from continuous import (Autoencoder, embed_surface, integrate_velocity, sample_continuous,
+                        train_continuous, train_latent)
+from categorical import sample_categorical, train_categorical
+from posterior import (guided_samples, posterior_diagnostics, posterior_samples,
+                       posterior_value, reward, train_posterior, train_reward_drift,
+                       weighted_diamond_samples)
+from expanding import ExpandingNet, sample_expanding, train_expanding
+from stochastic import StrongMap, evaluate_stochastic, train_stochastic
+
+ROOT = Path(__file__).resolve().parent
+CONTINUOUS = ['flow-matching','fmm-lagrangian','fmm-eulerian','self-distill',
+              'consistency','shortcut','meanflow','latent']
+CATEGORICAL = ['fmlm','categorical','discrete-lsd','discrete-esd']
+METHODS = CONTINUOUS+CATEGORICAL+['diamond','meta','expanding','ssfm']
+
+
+def parser():
+    p=argparse.ArgumentParser(description=__doc__)
+    p.add_argument('--method',choices=METHODS)
+    p.add_argument('--mode',choices=['train-sample','train','sample'],default='train-sample')
+    p.add_argument('--train-steps',type=int,default=1000)
+    p.add_argument('--teacher-steps',type=int,default=1000)
+    p.add_argument('--finetune-steps',type=int,default=0,help='Optional Meta reward-drift fine-tuning')
+    p.add_argument('--sample-steps',type=int,default=8)
+    p.add_argument('--posterior-steps',type=int,default=4)
+    p.add_argument('--particles',type=int,default=32)
+    p.add_argument('--reward-strength',type=float,default=1.)
+    p.add_argument('--ssfm-target',choices=['official-code','paper'],default='official-code')
+    p.add_argument('--batch-size',type=int,default=64)
+    p.add_argument('--samples',type=int,default=128)
+    p.add_argument('--width',type=int,default=64)
+    p.add_argument('--lr',type=float,default=1e-3)
+    p.add_argument('--seed',type=int,default=6270)
+    p.add_argument('--threads',type=int,default=1)
+    p.add_argument('--device',choices=['cpu','cuda'],default='cpu')
+    p.add_argument('--data',help='Whitespace-separated text, one sequence per line; or continuous CSV with two numeric columns')
+    p.add_argument('--out',help='Run directory; defaults to lecture_6/outputs/METHOD')
+    return p
+
+
+def restore_model(checkpoint,device):
+    method=checkpoint['method'];width=checkpoint['width']
+    if method in CATEGORICAL:
+        model=SequenceNet(checkpoint['length'],len(checkpoint['vocab']),width)
+    elif method=='expanding':
+        model=ExpandingNet(checkpoint['length'],len(checkpoint['vocab']),width)
+    elif method=='ssfm':
+        model=StrongMap(width,checkpoint['sigma'])
+    else:
+        model=MapNet(checkpoint['dim'],width,3 if method in ['diamond','meta'] else 0)
+    model.load_state_dict(checkpoint['model'])
+    model=model.to(device).eval()
+    return model
+
+
+def generate(model,state,args):
+    """All metrics use fresh, seeded samples; no training examples stand in for output."""
+    seed_all(args.seed+100,args.threads)
+    method=state['method'];device=args.device
+    report={'method':method,'sample_steps':args.sample_steps,'samples':args.samples,
+            'sampling_seed':args.seed+100}
+    if method in CATEGORICAL:
+        ids=sample_categorical(model,args.samples,args.sample_steps,device).cpu()
+        texts,metrics=text_metrics(ids,state['vocab'],reference=set(state['reference_text']))
+        report.update(metrics)
+        return texts,report
+    if method=='expanding':
+        ids,lengths,extra=sample_expanding(model,args.samples,args.sample_steps,device)
+        texts,metrics=text_metrics(ids.cpu(),state['vocab'],lengths.cpu(),set(state['reference_text']))
+        report.update(metrics);report.update(extra)
+        return texts,report
+    if method=='ssfm':
+        x,extra=evaluate_stochastic(model,args.samples,args.sample_steps,device)
+        report.update(extra)
+    elif method in ['diamond','meta']:
+        with torch.no_grad():
+            outer=torch.randn(args.samples,2,device=device)
+            t=torch.zeros(args.samples,1,device=device)
+            x=posterior_samples(model,outer,t,1,args.posterior_steps)[:,0]
+            guided=guided_samples(model,args.samples,args.sample_steps,args.particles,
+                                  args.reward_strength,args.posterior_steps)
+            report.update(posterior_diagnostics(model,args.posterior_steps))
+            report['unconditional_mean_reward']=float(reward(x,args.reward_strength).mean())
+            report['guided_mean_reward']=float(reward(guided,args.reward_strength).mean())
+            report['guided_distribution']=mixture_metrics(guided)
+            report['posterior_steps']=args.posterior_steps
+            report['particles']=args.particles
+            observation=torch.tensor([[.5,-.3]],device=device)
+            _,estimate,ess=weighted_diamond_samples(observation,.5,4096)
+            report['importance_posterior_mean']=estimate.tolist()
+            report['importance_effective_sample_size']=ess.tolist()
+        # Verify differentiability through the learned posterior's context.
+        observation=observation.detach().requires_grad_(True)
+        value,_,_=posterior_value(model,observation,.5,args.particles,args.reward_strength,args.posterior_steps)
+        gradient=torch.autograd.grad(value.sum(),observation)[0]
+        report['posterior_value_context_gradient']=gradient.tolist()
+        report['finite_value_gradient']=bool(torch.isfinite(gradient).all())
+        report['guided_samples']=guided.detach().cpu().tolist()
+        if 'reward_drift' in state:
+            drift=MapNet(2,state['width']).to(device)
+            drift.load_state_dict(state['reward_drift'])
+            # A complete sampler for the fitted drift; boundary-time queries
+            # extrapolate beyond the [.05,.85] fine-tuning interval.
+            aligned=integrate_velocity(lambda z,a:drift(z,a,a),outer,0.,1.,args.sample_steps)
+            report['finetuned_mean_reward']=float(reward(aligned,args.reward_strength).mean())
+            report['finetuned_finite_samples']=bool(torch.isfinite(aligned).all())
+            report['finetuned_samples']=aligned.detach().cpu().tolist()
+            report['finetuned_sampling_note']='Full-interval Heun integration; boundary times extrapolate beyond fine-tuning support.'
+    else:
+        noise=torch.randn(args.samples,state['dim'],device=device)
+        x=sample_continuous(model,method,noise,args.sample_steps)
+        if method=='latent':
+            ae=Autoencoder(state['width']).to(device)
+            ae.load_state_dict(state['autoencoder'])
+            with torch.no_grad():
+                x=ae.decoder(x*state['latent_std'].to(device)+state['latent_mean'].to(device))
+                heldout=state['heldout_data'].to(device)
+                reconstruction=ae.decoder(ae.encoder(embed_surface(heldout)))
+                report['heldout_reconstruction_mse']=float((reconstruction-embed_surface(heldout)).square().mean())
+                report['surface_residual_rmse']=float((x[:,2:]-.3*(x[:,:1].square()-x[:,1:2].square())).square().mean().sqrt())
+        if method not in ['consistency','meanflow','flow-matching']:
+            from common import finite_map
+            with torch.no_grad():
+                direct=finite_map(model,noise,0.,1.)
+                split=finite_map(model,finite_map(model,noise,0.,.5),.5,1.)
+                report['composition_rmse']=float((direct-split).square().mean().sqrt())
+    report['finite_samples']=bool(torch.isfinite(x).all())
+    if not report['finite_samples']:raise FloatingPointError('Sampling produced nonfinite coordinates.')
+    if x.shape[1]>=2 and state['data_kind']=='four-gaussian-mixture':
+        report.update(mixture_metrics(x[:,:2]))
+    rows=[' '.join(f'{value:.7f}' for value in row) for row in x.detach().cpu().tolist()]
+    return rows,report
+
+
+def main(argv=None):
+    p=parser();args=p.parse_args(argv)
+    if min(args.train_steps,args.teacher_steps,args.sample_steps,args.posterior_steps,
+           args.particles,args.batch_size,args.samples,args.width,args.threads)<1 or args.finetune_steps<0:
+        p.error('Step counts, sizes, and width must be positive; finetune steps must be nonnegative.')
+    if args.lr<=0:p.error('Learning rate must be positive.')
+    if args.device=='cuda' and not torch.cuda.is_available():p.error('CUDA is unavailable; select cpu.')
+    if args.mode=='sample' and args.out is None:p.error('Sample mode requires --out for its checkpoint.')
+    if args.mode!='sample' and args.method is None:args.method='flow-matching'
+    out=Path(args.out) if args.out else ROOT/'outputs'/args.method
+    out.mkdir(parents=True,exist_ok=True)
+    seed_all(args.seed,args.threads)
+    start=time.perf_counter()
+    if args.mode=='sample':
+        state=torch.load(out/'checkpoint.pt',map_location=args.device,weights_only=True)
+        if args.method is not None and args.method!=state['method']:
+            p.error('Requested method differs from the saved checkpoint.')
+        args.method=state['method']
+        if args.method=='ssfm' and args.sample_steps & (args.sample_steps-1):
+            p.error('SSFM sample steps must be a power of two.')
+        model=restore_model(state,args.device)
+        rows,report=generate(model,state,args)
+        (out/'resampled.txt').write_text('\n'.join(rows)+'\n')
+        write_json(out/'sample_report.json',report)
+        print(json.dumps({'method':args.method,'mode':'sample','out':str(out),'seconds':time.perf_counter()-start}))
+        return report
+    if args.method=='ssfm' and args.sample_steps & (args.sample_steps-1):
+        p.error('SSFM sample steps must be a power of two.')
+    if args.finetune_steps and args.method!='meta':p.error('--finetune-steps applies to meta.')
+    if args.data and args.method in ['diamond','meta','ssfm']:
+        p.error('Analytic posterior/OU examples use their specified reference distributions.')
+    stage_logs=[]
+    if args.method in CATEGORICAL+['expanding']:
+        default='variable_text.txt' if args.method=='expanding' else 'phrases.txt'
+        data_path=Path(args.data) if args.data else ROOT/'data'/default
+        ids,lengths,vocab=load_text(data_path,args.method=='expanding')
+        perm=torch.randperm(len(ids));ids,lengths=ids[perm],lengths[perm]
+        split=max(1,int(.8*len(ids)))
+        training=ids[:split].to(args.device)
+        if args.method=='expanding':
+            model,state,logs=train_expanding(training,lengths[:split].to(args.device),vocab,args)
+        else:
+            model,state,logs=train_categorical(args.method,training,vocab,args)
+        reference,_=text_metrics(ids[:split],vocab,lengths[:split])
+        state.update({'reference_text':reference,'data_kind':'synthetic-text' if args.data is None else 'custom-text'})
+        with torch.no_grad():
+            if args.method in CATEGORICAL:
+                heldout=ids[split:].to(args.device)
+                clean=F.one_hot(heldout,len(vocab)).float();t=torch.full((len(clean),1),.5,device=args.device)
+                x,_=interpolate(clean,t)
+                state['validation_ce']=float(F.cross_entropy(model(x,t,t).flatten(0,1),heldout.flatten()))
+    elif args.method=='ssfm':
+        model,state,logs=train_stochastic(args,args.device)
+        state['data_kind']='ornstein-uhlenbeck'
+    else:
+        if args.data:
+            import numpy as np
+            data=torch.tensor(np.loadtxt(args.data,delimiter=','),dtype=torch.float32)
+            if data.ndim!=2 or data.shape[1]!=2 or len(data)<8 or not torch.isfinite(data).all():
+                p.error('Continuous CSV needs at least eight finite rows and exactly two columns, without a header.')
+            data=data[torch.randperm(len(data))];kind='custom-continuous'
+        else:
+            data=mixture_data(4096);kind='four-gaussian-mixture'
+        split=int(.8*len(data));train=data[:split].to(args.device)
+        if args.method=='latent':
+            model,_,state,logs,stage_logs=train_latent(train,args)
+        elif args.method in ['diamond','meta']:
+            model,state,logs=train_posterior(args.method,train,args)
+            if args.finetune_steps:
+                drift,finetune_logs=train_reward_drift(model,train,args)
+                state['reward_drift']=drift.state_dict()
+                write_json(out/'finetune_losses.json',finetune_logs)
+        else:
+            model,state,logs,stage_logs=train_continuous(args.method,train,args)
+        state.update({'data_kind':kind,'heldout_data':data[split:]})
+    state.update({'format_version':1,'method':args.method,'width':args.width,'seed':args.seed})
+    torch.save(state,out/'checkpoint.pt')
+    write_json(out/'config.json',vars(args))
+    write_json(out/'losses.json',logs)
+    if stage_logs:write_json(out/'teacher_losses.json',stage_logs)
+    report={'method':args.method,'data_kind':state['data_kind'],
+            'train_loss_first_20_mean':sum(x['loss'] for x in logs[:20])/len(logs[:20]),
+            'train_loss_last_20_mean':sum(x['loss'] for x in logs[-20:])/len(logs[-20:]),
+            'training_steps':args.train_steps,'python':platform.python_version(),'torch':str(torch.__version__)}
+    if 'validation_ce' in state:report['heldout_diagonal_ce_at_half_time']=state['validation_ce']
+    if args.mode=='train-sample':
+        model.eval()
+        rows,metrics=generate(model,state,args)
+        (out/'samples.txt').write_text('\n'.join(rows)+'\n')
+        report.update(metrics)
+    report['elapsed_seconds']=time.perf_counter()-start
+    write_json(out/'report.json',report)
+    print(json.dumps({'method':args.method,'out':str(out),'loss':report['train_loss_last_20_mean'],
+                      'seconds':report['elapsed_seconds']}),flush=True)
+    return report
+
+
+if __name__=='__main__':main()
diff --git a/lecture_6/run_all.py b/lecture_6/run_all.py
new file mode 100644
index 0000000000000000000000000000000000000000..49bcedb22110467bf784a9b8d9bd06d02a31585c
--- /dev/null
+++ b/lecture_6/run_all.py
@@ -0,0 +1,32 @@
+#!/usr/bin/env python3
+"""Run every method, then verify generation from each saved checkpoint."""
+import argparse
+from pathlib import Path
+
+from run import METHODS, ROOT, main
+
+
+def run_all():
+    parser=argparse.ArgumentParser(description=__doc__)
+    parser.add_argument('--quick',action='store_true',help='20-step execution check; not a quality benchmark')
+    parser.add_argument('--out',default=str(ROOT/'outputs'))
+    parser.add_argument('--train-steps',type=int,default=1000)
+    args=parser.parse_args()
+    for method in METHODS:
+        out=Path(args.out)/method
+        command=['--method',method,'--out',str(out)]
+        if args.quick:
+            command+=['--train-steps','20','--teacher-steps','20','--batch-size','8',
+                      '--samples','8','--width','32','--sample-steps','4','--posterior-steps','2','--particles','4']
+        else:command+=['--train-steps',str(args.train_steps),'--teacher-steps',str(args.train_steps)]
+        main(command)
+        sample_args=['--mode','sample','--out',str(out)]
+        if args.quick:
+            sample_args+=['--samples','8','--sample-steps','4','--posterior-steps','2','--particles','4']
+        main(sample_args)
+        if (out/'samples.txt').read_bytes()!=(out/'resampled.txt').read_bytes():
+            raise AssertionError(f'{method}: seeded generation changed after checkpoint reload')
+    print(f'All {len(METHODS)} methods trained, sampled, and reproduced samples after checkpoint reload.')
+
+
+if __name__=='__main__':run_all()
diff --git a/lecture_6/source_manifest.json b/lecture_6/source_manifest.json
new file mode 100644
index 0000000000000000000000000000000000000000..38259ab28f36ba766f254a439aceae0be39b43ba
--- /dev/null
+++ b/lecture_6/source_manifest.json
@@ -0,0 +1,132 @@
+[
+  {
+    "paper_title": "Flow Map Matching",
+    "paper_url": "https://arxiv.org/abs/2406.07507v2",
+    "methods": [
+      "fmm-lagrangian",
+      "fmm-eulerian"
+    ],
+    "scope": "Frozen learned velocity teachers; residual-map JVPs; small MLP and bounded time range.",
+    "repository": "nmboffi/flow-maps",
+    "commit": "2f115a07fa9073553193e4b265dfc303827af2b0",
+    "inspected_file": "py/common/losses.py",
+    "inspected_file_sha256": "55d5a6cd2b7602afc93f848bda687aa4a287bfb7d1a4095d5071c7df59334d59"
+  },
+  {
+    "paper_title": "How to build a consistency model: Learning flow maps via self-distillation",
+    "paper_url": "https://arxiv.org/abs/2505.18825v2",
+    "methods": [
+      "self-distill"
+    ],
+    "scope": "Diagonal regression plus an EMA progressive target, normalized by a floored interval length. Learned uncertainty weights are omitted.",
+    "repository": "nmboffi/flow-maps",
+    "commit": "2f115a07fa9073553193e4b265dfc303827af2b0",
+    "inspected_file": "py/common/losses.py",
+    "inspected_file_sha256": "55d5a6cd2b7602afc93f848bda687aa4a287bfb7d1a4095d5071c7df59334d59"
+  },
+  {
+    "paper_title": "One Step Diffusion via Shortcut Models",
+    "paper_url": "https://arxiv.org/abs/2410.12557v3",
+    "methods": [
+      "shortcut"
+    ],
+    "scope": "Two half-step average target and dyadic intervals retained. Continuous start-time sampling and small MLP replace image-specific schedules and clipping.",
+    "repository": "kvfrans/shortcut-models",
+    "commit": "601004348667094e1b71f30942199759412d4432",
+    "inspected_file": "targets_shortcut.py",
+    "inspected_file_sha256": "adb2ac83febc1de012a7cdb713b9117d53616473ccd38f1104fd2475d8b1abc3"
+  },
+  {
+    "paper_title": "Mean Flows for One-step Generative Modeling",
+    "paper_url": "https://arxiv.org/abs/2505.13447",
+    "methods": [
+      "meanflow"
+    ],
+    "scope": "Backward clock, conditional-velocity JVP, detached target, adaptive loss, and 75% diagonal proportion retained. Uniform time sampling; no class guidance.",
+    "repository": "Gsunshine/meanflow",
+    "commit": "d70cb55d298ee03c53bf6da67bec281082e4e2d9",
+    "inspected_file": "meanflow.py",
+    "inspected_file_sha256": "b8dcee1033e6ba01de0019d14fad846a399d356d67e549ee311a5e19d2a7c3a4"
+  },
+  {
+    "paper_title": "Flow Map Language Models: One-step Language Modeling via Continuous Denoising",
+    "paper_url": "https://arxiv.org/abs/2602.16813v3",
+    "methods": [
+      "fmlm"
+    ],
+    "scope": "PSD denoiser target and Gaussian decoding clock retained. Independent clean-data diagonal supervision; EMA targets; quadrature lookup and MLP replace full language architecture.",
+    "repository": "david3684/flm",
+    "commit": "a1918d5164e5038e37d0b7a4fb2010ce75b863b3",
+    "inspected_file": "algo.py",
+    "inspected_file_sha256": "65206adc72013bb9b09b68fd847239b3193dd65fd59669bbdee42e061583d76a"
+  },
+  {
+    "paper_title": "Categorical Flow Maps",
+    "paper_url": "https://arxiv.org/abs/2602.12233v1",
+    "methods": [
+      "categorical"
+    ],
+    "scope": "Released ECLD endpoint CE plus sum-of-squares time energy. Detached-target KL has identical student gradient. EMA target replaces the current network target.",
+    "repository": "olsdavis/semicat",
+    "commit": "558602a0fa722514e4a6012f5c46a8ae178b3068",
+    "inspected_file": "semicat/models/semicat.py",
+    "inspected_file_sha256": "82f4bf2cab2fcfa78ccfc59d9094e6c3132f5c2933c1cd7e61ff0b644ac71425"
+  },
+  {
+    "paper_title": "Discrete Flow Maps",
+    "paper_url": "https://arxiv.org/abs/2604.09784v1",
+    "methods": [
+      "discrete-lsd",
+      "discrete-esd"
+    ],
+    "scope": "Derived from the paper. The linked project page has a placeholder Code link, so no author implementation was verified. Positive log denominators are explicitly clamped and counted; no gradient surgery."
+  },
+  {
+    "paper_title": "Diamond Maps: Stochastic Flow Maps",
+    "paper_url": "https://arxiv.org/abs/2602.05993",
+    "methods": [
+      "diamond"
+    ],
+    "scope": "GLASS conditional velocity and Lagrangian posterior distillation. Exact Gaussian-mixture denoiser replaces a pretrained image teacher. Weighted posterior recovery uses an explicit Gaussian proposal with a known density.",
+    "repository": "PeterHolderrieth/diamond_maps",
+    "commit": "d30f65c75a169a2ed624f146b2770aeef882543a",
+    "inspected_file": "posterior_diamond_maps/py/common/losses.py",
+    "inspected_file_sha256": "acb26f1e717e43a648661c1641cadd4a573ed2672b53210ad1ddb207c6a6ac1e"
+  },
+  {
+    "paper_title": "Meta Flow Maps enable scalable reward alignment",
+    "paper_url": "https://arxiv.org/abs/2601.14430v2",
+    "methods": [
+      "meta"
+    ],
+    "scope": "Data training with independent inner/outer noises and a shared endpoint; conditional semigroup objective. Optional Equation 43 fine-tuning also checked against src/mfm/losses/finetune.py.",
+    "repository": "adh1s/mfm",
+    "commit": "53c0f60db695cad88bbace8fb26469614e9e7d7d",
+    "inspected_file": "src/mfm/losses/losses.py",
+    "inspected_file_sha256": "52b99238199f5d6ac691c15566463d52725a6f7ebcdef1e252b2d28da5eb1df2"
+  },
+  {
+    "paper_title": "Expanding Flow Maps",
+    "paper_url": "https://arxiv.org/abs/2607.21585v1",
+    "methods": [
+      "expanding"
+    ],
+    "scope": "Paper Algorithms 2-4 and local-clock equations. The inspected repository contains README and artwork only. Classroom implementation includes a shared lifted canvas, remaining/interval count heads, explicit local clocks, and budget-capped binomial insertions.",
+    "repository": "sophtang/ExpandingFlowMaps",
+    "commit": "4defc1ff168d12526d85b551bea78150b9aec605",
+    "inspected_file": "README.md",
+    "inspected_file_sha256": "d2a55e221a909f7282609cc661e49c07a241570dcd1dab7b55c6df207f821f4a"
+  },
+  {
+    "paper_title": "Strong Stochastic Flow Maps",
+    "paper_url": "https://arxiv.org/abs/2606.01086v1",
+    "methods": [
+      "ssfm"
+    ],
+    "scope": "First two Legendre integrals, Chen composition, known diffusion, small-step matching. The released loss detaches an EMA split target; paper Algorithm 1 detaches the direct target. Both orientations are selectable. OU replaces image/molecular experiments; no learned uncertainty weights.",
+    "repository": "sammccallum/ssfm",
+    "commit": "24b563620a8ee61c683d791fe802b56668f98f9b",
+    "inspected_file": "ssfm/losses.py",
+    "inspected_file_sha256": "3c4414ffb29c906272831e3642827131582c4741fb2457cb71d122564da29233"
+  }
+]
diff --git a/lecture_6/stochastic.py b/lecture_6/stochastic.py
new file mode 100644
index 0000000000000000000000000000000000000000..8d310f22b68d6a58c8acbd8248be0906210d866e
--- /dev/null
+++ b/lecture_6/stochastic.py
@@ -0,0 +1,110 @@
+"""Strong stochastic flow maps for dX=-X dt + sigma dW.
+
+The first two shifted-Legendre Brownian integrals have variances h and h/3.
+Chen composition makes coarse and fine evaluations use the same path.
+"""
+import math
+
+import torch
+from torch import nn
+from torch.nn import functional as F
+
+from common import ema_copy, mlp, optimize, time_like
+
+
+def sample_coefficients(h, count=None):
+    h = torch.as_tensor(h)
+    if h.ndim == 0:
+        if count is None: raise ValueError('count is required for scalar h')
+        h = h.expand(count,1)
+    scale = torch.cat([h.sqrt(),(h/3).sqrt()],-1)
+    return torch.randn_like(scale)*scale
+
+
+def chen_two(left,right,h_left,h_right):
+    h=h_left+h_right
+    return torch.stack([left[...,0]+right[...,0],
+        (h_left*left[...,1]+h_right*right[...,1]-h_right*left[...,0]+h_left*right[...,0])/h],-1)
+
+
+class StrongMap(nn.Module):
+    def __init__(self,width=64,sigma=.7):
+        super().__init__()
+        self.net=mlp(5,1,width)
+        self.sigma=sigma
+
+    def average_drift(self,x,s,t,coefficients):
+        return self.net(torch.cat([x,time_like(s,x),time_like(t,x),coefficients],-1))
+
+    def forward(self,x,s,t,coefficients):
+        s,t=time_like(s,x),time_like(t,x)
+        return x+(t-s)*self.average_drift(x,s,t,coefficients)+self.sigma*coefficients[:,:1]
+
+
+def train_stochastic(args,device):
+    model=StrongMap(args.width).to(device)
+    teacher=ema_copy(model)
+    def objective(step):
+        B=args.batch_size
+        s=.9*torch.rand(B,1,device=device)
+        # Exact one-time OU marginals with X0~N(0,1), not simulated trajectories.
+        variance=torch.exp(-2*s)+model.sigma**2/2*(1-torch.exp(-2*s))
+        x=variance.sqrt()*torch.randn(B,1,device=device)
+        h=.001+.019*torch.rand_like(s)
+        c=sample_coefficients(h)
+        target=x-h*x+model.sigma*c[:,:1]
+        matching=((model(x,s,s+h,c)-target).square()/h).mean()
+        diagonal=F.mse_loss(model.average_drift(x,s,s,torch.zeros_like(c)),-x)
+        t=s+.025+(1-s-.025)*torch.rand_like(s)
+        u=(s+t)/2
+        L,R=sample_coefficients(u-s),sample_coefficients(t-u)
+        C=chen_two(L,R,(u-s).squeeze(-1),(t-u).squeeze(-1))
+        if args.ssfm_target=='paper':
+            # Paper Algorithm 1: EMA direct target; differentiate both splits.
+            with torch.no_grad():direct=teacher(x,s,t,C)
+            split=model(model(x,s,u,L),u,t,R)
+        else:
+            # Released code: EMA split target; differentiate the direct map.
+            with torch.no_grad():split=teacher(teacher(x,s,u,L),u,t,R)
+            direct=model(x,s,t,C)
+        consistency=((split-direct).square()/(t-s)).mean()
+        ramp=min(1.,(step+1)/max(1,args.train_steps//4))
+        return diagonal+matching+ramp*consistency,{'drift':diagonal,'small_step':matching,'strong_consistency':consistency}
+    logs=optimize(model,objective,args.train_steps,args.lr,teacher)
+    return model,{'model':model.state_dict(),'sigma':model.sigma},logs
+
+
+def aggregate_tree(coefficients):
+    """Coefficients are [B,leaves,2], with uniform leaf lengths."""
+    c=coefficients
+    h=1/c.shape[1]
+    while c.shape[1]>1:
+        c=chen_two(c[:,::2],c[:,1::2],h,h)
+        h*=2
+    return c[:,0]
+
+
+@torch.no_grad()
+def evaluate_stochastic(model,count,steps,device):
+    if steps & (steps-1):raise ValueError('SSFM sample steps must be a power of two.')
+    leaves=max(512,steps)
+    c=sample_coefficients(torch.tensor(1/leaves,device=device),count*leaves).reshape(count,leaves,2)
+    x0=torch.randn(count,1,device=device)
+    reference=x0.clone()
+    for i in range(leaves):reference=reference-reference/leaves+model.sigma*c[:,i,:1]
+    all_coeff=aggregate_tree(c)
+    direct=model(x0,0.,1.,all_coeff)
+    x=x0.clone()
+    block=leaves//steps
+    for i in range(steps):
+        # aggregate_tree assumes total duration one; equal-half Chen weights are
+        # scale invariant, so its output is valid for these smaller blocks too.
+        ci=aggregate_tree(c[:,i*block:(i+1)*block])
+        x=model(x,i/steps,(i+1)/steps,ci)
+    exact_variance=math.exp(-2)+model.sigma**2/2*(1-math.exp(-2))
+    return x,{'same_noise_reference_rmse':float((x-reference).square().mean().sqrt()),
+              'direct_vs_split_rmse':float((direct-x).square().mean().sqrt()),
+              'one_step_reference_rmse':float((direct-reference).square().mean().sqrt()),
+              'reference_em_steps':leaves,'sample_variance':float(x.var()),
+              'exact_terminal_variance':exact_variance,
+              'reference_note':'Same Brownian increments; EM reference retains finite discretization error.'}
diff --git a/lecture_6/tests/test_mathematics.py b/lecture_6/tests/test_mathematics.py
new file mode 100644
index 0000000000000000000000000000000000000000..42722f7a3abc1362cc58bff35f9756af03d233e0
--- /dev/null
+++ b/lecture_6/tests/test_mathematics.py
@@ -0,0 +1,189 @@
+"""Independent mathematical checks, including failure cases from the lecture."""
+import math
+import sys
+import unittest
+from pathlib import Path
+
+import torch
+from torch import nn
+from torch.nn import functional as F
+
+sys.path.insert(0,str(Path(__file__).resolve().parents[1]))
+from common import (MapNet, SequenceNet, finite_map, exact_denoiser, exact_velocity,
+                    mixture_posterior, seed_all, DATA_STD, CENTERS)
+from continuous import lagrangian_residual, eulerian_residual, semigroup_loss
+from categorical import (DecodingClock, categorical_map, composition_target,
+                         corrected_logit_teacher, probability_kl)
+from posterior import glass_denoiser, fine_tune_surrogate, weighted_diamond_samples
+from expanding import (ExpandingNet, local_clock, local_map, gap_counts,
+                       bounded_counts, insert_tokens, count_divergence)
+from stochastic import sample_coefficients, chen_two, aggregate_tree
+
+
+class ExactExponential(nn.Module):
+    def forward(self,x,s,t,context=None):
+        h=t-s
+        # Stable at h=0 while keeping the exact off-diagonal expression.
+        safe=h.clamp_min(1e-12)
+        ratio=torch.where(h.abs()<1e-8,1+h/2+h.square()/6,torch.expm1(h)/safe)
+        return x*ratio
+
+
+class ConstantLogits(nn.Module):
+    def forward(self,x,s,t):
+        return torch.zeros_like(x)+torch.tensor([.2,-.1],dtype=x.dtype,device=x.device)
+
+
+class MathematicsTests(unittest.TestCase):
+    def setUp(self):seed_all(6270)
+
+    def test_exact_identity_and_semigroup(self):
+        model=ExactExponential();x=torch.tensor([[1.2],[-.4]],dtype=torch.float64)
+        s=torch.zeros_like(x);u=s+.3;t=s+.9
+        torch.testing.assert_close(finite_map(model,x,s,s),x)
+        expected=x*math.exp(.9)
+        torch.testing.assert_close(finite_map(model,x,s,t),expected)
+        torch.testing.assert_close(finite_map(model,finite_map(model,x,s,u),u,t),expected)
+
+    def test_lagrangian_and_eulerian_jvp(self):
+        x=torch.tensor([[1.7]],dtype=torch.float64);s=x*0+.2;t=x*0+.8
+        for residual in [lagrangian_residual,eulerian_residual]:
+            value=residual(ExactExponential(),lambda z,a:z,x,s,t)
+            self.assertLess(float(value.abs().max()),1e-10)
+
+    def test_jvp_losses_reach_parameters(self):
+        for residual in [lagrangian_residual,eulerian_residual]:
+            m=MapNet(2,16);x=torch.randn(8,2);s=torch.rand(8,1)*.3;t=s+.5
+            loss=residual(m,lambda z,a:z,x,s,t).square().mean();loss.backward()
+            self.assertTrue(all(p.grad is not None and torch.isfinite(p.grad).all() for p in m.parameters()))
+            self.assertGreater(sum(float(p.grad.abs().sum()) for p in m.parameters()),0)
+
+    def test_composition_alone_does_not_identify_motion(self):
+        m=MapNet(2,8)
+        for p in m.parameters():p.data.zero_()
+        x=torch.randn(8,2);s=torch.zeros(8,1);t=s+1
+        self.assertEqual(float(semigroup_loss(m,m,x,s,t)),0.)
+        self.assertGreater(float((m(x,s,s)-x).square().mean()),0.)
+
+    def test_meanflow_backward_identity(self):
+        def average(z,r,t):return z*(-torch.expm1(-(t-r)))/(t-r)
+        z=torch.tensor([[1.7]],dtype=torch.float64);r=z*0+.2;t=z*0+.8
+        u,du=torch.func.jvp(average,(z,r,t),(z,torch.zeros_like(r),torch.ones_like(t)))
+        torch.testing.assert_close(u,z-(t-r)*du,atol=1e-11,rtol=1e-11)
+
+    def test_analytic_mixture_velocity(self):
+        x=torch.randn(20,2,dtype=torch.float64);t=torch.rand(20,1,dtype=torch.float64)*.9
+        torch.testing.assert_close(exact_velocity(x,t),(exact_denoiser(x,t)-x)/(1-t),atol=1e-10,rtol=1e-10)
+
+    def test_categorical_numerical_step(self):
+        class Net(nn.Module):
+            def forward(self,x,s,t):return torch.tensor([.1,.7,.2]).log().expand_as(x)
+        x=torch.tensor([[[-.2,.6,1.1]]]);y,p=categorical_map(Net(),x,.25,.75)
+        torch.testing.assert_close(y,torch.tensor([[[0.,2/3,.5]]]),atol=1e-7,rtol=1e-6)
+        self.assertGreater(float(y.sum()),1.1)
+        torch.testing.assert_close(p.sum(-1),torch.ones(1,1))
+
+    def test_weighted_probability_composition_matches_maps(self):
+        net=SequenceNet(3,4,12);x=torch.randn(6,3,4)
+        s=torch.zeros(6,1);u=s+.5;t=s+.75
+        q=composition_target(net,x,s,u,t)
+        mid,_=categorical_map(net,x,s,u);split,_=categorical_map(net,mid,u,t)
+        direct=(1-t[...,None])*x+t[...,None]*q
+        torch.testing.assert_close(direct,split)
+        torch.testing.assert_close(q.sum(-1),torch.ones(6,3))
+
+    def test_detached_kl_gradient(self):
+        logits=torch.tensor([.2,-.1],requires_grad=True);p=torch.tensor([.4,.6])
+        probability_kl(logits,p).backward()
+        torch.testing.assert_close(logits.grad,logits.softmax(-1)-p)
+
+    def test_discrete_teachers_with_zero_derivative(self):
+        x=torch.randn(5,3,2);s=torch.zeros(5,1)+.2;t=s+.5;net=ConstantLogits()
+        for kind in ['discrete-lsd','discrete-esd']:
+            logits,target,clipped=corrected_logit_teacher(net,net,x,s,t,kind)
+            torch.testing.assert_close(target,logits.softmax(-1))
+            self.assertEqual(float(clipped),0.)
+
+    def test_endpoint_match_does_not_remove_temporal_residual(self):
+        dt=torch.tensor([.2,-.2]);residual=.5*.5*dt
+        self.assertAlmostEqual(float(residual.square().sum()),.005,places=7)
+
+    def test_decoding_clock_inverse(self):
+        clock=DecodingClock(13);tau=torch.linspace(0,1,101)
+        time=clock.inverse(tau)
+        self.assertTrue((time[1:]>=time[:-1]).all())
+        self.assertEqual(float(time[0]),0.);self.assertEqual(float(time[-1]),1.)
+
+    def test_glass_matches_two_observation_bayes_rule(self):
+        inner=torch.tensor([[.3,-.2]],dtype=torch.float64);outer=inner+.4
+        s=torch.tensor([[.35]],dtype=torch.float64);t=s+.2
+        # Independent derivation by conditioning each Gaussian component twice.
+        variance=1/(1/DATA_STD**2+(s/(1-s))**2+(t/(1-t))**2)
+        means=variance[:,None]*(CENTERS.double()/DATA_STD**2+s[:,None]*inner[:,None]/(1-s[:,None])**2+t[:,None]*outer[:,None]/(1-t[:,None])**2)
+        covariance=torch.tensor([[float((1-s)**2+s**2*DATA_STD**2),float(s*t*DATA_STD**2)],
+                                 [float(s*t*DATA_STD**2),float((1-t)**2+t**2*DATA_STD**2)]],dtype=torch.float64)
+        residual=torch.stack([inner[:,None]-s[:,None]*CENTERS,outer[:,None]-t[:,None]*CENTERS],-1)
+        logits=-.5*torch.einsum('bkdi,ij,bkdj->bk',residual,torch.linalg.inv(covariance),residual)
+        expected=(logits.softmax(-1)[...,None]*means).sum(1)
+        torch.testing.assert_close(glass_denoiser(inner,s,outer,t),expected,atol=1e-9,rtol=1e-9)
+
+    def test_glass_no_inner_observation(self):
+        outer=torch.randn(5,2);t=torch.full((5,1),.4)
+        torch.testing.assert_close(glass_denoiser(torch.randn(5,2),torch.zeros_like(t),outer,t),exact_denoiser(outer,t))
+
+    def test_meta_surrogate_gradient(self):
+        delta=torch.tensor([[.3]],requires_grad=True)
+        w=torch.tensor([[1.],[4.]]);gw=torch.tensor([[.2],[.8]])
+        loss=fine_tune_surrogate(delta,w,gw,.5);loss.backward()
+        torch.testing.assert_close(delta.grad,2*(w*delta.detach()-.5*gw).mean().reshape(1,1))
+
+    def test_importance_weights_recover_posterior_mean(self):
+        x=torch.tensor([[.5,-.3]])
+        _,mean,ess=weighted_diamond_samples(x,.5,50000)
+        self.assertLess(float((mean-exact_denoiser(x,.5)).abs().max()),.2)
+        self.assertGreater(float(ess),100)
+
+    def test_insertion_preserves_order_and_clocks(self):
+        x=torch.tensor([[1.,0.],[0.,1.]]);b=torch.tensor([0.,.2]);counts=torch.tensor([1,0,1])
+        noise=torch.tensor([[-.2,.4],[.3,-.1]])
+        y,bt=insert_tokens(x,b,counts,noise,.5)
+        torch.testing.assert_close(y[1:3],x)
+        torch.testing.assert_close(bt,torch.tensor([.5,0.,.2,.5]))
+        torch.testing.assert_close(local_clock(.75,bt),torch.tensor([.5,.75,.6875,.5]))
+
+    def test_gap_labels_and_global_budget(self):
+        torch.testing.assert_close(gap_counts(torch.tensor([1,4]),torch.tensor([0,2,3,5]),6),torch.tensor([1.,2.,1.]))
+        counts,_=bounded_counts(torch.tensor([100.,100.,100.]),4)
+        self.assertLessEqual(int(counts.sum()),4)
+        self.assertTrue((counts>=0).all())
+
+    def test_count_divergence_minimizes_conditional_mean(self):
+        prediction=torch.tensor(2.,requires_grad=True)
+        count_divergence(torch.tensor([0.,1.,5.]),prediction).mean().backward()
+        self.assertAlmostEqual(float(prediction.grad),0.,places=6)
+
+    def test_insertion_interval_zero_and_terminal(self):
+        net=ExpandingNet(4,3,8);x=torch.zeros(1,4,3);b=torch.zeros(1,4);m=b.bool();s=torch.tensor([[.3]])
+        self.assertEqual(float(net.counts(x,b,m,s,s).sum()),0.)
+        t=torch.ones_like(s)
+        self.assertTrue(torch.isfinite(net.counts(x,b,m,s,t)).all())
+
+    def test_chen_arithmetic_and_covariance(self):
+        left=torch.tensor([.2,.04]);right=torch.tensor([-.1,-.02])
+        torch.testing.assert_close(chen_two(left,right,.5,.5),torch.tensor([.1,-.14]))
+        L=sample_coefficients(torch.tensor(.3),100000);R=sample_coefficients(torch.tensor(.7),100000)
+        C=chen_two(L,R,.3,.7)
+        torch.testing.assert_close(torch.cov(C.T),torch.diag(torch.tensor([1.,1/3])),atol=.015,rtol=0)
+
+    def test_same_noise_constant_sde_and_wrong_noise_counterexample(self):
+        direct=1+.5+.8*(.2-.1)
+        split=(1+.25+.8*.2)+.25+.8*(-.1)
+        self.assertAlmostEqual(direct,split);self.assertAlmostEqual(direct,1.58)
+        self.assertNotAlmostEqual(direct,1+.5+.8*(-.3))
+
+    def test_chen_tree_matches_increment_sum(self):
+        c=torch.randn(6,16,2)
+        torch.testing.assert_close(aggregate_tree(c)[:,0],c[:,:,0].sum(1))
+
+
+if __name__=='__main__':unittest.main()
diff --git a/lecture_6/verified_examples/README.md b/lecture_6/verified_examples/README.md
new file mode 100644
index 0000000000000000000000000000000000000000..11bc73cf3944c0cecbe3801380b047e21132b77a
--- /dev/null
+++ b/lecture_6/verified_examples/README.md
@@ -0,0 +1,76 @@
+# Verified Lecture 6 examples
+
+These are actual outputs from seeded CPU runs on 2026-09-13. All 16 default
+methods completed 1,000 training steps, sampled, and reproduced identical
+seeded samples after checkpoint reload. Teacher/autoencoder stages also used
+1,000 steps where applicable. The complete suite passed on PyTorch 2.9.1+cpu
+and PyTorch 2.14.0+cpu with Python 3.12.14. These checked-in outputs use 2.9.1.
+All 23 independent mathematical tests passed in both environments.
+
+Reproduce the default runs from `lecture_6/`:
+
+```bash
+python run_all.py --out outputs/verified-torch291 --train-steps 1000
+python -m unittest discover -s tests -v
+python numerical_examples.py --output outputs/numerical
+```
+
+The baseline reports use 128 samples, eight sampling steps, width 64, batch size
+64, and seed 6270. Posterior methods use four inner-map steps and 32 reward
+particles. Training losses are not comparable across different objectives.
+
+| Method | First 20 loss mean | Last 20 loss mean | Selected diagnostic |
+| --- | ---: | ---: | --- |
+| [categorical](categorical/report.json) | 2.47260 | 0.53130 | grammar support 1.000; mean length 4.00 |
+| [consistency](consistency/report.json) | 1.97463 | 1.97996 | mean center distance 0.753; mode entropy 1.386 |
+| [diamond](diamond/report.json) | 2.30034 | 1.39093 | posterior mean RMSE 0.285; variance RMSE 0.314 |
+| [discrete-esd](discrete-esd/report.json) | 2.47265 | 0.55223 | grammar support 1.000; mean length 4.00 |
+| [discrete-lsd](discrete-lsd/report.json) | 2.47260 | 0.52785 | grammar support 0.992; mean length 4.00 |
+| [expanding](expanding/report.json) | 4.25715 | 2.91940 | grammar support 0.617; mean length 4.09 |
+| [flow-matching](flow-matching/report.json) | 3.24047 | 2.02429 | mean center distance 0.575; mode entropy 1.383 |
+| [fmlm](fmlm/report.json) | 2.47259 | 0.52103 | grammar support 1.000; mean length 4.00 |
+| [fmm-eulerian](fmm-eulerian/report.json) | 1.99308 | 2.03712 | mean center distance 0.474; mode entropy 1.386 |
+| [fmm-lagrangian](fmm-lagrangian/report.json) | 1.98769 | 2.05232 | mean center distance 0.461; mode entropy 1.384 |
+| [latent](latent/report.json) | 1.95472 | 1.47142 | mean center distance 1.024; mode entropy 1.383 |
+| [meanflow](meanflow/report.json) | 1.67703 | 1.57479 | mean center distance 0.480; mode entropy 1.382 |
+| [meta](meta/report.json) | 3.04584 | 1.50320 | posterior mean RMSE 0.277; variance RMSE 0.487 |
+| [self-distill](self-distill/report.json) | 3.19830 | 2.18310 | mean center distance 0.729; mode entropy 1.381 |
+| [shortcut](shortcut/report.json) | 3.22197 | 2.18371 | mean center distance 0.738; mode entropy 1.385 |
+| [ssfm](ssfm/report.json) | 0.40952 | 0.00012 | same-noise RMSE 0.00483 |
+
+The fixed-length text examples recover almost all phrases in the four-family
+grammar at eight steps. The expanding example still produces invalid
+combinations; its support fraction is retained. Posterior means and variances
+both have measurable error. Continuous samples cover the modes but retain
+finite distributional error. These observations describe the actual small runs,
+and are not evidence of reproducing paper-scale quality.
+
+## Additional verified recipes
+
+```bash
+python examples/meta.py --finetune-steps 300 --out outputs/meta-finetune-verified
+python run.py --mode sample --out outputs/meta-finetune-verified
+python examples/ssfm.py --ssfm-target paper --lr 0.0001 --train-steps 2000 --out outputs/ssfm-paper-stable
+python run.py --mode sample --out outputs/ssfm-paper-stable
+```
+
+`meta-finetune/` records the complete optional reward-drift stage and its
+sampling metrics. `ssfm-paper/` records the paper's gradient orientation with
+its separate lower-learning-rate recipe. Both reproduced seeded samples after
+reloading. The paper-orientation recipe is optimization-sensitive: an initial
+1,000-step run at learning rate 0.001 diverged in accuracy despite finite
+numbers. Its same-noise RMSE was 51.94. This is why the default implementation
+uses the released code's EMA split target. The lower-learning-rate paper run
+also remained inaccurate, with same-noise RMSE 3.85 and one-step RMSE 22.40.
+It is retained as an optimization-sensitivity comparison, not a successful
+strong-solution fit. These failures concern this small-model training recipe;
+they do not establish a general failure of the paper's objective.
+
+`numerical_checks.json` retains the lecture's scalar-flow, posterior-gradient,
+probability-update, insertion-clock, and Brownian-composition checks. The scalar
+map's one-step endpoint RMSE is 0.011255 after 6,000 steps.
+
+The JSON files preserve each executed configuration and the full loss history.
+`checkpoint.pt` files are regenerated by the commands and excluded from Git,
+matching the prior lecture folders. `training_reload_log.txt` and
+`mathematics_test_log.txt` record the completed verification.
diff --git a/lecture_6/verified_examples/categorical/config.json b/lecture_6/verified_examples/categorical/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..ced2b9c0d2c98a3e7c1cc712e0c7c62dd4ffa5f1
--- /dev/null
+++ b/lecture_6/verified_examples/categorical/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "categorical",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/categorical"
+}
diff --git a/lecture_6/verified_examples/categorical/losses.json b/lecture_6/verified_examples/categorical/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..02b40bf2f05d6282a4700daad37e66f6b21244ea
--- /dev/null
+++ b/lecture_6/verified_examples/categorical/losses.json
@@ -0,0 +1,8002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.5544073581695557,
+    "diagonal_ce": 2.5544071197509766,
+    "finite": 7.632940832991153e-05,
+    "endpoint_kl": 7.518479833379388e-05,
+    "temporal_derivative": 1.1446123835412436e-06
+  },
+  {
+    "step": 1,
+    "loss": 2.542590379714966,
+    "diagonal_ce": 2.5425896644592285,
+    "finite": 8.30490025691688e-05,
+    "endpoint_kl": 8.175172843039036e-05,
+    "temporal_derivative": 1.2972749345863122e-06
+  },
+  {
+    "step": 2,
+    "loss": 2.534853219985962,
+    "diagonal_ce": 2.5348520278930664,
+    "finite": 0.00010586393909761682,
+    "endpoint_kl": 0.0001047200639732182,
+    "temporal_derivative": 1.1438776255090488e-06
+  },
+  {
+    "step": 3,
+    "loss": 2.5357630252838135,
+    "diagonal_ce": 2.5357601642608643,
+    "finite": 0.0001745914778439328,
+    "endpoint_kl": 0.00017318787286058068,
+    "temporal_derivative": 1.4036005495654535e-06
+  },
+  {
+    "step": 4,
+    "loss": 2.5233585834503174,
+    "diagonal_ce": 2.5233542919158936,
+    "finite": 0.0002109699125867337,
+    "endpoint_kl": 0.00020956818480044603,
+    "temporal_derivative": 1.4017317653269856e-06
+  },
+  {
+    "step": 5,
+    "loss": 2.513707160949707,
+    "diagonal_ce": 2.513700485229492,
+    "finite": 0.0002830560551956296,
+    "endpoint_kl": 0.0002816396881826222,
+    "temporal_derivative": 1.4163556443236303e-06
+  },
+  {
+    "step": 6,
+    "loss": 2.504714250564575,
+    "diagonal_ce": 2.5047030448913574,
+    "finite": 0.0004041844222228974,
+    "endpoint_kl": 0.00040259852539747953,
+    "temporal_derivative": 1.5858951201153104e-06
+  },
+  {
+    "step": 7,
+    "loss": 2.500147581100464,
+    "diagonal_ce": 2.5001327991485596,
+    "finite": 0.0004647070309147239,
+    "endpoint_kl": 0.00046355777885764837,
+    "temporal_derivative": 1.1492451221783995e-06
+  },
+  {
+    "step": 8,
+    "loss": 2.487760066986084,
+    "diagonal_ce": 2.487739086151123,
+    "finite": 0.0005813200841657817,
+    "endpoint_kl": 0.000579869607463479,
+    "temporal_derivative": 1.4504524870062596e-06
+  },
+  {
+    "step": 9,
+    "loss": 2.4852030277252197,
+    "diagonal_ce": 2.485175132751465,
+    "finite": 0.0006947845104150474,
+    "endpoint_kl": 0.0006931810639798641,
+    "temporal_derivative": 1.6034281316024135e-06
+  },
+  {
+    "step": 10,
+    "loss": 2.4704999923706055,
+    "diagonal_ce": 2.470461845397949,
+    "finite": 0.0008684956701472402,
+    "endpoint_kl": 0.0008665959467180073,
+    "temporal_derivative": 1.8997028519152082e-06
+  },
+  {
+    "step": 11,
+    "loss": 2.4671871662139893,
+    "diagonal_ce": 2.467137575149536,
+    "finite": 0.0010320243891328573,
+    "endpoint_kl": 0.0010301654692739248,
+    "temporal_derivative": 1.8588948478281964e-06
+  },
+  {
+    "step": 12,
+    "loss": 2.4572601318359375,
+    "diagonal_ce": 2.4571950435638428,
+    "finite": 0.0012506905477494001,
+    "endpoint_kl": 0.0012486027553677559,
+    "temporal_derivative": 2.087834900521557e-06
+  },
+  {
+    "step": 13,
+    "loss": 2.4415249824523926,
+    "diagonal_ce": 2.4414384365081787,
+    "finite": 0.0015436613466590643,
+    "endpoint_kl": 0.0015415996313095093,
+    "temporal_derivative": 2.0617349036911037e-06
+  },
+  {
+    "step": 14,
+    "loss": 2.434650182723999,
+    "diagonal_ce": 2.434540033340454,
+    "finite": 0.0018344277050346136,
+    "endpoint_kl": 0.0018321281531825662,
+    "temporal_derivative": 2.299527523064171e-06
+  },
+  {
+    "step": 15,
+    "loss": 2.423247814178467,
+    "diagonal_ce": 2.4231088161468506,
+    "finite": 0.002170581603422761,
+    "endpoint_kl": 0.002167089143767953,
+    "temporal_derivative": 3.4924253213830525e-06
+  },
+  {
+    "step": 16,
+    "loss": 2.411900520324707,
+    "diagonal_ce": 2.411724328994751,
+    "finite": 0.002591146156191826,
+    "endpoint_kl": 0.002586824120953679,
+    "temporal_derivative": 4.321937467466341e-06
+  },
+  {
+    "step": 17,
+    "loss": 2.399062395095825,
+    "diagonal_ce": 2.398834228515625,
+    "finite": 0.003168340539559722,
+    "endpoint_kl": 0.0031638452783226967,
+    "temporal_derivative": 4.495272605709033e-06
+  },
+  {
+    "step": 18,
+    "loss": 2.3888397216796875,
+    "diagonal_ce": 2.3885602951049805,
+    "finite": 0.003675153013318777,
+    "endpoint_kl": 0.0036704763770103455,
+    "temporal_derivative": 4.676721346186241e-06
+  },
+  {
+    "step": 19,
+    "loss": 2.375270366668701,
+    "diagonal_ce": 2.3749265670776367,
+    "finite": 0.00429822551086545,
+    "endpoint_kl": 0.004292478319257498,
+    "temporal_derivative": 5.74714158574352e-06
+  },
+  {
+    "step": 20,
+    "loss": 2.370637893676758,
+    "diagonal_ce": 2.3702311515808105,
+    "finite": 0.004843342583626509,
+    "endpoint_kl": 0.004838081076741219,
+    "temporal_derivative": 5.26162693859078e-06
+  },
+  {
+    "step": 21,
+    "loss": 2.3564529418945312,
+    "diagonal_ce": 2.3559768199920654,
+    "finite": 0.005410555750131607,
+    "endpoint_kl": 0.0054008993320167065,
+    "temporal_derivative": 9.656363545218483e-06
+  },
+  {
+    "step": 22,
+    "loss": 2.3378000259399414,
+    "diagonal_ce": 2.3371739387512207,
+    "finite": 0.006806087680160999,
+    "endpoint_kl": 0.006796645000576973,
+    "temporal_derivative": 9.442614100407809e-06
+  },
+  {
+    "step": 23,
+    "loss": 2.3271713256835938,
+    "diagonal_ce": 2.3264756202697754,
+    "finite": 0.0072468300350010395,
+    "endpoint_kl": 0.007234524469822645,
+    "temporal_derivative": 1.2305578820814844e-05
+  },
+  {
+    "step": 24,
+    "loss": 2.3007826805114746,
+    "diagonal_ce": 2.2998571395874023,
+    "finite": 0.009255515411496162,
+    "endpoint_kl": 0.009240753948688507,
+    "temporal_derivative": 1.4761657439521514e-05
+  },
+  {
+    "step": 25,
+    "loss": 2.2938525676727295,
+    "diagonal_ce": 2.2928428649902344,
+    "finite": 0.009708691388368607,
+    "endpoint_kl": 0.009690406732261181,
+    "temporal_derivative": 1.8284248653799295e-05
+  },
+  {
+    "step": 26,
+    "loss": 2.255554437637329,
+    "diagonal_ce": 2.254089117050171,
+    "finite": 0.013568769209086895,
+    "endpoint_kl": 0.013550477102398872,
+    "temporal_derivative": 1.8291888409294188e-05
+  },
+  {
+    "step": 27,
+    "loss": 2.241208791732788,
+    "diagonal_ce": 2.2395002841949463,
+    "finite": 0.015253731980919838,
+    "endpoint_kl": 0.015224538743495941,
+    "temporal_derivative": 2.9193290174589492e-05
+  },
+  {
+    "step": 28,
+    "loss": 2.2013537883758545,
+    "diagonal_ce": 2.1991817951202393,
+    "finite": 0.018723823130130768,
+    "endpoint_kl": 0.018685046583414078,
+    "temporal_derivative": 3.877732524415478e-05
+  },
+  {
+    "step": 29,
+    "loss": 2.2075366973876953,
+    "diagonal_ce": 2.205247402191162,
+    "finite": 0.019077960401773453,
+    "endpoint_kl": 0.019036367535591125,
+    "temporal_derivative": 4.159289164817892e-05
+  },
+  {
+    "step": 30,
+    "loss": 2.145982503890991,
+    "diagonal_ce": 2.1427714824676514,
+    "finite": 0.025895969942212105,
+    "endpoint_kl": 0.02584530971944332,
+    "temporal_derivative": 5.066043377155438e-05
+  },
+  {
+    "step": 31,
+    "loss": 2.1471738815307617,
+    "diagonal_ce": 2.1435811519622803,
+    "finite": 0.028067465871572495,
+    "endpoint_kl": 0.027990296483039856,
+    "temporal_derivative": 7.716968684690073e-05
+  },
+  {
+    "step": 32,
+    "loss": 2.1091232299804688,
+    "diagonal_ce": 2.104607582092285,
+    "finite": 0.03421023488044739,
+    "endpoint_kl": 0.03412972390651703,
+    "temporal_derivative": 8.051068289205432e-05
+  },
+  {
+    "step": 33,
+    "loss": 2.0793445110321045,
+    "diagonal_ce": 2.0737955570220947,
+    "finite": 0.04080162197351456,
+    "endpoint_kl": 0.04068128019571304,
+    "temporal_derivative": 0.00012034231622237712
+  },
+  {
+    "step": 34,
+    "loss": 2.050696849822998,
+    "diagonal_ce": 2.043943405151367,
+    "finite": 0.04823840782046318,
+    "endpoint_kl": 0.04809423163533211,
+    "temporal_derivative": 0.0001441754720872268
+  },
+  {
+    "step": 35,
+    "loss": 2.042114019393921,
+    "diagonal_ce": 2.0345730781555176,
+    "finite": 0.05236782133579254,
+    "endpoint_kl": 0.05217386782169342,
+    "temporal_derivative": 0.00019395248091313988
+  },
+  {
+    "step": 36,
+    "loss": 2.0182316303253174,
+    "diagonal_ce": 2.009305477142334,
+    "finite": 0.06031258776783943,
+    "endpoint_kl": 0.06009753793478012,
+    "temporal_derivative": 0.00021505143376998603
+  },
+  {
+    "step": 37,
+    "loss": 1.9797947406768799,
+    "diagonal_ce": 1.9689476490020752,
+    "finite": 0.07136280834674835,
+    "endpoint_kl": 0.07115823030471802,
+    "temporal_derivative": 0.00020457868231460452
+  },
+  {
+    "step": 38,
+    "loss": 1.9085204601287842,
+    "diagonal_ce": 1.8944611549377441,
+    "finite": 0.09012351930141449,
+    "endpoint_kl": 0.08974109590053558,
+    "temporal_derivative": 0.0003824200539384037
+  },
+  {
+    "step": 39,
+    "loss": 1.9078510999679565,
+    "diagonal_ce": 1.8924862146377563,
+    "finite": 0.0960308387875557,
+    "endpoint_kl": 0.09550947695970535,
+    "temporal_derivative": 0.0005213646800257266
+  },
+  {
+    "step": 40,
+    "loss": 1.8904298543930054,
+    "diagonal_ce": 1.8740822076797485,
+    "finite": 0.09968102723360062,
+    "endpoint_kl": 0.09931142628192902,
+    "temporal_derivative": 0.00036959961289539933
+  },
+  {
+    "step": 41,
+    "loss": 1.8355752229690552,
+    "diagonal_ce": 1.8137876987457275,
+    "finite": 0.12968780100345612,
+    "endpoint_kl": 0.12902162969112396,
+    "temporal_derivative": 0.0006661679362878203
+  },
+  {
+    "step": 42,
+    "loss": 1.8134040832519531,
+    "diagonal_ce": 1.7884372472763062,
+    "finite": 0.1451559066772461,
+    "endpoint_kl": 0.14440682530403137,
+    "temporal_derivative": 0.0007490808493457735
+  },
+  {
+    "step": 43,
+    "loss": 1.8089168071746826,
+    "diagonal_ce": 1.7808663845062256,
+    "finite": 0.15937714278697968,
+    "endpoint_kl": 0.1584840565919876,
+    "temporal_derivative": 0.0008930860785767436
+  },
+  {
+    "step": 44,
+    "loss": 1.745194911956787,
+    "diagonal_ce": 1.7091690301895142,
+    "finite": 0.20014360547065735,
+    "endpoint_kl": 0.19920840859413147,
+    "temporal_derivative": 0.000935193442273885
+  },
+  {
+    "step": 45,
+    "loss": 1.673020601272583,
+    "diagonal_ce": 1.6283366680145264,
+    "finite": 0.24284762144088745,
+    "endpoint_kl": 0.24155175685882568,
+    "temporal_derivative": 0.001295871683396399
+  },
+  {
+    "step": 46,
+    "loss": 1.6484133005142212,
+    "diagonal_ce": 1.5958384275436401,
+    "finite": 0.2796538472175598,
+    "endpoint_kl": 0.27799659967422485,
+    "temporal_derivative": 0.0016572428867220879
+  },
+  {
+    "step": 47,
+    "loss": 1.6668260097503662,
+    "diagonal_ce": 1.613418459892273,
+    "finite": 0.2781645357608795,
+    "endpoint_kl": 0.27688685059547424,
+    "temporal_derivative": 0.00127768749371171
+  },
+  {
+    "step": 48,
+    "loss": 1.6353559494018555,
+    "diagonal_ce": 1.56968355178833,
+    "finite": 0.33506321907043457,
+    "endpoint_kl": 0.33313465118408203,
+    "temporal_derivative": 0.0019285553134977818
+  },
+  {
+    "step": 49,
+    "loss": 1.6188005208969116,
+    "diagonal_ce": 1.544683814048767,
+    "finite": 0.370583713054657,
+    "endpoint_kl": 0.3680313527584076,
+    "temporal_derivative": 0.0025523467920720577
+  },
+  {
+    "step": 50,
+    "loss": 1.5468473434448242,
+    "diagonal_ce": 1.4587069749832153,
+    "finite": 0.4320605397224426,
+    "endpoint_kl": 0.430006742477417,
+    "temporal_derivative": 0.002053801901638508
+  },
+  {
+    "step": 51,
+    "loss": 1.5229467153549194,
+    "diagonal_ce": 1.4155631065368652,
+    "finite": 0.5162674188613892,
+    "endpoint_kl": 0.5135964155197144,
+    "temporal_derivative": 0.0026709961239248514
+  },
+  {
+    "step": 52,
+    "loss": 1.5205742120742798,
+    "diagonal_ce": 1.4097340106964111,
+    "finite": 0.5228309035301208,
+    "endpoint_kl": 0.5203722715377808,
+    "temporal_derivative": 0.0024586545769125223
+  },
+  {
+    "step": 53,
+    "loss": 1.5113658905029297,
+    "diagonal_ce": 1.3929777145385742,
+    "finite": 0.5480932593345642,
+    "endpoint_kl": 0.5461899042129517,
+    "temporal_derivative": 0.0019033784046769142
+  },
+  {
+    "step": 54,
+    "loss": 1.5057657957077026,
+    "diagonal_ce": 1.3663756847381592,
+    "finite": 0.6335912942886353,
+    "endpoint_kl": 0.6307672262191772,
+    "temporal_derivative": 0.0028240669053047895
+  },
+  {
+    "step": 55,
+    "loss": 1.5012673139572144,
+    "diagonal_ce": 1.355055332183838,
+    "finite": 0.6527321934700012,
+    "endpoint_kl": 0.6498069763183594,
+    "temporal_derivative": 0.002925220178440213
+  },
+  {
+    "step": 56,
+    "loss": 1.5146597623825073,
+    "diagonal_ce": 1.358648419380188,
+    "finite": 0.6842601299285889,
+    "endpoint_kl": 0.6805340647697449,
+    "temporal_derivative": 0.003726071212440729
+  },
+  {
+    "step": 57,
+    "loss": 1.4990224838256836,
+    "diagonal_ce": 1.3183447122573853,
+    "finite": 0.7787837386131287,
+    "endpoint_kl": 0.7758113741874695,
+    "temporal_derivative": 0.002972376998513937
+  },
+  {
+    "step": 58,
+    "loss": 1.4645848274230957,
+    "diagonal_ce": 1.2583729028701782,
+    "finite": 0.8737790584564209,
+    "endpoint_kl": 0.8716016411781311,
+    "temporal_derivative": 0.0021774270571768284
+  },
+  {
+    "step": 59,
+    "loss": 1.4868271350860596,
+    "diagonal_ce": 1.266188621520996,
+    "finite": 0.9193269610404968,
+    "endpoint_kl": 0.9161607027053833,
+    "temporal_derivative": 0.0031662769615650177
+  },
+  {
+    "step": 60,
+    "loss": 1.4938987493515015,
+    "diagonal_ce": 1.2853707075119019,
+    "finite": 0.8546229600906372,
+    "endpoint_kl": 0.8507145047187805,
+    "temporal_derivative": 0.003908432088792324
+  },
+  {
+    "step": 61,
+    "loss": 1.4739879369735718,
+    "diagonal_ce": 1.2439351081848145,
+    "finite": 0.9276322722434998,
+    "endpoint_kl": 0.9245495796203613,
+    "temporal_derivative": 0.00308269658125937
+  },
+  {
+    "step": 62,
+    "loss": 1.513153076171875,
+    "diagonal_ce": 1.3001669645309448,
+    "finite": 0.8451831340789795,
+    "endpoint_kl": 0.8403673768043518,
+    "temporal_derivative": 0.004815773572772741
+  },
+  {
+    "step": 63,
+    "loss": 1.4937876462936401,
+    "diagonal_ce": 1.2331486940383911,
+    "finite": 1.0181208848953247,
+    "endpoint_kl": 1.0159682035446167,
+    "temporal_derivative": 0.002152655739337206
+  },
+  {
+    "step": 64,
+    "loss": 1.480596899986267,
+    "diagonal_ce": 1.1878353357315063,
+    "finite": 1.1260061264038086,
+    "endpoint_kl": 1.1244136095046997,
+    "temporal_derivative": 0.001592483720742166
+  },
+  {
+    "step": 65,
+    "loss": 1.5131193399429321,
+    "diagonal_ce": 1.2519680261611938,
+    "finite": 0.9892094731330872,
+    "endpoint_kl": 0.9843289852142334,
+    "temporal_derivative": 0.004880484193563461
+  },
+  {
+    "step": 66,
+    "loss": 1.4922631978988647,
+    "diagonal_ce": 1.2038516998291016,
+    "finite": 1.076162338256836,
+    "endpoint_kl": 1.072676420211792,
+    "temporal_derivative": 0.0034859501756727695
+  },
+  {
+    "step": 67,
+    "loss": 1.4964410066604614,
+    "diagonal_ce": 1.213610291481018,
+    "finite": 1.0398187637329102,
+    "endpoint_kl": 1.0364152193069458,
+    "temporal_derivative": 0.0034035202115774155
+  },
+  {
+    "step": 68,
+    "loss": 1.4964302778244019,
+    "diagonal_ce": 1.19106125831604,
+    "finite": 1.1064095497131348,
+    "endpoint_kl": 1.1036489009857178,
+    "temporal_derivative": 0.002760685980319977
+  },
+  {
+    "step": 69,
+    "loss": 1.465470552444458,
+    "diagonal_ce": 1.165828824043274,
+    "finite": 1.0701491832733154,
+    "endpoint_kl": 1.0680460929870605,
+    "temporal_derivative": 0.00210314872674644
+  },
+  {
+    "step": 70,
+    "loss": 1.479806661605835,
+    "diagonal_ce": 1.1882067918777466,
+    "finite": 1.0267599821090698,
+    "endpoint_kl": 1.0237699747085571,
+    "temporal_derivative": 0.002990047913044691
+  },
+  {
+    "step": 71,
+    "loss": 1.488511562347412,
+    "diagonal_ce": 1.2027753591537476,
+    "finite": 0.9921396374702454,
+    "endpoint_kl": 0.9894720315933228,
+    "temporal_derivative": 0.0026676247362047434
+  },
+  {
+    "step": 72,
+    "loss": 1.5232017040252686,
+    "diagonal_ce": 1.2057089805603027,
+    "finite": 1.0873039960861206,
+    "endpoint_kl": 1.0851209163665771,
+    "temporal_derivative": 0.002183138392865658
+  },
+  {
+    "step": 73,
+    "loss": 1.473298192024231,
+    "diagonal_ce": 1.1928402185440063,
+    "finite": 0.9474932551383972,
+    "endpoint_kl": 0.9447940587997437,
+    "temporal_derivative": 0.00269921962171793
+  },
+  {
+    "step": 74,
+    "loss": 1.4657459259033203,
+    "diagonal_ce": 1.166577696800232,
+    "finite": 0.9972271919250488,
+    "endpoint_kl": 0.9947494268417358,
+    "temporal_derivative": 0.002477772068232298
+  },
+  {
+    "step": 75,
+    "loss": 1.4516823291778564,
+    "diagonal_ce": 1.157291293144226,
+    "finite": 0.9683917164802551,
+    "endpoint_kl": 0.9658401608467102,
+    "temporal_derivative": 0.0025515533052384853
+  },
+  {
+    "step": 76,
+    "loss": 1.4765833616256714,
+    "diagonal_ce": 1.2052042484283447,
+    "finite": 0.8811009526252747,
+    "endpoint_kl": 0.8781803846359253,
+    "temporal_derivative": 0.0029205959290266037
+  },
+  {
+    "step": 77,
+    "loss": 1.471144676208496,
+    "diagonal_ce": 1.1518831253051758,
+    "finite": 1.023274302482605,
+    "endpoint_kl": 1.0214143991470337,
+    "temporal_derivative": 0.0018598833121359348
+  },
+  {
+    "step": 78,
+    "loss": 1.4708565473556519,
+    "diagonal_ce": 1.2090386152267456,
+    "finite": 0.8285377621650696,
+    "endpoint_kl": 0.8255133032798767,
+    "temporal_derivative": 0.0030244351364672184
+  },
+  {
+    "step": 79,
+    "loss": 1.4805841445922852,
+    "diagonal_ce": 1.2215628623962402,
+    "finite": 0.8094416856765747,
+    "endpoint_kl": 0.8064945340156555,
+    "temporal_derivative": 0.0029471481684595346
+  },
+  {
+    "step": 80,
+    "loss": 1.4473904371261597,
+    "diagonal_ce": 1.1987028121948242,
+    "finite": 0.7675544023513794,
+    "endpoint_kl": 0.7652044296264648,
+    "temporal_derivative": 0.0023499862290918827
+  },
+  {
+    "step": 81,
+    "loss": 1.4508094787597656,
+    "diagonal_ce": 1.2033642530441284,
+    "finite": 0.7544062733650208,
+    "endpoint_kl": 0.7518830895423889,
+    "temporal_derivative": 0.002523208735510707
+  },
+  {
+    "step": 82,
+    "loss": 1.4552698135375977,
+    "diagonal_ce": 1.2174679040908813,
+    "finite": 0.7162708044052124,
+    "endpoint_kl": 0.7135928273200989,
+    "temporal_derivative": 0.0026779707986861467
+  },
+  {
+    "step": 83,
+    "loss": 1.4435813426971436,
+    "diagonal_ce": 1.2064204216003418,
+    "finite": 0.7058361172676086,
+    "endpoint_kl": 0.7032836079597473,
+    "temporal_derivative": 0.0025525325909256935
+  },
+  {
+    "step": 84,
+    "loss": 1.4396203756332397,
+    "diagonal_ce": 1.2116868495941162,
+    "finite": 0.6703928112983704,
+    "endpoint_kl": 0.6676512956619263,
+    "temporal_derivative": 0.002741539850831032
+  },
+  {
+    "step": 85,
+    "loss": 1.4166651964187622,
+    "diagonal_ce": 1.1870919466018677,
+    "finite": 0.6673641800880432,
+    "endpoint_kl": 0.665311872959137,
+    "temporal_derivative": 0.0020522898994386196
+  },
+  {
+    "step": 86,
+    "loss": 1.4224519729614258,
+    "diagonal_ce": 1.2107958793640137,
+    "finite": 0.6082073450088501,
+    "endpoint_kl": 0.6063982844352722,
+    "temporal_derivative": 0.001809031586162746
+  },
+  {
+    "step": 87,
+    "loss": 1.4137623310089111,
+    "diagonal_ce": 1.1834259033203125,
+    "finite": 0.6543649435043335,
+    "endpoint_kl": 0.6522403955459595,
+    "temporal_derivative": 0.002124571707099676
+  },
+  {
+    "step": 88,
+    "loss": 1.4134740829467773,
+    "diagonal_ce": 1.1985249519348145,
+    "finite": 0.6037898063659668,
+    "endpoint_kl": 0.6015058159828186,
+    "temporal_derivative": 0.0022839661687612534
+  },
+  {
+    "step": 89,
+    "loss": 1.4313863515853882,
+    "diagonal_ce": 1.233222484588623,
+    "finite": 0.5504551529884338,
+    "endpoint_kl": 0.547877848148346,
+    "temporal_derivative": 0.0025772922672331333
+  },
+  {
+    "step": 90,
+    "loss": 1.456665277481079,
+    "diagonal_ce": 1.2664062976837158,
+    "finite": 0.5226896405220032,
+    "endpoint_kl": 0.5195474624633789,
+    "temporal_derivative": 0.0031421498861163855
+  },
+  {
+    "step": 91,
+    "loss": 1.416088342666626,
+    "diagonal_ce": 1.2140430212020874,
+    "finite": 0.5490360260009766,
+    "endpoint_kl": 0.5469446778297424,
+    "temporal_derivative": 0.0020913220942020416
+  },
+  {
+    "step": 92,
+    "loss": 1.4019207954406738,
+    "diagonal_ce": 1.2036892175674438,
+    "finite": 0.5328806638717651,
+    "endpoint_kl": 0.5308390855789185,
+    "temporal_derivative": 0.002041605534031987
+  },
+  {
+    "step": 93,
+    "loss": 1.434041976928711,
+    "diagonal_ce": 1.2387290000915527,
+    "finite": 0.5194495916366577,
+    "endpoint_kl": 0.5172741413116455,
+    "temporal_derivative": 0.002175475237891078
+  },
+  {
+    "step": 94,
+    "loss": 1.4174705743789673,
+    "diagonal_ce": 1.2158156633377075,
+    "finite": 0.530670702457428,
+    "endpoint_kl": 0.5284373760223389,
+    "temporal_derivative": 0.0022333436645567417
+  },
+  {
+    "step": 95,
+    "loss": 1.3944141864776611,
+    "diagonal_ce": 1.2094688415527344,
+    "finite": 0.4816284477710724,
+    "endpoint_kl": 0.47953304648399353,
+    "temporal_derivative": 0.002095408271998167
+  },
+  {
+    "step": 96,
+    "loss": 1.380994439125061,
+    "diagonal_ce": 1.1904170513153076,
+    "finite": 0.49117884039878845,
+    "endpoint_kl": 0.4889596700668335,
+    "temporal_derivative": 0.0022191843017935753
+  },
+  {
+    "step": 97,
+    "loss": 1.405864953994751,
+    "diagonal_ce": 1.2136515378952026,
+    "finite": 0.4903404116630554,
+    "endpoint_kl": 0.48889264464378357,
+    "temporal_derivative": 0.0014477799413725734
+  },
+  {
+    "step": 98,
+    "loss": 1.4065524339675903,
+    "diagonal_ce": 1.2121574878692627,
+    "finite": 0.49089640378952026,
+    "endpoint_kl": 0.48852452635765076,
+    "temporal_derivative": 0.0023718683514744043
+  },
+  {
+    "step": 99,
+    "loss": 1.4159018993377686,
+    "diagonal_ce": 1.2282782793045044,
+    "finite": 0.46905919909477234,
+    "endpoint_kl": 0.467011421918869,
+    "temporal_derivative": 0.0020477776415646076
+  },
+  {
+    "step": 100,
+    "loss": 1.3993117809295654,
+    "diagonal_ce": 1.2077932357788086,
+    "finite": 0.474055677652359,
+    "endpoint_kl": 0.47213196754455566,
+    "temporal_derivative": 0.0019237081287428737
+  },
+  {
+    "step": 101,
+    "loss": 1.4278042316436768,
+    "diagonal_ce": 1.2424001693725586,
+    "finite": 0.4544216990470886,
+    "endpoint_kl": 0.45211243629455566,
+    "temporal_derivative": 0.0023092664778232574
+  },
+  {
+    "step": 102,
+    "loss": 1.391170859336853,
+    "diagonal_ce": 1.198323130607605,
+    "finite": 0.46807706356048584,
+    "endpoint_kl": 0.465901643037796,
+    "temporal_derivative": 0.0021754279732704163
+  },
+  {
+    "step": 103,
+    "loss": 1.405725121498108,
+    "diagonal_ce": 1.2084978818893433,
+    "finite": 0.4741038978099823,
+    "endpoint_kl": 0.4719969630241394,
+    "temporal_derivative": 0.0021069457288831472
+  },
+  {
+    "step": 104,
+    "loss": 1.39768648147583,
+    "diagonal_ce": 1.2083592414855957,
+    "finite": 0.4507792294025421,
+    "endpoint_kl": 0.4493013024330139,
+    "temporal_derivative": 0.0014779319753870368
+  },
+  {
+    "step": 105,
+    "loss": 1.3651411533355713,
+    "diagonal_ce": 1.1701905727386475,
+    "finite": 0.45978906750679016,
+    "endpoint_kl": 0.4581740200519562,
+    "temporal_derivative": 0.0016150360461324453
+  },
+  {
+    "step": 106,
+    "loss": 1.4011393785476685,
+    "diagonal_ce": 1.214289903640747,
+    "finite": 0.4365641474723816,
+    "endpoint_kl": 0.4346262514591217,
+    "temporal_derivative": 0.0019378893775865436
+  },
+  {
+    "step": 107,
+    "loss": 1.3680483102798462,
+    "diagonal_ce": 1.1731923818588257,
+    "finite": 0.4510553181171417,
+    "endpoint_kl": 0.44923701882362366,
+    "temporal_derivative": 0.0018182932399213314
+  },
+  {
+    "step": 108,
+    "loss": 1.3541040420532227,
+    "diagonal_ce": 1.1542450189590454,
+    "finite": 0.45839226245880127,
+    "endpoint_kl": 0.4566950500011444,
+    "temporal_derivative": 0.0016972264274954796
+  },
+  {
+    "step": 109,
+    "loss": 1.3613489866256714,
+    "diagonal_ce": 1.1702412366867065,
+    "finite": 0.4343358278274536,
+    "endpoint_kl": 0.4322434067726135,
+    "temporal_derivative": 0.0020924299024045467
+  },
+  {
+    "step": 110,
+    "loss": 1.3365224599838257,
+    "diagonal_ce": 1.1401753425598145,
+    "finite": 0.44222328066825867,
+    "endpoint_kl": 0.4406030476093292,
+    "temporal_derivative": 0.0016202233964577317
+  },
+  {
+    "step": 111,
+    "loss": 1.3481791019439697,
+    "diagonal_ce": 1.1558185815811157,
+    "finite": 0.4293762147426605,
+    "endpoint_kl": 0.42742449045181274,
+    "temporal_derivative": 0.001951722428202629
+  },
+  {
+    "step": 112,
+    "loss": 1.3673063516616821,
+    "diagonal_ce": 1.179024338722229,
+    "finite": 0.4165530502796173,
+    "endpoint_kl": 0.41495680809020996,
+    "temporal_derivative": 0.0015962381148710847
+  },
+  {
+    "step": 113,
+    "loss": 1.3412262201309204,
+    "diagonal_ce": 1.1395528316497803,
+    "finite": 0.44226616621017456,
+    "endpoint_kl": 0.44075798988342285,
+    "temporal_derivative": 0.0015081838937476277
+  },
+  {
+    "step": 114,
+    "loss": 1.3373537063598633,
+    "diagonal_ce": 1.1411250829696655,
+    "finite": 0.42658406496047974,
+    "endpoint_kl": 0.4252905547618866,
+    "temporal_derivative": 0.0012935182312503457
+  },
+  {
+    "step": 115,
+    "loss": 1.3599401712417603,
+    "diagonal_ce": 1.170145034790039,
+    "finite": 0.40904131531715393,
+    "endpoint_kl": 0.40758487582206726,
+    "temporal_derivative": 0.0014564413577318192
+  },
+  {
+    "step": 116,
+    "loss": 1.3638486862182617,
+    "diagonal_ce": 1.1678762435913086,
+    "finite": 0.41874462366104126,
+    "endpoint_kl": 0.4167105555534363,
+    "temporal_derivative": 0.002034065779298544
+  },
+  {
+    "step": 117,
+    "loss": 1.3375873565673828,
+    "diagonal_ce": 1.146521806716919,
+    "finite": 0.4047999382019043,
+    "endpoint_kl": 0.40347445011138916,
+    "temporal_derivative": 0.0013254875084385276
+  },
+  {
+    "step": 118,
+    "loss": 1.3486405611038208,
+    "diagonal_ce": 1.1591602563858032,
+    "finite": 0.39806780219078064,
+    "endpoint_kl": 0.3967713415622711,
+    "temporal_derivative": 0.0012964626075699925
+  },
+  {
+    "step": 119,
+    "loss": 1.303693413734436,
+    "diagonal_ce": 1.1030830144882202,
+    "finite": 0.41793835163116455,
+    "endpoint_kl": 0.41694116592407227,
+    "temporal_derivative": 0.0009971862891688943
+  },
+  {
+    "step": 120,
+    "loss": 1.3081254959106445,
+    "diagonal_ce": 1.118896722793579,
+    "finite": 0.3909684717655182,
+    "endpoint_kl": 0.3899071216583252,
+    "temporal_derivative": 0.0010613412596285343
+  },
+  {
+    "step": 121,
+    "loss": 1.2997082471847534,
+    "diagonal_ce": 1.1138670444488525,
+    "finite": 0.380822092294693,
+    "endpoint_kl": 0.37949955463409424,
+    "temporal_derivative": 0.0013225228758528829
+  },
+  {
+    "step": 122,
+    "loss": 1.3089191913604736,
+    "diagonal_ce": 1.118491291999817,
+    "finite": 0.387048602104187,
+    "endpoint_kl": 0.38593804836273193,
+    "temporal_derivative": 0.0011105494340881705
+  },
+  {
+    "step": 123,
+    "loss": 1.2961653470993042,
+    "diagonal_ce": 1.1120188236236572,
+    "finite": 0.37126317620277405,
+    "endpoint_kl": 0.37006711959838867,
+    "temporal_derivative": 0.0011960577685385942
+  },
+  {
+    "step": 124,
+    "loss": 1.2911105155944824,
+    "diagonal_ce": 1.096705436706543,
+    "finite": 0.38881006836891174,
+    "endpoint_kl": 0.38767576217651367,
+    "temporal_derivative": 0.0011342944344505668
+  },
+  {
+    "step": 125,
+    "loss": 1.3432000875473022,
+    "diagonal_ce": 1.1610496044158936,
+    "finite": 0.3614097237586975,
+    "endpoint_kl": 0.360269695520401,
+    "temporal_derivative": 0.0011400366201996803
+  },
+  {
+    "step": 126,
+    "loss": 1.3471733331680298,
+    "diagonal_ce": 1.1615616083145142,
+    "finite": 0.3653773069381714,
+    "endpoint_kl": 0.3639499843120575,
+    "temporal_derivative": 0.0014273286797106266
+  },
+  {
+    "step": 127,
+    "loss": 1.294755220413208,
+    "diagonal_ce": 1.110807180404663,
+    "finite": 0.35927337408065796,
+    "endpoint_kl": 0.35817280411720276,
+    "temporal_derivative": 0.0011005778796970844
+  },
+  {
+    "step": 128,
+    "loss": 1.2922635078430176,
+    "diagonal_ce": 1.1083980798721313,
+    "finite": 0.35632848739624023,
+    "endpoint_kl": 0.35517388582229614,
+    "temporal_derivative": 0.001154608791694045
+  },
+  {
+    "step": 129,
+    "loss": 1.265828251838684,
+    "diagonal_ce": 1.081952452659607,
+    "finite": 0.3536072373390198,
+    "endpoint_kl": 0.3526607155799866,
+    "temporal_derivative": 0.0009465094190090895
+  },
+  {
+    "step": 130,
+    "loss": 1.2741421461105347,
+    "diagonal_ce": 1.0988730192184448,
+    "finite": 0.3344831168651581,
+    "endpoint_kl": 0.33357924222946167,
+    "temporal_derivative": 0.0009038654388859868
+  },
+  {
+    "step": 131,
+    "loss": 1.2701627016067505,
+    "diagonal_ce": 1.0902713537216187,
+    "finite": 0.34070324897766113,
+    "endpoint_kl": 0.3399978578090668,
+    "temporal_derivative": 0.0007053962908685207
+  },
+  {
+    "step": 132,
+    "loss": 1.2763440608978271,
+    "diagonal_ce": 1.090584397315979,
+    "finite": 0.3491722047328949,
+    "endpoint_kl": 0.3484322428703308,
+    "temporal_derivative": 0.0007399679161608219
+  },
+  {
+    "step": 133,
+    "loss": 1.2556865215301514,
+    "diagonal_ce": 1.0733383893966675,
+    "finite": 0.34020185470581055,
+    "endpoint_kl": 0.3392893075942993,
+    "temporal_derivative": 0.0009125546785071492
+  },
+  {
+    "step": 134,
+    "loss": 1.2221465110778809,
+    "diagonal_ce": 1.0375982522964478,
+    "finite": 0.3417559564113617,
+    "endpoint_kl": 0.34086930751800537,
+    "temporal_derivative": 0.0008866611169651151
+  },
+  {
+    "step": 135,
+    "loss": 1.246103286743164,
+    "diagonal_ce": 1.0706517696380615,
+    "finite": 0.32252123951911926,
+    "endpoint_kl": 0.3216056227684021,
+    "temporal_derivative": 0.0009156297310255468
+  },
+  {
+    "step": 136,
+    "loss": 1.2465099096298218,
+    "diagonal_ce": 1.074049711227417,
+    "finite": 0.31470832228660583,
+    "endpoint_kl": 0.31384456157684326,
+    "temporal_derivative": 0.0008637707214802504
+  },
+  {
+    "step": 137,
+    "loss": 1.2590200901031494,
+    "diagonal_ce": 1.0762503147125244,
+    "finite": 0.331104576587677,
+    "endpoint_kl": 0.33031925559043884,
+    "temporal_derivative": 0.0007853262359276414
+  },
+  {
+    "step": 138,
+    "loss": 1.2186630964279175,
+    "diagonal_ce": 1.0401521921157837,
+    "finite": 0.32106274366378784,
+    "endpoint_kl": 0.32027140259742737,
+    "temporal_derivative": 0.0007913362351246178
+  },
+  {
+    "step": 139,
+    "loss": 1.1837332248687744,
+    "diagonal_ce": 1.0069867372512817,
+    "finite": 0.31561872363090515,
+    "endpoint_kl": 0.3148936629295349,
+    "temporal_derivative": 0.0007250556373037398
+  },
+  {
+    "step": 140,
+    "loss": 1.2142205238342285,
+    "diagonal_ce": 1.0409384965896606,
+    "finite": 0.3072376549243927,
+    "endpoint_kl": 0.3064950108528137,
+    "temporal_derivative": 0.000742645759601146
+  },
+  {
+    "step": 141,
+    "loss": 1.216724157333374,
+    "diagonal_ce": 1.0514878034591675,
+    "finite": 0.29090917110443115,
+    "endpoint_kl": 0.2900974750518799,
+    "temporal_derivative": 0.0008116815588437021
+  },
+  {
+    "step": 142,
+    "loss": 1.2064449787139893,
+    "diagonal_ce": 1.0328370332717896,
+    "finite": 0.303510457277298,
+    "endpoint_kl": 0.3028410077095032,
+    "temporal_derivative": 0.000669456843752414
+  },
+  {
+    "step": 143,
+    "loss": 1.1687676906585693,
+    "diagonal_ce": 0.9941796064376831,
+    "finite": 0.30310437083244324,
+    "endpoint_kl": 0.3025609254837036,
+    "temporal_derivative": 0.0005434368504211307
+  },
+  {
+    "step": 144,
+    "loss": 1.1825470924377441,
+    "diagonal_ce": 0.999571681022644,
+    "finite": 0.31547483801841736,
+    "endpoint_kl": 0.3147524297237396,
+    "temporal_derivative": 0.0007224220898933709
+  },
+  {
+    "step": 145,
+    "loss": 1.213896632194519,
+    "diagonal_ce": 1.0418847799301147,
+    "finite": 0.29454079270362854,
+    "endpoint_kl": 0.294060081243515,
+    "temporal_derivative": 0.00048070662887766957
+  },
+  {
+    "step": 146,
+    "loss": 1.1879854202270508,
+    "diagonal_ce": 0.9988696575164795,
+    "finite": 0.32162538170814514,
+    "endpoint_kl": 0.3210833668708801,
+    "temporal_derivative": 0.00054201326565817
+  },
+  {
+    "step": 147,
+    "loss": 1.1650160551071167,
+    "diagonal_ce": 0.9885150790214539,
+    "finite": 0.29814350605010986,
+    "endpoint_kl": 0.2975724935531616,
+    "temporal_derivative": 0.0005710183759219944
+  },
+  {
+    "step": 148,
+    "loss": 1.1844663619995117,
+    "diagonal_ce": 1.0073473453521729,
+    "finite": 0.2971794903278351,
+    "endpoint_kl": 0.29676559567451477,
+    "temporal_derivative": 0.00041389401303604245
+  },
+  {
+    "step": 149,
+    "loss": 1.1503050327301025,
+    "diagonal_ce": 0.9742929935455322,
+    "finite": 0.2933533787727356,
+    "endpoint_kl": 0.2928595244884491,
+    "temporal_derivative": 0.0004938568454235792
+  },
+  {
+    "step": 150,
+    "loss": 1.1680606603622437,
+    "diagonal_ce": 0.9838033318519592,
+    "finite": 0.30506187677383423,
+    "endpoint_kl": 0.30450439453125,
+    "temporal_derivative": 0.0005574790993705392
+  },
+  {
+    "step": 151,
+    "loss": 1.1927478313446045,
+    "diagonal_ce": 1.0115625858306885,
+    "finite": 0.29800212383270264,
+    "endpoint_kl": 0.29755672812461853,
+    "temporal_derivative": 0.0004453867150004953
+  },
+  {
+    "step": 152,
+    "loss": 1.141003131866455,
+    "diagonal_ce": 0.9670419096946716,
+    "finite": 0.2842504680156708,
+    "endpoint_kl": 0.2838272452354431,
+    "temporal_derivative": 0.00042321888031437993
+  },
+  {
+    "step": 153,
+    "loss": 1.1992237567901611,
+    "diagonal_ce": 1.0175175666809082,
+    "finite": 0.294977605342865,
+    "endpoint_kl": 0.29462942481040955,
+    "temporal_derivative": 0.0003481824533082545
+  },
+  {
+    "step": 154,
+    "loss": 1.153689980506897,
+    "diagonal_ce": 0.957048237323761,
+    "finite": 0.31716403365135193,
+    "endpoint_kl": 0.31678956747055054,
+    "temporal_derivative": 0.0003744757850654423
+  },
+  {
+    "step": 155,
+    "loss": 1.1570438146591187,
+    "diagonal_ce": 0.975225567817688,
+    "finite": 0.29137539863586426,
+    "endpoint_kl": 0.2909694015979767,
+    "temporal_derivative": 0.0004060094361193478
+  },
+  {
+    "step": 156,
+    "loss": 1.0819331407546997,
+    "diagonal_ce": 0.9126394987106323,
+    "finite": 0.2695757746696472,
+    "endpoint_kl": 0.26914310455322266,
+    "temporal_derivative": 0.0004326708731241524
+  },
+  {
+    "step": 157,
+    "loss": 1.1482596397399902,
+    "diagonal_ce": 0.9629828929901123,
+    "finite": 0.2931593358516693,
+    "endpoint_kl": 0.29278379678726196,
+    "temporal_derivative": 0.0003755256184376776
+  },
+  {
+    "step": 158,
+    "loss": 1.1637260913848877,
+    "diagonal_ce": 0.9799646139144897,
+    "finite": 0.2889331579208374,
+    "endpoint_kl": 0.28850996494293213,
+    "temporal_derivative": 0.0004231802886351943
+  },
+  {
+    "step": 159,
+    "loss": 1.130861520767212,
+    "diagonal_ce": 0.9420435428619385,
+    "finite": 0.2950280010700226,
+    "endpoint_kl": 0.2946292757987976,
+    "temporal_derivative": 0.00039871945045888424
+  },
+  {
+    "step": 160,
+    "loss": 1.1383845806121826,
+    "diagonal_ce": 0.9700751900672913,
+    "finite": 0.26135003566741943,
+    "endpoint_kl": 0.2611085772514343,
+    "temporal_derivative": 0.00024145709176082164
+  },
+  {
+    "step": 161,
+    "loss": 1.1000577211380005,
+    "diagonal_ce": 0.9256154894828796,
+    "finite": 0.2692009508609772,
+    "endpoint_kl": 0.26889127492904663,
+    "temporal_derivative": 0.00030968812643550336
+  },
+  {
+    "step": 162,
+    "loss": 1.0593043565750122,
+    "diagonal_ce": 0.8918354511260986,
+    "finite": 0.2568540871143341,
+    "endpoint_kl": 0.256659597158432,
+    "temporal_derivative": 0.000194479594938457
+  },
+  {
+    "step": 163,
+    "loss": 1.0528887510299683,
+    "diagonal_ce": 0.8781129717826843,
+    "finite": 0.26642653346061707,
+    "endpoint_kl": 0.2661956250667572,
+    "temporal_derivative": 0.0002309207629878074
+  },
+  {
+    "step": 164,
+    "loss": 1.0929887294769287,
+    "diagonal_ce": 0.9239159226417542,
+    "finite": 0.25617098808288574,
+    "endpoint_kl": 0.25590193271636963,
+    "temporal_derivative": 0.00026906418497674167
+  },
+  {
+    "step": 165,
+    "loss": 1.0864328145980835,
+    "diagonal_ce": 0.9117940068244934,
+    "finite": 0.26301029324531555,
+    "endpoint_kl": 0.2628321349620819,
+    "temporal_derivative": 0.000178144546225667
+  },
+  {
+    "step": 166,
+    "loss": 1.1623563766479492,
+    "diagonal_ce": 0.9887478351593018,
+    "finite": 0.2598930895328522,
+    "endpoint_kl": 0.2597004175186157,
+    "temporal_derivative": 0.0001926602708408609
+  },
+  {
+    "step": 167,
+    "loss": 1.0476125478744507,
+    "diagonal_ce": 0.8660736083984375,
+    "finite": 0.2701472043991089,
+    "endpoint_kl": 0.26987650990486145,
+    "temporal_derivative": 0.0002706825907807797
+  },
+  {
+    "step": 168,
+    "loss": 1.1117877960205078,
+    "diagonal_ce": 0.9389021396636963,
+    "finite": 0.25574791431427,
+    "endpoint_kl": 0.2555653750896454,
+    "temporal_derivative": 0.00018254006863571703
+  },
+  {
+    "step": 169,
+    "loss": 1.0744572877883911,
+    "diagonal_ce": 0.9087943434715271,
+    "finite": 0.24362190067768097,
+    "endpoint_kl": 0.24340546131134033,
+    "temporal_derivative": 0.00021643399668391794
+  },
+  {
+    "step": 170,
+    "loss": 1.135677456855774,
+    "diagonal_ce": 0.9630157351493835,
+    "finite": 0.2524294853210449,
+    "endpoint_kl": 0.252271831035614,
+    "temporal_derivative": 0.00015765169518999755
+  },
+  {
+    "step": 171,
+    "loss": 1.103511095046997,
+    "diagonal_ce": 0.9295750856399536,
+    "finite": 0.2528139650821686,
+    "endpoint_kl": 0.25265219807624817,
+    "temporal_derivative": 0.0001617793459445238
+  },
+  {
+    "step": 172,
+    "loss": 1.036933183670044,
+    "diagonal_ce": 0.8506107330322266,
+    "finite": 0.26925215125083923,
+    "endpoint_kl": 0.26908233761787415,
+    "temporal_derivative": 0.00016980663349386305
+  },
+  {
+    "step": 173,
+    "loss": 1.087260127067566,
+    "diagonal_ce": 0.8951094150543213,
+    "finite": 0.27607861161231995,
+    "endpoint_kl": 0.27587929368019104,
+    "temporal_derivative": 0.00019933230942115188
+  },
+  {
+    "step": 174,
+    "loss": 1.0952165126800537,
+    "diagonal_ce": 0.916511058807373,
+    "finite": 0.25529351830482483,
+    "endpoint_kl": 0.25514543056488037,
+    "temporal_derivative": 0.00014810124412178993
+  },
+  {
+    "step": 175,
+    "loss": 1.048609972000122,
+    "diagonal_ce": 0.8601927757263184,
+    "finite": 0.26763808727264404,
+    "endpoint_kl": 0.26750922203063965,
+    "temporal_derivative": 0.00012887746561318636
+  },
+  {
+    "step": 176,
+    "loss": 1.0990808010101318,
+    "diagonal_ce": 0.911076009273529,
+    "finite": 0.2655435800552368,
+    "endpoint_kl": 0.26539134979248047,
+    "temporal_derivative": 0.00015222580987028778
+  },
+  {
+    "step": 177,
+    "loss": 1.1061440706253052,
+    "diagonal_ce": 0.9307180047035217,
+    "finite": 0.2463849037885666,
+    "endpoint_kl": 0.2462739646434784,
+    "temporal_derivative": 0.00011093352804891765
+  },
+  {
+    "step": 178,
+    "loss": 1.0165090560913086,
+    "diagonal_ce": 0.8349846601486206,
+    "finite": 0.25352561473846436,
+    "endpoint_kl": 0.2534094452857971,
+    "temporal_derivative": 0.00011616491974564269
+  },
+  {
+    "step": 179,
+    "loss": 1.0072931051254272,
+    "diagonal_ce": 0.8186512589454651,
+    "finite": 0.2620026171207428,
+    "endpoint_kl": 0.2618483901023865,
+    "temporal_derivative": 0.000154222478158772
+  },
+  {
+    "step": 180,
+    "loss": 1.0661745071411133,
+    "diagonal_ce": 0.8517899513244629,
+    "finite": 0.2961113452911377,
+    "endpoint_kl": 0.2959953546524048,
+    "temporal_derivative": 0.00011599919525906444
+  },
+  {
+    "step": 181,
+    "loss": 0.9382820725440979,
+    "diagonal_ce": 0.7144222855567932,
+    "finite": 0.3074997067451477,
+    "endpoint_kl": 0.30736681818962097,
+    "temporal_derivative": 0.00013288736226968467
+  },
+  {
+    "step": 182,
+    "loss": 1.019436240196228,
+    "diagonal_ce": 0.8284291625022888,
+    "finite": 0.2609385848045349,
+    "endpoint_kl": 0.2608185112476349,
+    "temporal_derivative": 0.00012006337783532217
+  },
+  {
+    "step": 183,
+    "loss": 0.9781126379966736,
+    "diagonal_ce": 0.7882899045944214,
+    "finite": 0.2579112946987152,
+    "endpoint_kl": 0.2577785849571228,
+    "temporal_derivative": 0.00013271247735247016
+  },
+  {
+    "step": 184,
+    "loss": 1.0882928371429443,
+    "diagonal_ce": 0.9007250070571899,
+    "finite": 0.25347012281417847,
+    "endpoint_kl": 0.25330621004104614,
+    "temporal_derivative": 0.00016391600365750492
+  },
+  {
+    "step": 185,
+    "loss": 1.0920393466949463,
+    "diagonal_ce": 0.9098079204559326,
+    "finite": 0.24493467807769775,
+    "endpoint_kl": 0.24473704397678375,
+    "temporal_derivative": 0.00019763156888075173
+  },
+  {
+    "step": 186,
+    "loss": 0.9939064979553223,
+    "diagonal_ce": 0.8137807250022888,
+    "finite": 0.2408098727464676,
+    "endpoint_kl": 0.2406773716211319,
+    "temporal_derivative": 0.0001325054035987705
+  },
+  {
+    "step": 187,
+    "loss": 1.0504816770553589,
+    "diagonal_ce": 0.853303849697113,
+    "finite": 0.2622046172618866,
+    "endpoint_kl": 0.2620539963245392,
+    "temporal_derivative": 0.0001506316475570202
+  },
+  {
+    "step": 188,
+    "loss": 0.9871388077735901,
+    "diagonal_ce": 0.7670720815658569,
+    "finite": 0.2910935878753662,
+    "endpoint_kl": 0.29094165563583374,
+    "temporal_derivative": 0.000151933723827824
+  },
+  {
+    "step": 189,
+    "loss": 1.0968974828720093,
+    "diagonal_ce": 0.9302231073379517,
+    "finite": 0.21930833160877228,
+    "endpoint_kl": 0.21914911270141602,
+    "temporal_derivative": 0.00015921564772725105
+  },
+  {
+    "step": 190,
+    "loss": 0.9544996023178101,
+    "diagonal_ce": 0.7870709300041199,
+    "finite": 0.2191474586725235,
+    "endpoint_kl": 0.21901780366897583,
+    "temporal_derivative": 0.00012965181667823344
+  },
+  {
+    "step": 191,
+    "loss": 1.0441787242889404,
+    "diagonal_ce": 0.8769618272781372,
+    "finite": 0.21773041784763336,
+    "endpoint_kl": 0.21755445003509521,
+    "temporal_derivative": 0.00017596865654923022
+  },
+  {
+    "step": 192,
+    "loss": 1.0111545324325562,
+    "diagonal_ce": 0.8453695774078369,
+    "finite": 0.21474727988243103,
+    "endpoint_kl": 0.2145644724369049,
+    "temporal_derivative": 0.0001828141394071281
+  },
+  {
+    "step": 193,
+    "loss": 0.9334701299667358,
+    "diagonal_ce": 0.7588102221488953,
+    "finite": 0.22507716715335846,
+    "endpoint_kl": 0.22493618726730347,
+    "temporal_derivative": 0.00014098289830144495
+  },
+  {
+    "step": 194,
+    "loss": 0.9978575706481934,
+    "diagonal_ce": 0.8112563490867615,
+    "finite": 0.23923233151435852,
+    "endpoint_kl": 0.23908284306526184,
+    "temporal_derivative": 0.00014949195610824972
+  },
+  {
+    "step": 195,
+    "loss": 1.0343472957611084,
+    "diagonal_ce": 0.8648471832275391,
+    "finite": 0.21619917452335358,
+    "endpoint_kl": 0.2160172462463379,
+    "temporal_derivative": 0.0001819351891754195
+  },
+  {
+    "step": 196,
+    "loss": 1.0254420042037964,
+    "diagonal_ce": 0.8577360510826111,
+    "finite": 0.21282483637332916,
+    "endpoint_kl": 0.21264559030532837,
+    "temporal_derivative": 0.0001792396797100082
+  },
+  {
+    "step": 197,
+    "loss": 1.0678305625915527,
+    "diagonal_ce": 0.9075074791908264,
+    "finite": 0.2024282068014145,
+    "endpoint_kl": 0.20217932760715485,
+    "temporal_derivative": 0.0002488834725227207
+  },
+  {
+    "step": 198,
+    "loss": 1.1024113893508911,
+    "diagonal_ce": 0.933822512626648,
+    "finite": 0.2117951214313507,
+    "endpoint_kl": 0.21164357662200928,
+    "temporal_derivative": 0.00015154690481722355
+  },
+  {
+    "step": 199,
+    "loss": 0.9842629432678223,
+    "diagonal_ce": 0.8096986413002014,
+    "finite": 0.21820534765720367,
+    "endpoint_kl": 0.21795019507408142,
+    "temporal_derivative": 0.0002551525249145925
+  },
+  {
+    "step": 200,
+    "loss": 0.9348994493484497,
+    "diagonal_ce": 0.7501619458198547,
+    "finite": 0.22977297008037567,
+    "endpoint_kl": 0.22959120571613312,
+    "temporal_derivative": 0.00018176970479544252
+  },
+  {
+    "step": 201,
+    "loss": 1.044739842414856,
+    "diagonal_ce": 0.8449699878692627,
+    "finite": 0.2472398728132248,
+    "endpoint_kl": 0.2469678521156311,
+    "temporal_derivative": 0.00027202480123378336
+  },
+  {
+    "step": 202,
+    "loss": 1.0519016981124878,
+    "diagonal_ce": 0.8779082894325256,
+    "finite": 0.21427758038043976,
+    "endpoint_kl": 0.21399806439876556,
+    "temporal_derivative": 0.00027951880474574864
+  },
+  {
+    "step": 203,
+    "loss": 0.9672896265983582,
+    "diagonal_ce": 0.7765080332756042,
+    "finite": 0.2338009625673294,
+    "endpoint_kl": 0.23354807496070862,
+    "temporal_derivative": 0.00025289205950684845
+  },
+  {
+    "step": 204,
+    "loss": 1.0301530361175537,
+    "diagonal_ce": 0.859462320804596,
+    "finite": 0.20815947651863098,
+    "endpoint_kl": 0.20791620016098022,
+    "temporal_derivative": 0.00024327155551873147
+  },
+  {
+    "step": 205,
+    "loss": 0.9991276860237122,
+    "diagonal_ce": 0.8063660264015198,
+    "finite": 0.23393405973911285,
+    "endpoint_kl": 0.23361548781394958,
+    "temporal_derivative": 0.0003185713430866599
+  },
+  {
+    "step": 206,
+    "loss": 1.0378423929214478,
+    "diagonal_ce": 0.8571125864982605,
+    "finite": 0.21827273070812225,
+    "endpoint_kl": 0.2179311215877533,
+    "temporal_derivative": 0.0003416140389163047
+  },
+  {
+    "step": 207,
+    "loss": 1.0211310386657715,
+    "diagonal_ce": 0.8639443516731262,
+    "finite": 0.1889263242483139,
+    "endpoint_kl": 0.18849462270736694,
+    "temporal_derivative": 0.00043170625576749444
+  },
+  {
+    "step": 208,
+    "loss": 0.9759396314620972,
+    "diagonal_ce": 0.8068456649780273,
+    "finite": 0.20226548612117767,
+    "endpoint_kl": 0.2019558548927307,
+    "temporal_derivative": 0.0003096378641203046
+  },
+  {
+    "step": 209,
+    "loss": 1.054835557937622,
+    "diagonal_ce": 0.8897162675857544,
+    "finite": 0.19657066464424133,
+    "endpoint_kl": 0.1962112933397293,
+    "temporal_derivative": 0.00035936388303525746
+  },
+  {
+    "step": 210,
+    "loss": 0.9654353857040405,
+    "diagonal_ce": 0.8065531849861145,
+    "finite": 0.18824905157089233,
+    "endpoint_kl": 0.1877927929162979,
+    "temporal_derivative": 0.0004562575195450336
+  },
+  {
+    "step": 211,
+    "loss": 0.9841834306716919,
+    "diagonal_ce": 0.8313321471214294,
+    "finite": 0.1802491396665573,
+    "endpoint_kl": 0.17984013259410858,
+    "temporal_derivative": 0.00040900197927840054
+  },
+  {
+    "step": 212,
+    "loss": 1.0457412004470825,
+    "diagonal_ce": 0.8833876252174377,
+    "finite": 0.19055578112602234,
+    "endpoint_kl": 0.19010084867477417,
+    "temporal_derivative": 0.0004549362347461283
+  },
+  {
+    "step": 213,
+    "loss": 0.9376353025436401,
+    "diagonal_ce": 0.7672415375709534,
+    "finite": 0.19905810058116913,
+    "endpoint_kl": 0.1985754668712616,
+    "temporal_derivative": 0.00048264075303450227
+  },
+  {
+    "step": 214,
+    "loss": 0.9712674021720886,
+    "diagonal_ce": 0.7972973585128784,
+    "finite": 0.20229075849056244,
+    "endpoint_kl": 0.20186883211135864,
+    "temporal_derivative": 0.0004219226830173284
+  },
+  {
+    "step": 215,
+    "loss": 0.9914159178733826,
+    "diagonal_ce": 0.8219495415687561,
+    "finite": 0.19614163041114807,
+    "endpoint_kl": 0.19569066166877747,
+    "temporal_derivative": 0.00045096807298250496
+  },
+  {
+    "step": 216,
+    "loss": 1.0126341581344604,
+    "diagonal_ce": 0.8653546571731567,
+    "finite": 0.16967684030532837,
+    "endpoint_kl": 0.16923809051513672,
+    "temporal_derivative": 0.00043875142000615597
+  },
+  {
+    "step": 217,
+    "loss": 0.9710862636566162,
+    "diagonal_ce": 0.8083415031433105,
+    "finite": 0.1866338700056076,
+    "endpoint_kl": 0.18607240915298462,
+    "temporal_derivative": 0.000561457360163331
+  },
+  {
+    "step": 218,
+    "loss": 1.0620404481887817,
+    "diagonal_ce": 0.9203281402587891,
+    "finite": 0.1617720127105713,
+    "endpoint_kl": 0.16126026213169098,
+    "temporal_derivative": 0.0005117469117976725
+  },
+  {
+    "step": 219,
+    "loss": 0.9511362910270691,
+    "diagonal_ce": 0.800337016582489,
+    "finite": 0.17136278748512268,
+    "endpoint_kl": 0.1709303855895996,
+    "temporal_derivative": 0.0004324070177972317
+  },
+  {
+    "step": 220,
+    "loss": 0.9920287132263184,
+    "diagonal_ce": 0.8192179799079895,
+    "finite": 0.19548729062080383,
+    "endpoint_kl": 0.19509106874465942,
+    "temporal_derivative": 0.0003962155315093696
+  },
+  {
+    "step": 221,
+    "loss": 0.9943539500236511,
+    "diagonal_ce": 0.8560267090797424,
+    "finite": 0.15577392280101776,
+    "endpoint_kl": 0.1551838517189026,
+    "temporal_derivative": 0.0005900656105950475
+  },
+  {
+    "step": 222,
+    "loss": 0.9769794940948486,
+    "diagonal_ce": 0.8317676782608032,
+    "finite": 0.16279350221157074,
+    "endpoint_kl": 0.16233354806900024,
+    "temporal_derivative": 0.00045996037079021335
+  },
+  {
+    "step": 223,
+    "loss": 0.993228018283844,
+    "diagonal_ce": 0.8457832932472229,
+    "finite": 0.16455882787704468,
+    "endpoint_kl": 0.1639915257692337,
+    "temporal_derivative": 0.0005673019331879914
+  },
+  {
+    "step": 224,
+    "loss": 1.034408450126648,
+    "diagonal_ce": 0.8857126235961914,
+    "finite": 0.1652175933122635,
+    "endpoint_kl": 0.16454318165779114,
+    "temporal_derivative": 0.000674418406561017
+  },
+  {
+    "step": 225,
+    "loss": 1.0861016511917114,
+    "diagonal_ce": 0.9406200051307678,
+    "finite": 0.1609310507774353,
+    "endpoint_kl": 0.16018225252628326,
+    "temporal_derivative": 0.0007488008122891188
+  },
+  {
+    "step": 226,
+    "loss": 0.8771263360977173,
+    "diagonal_ce": 0.7134262919425964,
+    "finite": 0.18028639256954193,
+    "endpoint_kl": 0.17966078221797943,
+    "temporal_derivative": 0.000625616405159235
+  },
+  {
+    "step": 227,
+    "loss": 0.9876677989959717,
+    "diagonal_ce": 0.8342651128768921,
+    "finite": 0.16820469498634338,
+    "endpoint_kl": 0.16752555966377258,
+    "temporal_derivative": 0.0006791353225708008
+  },
+  {
+    "step": 228,
+    "loss": 1.142808198928833,
+    "diagonal_ce": 1.011785626411438,
+    "finite": 0.14303769171237946,
+    "endpoint_kl": 0.14206404983997345,
+    "temporal_derivative": 0.0009736374486237764
+  },
+  {
+    "step": 229,
+    "loss": 0.9260462522506714,
+    "diagonal_ce": 0.7819651961326599,
+    "finite": 0.15660981833934784,
+    "endpoint_kl": 0.1557874232530594,
+    "temporal_derivative": 0.000822397880256176
+  },
+  {
+    "step": 230,
+    "loss": 0.8859699964523315,
+    "diagonal_ce": 0.736366331577301,
+    "finite": 0.16190876066684723,
+    "endpoint_kl": 0.16108305752277374,
+    "temporal_derivative": 0.0008257072186097503
+  },
+  {
+    "step": 231,
+    "loss": 1.0498230457305908,
+    "diagonal_ce": 0.9005999565124512,
+    "finite": 0.1608007848262787,
+    "endpoint_kl": 0.15987123548984528,
+    "temporal_derivative": 0.0009295441559515893
+  },
+  {
+    "step": 232,
+    "loss": 0.901606559753418,
+    "diagonal_ce": 0.7474430203437805,
+    "finite": 0.1654115468263626,
+    "endpoint_kl": 0.1647835075855255,
+    "temporal_derivative": 0.0006280398229137063
+  },
+  {
+    "step": 233,
+    "loss": 1.0533850193023682,
+    "diagonal_ce": 0.9175576567649841,
+    "finite": 0.14511466026306152,
+    "endpoint_kl": 0.14412014186382294,
+    "temporal_derivative": 0.0009945122292265296
+  },
+  {
+    "step": 234,
+    "loss": 0.8639596700668335,
+    "diagonal_ce": 0.7087271213531494,
+    "finite": 0.16514098644256592,
+    "endpoint_kl": 0.16447731852531433,
+    "temporal_derivative": 0.000663667160551995
+  },
+  {
+    "step": 235,
+    "loss": 0.9339244365692139,
+    "diagonal_ce": 0.7969692349433899,
+    "finite": 0.14507964253425598,
+    "endpoint_kl": 0.1441473662853241,
+    "temporal_derivative": 0.0009322824189439416
+  },
+  {
+    "step": 236,
+    "loss": 0.9648762345314026,
+    "diagonal_ce": 0.827559769153595,
+    "finite": 0.14484857022762299,
+    "endpoint_kl": 0.14384248852729797,
+    "temporal_derivative": 0.0010060754138976336
+  },
+  {
+    "step": 237,
+    "loss": 0.976783275604248,
+    "diagonal_ce": 0.8275866508483887,
+    "finite": 0.1567191183567047,
+    "endpoint_kl": 0.15584295988082886,
+    "temporal_derivative": 0.0008761528297327459
+  },
+  {
+    "step": 238,
+    "loss": 0.9206424355506897,
+    "diagonal_ce": 0.7951909899711609,
+    "finite": 0.1312253624200821,
+    "endpoint_kl": 0.1302853524684906,
+    "temporal_derivative": 0.0009400141425430775
+  },
+  {
+    "step": 239,
+    "loss": 0.9334163069725037,
+    "diagonal_ce": 0.7921778559684753,
+    "finite": 0.14712339639663696,
+    "endpoint_kl": 0.14595380425453186,
+    "temporal_derivative": 0.0011695962166413665
+  },
+  {
+    "step": 240,
+    "loss": 0.9892807006835938,
+    "diagonal_ce": 0.8489158153533936,
+    "finite": 0.14560671150684357,
+    "endpoint_kl": 0.1446576714515686,
+    "temporal_derivative": 0.0009490414522588253
+  },
+  {
+    "step": 241,
+    "loss": 0.9076331257820129,
+    "diagonal_ce": 0.7716941237449646,
+    "finite": 0.14043283462524414,
+    "endpoint_kl": 0.13947993516921997,
+    "temporal_derivative": 0.0009528977097943425
+  },
+  {
+    "step": 242,
+    "loss": 0.8933529257774353,
+    "diagonal_ce": 0.7748848795890808,
+    "finite": 0.12188071012496948,
+    "endpoint_kl": 0.12079939246177673,
+    "temporal_derivative": 0.0010813212720677257
+  },
+  {
+    "step": 243,
+    "loss": 0.9463752508163452,
+    "diagonal_ce": 0.8096158504486084,
+    "finite": 0.14012235403060913,
+    "endpoint_kl": 0.13905170559883118,
+    "temporal_derivative": 0.0010706426110118628
+  },
+  {
+    "step": 244,
+    "loss": 0.9372751116752625,
+    "diagonal_ce": 0.7945134043693542,
+    "finite": 0.14567522704601288,
+    "endpoint_kl": 0.1446695774793625,
+    "temporal_derivative": 0.0010056453756988049
+  },
+  {
+    "step": 245,
+    "loss": 0.9118030667304993,
+    "diagonal_ce": 0.7669032216072083,
+    "finite": 0.14725594222545624,
+    "endpoint_kl": 0.14614278078079224,
+    "temporal_derivative": 0.0011131585342809558
+  },
+  {
+    "step": 246,
+    "loss": 0.8846776485443115,
+    "diagonal_ce": 0.7410175204277039,
+    "finite": 0.14540502429008484,
+    "endpoint_kl": 0.1443624496459961,
+    "temporal_derivative": 0.0010425691725686193
+  },
+  {
+    "step": 247,
+    "loss": 0.8693007230758667,
+    "diagonal_ce": 0.7333598732948303,
+    "finite": 0.13703712821006775,
+    "endpoint_kl": 0.13582244515419006,
+    "temporal_derivative": 0.0012146772351115942
+  },
+  {
+    "step": 248,
+    "loss": 0.9313544631004333,
+    "diagonal_ce": 0.8022976517677307,
+    "finite": 0.12957510352134705,
+    "endpoint_kl": 0.1283237487077713,
+    "temporal_derivative": 0.0012513542314991355
+  },
+  {
+    "step": 249,
+    "loss": 0.8563617467880249,
+    "diagonal_ce": 0.7127383947372437,
+    "finite": 0.14362335205078125,
+    "endpoint_kl": 0.1425091177225113,
+    "temporal_derivative": 0.001114238752052188
+  },
+  {
+    "step": 250,
+    "loss": 0.9981943368911743,
+    "diagonal_ce": 0.8798519372940063,
+    "finite": 0.11834242194890976,
+    "endpoint_kl": 0.1168321967124939,
+    "temporal_derivative": 0.0015102236066013575
+  },
+  {
+    "step": 251,
+    "loss": 0.9219728112220764,
+    "diagonal_ce": 0.8009999394416809,
+    "finite": 0.12097285687923431,
+    "endpoint_kl": 0.11964704841375351,
+    "temporal_derivative": 0.0013258083490654826
+  },
+  {
+    "step": 252,
+    "loss": 0.8436810374259949,
+    "diagonal_ce": 0.7198320627212524,
+    "finite": 0.12384897470474243,
+    "endpoint_kl": 0.12256253510713577,
+    "temporal_derivative": 0.001286436920054257
+  },
+  {
+    "step": 253,
+    "loss": 0.8369506001472473,
+    "diagonal_ce": 0.7177110910415649,
+    "finite": 0.11923949420452118,
+    "endpoint_kl": 0.117681585252285,
+    "temporal_derivative": 0.0015579083701595664
+  },
+  {
+    "step": 254,
+    "loss": 0.9933238625526428,
+    "diagonal_ce": 0.8745419383049011,
+    "finite": 0.1187819093465805,
+    "endpoint_kl": 0.11745459586381912,
+    "temporal_derivative": 0.001327310805208981
+  },
+  {
+    "step": 255,
+    "loss": 0.9136381149291992,
+    "diagonal_ce": 0.7945030331611633,
+    "finite": 0.1191350519657135,
+    "endpoint_kl": 0.11722363531589508,
+    "temporal_derivative": 0.0019114180468022823
+  },
+  {
+    "step": 256,
+    "loss": 0.8799439072608948,
+    "diagonal_ce": 0.7692962884902954,
+    "finite": 0.11064762622117996,
+    "endpoint_kl": 0.10909728705883026,
+    "temporal_derivative": 0.0015503359027206898
+  },
+  {
+    "step": 257,
+    "loss": 0.9516653418540955,
+    "diagonal_ce": 0.8443530201911926,
+    "finite": 0.10731230676174164,
+    "endpoint_kl": 0.10589675605297089,
+    "temporal_derivative": 0.001415553968399763
+  },
+  {
+    "step": 258,
+    "loss": 0.9059234857559204,
+    "diagonal_ce": 0.8023149967193604,
+    "finite": 0.10360848903656006,
+    "endpoint_kl": 0.1023307591676712,
+    "temporal_derivative": 0.0012777317315340042
+  },
+  {
+    "step": 259,
+    "loss": 0.8617986440658569,
+    "diagonal_ce": 0.7484579086303711,
+    "finite": 0.11334070563316345,
+    "endpoint_kl": 0.11218637228012085,
+    "temporal_derivative": 0.0011543321888893843
+  },
+  {
+    "step": 260,
+    "loss": 0.9345880746841431,
+    "diagonal_ce": 0.8316216468811035,
+    "finite": 0.10296644270420074,
+    "endpoint_kl": 0.10161609202623367,
+    "temporal_derivative": 0.0013503488153219223
+  },
+  {
+    "step": 261,
+    "loss": 0.9375894069671631,
+    "diagonal_ce": 0.8245556950569153,
+    "finite": 0.1130337193608284,
+    "endpoint_kl": 0.11151023954153061,
+    "temporal_derivative": 0.0015234769089147449
+  },
+  {
+    "step": 262,
+    "loss": 0.9119080901145935,
+    "diagonal_ce": 0.7923997044563293,
+    "finite": 0.11950840801000595,
+    "endpoint_kl": 0.11801460385322571,
+    "temporal_derivative": 0.0014938024105504155
+  },
+  {
+    "step": 263,
+    "loss": 0.921541154384613,
+    "diagonal_ce": 0.7947967052459717,
+    "finite": 0.12674444913864136,
+    "endpoint_kl": 0.12540185451507568,
+    "temporal_derivative": 0.0013425878714770079
+  },
+  {
+    "step": 264,
+    "loss": 0.7985232472419739,
+    "diagonal_ce": 0.6810199022293091,
+    "finite": 0.11750335246324539,
+    "endpoint_kl": 0.116231270134449,
+    "temporal_derivative": 0.0012720818631350994
+  },
+  {
+    "step": 265,
+    "loss": 0.9425687193870544,
+    "diagonal_ce": 0.8121451735496521,
+    "finite": 0.13042354583740234,
+    "endpoint_kl": 0.128434956073761,
+    "temporal_derivative": 0.001988586038351059
+  },
+  {
+    "step": 266,
+    "loss": 0.987080454826355,
+    "diagonal_ce": 0.8747987747192383,
+    "finite": 0.11228165775537491,
+    "endpoint_kl": 0.11070370674133301,
+    "temporal_derivative": 0.001577948685735464
+  },
+  {
+    "step": 267,
+    "loss": 0.9509218335151672,
+    "diagonal_ce": 0.835095226764679,
+    "finite": 0.11582662910223007,
+    "endpoint_kl": 0.11405966430902481,
+    "temporal_derivative": 0.0017669653752818704
+  },
+  {
+    "step": 268,
+    "loss": 1.016595482826233,
+    "diagonal_ce": 0.9020978212356567,
+    "finite": 0.11449763923883438,
+    "endpoint_kl": 0.11305659264326096,
+    "temporal_derivative": 0.0014410477597266436
+  },
+  {
+    "step": 269,
+    "loss": 0.8682677149772644,
+    "diagonal_ce": 0.7506383061408997,
+    "finite": 0.11762940883636475,
+    "endpoint_kl": 0.11605460196733475,
+    "temporal_derivative": 0.0015748079167678952
+  },
+  {
+    "step": 270,
+    "loss": 0.8779438138008118,
+    "diagonal_ce": 0.7538718581199646,
+    "finite": 0.12407193332910538,
+    "endpoint_kl": 0.12223897129297256,
+    "temporal_derivative": 0.0018329632002860308
+  },
+  {
+    "step": 271,
+    "loss": 0.8354343771934509,
+    "diagonal_ce": 0.7225522398948669,
+    "finite": 0.11288212984800339,
+    "endpoint_kl": 0.11098570376634598,
+    "temporal_derivative": 0.0018964254995808005
+  },
+  {
+    "step": 272,
+    "loss": 0.8556299805641174,
+    "diagonal_ce": 0.7381468415260315,
+    "finite": 0.11748311668634415,
+    "endpoint_kl": 0.1157422885298729,
+    "temporal_derivative": 0.0017408267594873905
+  },
+  {
+    "step": 273,
+    "loss": 0.9942119121551514,
+    "diagonal_ce": 0.8797550797462463,
+    "finite": 0.11445684731006622,
+    "endpoint_kl": 0.11232192814350128,
+    "temporal_derivative": 0.002134918235242367
+  },
+  {
+    "step": 274,
+    "loss": 0.8538438081741333,
+    "diagonal_ce": 0.7508320212364197,
+    "finite": 0.10301180183887482,
+    "endpoint_kl": 0.10109728574752808,
+    "temporal_derivative": 0.001914518652483821
+  },
+  {
+    "step": 275,
+    "loss": 0.8758823871612549,
+    "diagonal_ce": 0.7792089581489563,
+    "finite": 0.09667344391345978,
+    "endpoint_kl": 0.09476866573095322,
+    "temporal_derivative": 0.0019047744572162628
+  },
+  {
+    "step": 276,
+    "loss": 0.8670420050621033,
+    "diagonal_ce": 0.7630859017372131,
+    "finite": 0.10395608097314835,
+    "endpoint_kl": 0.1022702008485794,
+    "temporal_derivative": 0.0016858805902302265
+  },
+  {
+    "step": 277,
+    "loss": 0.8790938854217529,
+    "diagonal_ce": 0.7803546190261841,
+    "finite": 0.09873928129673004,
+    "endpoint_kl": 0.09680406749248505,
+    "temporal_derivative": 0.0019352162489667535
+  },
+  {
+    "step": 278,
+    "loss": 0.9512697458267212,
+    "diagonal_ce": 0.8555622696876526,
+    "finite": 0.0957074835896492,
+    "endpoint_kl": 0.09368567913770676,
+    "temporal_derivative": 0.002021803753450513
+  },
+  {
+    "step": 279,
+    "loss": 0.881476104259491,
+    "diagonal_ce": 0.7841536998748779,
+    "finite": 0.09732240438461304,
+    "endpoint_kl": 0.09566861391067505,
+    "temporal_derivative": 0.001653790706768632
+  },
+  {
+    "step": 280,
+    "loss": 0.8080086708068848,
+    "diagonal_ce": 0.7217779755592346,
+    "finite": 0.08623068779706955,
+    "endpoint_kl": 0.08456457406282425,
+    "temporal_derivative": 0.0016661169938743114
+  },
+  {
+    "step": 281,
+    "loss": 0.9494205117225647,
+    "diagonal_ce": 0.8632472157478333,
+    "finite": 0.08617327362298965,
+    "endpoint_kl": 0.08410649001598358,
+    "temporal_derivative": 0.002066780347377062
+  },
+  {
+    "step": 282,
+    "loss": 0.8629012703895569,
+    "diagonal_ce": 0.7657865285873413,
+    "finite": 0.09711475670337677,
+    "endpoint_kl": 0.09455860406160355,
+    "temporal_derivative": 0.002556150546297431
+  },
+  {
+    "step": 283,
+    "loss": 0.8414885997772217,
+    "diagonal_ce": 0.7447023987770081,
+    "finite": 0.09678623080253601,
+    "endpoint_kl": 0.09531401097774506,
+    "temporal_derivative": 0.0014722197083756328
+  },
+  {
+    "step": 284,
+    "loss": 0.8157846331596375,
+    "diagonal_ce": 0.7257735729217529,
+    "finite": 0.09001107513904572,
+    "endpoint_kl": 0.08832951635122299,
+    "temporal_derivative": 0.0016815605340525508
+  },
+  {
+    "step": 285,
+    "loss": 0.8551137447357178,
+    "diagonal_ce": 0.7611475586891174,
+    "finite": 0.09396620839834213,
+    "endpoint_kl": 0.09189271181821823,
+    "temporal_derivative": 0.002073494717478752
+  },
+  {
+    "step": 286,
+    "loss": 0.8198992013931274,
+    "diagonal_ce": 0.7317247986793518,
+    "finite": 0.08817438781261444,
+    "endpoint_kl": 0.08603005856275558,
+    "temporal_derivative": 0.0021443264558911324
+  },
+  {
+    "step": 287,
+    "loss": 0.8882602453231812,
+    "diagonal_ce": 0.7996184229850769,
+    "finite": 0.08864180743694305,
+    "endpoint_kl": 0.08649920672178268,
+    "temporal_derivative": 0.0021426044404506683
+  },
+  {
+    "step": 288,
+    "loss": 0.8139827251434326,
+    "diagonal_ce": 0.7105043530464172,
+    "finite": 0.103478342294693,
+    "endpoint_kl": 0.10163746029138565,
+    "temporal_derivative": 0.0018408807227388024
+  },
+  {
+    "step": 289,
+    "loss": 0.8474793434143066,
+    "diagonal_ce": 0.7591192126274109,
+    "finite": 0.08836011588573456,
+    "endpoint_kl": 0.08672528713941574,
+    "temporal_derivative": 0.0016348307253792882
+  },
+  {
+    "step": 290,
+    "loss": 0.8045124411582947,
+    "diagonal_ce": 0.7110514640808105,
+    "finite": 0.09346095472574234,
+    "endpoint_kl": 0.0917578861117363,
+    "temporal_derivative": 0.001703066984191537
+  },
+  {
+    "step": 291,
+    "loss": 0.875935435295105,
+    "diagonal_ce": 0.7766366600990295,
+    "finite": 0.09929878264665604,
+    "endpoint_kl": 0.09697885066270828,
+    "temporal_derivative": 0.002319930586963892
+  },
+  {
+    "step": 292,
+    "loss": 1.0013368129730225,
+    "diagonal_ce": 0.9005983471870422,
+    "finite": 0.1007385104894638,
+    "endpoint_kl": 0.09852702915668488,
+    "temporal_derivative": 0.002211481798440218
+  },
+  {
+    "step": 293,
+    "loss": 0.8104107975959778,
+    "diagonal_ce": 0.7180766463279724,
+    "finite": 0.09233416616916656,
+    "endpoint_kl": 0.09032763540744781,
+    "temporal_derivative": 0.0020065291319042444
+  },
+  {
+    "step": 294,
+    "loss": 0.8613682389259338,
+    "diagonal_ce": 0.7713143825531006,
+    "finite": 0.09005386382341385,
+    "endpoint_kl": 0.08715235441923141,
+    "temporal_derivative": 0.002901506843045354
+  },
+  {
+    "step": 295,
+    "loss": 0.881777286529541,
+    "diagonal_ce": 0.785130500793457,
+    "finite": 0.09664680063724518,
+    "endpoint_kl": 0.09425579756498337,
+    "temporal_derivative": 0.0023910023737698793
+  },
+  {
+    "step": 296,
+    "loss": 0.7644721865653992,
+    "diagonal_ce": 0.673441469669342,
+    "finite": 0.09103070944547653,
+    "endpoint_kl": 0.08900703489780426,
+    "temporal_derivative": 0.0020236726850271225
+  },
+  {
+    "step": 297,
+    "loss": 0.8235813975334167,
+    "diagonal_ce": 0.7439236640930176,
+    "finite": 0.07965773344039917,
+    "endpoint_kl": 0.07748696208000183,
+    "temporal_derivative": 0.0021707734558731318
+  },
+  {
+    "step": 298,
+    "loss": 0.7926826477050781,
+    "diagonal_ce": 0.6930114030838013,
+    "finite": 0.09967122226953506,
+    "endpoint_kl": 0.09759768098592758,
+    "temporal_derivative": 0.0020735403522849083
+  },
+  {
+    "step": 299,
+    "loss": 0.7375147938728333,
+    "diagonal_ce": 0.6299781799316406,
+    "finite": 0.10753659158945084,
+    "endpoint_kl": 0.1062517985701561,
+    "temporal_derivative": 0.0012847912730649114
+  },
+  {
+    "step": 300,
+    "loss": 0.7121520042419434,
+    "diagonal_ce": 0.6157501935958862,
+    "finite": 0.09640181064605713,
+    "endpoint_kl": 0.09479618817567825,
+    "temporal_derivative": 0.0016056246822699904
+  },
+  {
+    "step": 301,
+    "loss": 0.9451065063476562,
+    "diagonal_ce": 0.8536471724510193,
+    "finite": 0.09145932644605637,
+    "endpoint_kl": 0.0891033336520195,
+    "temporal_derivative": 0.0023559927940368652
+  },
+  {
+    "step": 302,
+    "loss": 0.8501521348953247,
+    "diagonal_ce": 0.7649291157722473,
+    "finite": 0.08522304147481918,
+    "endpoint_kl": 0.08289195597171783,
+    "temporal_derivative": 0.002331086667254567
+  },
+  {
+    "step": 303,
+    "loss": 0.8895474076271057,
+    "diagonal_ce": 0.7954803705215454,
+    "finite": 0.09406702220439911,
+    "endpoint_kl": 0.09219861030578613,
+    "temporal_derivative": 0.0018684144597500563
+  },
+  {
+    "step": 304,
+    "loss": 0.931648313999176,
+    "diagonal_ce": 0.8506463170051575,
+    "finite": 0.08100197464227676,
+    "endpoint_kl": 0.0785268247127533,
+    "temporal_derivative": 0.0024751476012170315
+  },
+  {
+    "step": 305,
+    "loss": 0.8570618629455566,
+    "diagonal_ce": 0.7782818078994751,
+    "finite": 0.07878004759550095,
+    "endpoint_kl": 0.07630790024995804,
+    "temporal_derivative": 0.002472145948559046
+  },
+  {
+    "step": 306,
+    "loss": 0.8737565875053406,
+    "diagonal_ce": 0.7935843467712402,
+    "finite": 0.08017226308584213,
+    "endpoint_kl": 0.07739369571208954,
+    "temporal_derivative": 0.002778567373752594
+  },
+  {
+    "step": 307,
+    "loss": 0.7656666040420532,
+    "diagonal_ce": 0.6828540563583374,
+    "finite": 0.08281255513429642,
+    "endpoint_kl": 0.08052818477153778,
+    "temporal_derivative": 0.0022843703627586365
+  },
+  {
+    "step": 308,
+    "loss": 0.8634397983551025,
+    "diagonal_ce": 0.7767010927200317,
+    "finite": 0.08673872798681259,
+    "endpoint_kl": 0.0840117484331131,
+    "temporal_derivative": 0.002726977923884988
+  },
+  {
+    "step": 309,
+    "loss": 0.8405067324638367,
+    "diagonal_ce": 0.7532230019569397,
+    "finite": 0.08728374540805817,
+    "endpoint_kl": 0.08482678234577179,
+    "temporal_derivative": 0.0024569653905928135
+  },
+  {
+    "step": 310,
+    "loss": 0.8247793912887573,
+    "diagonal_ce": 0.7375202775001526,
+    "finite": 0.08725909888744354,
+    "endpoint_kl": 0.08493202179670334,
+    "temporal_derivative": 0.0023270752280950546
+  },
+  {
+    "step": 311,
+    "loss": 0.8290766477584839,
+    "diagonal_ce": 0.7545825242996216,
+    "finite": 0.07449411600828171,
+    "endpoint_kl": 0.07197394967079163,
+    "temporal_derivative": 0.002520166803151369
+  },
+  {
+    "step": 312,
+    "loss": 0.7923851013183594,
+    "diagonal_ce": 0.7157971858978271,
+    "finite": 0.07658791542053223,
+    "endpoint_kl": 0.07425141334533691,
+    "temporal_derivative": 0.002336499048396945
+  },
+  {
+    "step": 313,
+    "loss": 0.8220607042312622,
+    "diagonal_ce": 0.7409694790840149,
+    "finite": 0.08109120279550552,
+    "endpoint_kl": 0.07827255129814148,
+    "temporal_derivative": 0.0028186540585011244
+  },
+  {
+    "step": 314,
+    "loss": 0.8500024080276489,
+    "diagonal_ce": 0.7791414260864258,
+    "finite": 0.07086101174354553,
+    "endpoint_kl": 0.06886760890483856,
+    "temporal_derivative": 0.001993403770029545
+  },
+  {
+    "step": 315,
+    "loss": 0.8394320011138916,
+    "diagonal_ce": 0.763312816619873,
+    "finite": 0.07611916214227676,
+    "endpoint_kl": 0.07441546767950058,
+    "temporal_derivative": 0.0017036936478689313
+  },
+  {
+    "step": 316,
+    "loss": 0.770973265171051,
+    "diagonal_ce": 0.6950976848602295,
+    "finite": 0.07587559521198273,
+    "endpoint_kl": 0.07327265292406082,
+    "temporal_derivative": 0.0026029387954622507
+  },
+  {
+    "step": 317,
+    "loss": 0.7387653589248657,
+    "diagonal_ce": 0.6533214449882507,
+    "finite": 0.08544391393661499,
+    "endpoint_kl": 0.08278743922710419,
+    "temporal_derivative": 0.002656474942341447
+  },
+  {
+    "step": 318,
+    "loss": 0.820645272731781,
+    "diagonal_ce": 0.7480201125144958,
+    "finite": 0.07262516021728516,
+    "endpoint_kl": 0.07054199278354645,
+    "temporal_derivative": 0.0020831655710935593
+  },
+  {
+    "step": 319,
+    "loss": 0.8939384818077087,
+    "diagonal_ce": 0.8107317686080933,
+    "finite": 0.08320670574903488,
+    "endpoint_kl": 0.08068183809518814,
+    "temporal_derivative": 0.002524866256862879
+  },
+  {
+    "step": 320,
+    "loss": 0.8820970058441162,
+    "diagonal_ce": 0.8075045943260193,
+    "finite": 0.07459241896867752,
+    "endpoint_kl": 0.07197578996419907,
+    "temporal_derivative": 0.002616632031276822
+  },
+  {
+    "step": 321,
+    "loss": 0.805249035358429,
+    "diagonal_ce": 0.7343462109565735,
+    "finite": 0.07090280950069427,
+    "endpoint_kl": 0.06905925273895264,
+    "temporal_derivative": 0.0018435590900480747
+  },
+  {
+    "step": 322,
+    "loss": 0.7174094915390015,
+    "diagonal_ce": 0.6422041654586792,
+    "finite": 0.07520529627799988,
+    "endpoint_kl": 0.07261671125888824,
+    "temporal_derivative": 0.002588583156466484
+  },
+  {
+    "step": 323,
+    "loss": 0.7811542749404907,
+    "diagonal_ce": 0.7029714584350586,
+    "finite": 0.07818280905485153,
+    "endpoint_kl": 0.07634813338518143,
+    "temporal_derivative": 0.0018346731085330248
+  },
+  {
+    "step": 324,
+    "loss": 0.7493395209312439,
+    "diagonal_ce": 0.6701932549476624,
+    "finite": 0.07914625108242035,
+    "endpoint_kl": 0.07737073302268982,
+    "temporal_derivative": 0.0017755161970853806
+  },
+  {
+    "step": 325,
+    "loss": 0.715337336063385,
+    "diagonal_ce": 0.6382465958595276,
+    "finite": 0.07709074765443802,
+    "endpoint_kl": 0.07521064579486847,
+    "temporal_derivative": 0.0018801006954163313
+  },
+  {
+    "step": 326,
+    "loss": 0.8676803708076477,
+    "diagonal_ce": 0.7918447852134705,
+    "finite": 0.07583556324243546,
+    "endpoint_kl": 0.07318360358476639,
+    "temporal_derivative": 0.00265195919200778
+  },
+  {
+    "step": 327,
+    "loss": 0.8167669177055359,
+    "diagonal_ce": 0.7449983954429626,
+    "finite": 0.07176849991083145,
+    "endpoint_kl": 0.06992476433515549,
+    "temporal_derivative": 0.0018437389517202973
+  },
+  {
+    "step": 328,
+    "loss": 0.7330433130264282,
+    "diagonal_ce": 0.6638765335083008,
+    "finite": 0.06916678696870804,
+    "endpoint_kl": 0.06675054877996445,
+    "temporal_derivative": 0.0024162381887435913
+  },
+  {
+    "step": 329,
+    "loss": 0.8944128751754761,
+    "diagonal_ce": 0.8311986923217773,
+    "finite": 0.06321418285369873,
+    "endpoint_kl": 0.0600905641913414,
+    "temporal_derivative": 0.0031236184295266867
+  },
+  {
+    "step": 330,
+    "loss": 0.7488818168640137,
+    "diagonal_ce": 0.6781809329986572,
+    "finite": 0.07070086151361465,
+    "endpoint_kl": 0.0691903680562973,
+    "temporal_derivative": 0.001510495669208467
+  },
+  {
+    "step": 331,
+    "loss": 0.7581610083580017,
+    "diagonal_ce": 0.6889145970344543,
+    "finite": 0.06924638897180557,
+    "endpoint_kl": 0.06676160544157028,
+    "temporal_derivative": 0.002484782598912716
+  },
+  {
+    "step": 332,
+    "loss": 0.8156896829605103,
+    "diagonal_ce": 0.743793249130249,
+    "finite": 0.07189640402793884,
+    "endpoint_kl": 0.06925786286592484,
+    "temporal_derivative": 0.0026385397650301456
+  },
+  {
+    "step": 333,
+    "loss": 0.8020992279052734,
+    "diagonal_ce": 0.7300860285758972,
+    "finite": 0.07201318442821503,
+    "endpoint_kl": 0.0691826194524765,
+    "temporal_derivative": 0.002830561250448227
+  },
+  {
+    "step": 334,
+    "loss": 0.88006991147995,
+    "diagonal_ce": 0.8161344528198242,
+    "finite": 0.06393544375896454,
+    "endpoint_kl": 0.060963649302721024,
+    "temporal_derivative": 0.0029717967845499516
+  },
+  {
+    "step": 335,
+    "loss": 0.692974865436554,
+    "diagonal_ce": 0.6255702972412109,
+    "finite": 0.06740459054708481,
+    "endpoint_kl": 0.06544768065214157,
+    "temporal_derivative": 0.0019569075666368008
+  },
+  {
+    "step": 336,
+    "loss": 0.7024202346801758,
+    "diagonal_ce": 0.6356932520866394,
+    "finite": 0.06672695279121399,
+    "endpoint_kl": 0.06466184556484222,
+    "temporal_derivative": 0.0020651088561862707
+  },
+  {
+    "step": 337,
+    "loss": 0.8106465935707092,
+    "diagonal_ce": 0.749203622341156,
+    "finite": 0.06144294887781143,
+    "endpoint_kl": 0.058745965361595154,
+    "temporal_derivative": 0.002696982817724347
+  },
+  {
+    "step": 338,
+    "loss": 0.776925802230835,
+    "diagonal_ce": 0.7092796564102173,
+    "finite": 0.06764612346887589,
+    "endpoint_kl": 0.06545485556125641,
+    "temporal_derivative": 0.002191264647990465
+  },
+  {
+    "step": 339,
+    "loss": 0.7533921599388123,
+    "diagonal_ce": 0.6891747117042542,
+    "finite": 0.0642174631357193,
+    "endpoint_kl": 0.06189394369721413,
+    "temporal_derivative": 0.0023235208354890347
+  },
+  {
+    "step": 340,
+    "loss": 0.7847169041633606,
+    "diagonal_ce": 0.721679151058197,
+    "finite": 0.06303777545690536,
+    "endpoint_kl": 0.06050172075629234,
+    "temporal_derivative": 0.002536054467782378
+  },
+  {
+    "step": 341,
+    "loss": 0.842780590057373,
+    "diagonal_ce": 0.7722103595733643,
+    "finite": 0.07057023048400879,
+    "endpoint_kl": 0.06725535541772842,
+    "temporal_derivative": 0.0033148787915706635
+  },
+  {
+    "step": 342,
+    "loss": 0.7150567770004272,
+    "diagonal_ce": 0.6468321084976196,
+    "finite": 0.06822464615106583,
+    "endpoint_kl": 0.06607333570718765,
+    "temporal_derivative": 0.0021513071842491627
+  },
+  {
+    "step": 343,
+    "loss": 0.7886401414871216,
+    "diagonal_ce": 0.7245698571205139,
+    "finite": 0.06407031416893005,
+    "endpoint_kl": 0.06178520992398262,
+    "temporal_derivative": 0.0022851047106087208
+  },
+  {
+    "step": 344,
+    "loss": 0.7726573348045349,
+    "diagonal_ce": 0.706908106803894,
+    "finite": 0.06574922800064087,
+    "endpoint_kl": 0.06368662416934967,
+    "temporal_derivative": 0.0020626019686460495
+  },
+  {
+    "step": 345,
+    "loss": 0.7792454361915588,
+    "diagonal_ce": 0.7136935591697693,
+    "finite": 0.06555188447237015,
+    "endpoint_kl": 0.06371492147445679,
+    "temporal_derivative": 0.001836959389038384
+  },
+  {
+    "step": 346,
+    "loss": 0.7103873491287231,
+    "diagonal_ce": 0.6434116959571838,
+    "finite": 0.0669756829738617,
+    "endpoint_kl": 0.06471855193376541,
+    "temporal_derivative": 0.0022571273148059845
+  },
+  {
+    "step": 347,
+    "loss": 0.670769214630127,
+    "diagonal_ce": 0.6076656579971313,
+    "finite": 0.06310354173183441,
+    "endpoint_kl": 0.06107800081372261,
+    "temporal_derivative": 0.002025539055466652
+  },
+  {
+    "step": 348,
+    "loss": 0.7496060729026794,
+    "diagonal_ce": 0.6822887063026428,
+    "finite": 0.06731735914945602,
+    "endpoint_kl": 0.06480877101421356,
+    "temporal_derivative": 0.0025085865054279566
+  },
+  {
+    "step": 349,
+    "loss": 0.7246065735816956,
+    "diagonal_ce": 0.6554455161094666,
+    "finite": 0.06916105002164841,
+    "endpoint_kl": 0.06626693159341812,
+    "temporal_derivative": 0.0028941165655851364
+  },
+  {
+    "step": 350,
+    "loss": 0.7396515011787415,
+    "diagonal_ce": 0.6779351830482483,
+    "finite": 0.06171629950404167,
+    "endpoint_kl": 0.05935198441147804,
+    "temporal_derivative": 0.0023643162567168474
+  },
+  {
+    "step": 351,
+    "loss": 0.7694733738899231,
+    "diagonal_ce": 0.7083618640899658,
+    "finite": 0.06111149862408638,
+    "endpoint_kl": 0.058531031012535095,
+    "temporal_derivative": 0.00258046668022871
+  },
+  {
+    "step": 352,
+    "loss": 0.7219135761260986,
+    "diagonal_ce": 0.654807448387146,
+    "finite": 0.06710611283779144,
+    "endpoint_kl": 0.06466774642467499,
+    "temporal_derivative": 0.0024383687414228916
+  },
+  {
+    "step": 353,
+    "loss": 0.835510790348053,
+    "diagonal_ce": 0.7696068286895752,
+    "finite": 0.06590396165847778,
+    "endpoint_kl": 0.0638800859451294,
+    "temporal_derivative": 0.0020238771103322506
+  },
+  {
+    "step": 354,
+    "loss": 0.7762301564216614,
+    "diagonal_ce": 0.7173115611076355,
+    "finite": 0.058918606489896774,
+    "endpoint_kl": 0.05633672699332237,
+    "temporal_derivative": 0.002581880195066333
+  },
+  {
+    "step": 355,
+    "loss": 0.8126651644706726,
+    "diagonal_ce": 0.7523361444473267,
+    "finite": 0.060329046100378036,
+    "endpoint_kl": 0.057332590222358704,
+    "temporal_derivative": 0.0029964568093419075
+  },
+  {
+    "step": 356,
+    "loss": 0.8022878766059875,
+    "diagonal_ce": 0.7405891418457031,
+    "finite": 0.061698753386735916,
+    "endpoint_kl": 0.0594639778137207,
+    "temporal_derivative": 0.002234774176031351
+  },
+  {
+    "step": 357,
+    "loss": 0.7916211485862732,
+    "diagonal_ce": 0.7314566969871521,
+    "finite": 0.0601644292473793,
+    "endpoint_kl": 0.05801638588309288,
+    "temporal_derivative": 0.0021480449941009283
+  },
+  {
+    "step": 358,
+    "loss": 0.7328387498855591,
+    "diagonal_ce": 0.6688967347145081,
+    "finite": 0.06394200026988983,
+    "endpoint_kl": 0.06131879985332489,
+    "temporal_derivative": 0.0026232032105326653
+  },
+  {
+    "step": 359,
+    "loss": 0.8664532899856567,
+    "diagonal_ce": 0.8098282814025879,
+    "finite": 0.05662503466010094,
+    "endpoint_kl": 0.054008614271879196,
+    "temporal_derivative": 0.002616418991237879
+  },
+  {
+    "step": 360,
+    "loss": 0.7332645654678345,
+    "diagonal_ce": 0.6749674081802368,
+    "finite": 0.058297183364629745,
+    "endpoint_kl": 0.05557847023010254,
+    "temporal_derivative": 0.0027187145315110683
+  },
+  {
+    "step": 361,
+    "loss": 0.7232518196105957,
+    "diagonal_ce": 0.6622488498687744,
+    "finite": 0.06100296974182129,
+    "endpoint_kl": 0.05943414568901062,
+    "temporal_derivative": 0.0015688224229961634
+  },
+  {
+    "step": 362,
+    "loss": 0.7601560354232788,
+    "diagonal_ce": 0.7088234424591064,
+    "finite": 0.05133259668946266,
+    "endpoint_kl": 0.0488688200712204,
+    "temporal_derivative": 0.002463776618242264
+  },
+  {
+    "step": 363,
+    "loss": 0.7285625338554382,
+    "diagonal_ce": 0.6747781038284302,
+    "finite": 0.053784433752298355,
+    "endpoint_kl": 0.05144033581018448,
+    "temporal_derivative": 0.002344096777960658
+  },
+  {
+    "step": 364,
+    "loss": 0.7073761820793152,
+    "diagonal_ce": 0.6492300629615784,
+    "finite": 0.05814614146947861,
+    "endpoint_kl": 0.05573666840791702,
+    "temporal_derivative": 0.002409473992884159
+  },
+  {
+    "step": 365,
+    "loss": 0.7640906572341919,
+    "diagonal_ce": 0.7089832425117493,
+    "finite": 0.055107440799474716,
+    "endpoint_kl": 0.052078112959861755,
+    "temporal_derivative": 0.003029329003766179
+  },
+  {
+    "step": 366,
+    "loss": 0.8714821338653564,
+    "diagonal_ce": 0.8175311088562012,
+    "finite": 0.05395101383328438,
+    "endpoint_kl": 0.05154750123620033,
+    "temporal_derivative": 0.0024035112001001835
+  },
+  {
+    "step": 367,
+    "loss": 0.7511534690856934,
+    "diagonal_ce": 0.7021787166595459,
+    "finite": 0.04897475242614746,
+    "endpoint_kl": 0.046254999935626984,
+    "temporal_derivative": 0.0027197517920285463
+  },
+  {
+    "step": 368,
+    "loss": 0.7559288144111633,
+    "diagonal_ce": 0.7044124603271484,
+    "finite": 0.05151635780930519,
+    "endpoint_kl": 0.049013033509254456,
+    "temporal_derivative": 0.0025033243000507355
+  },
+  {
+    "step": 369,
+    "loss": 0.829926073551178,
+    "diagonal_ce": 0.7760875225067139,
+    "finite": 0.0538385771214962,
+    "endpoint_kl": 0.05078619346022606,
+    "temporal_derivative": 0.003052385291084647
+  },
+  {
+    "step": 370,
+    "loss": 0.7610189318656921,
+    "diagonal_ce": 0.709424614906311,
+    "finite": 0.051594339311122894,
+    "endpoint_kl": 0.04900006204843521,
+    "temporal_derivative": 0.0025942763313651085
+  },
+  {
+    "step": 371,
+    "loss": 0.7490988969802856,
+    "diagonal_ce": 0.700247049331665,
+    "finite": 0.048851821571588516,
+    "endpoint_kl": 0.04664329066872597,
+    "temporal_derivative": 0.002208529971539974
+  },
+  {
+    "step": 372,
+    "loss": 0.7522510886192322,
+    "diagonal_ce": 0.7001712322235107,
+    "finite": 0.05207984521985054,
+    "endpoint_kl": 0.05009889230132103,
+    "temporal_derivative": 0.001980953384190798
+  },
+  {
+    "step": 373,
+    "loss": 0.7452574372291565,
+    "diagonal_ce": 0.690600574016571,
+    "finite": 0.054656874388456345,
+    "endpoint_kl": 0.052734870463609695,
+    "temporal_derivative": 0.001922002644278109
+  },
+  {
+    "step": 374,
+    "loss": 0.7334696650505066,
+    "diagonal_ce": 0.6860974431037903,
+    "finite": 0.04737221077084541,
+    "endpoint_kl": 0.04527774453163147,
+    "temporal_derivative": 0.002094466704875231
+  },
+  {
+    "step": 375,
+    "loss": 0.6299623847007751,
+    "diagonal_ce": 0.5781221985816956,
+    "finite": 0.05184018611907959,
+    "endpoint_kl": 0.04969631880521774,
+    "temporal_derivative": 0.0021438677795231342
+  },
+  {
+    "step": 376,
+    "loss": 0.6611906290054321,
+    "diagonal_ce": 0.6107749938964844,
+    "finite": 0.05041561275720596,
+    "endpoint_kl": 0.04847341030836105,
+    "temporal_derivative": 0.0019422005861997604
+  },
+  {
+    "step": 377,
+    "loss": 0.711529016494751,
+    "diagonal_ce": 0.6567448377609253,
+    "finite": 0.05478419363498688,
+    "endpoint_kl": 0.0530642569065094,
+    "temporal_derivative": 0.0017199369613081217
+  },
+  {
+    "step": 378,
+    "loss": 0.8542795777320862,
+    "diagonal_ce": 0.8039389252662659,
+    "finite": 0.05034065246582031,
+    "endpoint_kl": 0.048727571964263916,
+    "temporal_derivative": 0.0016130795702338219
+  },
+  {
+    "step": 379,
+    "loss": 0.7722690105438232,
+    "diagonal_ce": 0.7246208786964417,
+    "finite": 0.04764815792441368,
+    "endpoint_kl": 0.04553095996379852,
+    "temporal_derivative": 0.002117197262123227
+  },
+  {
+    "step": 380,
+    "loss": 0.6552140712738037,
+    "diagonal_ce": 0.6017966270446777,
+    "finite": 0.053417451679706573,
+    "endpoint_kl": 0.051271550357341766,
+    "temporal_derivative": 0.0021459003910422325
+  },
+  {
+    "step": 381,
+    "loss": 0.7825742363929749,
+    "diagonal_ce": 0.7329248189926147,
+    "finite": 0.04964940622448921,
+    "endpoint_kl": 0.04787039756774902,
+    "temporal_derivative": 0.0017790080746635795
+  },
+  {
+    "step": 382,
+    "loss": 0.6142404079437256,
+    "diagonal_ce": 0.5643807649612427,
+    "finite": 0.049859628081321716,
+    "endpoint_kl": 0.048080142587423325,
+    "temporal_derivative": 0.0017794851446524262
+  },
+  {
+    "step": 383,
+    "loss": 0.8076237440109253,
+    "diagonal_ce": 0.759630560874939,
+    "finite": 0.04799316078424454,
+    "endpoint_kl": 0.04621589183807373,
+    "temporal_derivative": 0.0017772705759853125
+  },
+  {
+    "step": 384,
+    "loss": 0.6492577791213989,
+    "diagonal_ce": 0.5981295108795166,
+    "finite": 0.051128268241882324,
+    "endpoint_kl": 0.04912304878234863,
+    "temporal_derivative": 0.002005219692364335
+  },
+  {
+    "step": 385,
+    "loss": 0.778775691986084,
+    "diagonal_ce": 0.7312718629837036,
+    "finite": 0.04750380292534828,
+    "endpoint_kl": 0.044996682554483414,
+    "temporal_derivative": 0.002507119905203581
+  },
+  {
+    "step": 386,
+    "loss": 0.7651388645172119,
+    "diagonal_ce": 0.7185679078102112,
+    "finite": 0.04657098650932312,
+    "endpoint_kl": 0.043751299381256104,
+    "temporal_derivative": 0.0028196866624057293
+  },
+  {
+    "step": 387,
+    "loss": 0.6888495087623596,
+    "diagonal_ce": 0.6389342546463013,
+    "finite": 0.04991525039076805,
+    "endpoint_kl": 0.048299092799425125,
+    "temporal_derivative": 0.001616158988326788
+  },
+  {
+    "step": 388,
+    "loss": 0.6288641691207886,
+    "diagonal_ce": 0.5818844437599182,
+    "finite": 0.046979717910289764,
+    "endpoint_kl": 0.04527422785758972,
+    "temporal_derivative": 0.0017054881900548935
+  },
+  {
+    "step": 389,
+    "loss": 0.8417105674743652,
+    "diagonal_ce": 0.795220673084259,
+    "finite": 0.0464898943901062,
+    "endpoint_kl": 0.043845802545547485,
+    "temporal_derivative": 0.0026440913788974285
+  },
+  {
+    "step": 390,
+    "loss": 0.6533275246620178,
+    "diagonal_ce": 0.6044595837593079,
+    "finite": 0.04886792227625847,
+    "endpoint_kl": 0.046973664313554764,
+    "temporal_derivative": 0.0018942570313811302
+  },
+  {
+    "step": 391,
+    "loss": 0.6902409791946411,
+    "diagonal_ce": 0.642799437046051,
+    "finite": 0.04744154214859009,
+    "endpoint_kl": 0.0451638400554657,
+    "temporal_derivative": 0.0022777027916163206
+  },
+  {
+    "step": 392,
+    "loss": 0.6965826153755188,
+    "diagonal_ce": 0.6539576053619385,
+    "finite": 0.04262499511241913,
+    "endpoint_kl": 0.04069558531045914,
+    "temporal_derivative": 0.0019294088706374168
+  },
+  {
+    "step": 393,
+    "loss": 0.6715112328529358,
+    "diagonal_ce": 0.6249377131462097,
+    "finite": 0.046573515981435776,
+    "endpoint_kl": 0.044675640761852264,
+    "temporal_derivative": 0.001897874055430293
+  },
+  {
+    "step": 394,
+    "loss": 0.6965920925140381,
+    "diagonal_ce": 0.6514021158218384,
+    "finite": 0.045190006494522095,
+    "endpoint_kl": 0.04289260506629944,
+    "temporal_derivative": 0.0022974000312387943
+  },
+  {
+    "step": 395,
+    "loss": 0.7038607597351074,
+    "diagonal_ce": 0.6604854464530945,
+    "finite": 0.04337534308433533,
+    "endpoint_kl": 0.0416521281003952,
+    "temporal_derivative": 0.0017232131212949753
+  },
+  {
+    "step": 396,
+    "loss": 0.7092626690864563,
+    "diagonal_ce": 0.6624000072479248,
+    "finite": 0.046862635761499405,
+    "endpoint_kl": 0.04481438547372818,
+    "temporal_derivative": 0.0020482498221099377
+  },
+  {
+    "step": 397,
+    "loss": 0.6779962182044983,
+    "diagonal_ce": 0.6312227249145508,
+    "finite": 0.04677348583936691,
+    "endpoint_kl": 0.04483107104897499,
+    "temporal_derivative": 0.001942414790391922
+  },
+  {
+    "step": 398,
+    "loss": 0.7997133135795593,
+    "diagonal_ce": 0.7587990760803223,
+    "finite": 0.040914248675107956,
+    "endpoint_kl": 0.03873352333903313,
+    "temporal_derivative": 0.002180725336074829
+  },
+  {
+    "step": 399,
+    "loss": 0.6832430958747864,
+    "diagonal_ce": 0.634221076965332,
+    "finite": 0.04902200028300285,
+    "endpoint_kl": 0.047204554080963135,
+    "temporal_derivative": 0.0018174462020397186
+  },
+  {
+    "step": 400,
+    "loss": 0.6867102980613708,
+    "diagonal_ce": 0.642072319984436,
+    "finite": 0.044637974351644516,
+    "endpoint_kl": 0.043103091418743134,
+    "temporal_derivative": 0.0015348835149779916
+  },
+  {
+    "step": 401,
+    "loss": 0.7762218713760376,
+    "diagonal_ce": 0.7332414984703064,
+    "finite": 0.042980387806892395,
+    "endpoint_kl": 0.040707409381866455,
+    "temporal_derivative": 0.0022729788906872272
+  },
+  {
+    "step": 402,
+    "loss": 0.7397513389587402,
+    "diagonal_ce": 0.6984153389930725,
+    "finite": 0.04133601859211922,
+    "endpoint_kl": 0.039367616176605225,
+    "temporal_derivative": 0.0019684024155139923
+  },
+  {
+    "step": 403,
+    "loss": 0.7000986337661743,
+    "diagonal_ce": 0.6562238335609436,
+    "finite": 0.04387481138110161,
+    "endpoint_kl": 0.04239266365766525,
+    "temporal_derivative": 0.0014821488875895739
+  },
+  {
+    "step": 404,
+    "loss": 0.688836932182312,
+    "diagonal_ce": 0.647304356098175,
+    "finite": 0.041532568633556366,
+    "endpoint_kl": 0.03973884880542755,
+    "temporal_derivative": 0.0017937211086973548
+  },
+  {
+    "step": 405,
+    "loss": 0.6771454215049744,
+    "diagonal_ce": 0.6390926241874695,
+    "finite": 0.038052793592214584,
+    "endpoint_kl": 0.03629118576645851,
+    "temporal_derivative": 0.0017616061959415674
+  },
+  {
+    "step": 406,
+    "loss": 0.7476484775543213,
+    "diagonal_ce": 0.7069072127342224,
+    "finite": 0.040741290897130966,
+    "endpoint_kl": 0.03899068385362625,
+    "temporal_derivative": 0.001750606345012784
+  },
+  {
+    "step": 407,
+    "loss": 0.6857348680496216,
+    "diagonal_ce": 0.6436883211135864,
+    "finite": 0.04204656556248665,
+    "endpoint_kl": 0.04046718776226044,
+    "temporal_derivative": 0.0015793764032423496
+  },
+  {
+    "step": 408,
+    "loss": 0.600089430809021,
+    "diagonal_ce": 0.5627526044845581,
+    "finite": 0.0373368114233017,
+    "endpoint_kl": 0.0357745885848999,
+    "temporal_derivative": 0.0015622228384017944
+  },
+  {
+    "step": 409,
+    "loss": 0.6567298769950867,
+    "diagonal_ce": 0.6187436580657959,
+    "finite": 0.03798622637987137,
+    "endpoint_kl": 0.036463573575019836,
+    "temporal_derivative": 0.0015226523391902447
+  },
+  {
+    "step": 410,
+    "loss": 0.6564363241195679,
+    "diagonal_ce": 0.6163579821586609,
+    "finite": 0.04007835313677788,
+    "endpoint_kl": 0.03808560222387314,
+    "temporal_derivative": 0.0019927516113966703
+  },
+  {
+    "step": 411,
+    "loss": 0.670235812664032,
+    "diagonal_ce": 0.6301630735397339,
+    "finite": 0.0400727316737175,
+    "endpoint_kl": 0.03783141449093819,
+    "temporal_derivative": 0.002241317182779312
+  },
+  {
+    "step": 412,
+    "loss": 0.737362802028656,
+    "diagonal_ce": 0.6999157071113586,
+    "finite": 0.037447087466716766,
+    "endpoint_kl": 0.035607703030109406,
+    "temporal_derivative": 0.0018393825739622116
+  },
+  {
+    "step": 413,
+    "loss": 0.7249117493629456,
+    "diagonal_ce": 0.6873629093170166,
+    "finite": 0.037548817694187164,
+    "endpoint_kl": 0.03591426461935043,
+    "temporal_derivative": 0.001634553074836731
+  },
+  {
+    "step": 414,
+    "loss": 0.6959080696105957,
+    "diagonal_ce": 0.6540534496307373,
+    "finite": 0.04185464605689049,
+    "endpoint_kl": 0.040553752332925797,
+    "temporal_derivative": 0.0013008932583034039
+  },
+  {
+    "step": 415,
+    "loss": 0.6509254574775696,
+    "diagonal_ce": 0.6105828881263733,
+    "finite": 0.040342554450035095,
+    "endpoint_kl": 0.038566723465919495,
+    "temporal_derivative": 0.001775829354301095
+  },
+  {
+    "step": 416,
+    "loss": 0.6543774008750916,
+    "diagonal_ce": 0.6127813458442688,
+    "finite": 0.04159605875611305,
+    "endpoint_kl": 0.04000374674797058,
+    "temporal_derivative": 0.0015923130558803678
+  },
+  {
+    "step": 417,
+    "loss": 0.7267346382141113,
+    "diagonal_ce": 0.6852052211761475,
+    "finite": 0.04152940958738327,
+    "endpoint_kl": 0.03998558968305588,
+    "temporal_derivative": 0.001543819555081427
+  },
+  {
+    "step": 418,
+    "loss": 0.6695206761360168,
+    "diagonal_ce": 0.6262125968933105,
+    "finite": 0.043308090418577194,
+    "endpoint_kl": 0.04170852154493332,
+    "temporal_derivative": 0.001599569572135806
+  },
+  {
+    "step": 419,
+    "loss": 0.6791941523551941,
+    "diagonal_ce": 0.6421746015548706,
+    "finite": 0.037019554525613785,
+    "endpoint_kl": 0.03557942435145378,
+    "temporal_derivative": 0.0014401315711438656
+  },
+  {
+    "step": 420,
+    "loss": 0.6425529718399048,
+    "diagonal_ce": 0.6046424508094788,
+    "finite": 0.03791051730513573,
+    "endpoint_kl": 0.03644812852144241,
+    "temporal_derivative": 0.0014623887836933136
+  },
+  {
+    "step": 421,
+    "loss": 0.6294628381729126,
+    "diagonal_ce": 0.5873357057571411,
+    "finite": 0.04212713986635208,
+    "endpoint_kl": 0.040738094598054886,
+    "temporal_derivative": 0.0013890457339584827
+  },
+  {
+    "step": 422,
+    "loss": 0.6536637544631958,
+    "diagonal_ce": 0.6142516732215881,
+    "finite": 0.03941209986805916,
+    "endpoint_kl": 0.03759729117155075,
+    "temporal_derivative": 0.0018148072995245457
+  },
+  {
+    "step": 423,
+    "loss": 0.6872714757919312,
+    "diagonal_ce": 0.6514323949813843,
+    "finite": 0.03583909571170807,
+    "endpoint_kl": 0.03481828793883324,
+    "temporal_derivative": 0.0010208088206127286
+  },
+  {
+    "step": 424,
+    "loss": 0.5991441607475281,
+    "diagonal_ce": 0.5629593133926392,
+    "finite": 0.03618485480546951,
+    "endpoint_kl": 0.034563228487968445,
+    "temporal_derivative": 0.0016216252697631717
+  },
+  {
+    "step": 425,
+    "loss": 0.7694857716560364,
+    "diagonal_ce": 0.7294543385505676,
+    "finite": 0.04003145918250084,
+    "endpoint_kl": 0.038409341126680374,
+    "temporal_derivative": 0.0016221166588366032
+  },
+  {
+    "step": 426,
+    "loss": 0.6069278120994568,
+    "diagonal_ce": 0.5696174502372742,
+    "finite": 0.03731037676334381,
+    "endpoint_kl": 0.03640057146549225,
+    "temporal_derivative": 0.0009098035516217351
+  },
+  {
+    "step": 427,
+    "loss": 0.6924628615379333,
+    "diagonal_ce": 0.6549745202064514,
+    "finite": 0.03748832270503044,
+    "endpoint_kl": 0.035405948758125305,
+    "temporal_derivative": 0.002082375343888998
+  },
+  {
+    "step": 428,
+    "loss": 0.6912294030189514,
+    "diagonal_ce": 0.6536976099014282,
+    "finite": 0.03753179684281349,
+    "endpoint_kl": 0.03605180233716965,
+    "temporal_derivative": 0.0014799929922446609
+  },
+  {
+    "step": 429,
+    "loss": 0.6086661219596863,
+    "diagonal_ce": 0.5706855058670044,
+    "finite": 0.03798060491681099,
+    "endpoint_kl": 0.03666204214096069,
+    "temporal_derivative": 0.0013185633579269052
+  },
+  {
+    "step": 430,
+    "loss": 0.619117796421051,
+    "diagonal_ce": 0.5844510793685913,
+    "finite": 0.03466673940420151,
+    "endpoint_kl": 0.03268025070428848,
+    "temporal_derivative": 0.0019864903297275305
+  },
+  {
+    "step": 431,
+    "loss": 0.545923113822937,
+    "diagonal_ce": 0.5095071196556091,
+    "finite": 0.03641596809029579,
+    "endpoint_kl": 0.03514518216252327,
+    "temporal_derivative": 0.0012707855785265565
+  },
+  {
+    "step": 432,
+    "loss": 0.6125374436378479,
+    "diagonal_ce": 0.5773521661758423,
+    "finite": 0.03518529236316681,
+    "endpoint_kl": 0.033343445509672165,
+    "temporal_derivative": 0.001841848366893828
+  },
+  {
+    "step": 433,
+    "loss": 0.696077823638916,
+    "diagonal_ce": 0.6590732932090759,
+    "finite": 0.03700454160571098,
+    "endpoint_kl": 0.0355018675327301,
+    "temporal_derivative": 0.0015026740729808807
+  },
+  {
+    "step": 434,
+    "loss": 0.6294531226158142,
+    "diagonal_ce": 0.5948150753974915,
+    "finite": 0.03463803604245186,
+    "endpoint_kl": 0.03337130695581436,
+    "temporal_derivative": 0.0012667294358834624
+  },
+  {
+    "step": 435,
+    "loss": 0.7772732973098755,
+    "diagonal_ce": 0.7406378984451294,
+    "finite": 0.03663540631532669,
+    "endpoint_kl": 0.03523740544915199,
+    "temporal_derivative": 0.0013980016810819507
+  },
+  {
+    "step": 436,
+    "loss": 0.6167677044868469,
+    "diagonal_ce": 0.5798765420913696,
+    "finite": 0.036891140043735504,
+    "endpoint_kl": 0.03523019328713417,
+    "temporal_derivative": 0.0016609473386779428
+  },
+  {
+    "step": 437,
+    "loss": 0.6359614133834839,
+    "diagonal_ce": 0.6008819937705994,
+    "finite": 0.03507940471172333,
+    "endpoint_kl": 0.03313637524843216,
+    "temporal_derivative": 0.001943028997629881
+  },
+  {
+    "step": 438,
+    "loss": 0.7213693857192993,
+    "diagonal_ce": 0.6863555312156677,
+    "finite": 0.03501388430595398,
+    "endpoint_kl": 0.03395644947886467,
+    "temporal_derivative": 0.001057433895766735
+  },
+  {
+    "step": 439,
+    "loss": 0.5913248658180237,
+    "diagonal_ce": 0.5560294985771179,
+    "finite": 0.03529537841677666,
+    "endpoint_kl": 0.03404976427555084,
+    "temporal_derivative": 0.0012456143740564585
+  },
+  {
+    "step": 440,
+    "loss": 0.6467137336730957,
+    "diagonal_ce": 0.6123819947242737,
+    "finite": 0.03433172404766083,
+    "endpoint_kl": 0.03269270062446594,
+    "temporal_derivative": 0.0016390250530093908
+  },
+  {
+    "step": 441,
+    "loss": 0.6568669676780701,
+    "diagonal_ce": 0.6252691745758057,
+    "finite": 0.031597789376974106,
+    "endpoint_kl": 0.03035929799079895,
+    "temporal_derivative": 0.0012384920846670866
+  },
+  {
+    "step": 442,
+    "loss": 0.6817370057106018,
+    "diagonal_ce": 0.6449582576751709,
+    "finite": 0.03677875176072121,
+    "endpoint_kl": 0.03560202941298485,
+    "temporal_derivative": 0.0011767211835831404
+  },
+  {
+    "step": 443,
+    "loss": 0.6470999717712402,
+    "diagonal_ce": 0.6135203242301941,
+    "finite": 0.033579666167497635,
+    "endpoint_kl": 0.032737985253334045,
+    "temporal_derivative": 0.0008416813798248768
+  },
+  {
+    "step": 444,
+    "loss": 0.6399222016334534,
+    "diagonal_ce": 0.6056743264198303,
+    "finite": 0.03424787148833275,
+    "endpoint_kl": 0.03272575885057449,
+    "temporal_derivative": 0.0015221114736050367
+  },
+  {
+    "step": 445,
+    "loss": 0.700674295425415,
+    "diagonal_ce": 0.6664058566093445,
+    "finite": 0.03426843509078026,
+    "endpoint_kl": 0.03272619470953941,
+    "temporal_derivative": 0.0015422394499182701
+  },
+  {
+    "step": 446,
+    "loss": 0.6713899970054626,
+    "diagonal_ce": 0.6363436579704285,
+    "finite": 0.035046353936195374,
+    "endpoint_kl": 0.03402605280280113,
+    "temporal_derivative": 0.0010203002020716667
+  },
+  {
+    "step": 447,
+    "loss": 0.6459946036338806,
+    "diagonal_ce": 0.6130318641662598,
+    "finite": 0.03296271339058876,
+    "endpoint_kl": 0.03139645606279373,
+    "temporal_derivative": 0.0015662576770409942
+  },
+  {
+    "step": 448,
+    "loss": 0.6260905265808105,
+    "diagonal_ce": 0.5946460366249084,
+    "finite": 0.03144446387887001,
+    "endpoint_kl": 0.030167128890752792,
+    "temporal_derivative": 0.0012773358030244708
+  },
+  {
+    "step": 449,
+    "loss": 0.5182821750640869,
+    "diagonal_ce": 0.4865835905075073,
+    "finite": 0.03169860318303108,
+    "endpoint_kl": 0.030662326142191887,
+    "temporal_derivative": 0.0010362761095166206
+  },
+  {
+    "step": 450,
+    "loss": 0.6330307722091675,
+    "diagonal_ce": 0.6012206673622131,
+    "finite": 0.03181012347340584,
+    "endpoint_kl": 0.030724983662366867,
+    "temporal_derivative": 0.0010851396946236491
+  },
+  {
+    "step": 451,
+    "loss": 0.6631491780281067,
+    "diagonal_ce": 0.633699893951416,
+    "finite": 0.029449261724948883,
+    "endpoint_kl": 0.027955587953329086,
+    "temporal_derivative": 0.0014936747029423714
+  },
+  {
+    "step": 452,
+    "loss": 0.6947271227836609,
+    "diagonal_ce": 0.6639907360076904,
+    "finite": 0.030736368149518967,
+    "endpoint_kl": 0.02970171347260475,
+    "temporal_derivative": 0.0010346552589908242
+  },
+  {
+    "step": 453,
+    "loss": 0.6550069451332092,
+    "diagonal_ce": 0.6251819133758545,
+    "finite": 0.02982505038380623,
+    "endpoint_kl": 0.02851627767086029,
+    "temporal_derivative": 0.0013087717816233635
+  },
+  {
+    "step": 454,
+    "loss": 0.748262345790863,
+    "diagonal_ce": 0.7185036540031433,
+    "finite": 0.029758695513010025,
+    "endpoint_kl": 0.028469236567616463,
+    "temporal_derivative": 0.0012894587125629187
+  },
+  {
+    "step": 455,
+    "loss": 0.5780810713768005,
+    "diagonal_ce": 0.5513167381286621,
+    "finite": 0.02676432579755783,
+    "endpoint_kl": 0.025511443614959717,
+    "temporal_derivative": 0.0012528826482594013
+  },
+  {
+    "step": 456,
+    "loss": 0.6781267523765564,
+    "diagonal_ce": 0.6505507230758667,
+    "finite": 0.027576033025979996,
+    "endpoint_kl": 0.02599659189581871,
+    "temporal_derivative": 0.00157944206148386
+  },
+  {
+    "step": 457,
+    "loss": 0.6530357003211975,
+    "diagonal_ce": 0.6233469247817993,
+    "finite": 0.02968878112733364,
+    "endpoint_kl": 0.028435569256544113,
+    "temporal_derivative": 0.001253211754374206
+  },
+  {
+    "step": 458,
+    "loss": 0.5506830215454102,
+    "diagonal_ce": 0.5226393938064575,
+    "finite": 0.028043609112501144,
+    "endpoint_kl": 0.02707328274846077,
+    "temporal_derivative": 0.0009703265968710184
+  },
+  {
+    "step": 459,
+    "loss": 0.6063569188117981,
+    "diagonal_ce": 0.5747520923614502,
+    "finite": 0.0316048227250576,
+    "endpoint_kl": 0.030029619112610817,
+    "temporal_derivative": 0.0015752044273540378
+  },
+  {
+    "step": 460,
+    "loss": 0.6795127987861633,
+    "diagonal_ce": 0.6507276892662048,
+    "finite": 0.028785115107893944,
+    "endpoint_kl": 0.02751743607223034,
+    "temporal_derivative": 0.0012676792684942484
+  },
+  {
+    "step": 461,
+    "loss": 0.6749408841133118,
+    "diagonal_ce": 0.645603597164154,
+    "finite": 0.02933727391064167,
+    "endpoint_kl": 0.028387360274791718,
+    "temporal_derivative": 0.0009499142179265618
+  },
+  {
+    "step": 462,
+    "loss": 0.5678670406341553,
+    "diagonal_ce": 0.5407708883285522,
+    "finite": 0.027096152305603027,
+    "endpoint_kl": 0.025137387216091156,
+    "temporal_derivative": 0.0019587641581892967
+  },
+  {
+    "step": 463,
+    "loss": 0.6870508790016174,
+    "diagonal_ce": 0.6585642099380493,
+    "finite": 0.02848665416240692,
+    "endpoint_kl": 0.026780635118484497,
+    "temporal_derivative": 0.0017060197424143553
+  },
+  {
+    "step": 464,
+    "loss": 0.5715030431747437,
+    "diagonal_ce": 0.5430439114570618,
+    "finite": 0.028459124267101288,
+    "endpoint_kl": 0.027727559208869934,
+    "temporal_derivative": 0.0007315647089853883
+  },
+  {
+    "step": 465,
+    "loss": 0.7678308486938477,
+    "diagonal_ce": 0.7420676350593567,
+    "finite": 0.025763213634490967,
+    "endpoint_kl": 0.024623969569802284,
+    "temporal_derivative": 0.001139243715442717
+  },
+  {
+    "step": 466,
+    "loss": 0.5363700985908508,
+    "diagonal_ce": 0.5048659443855286,
+    "finite": 0.03150415048003197,
+    "endpoint_kl": 0.030728548765182495,
+    "temporal_derivative": 0.0007756019476801157
+  },
+  {
+    "step": 467,
+    "loss": 0.704810380935669,
+    "diagonal_ce": 0.676565945148468,
+    "finite": 0.028244443237781525,
+    "endpoint_kl": 0.02707032859325409,
+    "temporal_derivative": 0.0011741137132048607
+  },
+  {
+    "step": 468,
+    "loss": 0.7160405516624451,
+    "diagonal_ce": 0.6869292855262756,
+    "finite": 0.029111258685588837,
+    "endpoint_kl": 0.027597345411777496,
+    "temporal_derivative": 0.0015139124589040875
+  },
+  {
+    "step": 469,
+    "loss": 0.67289799451828,
+    "diagonal_ce": 0.6459936499595642,
+    "finite": 0.026904333382844925,
+    "endpoint_kl": 0.025729723274707794,
+    "temporal_derivative": 0.0011746103409677744
+  },
+  {
+    "step": 470,
+    "loss": 0.5353058576583862,
+    "diagonal_ce": 0.5065027475357056,
+    "finite": 0.028803110122680664,
+    "endpoint_kl": 0.027932843193411827,
+    "temporal_derivative": 0.0008702663471922278
+  },
+  {
+    "step": 471,
+    "loss": 0.5487145781517029,
+    "diagonal_ce": 0.5229033827781677,
+    "finite": 0.025811199098825455,
+    "endpoint_kl": 0.024933869019150734,
+    "temporal_derivative": 0.0008773299632593989
+  },
+  {
+    "step": 472,
+    "loss": 0.6779687404632568,
+    "diagonal_ce": 0.649921178817749,
+    "finite": 0.02804754115641117,
+    "endpoint_kl": 0.026496589183807373,
+    "temporal_derivative": 0.0015509527875110507
+  },
+  {
+    "step": 473,
+    "loss": 0.5934829711914062,
+    "diagonal_ce": 0.5633668303489685,
+    "finite": 0.030116133391857147,
+    "endpoint_kl": 0.029014023020863533,
+    "temporal_derivative": 0.0011021109530702233
+  },
+  {
+    "step": 474,
+    "loss": 0.47408759593963623,
+    "diagonal_ce": 0.445747971534729,
+    "finite": 0.028339624404907227,
+    "endpoint_kl": 0.027367714792490005,
+    "temporal_derivative": 0.0009719090303406119
+  },
+  {
+    "step": 475,
+    "loss": 0.5241489410400391,
+    "diagonal_ce": 0.49462535977363586,
+    "finite": 0.02952357940375805,
+    "endpoint_kl": 0.028905022889375687,
+    "temporal_derivative": 0.000618556106928736
+  },
+  {
+    "step": 476,
+    "loss": 0.6626406908035278,
+    "diagonal_ce": 0.6344976425170898,
+    "finite": 0.028143063187599182,
+    "endpoint_kl": 0.027401167899370193,
+    "temporal_derivative": 0.0007418944733217359
+  },
+  {
+    "step": 477,
+    "loss": 0.7826799750328064,
+    "diagonal_ce": 0.7550444006919861,
+    "finite": 0.027635587379336357,
+    "endpoint_kl": 0.026808250695466995,
+    "temporal_derivative": 0.0008273370331153274
+  },
+  {
+    "step": 478,
+    "loss": 0.6072317361831665,
+    "diagonal_ce": 0.5819743871688843,
+    "finite": 0.025257334113121033,
+    "endpoint_kl": 0.024305976927280426,
+    "temporal_derivative": 0.0009513570694252849
+  },
+  {
+    "step": 479,
+    "loss": 0.6250020265579224,
+    "diagonal_ce": 0.5974449515342712,
+    "finite": 0.02755708061158657,
+    "endpoint_kl": 0.02661152184009552,
+    "temporal_derivative": 0.0009455583058297634
+  },
+  {
+    "step": 480,
+    "loss": 0.5603417158126831,
+    "diagonal_ce": 0.5334782600402832,
+    "finite": 0.026863453909754753,
+    "endpoint_kl": 0.025668611750006676,
+    "temporal_derivative": 0.0011948420433327556
+  },
+  {
+    "step": 481,
+    "loss": 0.5742697715759277,
+    "diagonal_ce": 0.5449542999267578,
+    "finite": 0.029315490275621414,
+    "endpoint_kl": 0.028383364900946617,
+    "temporal_derivative": 0.0009321247925981879
+  },
+  {
+    "step": 482,
+    "loss": 0.6496041417121887,
+    "diagonal_ce": 0.6233639121055603,
+    "finite": 0.026240205392241478,
+    "endpoint_kl": 0.025131411850452423,
+    "temporal_derivative": 0.0011087938910350204
+  },
+  {
+    "step": 483,
+    "loss": 0.49015313386917114,
+    "diagonal_ce": 0.4630454480648041,
+    "finite": 0.02710767462849617,
+    "endpoint_kl": 0.026455029845237732,
+    "temporal_derivative": 0.0006526450160890818
+  },
+  {
+    "step": 484,
+    "loss": 0.7159749269485474,
+    "diagonal_ce": 0.6910820007324219,
+    "finite": 0.02489294856786728,
+    "endpoint_kl": 0.024170663207769394,
+    "temporal_derivative": 0.0007222850690595806
+  },
+  {
+    "step": 485,
+    "loss": 0.562352180480957,
+    "diagonal_ce": 0.5339844226837158,
+    "finite": 0.02836773544549942,
+    "endpoint_kl": 0.02751908078789711,
+    "temporal_derivative": 0.0008486551232635975
+  },
+  {
+    "step": 486,
+    "loss": 0.6400886178016663,
+    "diagonal_ce": 0.6144037842750549,
+    "finite": 0.025684848427772522,
+    "endpoint_kl": 0.024717308580875397,
+    "temporal_derivative": 0.0009675397304818034
+  },
+  {
+    "step": 487,
+    "loss": 0.4997721016407013,
+    "diagonal_ce": 0.47291961312294006,
+    "finite": 0.026852475479245186,
+    "endpoint_kl": 0.026329096406698227,
+    "temporal_derivative": 0.0005233787233009934
+  },
+  {
+    "step": 488,
+    "loss": 0.6649565100669861,
+    "diagonal_ce": 0.6413138508796692,
+    "finite": 0.023642687126994133,
+    "endpoint_kl": 0.022508719936013222,
+    "temporal_derivative": 0.0011339666089043021
+  },
+  {
+    "step": 489,
+    "loss": 0.6815486550331116,
+    "diagonal_ce": 0.6570622324943542,
+    "finite": 0.024486413225531578,
+    "endpoint_kl": 0.023305434733629227,
+    "temporal_derivative": 0.0011809790739789605
+  },
+  {
+    "step": 490,
+    "loss": 0.5681191086769104,
+    "diagonal_ce": 0.5455788373947144,
+    "finite": 0.02254028059542179,
+    "endpoint_kl": 0.021637680009007454,
+    "temporal_derivative": 0.0009026002371683717
+  },
+  {
+    "step": 491,
+    "loss": 0.5757036209106445,
+    "diagonal_ce": 0.5523895025253296,
+    "finite": 0.02331414259970188,
+    "endpoint_kl": 0.02278132550418377,
+    "temporal_derivative": 0.0005328167462721467
+  },
+  {
+    "step": 492,
+    "loss": 0.5711296796798706,
+    "diagonal_ce": 0.545204758644104,
+    "finite": 0.025924906134605408,
+    "endpoint_kl": 0.025245260447263718,
+    "temporal_derivative": 0.000679646385833621
+  },
+  {
+    "step": 493,
+    "loss": 0.5871724486351013,
+    "diagonal_ce": 0.5639461874961853,
+    "finite": 0.02322627604007721,
+    "endpoint_kl": 0.022109385579824448,
+    "temporal_derivative": 0.0011168895289301872
+  },
+  {
+    "step": 494,
+    "loss": 0.6774849891662598,
+    "diagonal_ce": 0.6560116410255432,
+    "finite": 0.02147333323955536,
+    "endpoint_kl": 0.020543787628412247,
+    "temporal_derivative": 0.0009295454365201294
+  },
+  {
+    "step": 495,
+    "loss": 0.7491053938865662,
+    "diagonal_ce": 0.7246834635734558,
+    "finite": 0.02442195452749729,
+    "endpoint_kl": 0.023670675233006477,
+    "temporal_derivative": 0.0007512798765674233
+  },
+  {
+    "step": 496,
+    "loss": 0.7208460569381714,
+    "diagonal_ce": 0.6958198547363281,
+    "finite": 0.025026194751262665,
+    "endpoint_kl": 0.023403190076351166,
+    "temporal_derivative": 0.0016230051405727863
+  },
+  {
+    "step": 497,
+    "loss": 0.6046584248542786,
+    "diagonal_ce": 0.5824440717697144,
+    "finite": 0.02221435308456421,
+    "endpoint_kl": 0.02154010720551014,
+    "temporal_derivative": 0.0006742464611306787
+  },
+  {
+    "step": 498,
+    "loss": 0.6083553433418274,
+    "diagonal_ce": 0.5886453986167908,
+    "finite": 0.01970992237329483,
+    "endpoint_kl": 0.018912598490715027,
+    "temporal_derivative": 0.0007973241154104471
+  },
+  {
+    "step": 499,
+    "loss": 0.5986374020576477,
+    "diagonal_ce": 0.5751713514328003,
+    "finite": 0.023466046899557114,
+    "endpoint_kl": 0.02259533852338791,
+    "temporal_derivative": 0.0008707086089998484
+  },
+  {
+    "step": 500,
+    "loss": 0.6007665395736694,
+    "diagonal_ce": 0.5789028406143188,
+    "finite": 0.02186371572315693,
+    "endpoint_kl": 0.02106316015124321,
+    "temporal_derivative": 0.0008005552226677537
+  },
+  {
+    "step": 501,
+    "loss": 0.7025967240333557,
+    "diagonal_ce": 0.6820149421691895,
+    "finite": 0.02058177813887596,
+    "endpoint_kl": 0.019824925810098648,
+    "temporal_derivative": 0.0007568527362309396
+  },
+  {
+    "step": 502,
+    "loss": 0.550146222114563,
+    "diagonal_ce": 0.5294302105903625,
+    "finite": 0.020716017112135887,
+    "endpoint_kl": 0.02009480446577072,
+    "temporal_derivative": 0.0006212121224962175
+  },
+  {
+    "step": 503,
+    "loss": 0.5593010783195496,
+    "diagonal_ce": 0.5396237373352051,
+    "finite": 0.01967734843492508,
+    "endpoint_kl": 0.0189998596906662,
+    "temporal_derivative": 0.0006774882785975933
+  },
+  {
+    "step": 504,
+    "loss": 0.5171764492988586,
+    "diagonal_ce": 0.4975915849208832,
+    "finite": 0.019584881141781807,
+    "endpoint_kl": 0.018786557018756866,
+    "temporal_derivative": 0.000798324472270906
+  },
+  {
+    "step": 505,
+    "loss": 0.5185128450393677,
+    "diagonal_ce": 0.49810490012168884,
+    "finite": 0.020407946780323982,
+    "endpoint_kl": 0.019535820931196213,
+    "temporal_derivative": 0.0008721253834664822
+  },
+  {
+    "step": 506,
+    "loss": 0.6379070281982422,
+    "diagonal_ce": 0.6175776720046997,
+    "finite": 0.020329350605607033,
+    "endpoint_kl": 0.01949642412364483,
+    "temporal_derivative": 0.0008329261327162385
+  },
+  {
+    "step": 507,
+    "loss": 0.6119281649589539,
+    "diagonal_ce": 0.592779815196991,
+    "finite": 0.019148357212543488,
+    "endpoint_kl": 0.01818530634045601,
+    "temporal_derivative": 0.0009630504064261913
+  },
+  {
+    "step": 508,
+    "loss": 0.7814547419548035,
+    "diagonal_ce": 0.7615764141082764,
+    "finite": 0.019878318533301353,
+    "endpoint_kl": 0.019222412258386612,
+    "temporal_derivative": 0.0006559065659530461
+  },
+  {
+    "step": 509,
+    "loss": 0.5564754009246826,
+    "diagonal_ce": 0.5378474593162537,
+    "finite": 0.018627937883138657,
+    "endpoint_kl": 0.018015360459685326,
+    "temporal_derivative": 0.0006125779473222792
+  },
+  {
+    "step": 510,
+    "loss": 0.5574637651443481,
+    "diagonal_ce": 0.5387844443321228,
+    "finite": 0.01867929846048355,
+    "endpoint_kl": 0.018091563135385513,
+    "temporal_derivative": 0.0005877352086827159
+  },
+  {
+    "step": 511,
+    "loss": 0.5767285227775574,
+    "diagonal_ce": 0.5584138035774231,
+    "finite": 0.018314726650714874,
+    "endpoint_kl": 0.017610065639019012,
+    "temporal_derivative": 0.0007046602549962699
+  },
+  {
+    "step": 512,
+    "loss": 0.5707470178604126,
+    "diagonal_ce": 0.5503959059715271,
+    "finite": 0.0203511081635952,
+    "endpoint_kl": 0.019582897424697876,
+    "temporal_derivative": 0.0007682109717279673
+  },
+  {
+    "step": 513,
+    "loss": 0.6506462693214417,
+    "diagonal_ce": 0.6315202713012695,
+    "finite": 0.019125986844301224,
+    "endpoint_kl": 0.018615566194057465,
+    "temporal_derivative": 0.0005104215233586729
+  },
+  {
+    "step": 514,
+    "loss": 0.5798529982566833,
+    "diagonal_ce": 0.5622287392616272,
+    "finite": 0.017624251544475555,
+    "endpoint_kl": 0.017053337767720222,
+    "temporal_derivative": 0.0005709131946787238
+  },
+  {
+    "step": 515,
+    "loss": 0.5776331424713135,
+    "diagonal_ce": 0.5584138035774231,
+    "finite": 0.019219359382987022,
+    "endpoint_kl": 0.01844361610710621,
+    "temporal_derivative": 0.0007757436251267791
+  },
+  {
+    "step": 516,
+    "loss": 0.6347741484642029,
+    "diagonal_ce": 0.6167048811912537,
+    "finite": 0.018069274723529816,
+    "endpoint_kl": 0.017329810187220573,
+    "temporal_derivative": 0.000739465409424156
+  },
+  {
+    "step": 517,
+    "loss": 0.5261118412017822,
+    "diagonal_ce": 0.5059478878974915,
+    "finite": 0.02016393467783928,
+    "endpoint_kl": 0.019657349213957787,
+    "temporal_derivative": 0.0005065846489742398
+  },
+  {
+    "step": 518,
+    "loss": 0.7314395308494568,
+    "diagonal_ce": 0.7127516269683838,
+    "finite": 0.018687881529331207,
+    "endpoint_kl": 0.017864158377051353,
+    "temporal_derivative": 0.0008237239671871066
+  },
+  {
+    "step": 519,
+    "loss": 0.5377277135848999,
+    "diagonal_ce": 0.5203701853752136,
+    "finite": 0.01735752820968628,
+    "endpoint_kl": 0.01667400822043419,
+    "temporal_derivative": 0.0006835208041593432
+  },
+  {
+    "step": 520,
+    "loss": 0.7556924819946289,
+    "diagonal_ce": 0.738533079624176,
+    "finite": 0.01715940795838833,
+    "endpoint_kl": 0.016534239053726196,
+    "temporal_derivative": 0.000625169777777046
+  },
+  {
+    "step": 521,
+    "loss": 0.7118908166885376,
+    "diagonal_ce": 0.6947343349456787,
+    "finite": 0.017156492918729782,
+    "endpoint_kl": 0.016517069190740585,
+    "temporal_derivative": 0.000639422913081944
+  },
+  {
+    "step": 522,
+    "loss": 0.49370139837265015,
+    "diagonal_ce": 0.47573122382164,
+    "finite": 0.017970167100429535,
+    "endpoint_kl": 0.017429938539862633,
+    "temporal_derivative": 0.0005402289680205286
+  },
+  {
+    "step": 523,
+    "loss": 0.604189395904541,
+    "diagonal_ce": 0.5856785178184509,
+    "finite": 0.018510859459638596,
+    "endpoint_kl": 0.017860617488622665,
+    "temporal_derivative": 0.0006502421456389129
+  },
+  {
+    "step": 524,
+    "loss": 0.7017306089401245,
+    "diagonal_ce": 0.6852315068244934,
+    "finite": 0.016499076038599014,
+    "endpoint_kl": 0.015681318938732147,
+    "temporal_derivative": 0.0008177570998668671
+  },
+  {
+    "step": 525,
+    "loss": 0.552733302116394,
+    "diagonal_ce": 0.5349341630935669,
+    "finite": 0.017799125984311104,
+    "endpoint_kl": 0.0174430962651968,
+    "temporal_derivative": 0.00035603021387942135
+  },
+  {
+    "step": 526,
+    "loss": 0.6218006610870361,
+    "diagonal_ce": 0.6058076024055481,
+    "finite": 0.015993066132068634,
+    "endpoint_kl": 0.01504258718341589,
+    "temporal_derivative": 0.0009504790068604052
+  },
+  {
+    "step": 527,
+    "loss": 0.528149425983429,
+    "diagonal_ce": 0.5128234028816223,
+    "finite": 0.01532600075006485,
+    "endpoint_kl": 0.014695967547595501,
+    "temporal_derivative": 0.0006300333188846707
+  },
+  {
+    "step": 528,
+    "loss": 0.5258792638778687,
+    "diagonal_ce": 0.510429322719574,
+    "finite": 0.015449948608875275,
+    "endpoint_kl": 0.014915179461240768,
+    "temporal_derivative": 0.0005347686819732189
+  },
+  {
+    "step": 529,
+    "loss": 0.5016969442367554,
+    "diagonal_ce": 0.48614028096199036,
+    "finite": 0.015556633472442627,
+    "endpoint_kl": 0.015227539464831352,
+    "temporal_derivative": 0.00032909418223425746
+  },
+  {
+    "step": 530,
+    "loss": 0.7365314960479736,
+    "diagonal_ce": 0.7227200865745544,
+    "finite": 0.01381143368780613,
+    "endpoint_kl": 0.013013812713325024,
+    "temporal_derivative": 0.0007976206252351403
+  },
+  {
+    "step": 531,
+    "loss": 0.6372222900390625,
+    "diagonal_ce": 0.6224412322044373,
+    "finite": 0.014781049452722073,
+    "endpoint_kl": 0.014093125239014626,
+    "temporal_derivative": 0.0006879239808768034
+  },
+  {
+    "step": 532,
+    "loss": 0.6034877300262451,
+    "diagonal_ce": 0.5891072154045105,
+    "finite": 0.014380536042153835,
+    "endpoint_kl": 0.013772264122962952,
+    "temporal_derivative": 0.0006082721520215273
+  },
+  {
+    "step": 533,
+    "loss": 0.660100519657135,
+    "diagonal_ce": 0.6459159851074219,
+    "finite": 0.014184539206326008,
+    "endpoint_kl": 0.013587197288870811,
+    "temporal_derivative": 0.0005973416264168918
+  },
+  {
+    "step": 534,
+    "loss": 0.5736604332923889,
+    "diagonal_ce": 0.5584776401519775,
+    "finite": 0.015182804316282272,
+    "endpoint_kl": 0.014794842340052128,
+    "temporal_derivative": 0.0003879622381646186
+  },
+  {
+    "step": 535,
+    "loss": 0.7606274485588074,
+    "diagonal_ce": 0.7443599700927734,
+    "finite": 0.01626749336719513,
+    "endpoint_kl": 0.015648361295461655,
+    "temporal_derivative": 0.0006191317806951702
+  },
+  {
+    "step": 536,
+    "loss": 0.46563178300857544,
+    "diagonal_ce": 0.4510115683078766,
+    "finite": 0.014620214700698853,
+    "endpoint_kl": 0.014112131670117378,
+    "temporal_derivative": 0.0005080826231278479
+  },
+  {
+    "step": 537,
+    "loss": 0.6085848808288574,
+    "diagonal_ce": 0.5935178995132446,
+    "finite": 0.015066998079419136,
+    "endpoint_kl": 0.014572863467037678,
+    "temporal_derivative": 0.0004941346123814583
+  },
+  {
+    "step": 538,
+    "loss": 0.6110110878944397,
+    "diagonal_ce": 0.5965157747268677,
+    "finite": 0.014495338313281536,
+    "endpoint_kl": 0.014185371808707714,
+    "temporal_derivative": 0.0003099667374044657
+  },
+  {
+    "step": 539,
+    "loss": 0.6800404191017151,
+    "diagonal_ce": 0.664993941783905,
+    "finite": 0.015046472661197186,
+    "endpoint_kl": 0.01439347118139267,
+    "temporal_derivative": 0.0006530018872581422
+  },
+  {
+    "step": 540,
+    "loss": 0.627405047416687,
+    "diagonal_ce": 0.611556887626648,
+    "finite": 0.015848159790039062,
+    "endpoint_kl": 0.01521420106291771,
+    "temporal_derivative": 0.0006339591927826405
+  },
+  {
+    "step": 541,
+    "loss": 0.5623912215232849,
+    "diagonal_ce": 0.5487049221992493,
+    "finite": 0.013686295598745346,
+    "endpoint_kl": 0.01316368393599987,
+    "temporal_derivative": 0.0005226117791607976
+  },
+  {
+    "step": 542,
+    "loss": 0.7922937273979187,
+    "diagonal_ce": 0.7781387567520142,
+    "finite": 0.014154964126646519,
+    "endpoint_kl": 0.013395785354077816,
+    "temporal_derivative": 0.000759178539738059
+  },
+  {
+    "step": 543,
+    "loss": 0.5777837634086609,
+    "diagonal_ce": 0.5640637278556824,
+    "finite": 0.013720016926527023,
+    "endpoint_kl": 0.0131834726780653,
+    "temporal_derivative": 0.0005365442484617233
+  },
+  {
+    "step": 544,
+    "loss": 0.7057955265045166,
+    "diagonal_ce": 0.690701961517334,
+    "finite": 0.015093558467924595,
+    "endpoint_kl": 0.014508580788969994,
+    "temporal_derivative": 0.000584977853577584
+  },
+  {
+    "step": 545,
+    "loss": 0.5312912464141846,
+    "diagonal_ce": 0.5168184638023376,
+    "finite": 0.01447276957333088,
+    "endpoint_kl": 0.013883713632822037,
+    "temporal_derivative": 0.0005890559987165034
+  },
+  {
+    "step": 546,
+    "loss": 0.5161409378051758,
+    "diagonal_ce": 0.502602756023407,
+    "finite": 0.013538187369704247,
+    "endpoint_kl": 0.012859649024903774,
+    "temporal_derivative": 0.0006785380537621677
+  },
+  {
+    "step": 547,
+    "loss": 0.6602568626403809,
+    "diagonal_ce": 0.6467154026031494,
+    "finite": 0.013541464693844318,
+    "endpoint_kl": 0.013049930334091187,
+    "temporal_derivative": 0.0004915344179607928
+  },
+  {
+    "step": 548,
+    "loss": 0.5422530174255371,
+    "diagonal_ce": 0.5293629765510559,
+    "finite": 0.012890070676803589,
+    "endpoint_kl": 0.012503638863563538,
+    "temporal_derivative": 0.00038643143489025533
+  },
+  {
+    "step": 549,
+    "loss": 0.5137969255447388,
+    "diagonal_ce": 0.499650239944458,
+    "finite": 0.014146688394248486,
+    "endpoint_kl": 0.013817721977829933,
+    "temporal_derivative": 0.00032896659104153514
+  },
+  {
+    "step": 550,
+    "loss": 0.5775702595710754,
+    "diagonal_ce": 0.5627338290214539,
+    "finite": 0.014836459420621395,
+    "endpoint_kl": 0.014366811141371727,
+    "temporal_derivative": 0.0004696479008998722
+  },
+  {
+    "step": 551,
+    "loss": 0.6328571438789368,
+    "diagonal_ce": 0.617417573928833,
+    "finite": 0.015439562499523163,
+    "endpoint_kl": 0.015011725947260857,
+    "temporal_derivative": 0.0004278360866010189
+  },
+  {
+    "step": 552,
+    "loss": 0.6161769032478333,
+    "diagonal_ce": 0.6021526455879211,
+    "finite": 0.014024229720234871,
+    "endpoint_kl": 0.013733943924307823,
+    "temporal_derivative": 0.000290285621304065
+  },
+  {
+    "step": 553,
+    "loss": 0.6863598823547363,
+    "diagonal_ce": 0.6723325252532959,
+    "finite": 0.014027356170117855,
+    "endpoint_kl": 0.013428837060928345,
+    "temporal_derivative": 0.0005985189927741885
+  },
+  {
+    "step": 554,
+    "loss": 0.6704072952270508,
+    "diagonal_ce": 0.6562876105308533,
+    "finite": 0.014119693078100681,
+    "endpoint_kl": 0.013635245151817799,
+    "temporal_derivative": 0.0004844479844905436
+  },
+  {
+    "step": 555,
+    "loss": 0.7359305620193481,
+    "diagonal_ce": 0.7209897637367249,
+    "finite": 0.014940783381462097,
+    "endpoint_kl": 0.014300786890089512,
+    "temporal_derivative": 0.000639996724203229
+  },
+  {
+    "step": 556,
+    "loss": 0.5147736072540283,
+    "diagonal_ce": 0.5009187459945679,
+    "finite": 0.013854864984750748,
+    "endpoint_kl": 0.0135341240093112,
+    "temporal_derivative": 0.0003207409754395485
+  },
+  {
+    "step": 557,
+    "loss": 0.564838171005249,
+    "diagonal_ce": 0.5517274737358093,
+    "finite": 0.013110722415149212,
+    "endpoint_kl": 0.012694419361650944,
+    "temporal_derivative": 0.0004163026751484722
+  },
+  {
+    "step": 558,
+    "loss": 0.5297942757606506,
+    "diagonal_ce": 0.5176444053649902,
+    "finite": 0.012149889953434467,
+    "endpoint_kl": 0.011572064831852913,
+    "temporal_derivative": 0.0005778248887509108
+  },
+  {
+    "step": 559,
+    "loss": 0.5605998039245605,
+    "diagonal_ce": 0.5471878051757812,
+    "finite": 0.013412018306553364,
+    "endpoint_kl": 0.012832822278141975,
+    "temporal_derivative": 0.000579195620957762
+  },
+  {
+    "step": 560,
+    "loss": 0.5985124111175537,
+    "diagonal_ce": 0.5863640308380127,
+    "finite": 0.012148366309702396,
+    "endpoint_kl": 0.01178056001663208,
+    "temporal_derivative": 0.0003678064385894686
+  },
+  {
+    "step": 561,
+    "loss": 0.6416478753089905,
+    "diagonal_ce": 0.6292941570281982,
+    "finite": 0.012353711761534214,
+    "endpoint_kl": 0.011937475763261318,
+    "temporal_derivative": 0.00041623602737672627
+  },
+  {
+    "step": 562,
+    "loss": 0.5278003215789795,
+    "diagonal_ce": 0.5145437121391296,
+    "finite": 0.013256593607366085,
+    "endpoint_kl": 0.012888106517493725,
+    "temporal_derivative": 0.0003684872935991734
+  },
+  {
+    "step": 563,
+    "loss": 0.592042863368988,
+    "diagonal_ce": 0.5785984992980957,
+    "finite": 0.013444392941892147,
+    "endpoint_kl": 0.013121497817337513,
+    "temporal_derivative": 0.0003228950372431427
+  },
+  {
+    "step": 564,
+    "loss": 0.6071479916572571,
+    "diagonal_ce": 0.5965244174003601,
+    "finite": 0.010623584501445293,
+    "endpoint_kl": 0.0100797638297081,
+    "temporal_derivative": 0.0005438209045678377
+  },
+  {
+    "step": 565,
+    "loss": 0.6757490634918213,
+    "diagonal_ce": 0.6635696887969971,
+    "finite": 0.01217939704656601,
+    "endpoint_kl": 0.011968068778514862,
+    "temporal_derivative": 0.00021132855908945203
+  },
+  {
+    "step": 566,
+    "loss": 0.6571349501609802,
+    "diagonal_ce": 0.6448314189910889,
+    "finite": 0.012303538620471954,
+    "endpoint_kl": 0.011869723908603191,
+    "temporal_derivative": 0.0004338146245572716
+  },
+  {
+    "step": 567,
+    "loss": 0.5707795023918152,
+    "diagonal_ce": 0.5587357878684998,
+    "finite": 0.01204373873770237,
+    "endpoint_kl": 0.011623131111264229,
+    "temporal_derivative": 0.0004206073353998363
+  },
+  {
+    "step": 568,
+    "loss": 0.763347327709198,
+    "diagonal_ce": 0.7525315284729004,
+    "finite": 0.010815808549523354,
+    "endpoint_kl": 0.010224666446447372,
+    "temporal_derivative": 0.0005911417538300157
+  },
+  {
+    "step": 569,
+    "loss": 0.5427829027175903,
+    "diagonal_ce": 0.5312288403511047,
+    "finite": 0.011554040014743805,
+    "endpoint_kl": 0.011235951445996761,
+    "temporal_derivative": 0.0003180883068125695
+  },
+  {
+    "step": 570,
+    "loss": 0.4415638744831085,
+    "diagonal_ce": 0.4289889335632324,
+    "finite": 0.012574944645166397,
+    "endpoint_kl": 0.012335083447396755,
+    "temporal_derivative": 0.00023986150335986167
+  },
+  {
+    "step": 571,
+    "loss": 0.45347920060157776,
+    "diagonal_ce": 0.44165048003196716,
+    "finite": 0.011828720569610596,
+    "endpoint_kl": 0.011598816141486168,
+    "temporal_derivative": 0.00022990403522271663
+  },
+  {
+    "step": 572,
+    "loss": 0.5011372566223145,
+    "diagonal_ce": 0.4882158637046814,
+    "finite": 0.012921405024826527,
+    "endpoint_kl": 0.01250062882900238,
+    "temporal_derivative": 0.00042077634134329855
+  },
+  {
+    "step": 573,
+    "loss": 0.5616585612297058,
+    "diagonal_ce": 0.5500845909118652,
+    "finite": 0.01157394889742136,
+    "endpoint_kl": 0.011281942017376423,
+    "temporal_derivative": 0.00029200688004493713
+  },
+  {
+    "step": 574,
+    "loss": 0.6379475593566895,
+    "diagonal_ce": 0.626484215259552,
+    "finite": 0.011463352479040623,
+    "endpoint_kl": 0.01113808061927557,
+    "temporal_derivative": 0.0003252716560382396
+  },
+  {
+    "step": 575,
+    "loss": 0.7516742944717407,
+    "diagonal_ce": 0.7404987215995789,
+    "finite": 0.01117558591067791,
+    "endpoint_kl": 0.010785999707877636,
+    "temporal_derivative": 0.00038958602817729115
+  },
+  {
+    "step": 576,
+    "loss": 0.646344780921936,
+    "diagonal_ce": 0.6361464858055115,
+    "finite": 0.010198287665843964,
+    "endpoint_kl": 0.009827813133597374,
+    "temporal_derivative": 0.00037047406658530235
+  },
+  {
+    "step": 577,
+    "loss": 0.6134806871414185,
+    "diagonal_ce": 0.6017199158668518,
+    "finite": 0.011760743334889412,
+    "endpoint_kl": 0.011197042651474476,
+    "temporal_derivative": 0.0005637008580379188
+  },
+  {
+    "step": 578,
+    "loss": 0.5641360878944397,
+    "diagonal_ce": 0.5529347658157349,
+    "finite": 0.01120133325457573,
+    "endpoint_kl": 0.010946031659841537,
+    "temporal_derivative": 0.00025530115817673504
+  },
+  {
+    "step": 579,
+    "loss": 0.6715434789657593,
+    "diagonal_ce": 0.6621189117431641,
+    "finite": 0.009424544870853424,
+    "endpoint_kl": 0.00906312931329012,
+    "temporal_derivative": 0.00036141599412076175
+  },
+  {
+    "step": 580,
+    "loss": 0.6697326302528381,
+    "diagonal_ce": 0.6589749455451965,
+    "finite": 0.010757670737802982,
+    "endpoint_kl": 0.010360954329371452,
+    "temporal_derivative": 0.000396716728573665
+  },
+  {
+    "step": 581,
+    "loss": 0.5814065933227539,
+    "diagonal_ce": 0.5701166391372681,
+    "finite": 0.011289965361356735,
+    "endpoint_kl": 0.0109642893075943,
+    "temporal_derivative": 0.00032567590824328363
+  },
+  {
+    "step": 582,
+    "loss": 0.7492846250534058,
+    "diagonal_ce": 0.7381317615509033,
+    "finite": 0.011152870953083038,
+    "endpoint_kl": 0.010738370940089226,
+    "temporal_derivative": 0.00041450001299381256
+  },
+  {
+    "step": 583,
+    "loss": 0.5745173096656799,
+    "diagonal_ce": 0.5642968416213989,
+    "finite": 0.01022046897560358,
+    "endpoint_kl": 0.009910577908158302,
+    "temporal_derivative": 0.0003098907181993127
+  },
+  {
+    "step": 584,
+    "loss": 0.5986927151679993,
+    "diagonal_ce": 0.5881394743919373,
+    "finite": 0.010553236119449139,
+    "endpoint_kl": 0.010242873802781105,
+    "temporal_derivative": 0.00031036272412166
+  },
+  {
+    "step": 585,
+    "loss": 0.5857285857200623,
+    "diagonal_ce": 0.5750396847724915,
+    "finite": 0.010688927955925465,
+    "endpoint_kl": 0.010313622653484344,
+    "temporal_derivative": 0.0003753055352717638
+  },
+  {
+    "step": 586,
+    "loss": 0.5273049473762512,
+    "diagonal_ce": 0.5158793330192566,
+    "finite": 0.011425608769059181,
+    "endpoint_kl": 0.011098457500338554,
+    "temporal_derivative": 0.000327151152305305
+  },
+  {
+    "step": 587,
+    "loss": 0.5585721731185913,
+    "diagonal_ce": 0.5469650626182556,
+    "finite": 0.01160711795091629,
+    "endpoint_kl": 0.011266974732279778,
+    "temporal_derivative": 0.00034014316042885184
+  },
+  {
+    "step": 588,
+    "loss": 0.5021852850914001,
+    "diagonal_ce": 0.49146154522895813,
+    "finite": 0.010723716579377651,
+    "endpoint_kl": 0.010443906299769878,
+    "temporal_derivative": 0.0002798099012579769
+  },
+  {
+    "step": 589,
+    "loss": 0.618878960609436,
+    "diagonal_ce": 0.6080394387245178,
+    "finite": 0.010839549824595451,
+    "endpoint_kl": 0.010549856349825859,
+    "temporal_derivative": 0.00028969309641979635
+  },
+  {
+    "step": 590,
+    "loss": 0.4836283326148987,
+    "diagonal_ce": 0.4730866253376007,
+    "finite": 0.010541700758039951,
+    "endpoint_kl": 0.010382908396422863,
+    "temporal_derivative": 0.00015879257989581674
+  },
+  {
+    "step": 591,
+    "loss": 0.9089632034301758,
+    "diagonal_ce": 0.8986737132072449,
+    "finite": 0.010289487428963184,
+    "endpoint_kl": 0.00975887943059206,
+    "temporal_derivative": 0.0005306077073328197
+  },
+  {
+    "step": 592,
+    "loss": 0.714104413986206,
+    "diagonal_ce": 0.7044382691383362,
+    "finite": 0.009666155092418194,
+    "endpoint_kl": 0.009313360787928104,
+    "temporal_derivative": 0.00035279415897093713
+  },
+  {
+    "step": 593,
+    "loss": 0.6505877375602722,
+    "diagonal_ce": 0.6404381990432739,
+    "finite": 0.010149565525352955,
+    "endpoint_kl": 0.009866300970315933,
+    "temporal_derivative": 0.0002832643804140389
+  },
+  {
+    "step": 594,
+    "loss": 0.4943738877773285,
+    "diagonal_ce": 0.4854024052619934,
+    "finite": 0.008971484377980232,
+    "endpoint_kl": 0.008731304667890072,
+    "temporal_derivative": 0.00024017927353270352
+  },
+  {
+    "step": 595,
+    "loss": 0.6074837446212769,
+    "diagonal_ce": 0.5965407490730286,
+    "finite": 0.010942990891635418,
+    "endpoint_kl": 0.010651649907231331,
+    "temporal_derivative": 0.00029134127544239163
+  },
+  {
+    "step": 596,
+    "loss": 0.6234621405601501,
+    "diagonal_ce": 0.6133776307106018,
+    "finite": 0.010084529407322407,
+    "endpoint_kl": 0.009823936969041824,
+    "temporal_derivative": 0.00026059255469590425
+  },
+  {
+    "step": 597,
+    "loss": 0.5868486166000366,
+    "diagonal_ce": 0.5774108171463013,
+    "finite": 0.00943781342357397,
+    "endpoint_kl": 0.009089318104088306,
+    "temporal_derivative": 0.0003484952903818339
+  },
+  {
+    "step": 598,
+    "loss": 0.6410503387451172,
+    "diagonal_ce": 0.6312393546104431,
+    "finite": 0.009811011143028736,
+    "endpoint_kl": 0.009601159952580929,
+    "temporal_derivative": 0.0002098507684422657
+  },
+  {
+    "step": 599,
+    "loss": 0.6714843511581421,
+    "diagonal_ce": 0.6627311706542969,
+    "finite": 0.008753172121942043,
+    "endpoint_kl": 0.008408552967011929,
+    "temporal_derivative": 0.000344618980307132
+  },
+  {
+    "step": 600,
+    "loss": 0.5487948656082153,
+    "diagonal_ce": 0.5390611886978149,
+    "finite": 0.009733669459819794,
+    "endpoint_kl": 0.009417490102350712,
+    "temporal_derivative": 0.0003161795320920646
+  },
+  {
+    "step": 601,
+    "loss": 0.6494770646095276,
+    "diagonal_ce": 0.6402629017829895,
+    "finite": 0.009214137680828571,
+    "endpoint_kl": 0.008851849474012852,
+    "temporal_derivative": 0.00036228858516551554
+  },
+  {
+    "step": 602,
+    "loss": 0.62929368019104,
+    "diagonal_ce": 0.6204268932342529,
+    "finite": 0.008866772055625916,
+    "endpoint_kl": 0.00860089622437954,
+    "temporal_derivative": 0.00026587609318085015
+  },
+  {
+    "step": 603,
+    "loss": 0.5341790318489075,
+    "diagonal_ce": 0.524486243724823,
+    "finite": 0.009692773222923279,
+    "endpoint_kl": 0.009449543431401253,
+    "temporal_derivative": 0.00024322934041265398
+  },
+  {
+    "step": 604,
+    "loss": 0.48749038577079773,
+    "diagonal_ce": 0.4785454273223877,
+    "finite": 0.008944950066506863,
+    "endpoint_kl": 0.008717473596334457,
+    "temporal_derivative": 0.00022747631010133773
+  },
+  {
+    "step": 605,
+    "loss": 0.600166916847229,
+    "diagonal_ce": 0.5913296341896057,
+    "finite": 0.00883726216852665,
+    "endpoint_kl": 0.00857328437268734,
+    "temporal_derivative": 0.0002639782032929361
+  },
+  {
+    "step": 606,
+    "loss": 0.592514157295227,
+    "diagonal_ce": 0.5830196142196655,
+    "finite": 0.009494518861174583,
+    "endpoint_kl": 0.009240083396434784,
+    "temporal_derivative": 0.00025443563936278224
+  },
+  {
+    "step": 607,
+    "loss": 0.7894976139068604,
+    "diagonal_ce": 0.7805678844451904,
+    "finite": 0.008929741568863392,
+    "endpoint_kl": 0.008545832708477974,
+    "temporal_derivative": 0.00038390891859307885
+  },
+  {
+    "step": 608,
+    "loss": 0.45300501585006714,
+    "diagonal_ce": 0.445063054561615,
+    "finite": 0.0079419557005167,
+    "endpoint_kl": 0.00775759806856513,
+    "temporal_derivative": 0.0001843575300881639
+  },
+  {
+    "step": 609,
+    "loss": 0.48326462507247925,
+    "diagonal_ce": 0.4743110239505768,
+    "finite": 0.008953590877354145,
+    "endpoint_kl": 0.008802761323750019,
+    "temporal_derivative": 0.0001508296700194478
+  },
+  {
+    "step": 610,
+    "loss": 0.7331321239471436,
+    "diagonal_ce": 0.7234583497047424,
+    "finite": 0.009673763997852802,
+    "endpoint_kl": 0.009411722421646118,
+    "temporal_derivative": 0.00026204189634881914
+  },
+  {
+    "step": 611,
+    "loss": 0.565004825592041,
+    "diagonal_ce": 0.5553264617919922,
+    "finite": 0.009678388945758343,
+    "endpoint_kl": 0.009367221035063267,
+    "temporal_derivative": 0.00031116820173338056
+  },
+  {
+    "step": 612,
+    "loss": 0.5320101380348206,
+    "diagonal_ce": 0.5223372578620911,
+    "finite": 0.009672904387116432,
+    "endpoint_kl": 0.009242907166481018,
+    "temporal_derivative": 0.0004299969004932791
+  },
+  {
+    "step": 613,
+    "loss": 0.6070746183395386,
+    "diagonal_ce": 0.5981148481369019,
+    "finite": 0.00895975437015295,
+    "endpoint_kl": 0.008587369695305824,
+    "temporal_derivative": 0.00037238470395095646
+  },
+  {
+    "step": 614,
+    "loss": 0.5897574424743652,
+    "diagonal_ce": 0.5804323554039001,
+    "finite": 0.009325072169303894,
+    "endpoint_kl": 0.008996385149657726,
+    "temporal_derivative": 0.00032868661219254136
+  },
+  {
+    "step": 615,
+    "loss": 0.5179954171180725,
+    "diagonal_ce": 0.5085126161575317,
+    "finite": 0.009482810273766518,
+    "endpoint_kl": 0.009208090603351593,
+    "temporal_derivative": 0.000274720077868551
+  },
+  {
+    "step": 616,
+    "loss": 0.4795977771282196,
+    "diagonal_ce": 0.47169914841651917,
+    "finite": 0.007898627780377865,
+    "endpoint_kl": 0.007727879099547863,
+    "temporal_derivative": 0.00017074834613595158
+  },
+  {
+    "step": 617,
+    "loss": 0.597510814666748,
+    "diagonal_ce": 0.5883800983428955,
+    "finite": 0.009130739606916904,
+    "endpoint_kl": 0.008888975717127323,
+    "temporal_derivative": 0.00024176432634703815
+  },
+  {
+    "step": 618,
+    "loss": 0.6225337386131287,
+    "diagonal_ce": 0.6128711104393005,
+    "finite": 0.009662602096796036,
+    "endpoint_kl": 0.009453869424760342,
+    "temporal_derivative": 0.0002087329630739987
+  },
+  {
+    "step": 619,
+    "loss": 0.7599794864654541,
+    "diagonal_ce": 0.7508246302604675,
+    "finite": 0.009154865518212318,
+    "endpoint_kl": 0.008836659602820873,
+    "temporal_derivative": 0.0003182061482220888
+  },
+  {
+    "step": 620,
+    "loss": 0.6630215644836426,
+    "diagonal_ce": 0.6546871066093445,
+    "finite": 0.008334478363394737,
+    "endpoint_kl": 0.00809516105800867,
+    "temporal_derivative": 0.00023931742180138826
+  },
+  {
+    "step": 621,
+    "loss": 0.6790797114372253,
+    "diagonal_ce": 0.6695515513420105,
+    "finite": 0.009528185240924358,
+    "endpoint_kl": 0.009312093257904053,
+    "temporal_derivative": 0.00021609220129903406
+  },
+  {
+    "step": 622,
+    "loss": 0.510382890701294,
+    "diagonal_ce": 0.5017039179801941,
+    "finite": 0.008678981103003025,
+    "endpoint_kl": 0.00845425110310316,
+    "temporal_derivative": 0.00022472967975772917
+  },
+  {
+    "step": 623,
+    "loss": 0.5336233377456665,
+    "diagonal_ce": 0.5233542919158936,
+    "finite": 0.010269030928611755,
+    "endpoint_kl": 0.010084099136292934,
+    "temporal_derivative": 0.0001849319669418037
+  },
+  {
+    "step": 624,
+    "loss": 0.5252987742424011,
+    "diagonal_ce": 0.5153676271438599,
+    "finite": 0.009931143373250961,
+    "endpoint_kl": 0.009529152885079384,
+    "temporal_derivative": 0.00040199002251029015
+  },
+  {
+    "step": 625,
+    "loss": 0.5543482303619385,
+    "diagonal_ce": 0.5463479161262512,
+    "finite": 0.008000331930816174,
+    "endpoint_kl": 0.007742558140307665,
+    "temporal_derivative": 0.0002577739651314914
+  },
+  {
+    "step": 626,
+    "loss": 0.6094878315925598,
+    "diagonal_ce": 0.6011572480201721,
+    "finite": 0.008330592885613441,
+    "endpoint_kl": 0.008029212243855,
+    "temporal_derivative": 0.0003013803798239678
+  },
+  {
+    "step": 627,
+    "loss": 0.8175238370895386,
+    "diagonal_ce": 0.8095127940177917,
+    "finite": 0.00801103375852108,
+    "endpoint_kl": 0.007840633392333984,
+    "temporal_derivative": 0.00017040083184838295
+  },
+  {
+    "step": 628,
+    "loss": 0.6114314198493958,
+    "diagonal_ce": 0.60341876745224,
+    "finite": 0.00801265798509121,
+    "endpoint_kl": 0.007852444425225258,
+    "temporal_derivative": 0.00016021367628127337
+  },
+  {
+    "step": 629,
+    "loss": 0.5177657008171082,
+    "diagonal_ce": 0.5093323588371277,
+    "finite": 0.008433370850980282,
+    "endpoint_kl": 0.008248837664723396,
+    "temporal_derivative": 0.00018453340453561395
+  },
+  {
+    "step": 630,
+    "loss": 0.6077531576156616,
+    "diagonal_ce": 0.6002942323684692,
+    "finite": 0.0074589247815310955,
+    "endpoint_kl": 0.00721328379586339,
+    "temporal_derivative": 0.0002456409565638751
+  },
+  {
+    "step": 631,
+    "loss": 0.38670533895492554,
+    "diagonal_ce": 0.3785907030105591,
+    "finite": 0.008114623837172985,
+    "endpoint_kl": 0.007982838898897171,
+    "temporal_derivative": 0.00013178476365283132
+  },
+  {
+    "step": 632,
+    "loss": 0.7380049228668213,
+    "diagonal_ce": 0.7301989793777466,
+    "finite": 0.007805929519236088,
+    "endpoint_kl": 0.007585795596241951,
+    "temporal_derivative": 0.0002201340685132891
+  },
+  {
+    "step": 633,
+    "loss": 0.5000163912773132,
+    "diagonal_ce": 0.49219590425491333,
+    "finite": 0.007820486091077328,
+    "endpoint_kl": 0.007544867694377899,
+    "temporal_derivative": 0.0002756183675955981
+  },
+  {
+    "step": 634,
+    "loss": 0.6095215678215027,
+    "diagonal_ce": 0.6022709012031555,
+    "finite": 0.007250668480992317,
+    "endpoint_kl": 0.007081407122313976,
+    "temporal_derivative": 0.0001692614605417475
+  },
+  {
+    "step": 635,
+    "loss": 0.5619121193885803,
+    "diagonal_ce": 0.554209291934967,
+    "finite": 0.007702844217419624,
+    "endpoint_kl": 0.007546043023467064,
+    "temporal_derivative": 0.00015680139767937362
+  },
+  {
+    "step": 636,
+    "loss": 0.7056868076324463,
+    "diagonal_ce": 0.6971887946128845,
+    "finite": 0.008497990667819977,
+    "endpoint_kl": 0.008199040777981281,
+    "temporal_derivative": 0.0002989501808770001
+  },
+  {
+    "step": 637,
+    "loss": 0.4571385383605957,
+    "diagonal_ce": 0.4488433599472046,
+    "finite": 0.008295191451907158,
+    "endpoint_kl": 0.008066796697676182,
+    "temporal_derivative": 0.00022839497250970453
+  },
+  {
+    "step": 638,
+    "loss": 0.609512448310852,
+    "diagonal_ce": 0.6014016270637512,
+    "finite": 0.00811081938445568,
+    "endpoint_kl": 0.007876656018197536,
+    "temporal_derivative": 0.00023416375915985554
+  },
+  {
+    "step": 639,
+    "loss": 0.43409037590026855,
+    "diagonal_ce": 0.4259406328201294,
+    "finite": 0.008149744011461735,
+    "endpoint_kl": 0.007992114871740341,
+    "temporal_derivative": 0.00015762927068863064
+  },
+  {
+    "step": 640,
+    "loss": 0.5347310304641724,
+    "diagonal_ce": 0.5267022848129272,
+    "finite": 0.00802876241505146,
+    "endpoint_kl": 0.007912852801382542,
+    "temporal_derivative": 0.0001159093008027412
+  },
+  {
+    "step": 641,
+    "loss": 0.537850558757782,
+    "diagonal_ce": 0.5293262004852295,
+    "finite": 0.008524338714778423,
+    "endpoint_kl": 0.008280662819743156,
+    "temporal_derivative": 0.00024367561854887754
+  },
+  {
+    "step": 642,
+    "loss": 0.6743884682655334,
+    "diagonal_ce": 0.666636049747467,
+    "finite": 0.0077524068765342236,
+    "endpoint_kl": 0.007599338423460722,
+    "temporal_derivative": 0.00015306829300243407
+  },
+  {
+    "step": 643,
+    "loss": 0.7999475598335266,
+    "diagonal_ce": 0.7925453782081604,
+    "finite": 0.007402161601930857,
+    "endpoint_kl": 0.007201700937002897,
+    "temporal_derivative": 0.0002004607522394508
+  },
+  {
+    "step": 644,
+    "loss": 0.6722888946533203,
+    "diagonal_ce": 0.6640599370002747,
+    "finite": 0.008228936232626438,
+    "endpoint_kl": 0.008090081624686718,
+    "temporal_derivative": 0.00013885444786865264
+  },
+  {
+    "step": 645,
+    "loss": 0.5187234878540039,
+    "diagonal_ce": 0.5106510519981384,
+    "finite": 0.008072406984865665,
+    "endpoint_kl": 0.008006565272808075,
+    "temporal_derivative": 6.58420249237679e-05
+  },
+  {
+    "step": 646,
+    "loss": 0.578794538974762,
+    "diagonal_ce": 0.5708521604537964,
+    "finite": 0.007942390628159046,
+    "endpoint_kl": 0.007692722603678703,
+    "temporal_derivative": 0.0002496681408956647
+  },
+  {
+    "step": 647,
+    "loss": 0.6018919944763184,
+    "diagonal_ce": 0.5953752398490906,
+    "finite": 0.006516741123050451,
+    "endpoint_kl": 0.006391162518411875,
+    "temporal_derivative": 0.00012557863374240696
+  },
+  {
+    "step": 648,
+    "loss": 0.5097047686576843,
+    "diagonal_ce": 0.5031912922859192,
+    "finite": 0.006513494532555342,
+    "endpoint_kl": 0.006379312835633755,
+    "temporal_derivative": 0.00013418182788882405
+  },
+  {
+    "step": 649,
+    "loss": 0.5256910920143127,
+    "diagonal_ce": 0.5186395049095154,
+    "finite": 0.007051569875329733,
+    "endpoint_kl": 0.006904969923198223,
+    "temporal_derivative": 0.00014660005399491638
+  },
+  {
+    "step": 650,
+    "loss": 0.5858699083328247,
+    "diagonal_ce": 0.5778449773788452,
+    "finite": 0.008024957031011581,
+    "endpoint_kl": 0.007789572700858116,
+    "temporal_derivative": 0.0002353840391151607
+  },
+  {
+    "step": 651,
+    "loss": 0.6073177456855774,
+    "diagonal_ce": 0.5994760990142822,
+    "finite": 0.007841653190553188,
+    "endpoint_kl": 0.007628552615642548,
+    "temporal_derivative": 0.00021310016745701432
+  },
+  {
+    "step": 652,
+    "loss": 0.4428585171699524,
+    "diagonal_ce": 0.4344789385795593,
+    "finite": 0.008379586972296238,
+    "endpoint_kl": 0.00817999430000782,
+    "temporal_derivative": 0.0001995922502828762
+  },
+  {
+    "step": 653,
+    "loss": 0.6299701929092407,
+    "diagonal_ce": 0.6215366125106812,
+    "finite": 0.008433578535914421,
+    "endpoint_kl": 0.008244359865784645,
+    "temporal_derivative": 0.00018921823357231915
+  },
+  {
+    "step": 654,
+    "loss": 0.593685507774353,
+    "diagonal_ce": 0.58601313829422,
+    "finite": 0.0076723527163267136,
+    "endpoint_kl": 0.007425578776746988,
+    "temporal_derivative": 0.0002467740559950471
+  },
+  {
+    "step": 655,
+    "loss": 0.4511115849018097,
+    "diagonal_ce": 0.4437938928604126,
+    "finite": 0.007317690644413233,
+    "endpoint_kl": 0.0071751512587070465,
+    "temporal_derivative": 0.00014253947301767766
+  },
+  {
+    "step": 656,
+    "loss": 0.5124878287315369,
+    "diagonal_ce": 0.5049780607223511,
+    "finite": 0.0075097642838954926,
+    "endpoint_kl": 0.00738652516156435,
+    "temporal_derivative": 0.00012323932605795562
+  },
+  {
+    "step": 657,
+    "loss": 0.7993290424346924,
+    "diagonal_ce": 0.7926183938980103,
+    "finite": 0.006710657384246588,
+    "endpoint_kl": 0.0065880571492016315,
+    "temporal_derivative": 0.00012260001676622778
+  },
+  {
+    "step": 658,
+    "loss": 0.6152363419532776,
+    "diagonal_ce": 0.6073440909385681,
+    "finite": 0.007892276160418987,
+    "endpoint_kl": 0.007760121952742338,
+    "temporal_derivative": 0.00013215397484600544
+  },
+  {
+    "step": 659,
+    "loss": 0.695976734161377,
+    "diagonal_ce": 0.6885759234428406,
+    "finite": 0.007400831673294306,
+    "endpoint_kl": 0.007287094369530678,
+    "temporal_derivative": 0.0001137374056270346
+  },
+  {
+    "step": 660,
+    "loss": 0.7299202084541321,
+    "diagonal_ce": 0.7226571440696716,
+    "finite": 0.007263089530169964,
+    "endpoint_kl": 0.007135963533073664,
+    "temporal_derivative": 0.00012712595344055444
+  },
+  {
+    "step": 661,
+    "loss": 0.6764603853225708,
+    "diagonal_ce": 0.6688030362129211,
+    "finite": 0.007657330948859453,
+    "endpoint_kl": 0.007545439526438713,
+    "temporal_derivative": 0.00011189164797542617
+  },
+  {
+    "step": 662,
+    "loss": 0.5138146281242371,
+    "diagonal_ce": 0.5067119002342224,
+    "finite": 0.007102733012288809,
+    "endpoint_kl": 0.006944743450731039,
+    "temporal_derivative": 0.00015798956155776978
+  },
+  {
+    "step": 663,
+    "loss": 0.5751270055770874,
+    "diagonal_ce": 0.5683359503746033,
+    "finite": 0.006791057530790567,
+    "endpoint_kl": 0.00666447076946497,
+    "temporal_derivative": 0.00012658655759878457
+  },
+  {
+    "step": 664,
+    "loss": 0.7133313417434692,
+    "diagonal_ce": 0.7065955996513367,
+    "finite": 0.006735757924616337,
+    "endpoint_kl": 0.006587271112948656,
+    "temporal_derivative": 0.00014848672435618937
+  },
+  {
+    "step": 665,
+    "loss": 0.6454363465309143,
+    "diagonal_ce": 0.6370474696159363,
+    "finite": 0.008388899266719818,
+    "endpoint_kl": 0.008223485201597214,
+    "temporal_derivative": 0.0001654143416089937
+  },
+  {
+    "step": 666,
+    "loss": 0.5368044972419739,
+    "diagonal_ce": 0.528491735458374,
+    "finite": 0.00831274688243866,
+    "endpoint_kl": 0.008035139180719852,
+    "temporal_derivative": 0.00027760775992646813
+  },
+  {
+    "step": 667,
+    "loss": 0.4897885322570801,
+    "diagonal_ce": 0.4829842150211334,
+    "finite": 0.006804316770285368,
+    "endpoint_kl": 0.006616223603487015,
+    "temporal_derivative": 0.0001880933705251664
+  },
+  {
+    "step": 668,
+    "loss": 0.4232230484485626,
+    "diagonal_ce": 0.41681191325187683,
+    "finite": 0.006411134731024504,
+    "endpoint_kl": 0.006253968924283981,
+    "temporal_derivative": 0.00015716577763669193
+  },
+  {
+    "step": 669,
+    "loss": 0.5891626477241516,
+    "diagonal_ce": 0.5815636515617371,
+    "finite": 0.00759900314733386,
+    "endpoint_kl": 0.0074140774086117744,
+    "temporal_derivative": 0.00018492562230676413
+  },
+  {
+    "step": 670,
+    "loss": 0.6407796740531921,
+    "diagonal_ce": 0.6339160799980164,
+    "finite": 0.006863608956336975,
+    "endpoint_kl": 0.006705082021653652,
+    "temporal_derivative": 0.00015852678916417062
+  },
+  {
+    "step": 671,
+    "loss": 0.5123079419136047,
+    "diagonal_ce": 0.5062583088874817,
+    "finite": 0.0060496400110423565,
+    "endpoint_kl": 0.005927438847720623,
+    "temporal_derivative": 0.000122201323392801
+  },
+  {
+    "step": 672,
+    "loss": 0.7566103339195251,
+    "diagonal_ce": 0.7500026226043701,
+    "finite": 0.006607703864574432,
+    "endpoint_kl": 0.006363745778799057,
+    "temporal_derivative": 0.0002439582021906972
+  },
+  {
+    "step": 673,
+    "loss": 0.5101290345191956,
+    "diagonal_ce": 0.5039084553718567,
+    "finite": 0.006220595445483923,
+    "endpoint_kl": 0.00604732520878315,
+    "temporal_derivative": 0.00017327020759694278
+  },
+  {
+    "step": 674,
+    "loss": 0.48773300647735596,
+    "diagonal_ce": 0.4809800386428833,
+    "finite": 0.006752954795956612,
+    "endpoint_kl": 0.0066588385961949825,
+    "temporal_derivative": 9.411598148290068e-05
+  },
+  {
+    "step": 675,
+    "loss": 0.6913887858390808,
+    "diagonal_ce": 0.6839112043380737,
+    "finite": 0.00747756939381361,
+    "endpoint_kl": 0.007163486443459988,
+    "temporal_derivative": 0.00031408295035362244
+  },
+  {
+    "step": 676,
+    "loss": 0.5578078627586365,
+    "diagonal_ce": 0.5504166483879089,
+    "finite": 0.007391218561679125,
+    "endpoint_kl": 0.007174128666520119,
+    "temporal_derivative": 0.00021708974963985384
+  },
+  {
+    "step": 677,
+    "loss": 0.6736658811569214,
+    "diagonal_ce": 0.6666567921638489,
+    "finite": 0.0070090992376208305,
+    "endpoint_kl": 0.006839811336249113,
+    "temporal_derivative": 0.0001692880759947002
+  },
+  {
+    "step": 678,
+    "loss": 0.8130902051925659,
+    "diagonal_ce": 0.80610191822052,
+    "finite": 0.006988260895013809,
+    "endpoint_kl": 0.006745454389601946,
+    "temporal_derivative": 0.00024280660727526993
+  },
+  {
+    "step": 679,
+    "loss": 0.5374239087104797,
+    "diagonal_ce": 0.5299720168113708,
+    "finite": 0.007451899349689484,
+    "endpoint_kl": 0.007195042446255684,
+    "temporal_derivative": 0.00025685701984912157
+  },
+  {
+    "step": 680,
+    "loss": 0.5700691342353821,
+    "diagonal_ce": 0.5630290508270264,
+    "finite": 0.0070400964468717575,
+    "endpoint_kl": 0.0068129743449389935,
+    "temporal_derivative": 0.0002271221310365945
+  },
+  {
+    "step": 681,
+    "loss": 0.5962613821029663,
+    "diagonal_ce": 0.5882946848869324,
+    "finite": 0.00796670001000166,
+    "endpoint_kl": 0.00778163643553853,
+    "temporal_derivative": 0.00018506389460526407
+  },
+  {
+    "step": 682,
+    "loss": 0.7614372372627258,
+    "diagonal_ce": 0.7540015578269958,
+    "finite": 0.007435682229697704,
+    "endpoint_kl": 0.0071805790066719055,
+    "temporal_derivative": 0.0002551032812334597
+  },
+  {
+    "step": 683,
+    "loss": 0.6142627596855164,
+    "diagonal_ce": 0.6076231002807617,
+    "finite": 0.006639685016125441,
+    "endpoint_kl": 0.006475042551755905,
+    "temporal_derivative": 0.00016464262444060296
+  },
+  {
+    "step": 684,
+    "loss": 0.5705232620239258,
+    "diagonal_ce": 0.5634599328041077,
+    "finite": 0.007063299883157015,
+    "endpoint_kl": 0.006930273957550526,
+    "temporal_derivative": 0.00013302589650265872
+  },
+  {
+    "step": 685,
+    "loss": 0.6594533324241638,
+    "diagonal_ce": 0.6526299118995667,
+    "finite": 0.006823424715548754,
+    "endpoint_kl": 0.0066797262988984585,
+    "temporal_derivative": 0.00014369840209838003
+  },
+  {
+    "step": 686,
+    "loss": 0.5886960029602051,
+    "diagonal_ce": 0.5823883414268494,
+    "finite": 0.0063076806254684925,
+    "endpoint_kl": 0.006157073192298412,
+    "temporal_derivative": 0.00015060752048157156
+  },
+  {
+    "step": 687,
+    "loss": 0.6382907629013062,
+    "diagonal_ce": 0.6323772668838501,
+    "finite": 0.00591347087174654,
+    "endpoint_kl": 0.005671725608408451,
+    "temporal_derivative": 0.00024174529244191945
+  },
+  {
+    "step": 688,
+    "loss": 0.5084272027015686,
+    "diagonal_ce": 0.5024076104164124,
+    "finite": 0.00601956294849515,
+    "endpoint_kl": 0.005833660252392292,
+    "temporal_derivative": 0.0001859025505837053
+  },
+  {
+    "step": 689,
+    "loss": 0.7049434185028076,
+    "diagonal_ce": 0.6996632814407349,
+    "finite": 0.005280114244669676,
+    "endpoint_kl": 0.00507426168769598,
+    "temporal_derivative": 0.00020585238235071301
+  },
+  {
+    "step": 690,
+    "loss": 0.7363476157188416,
+    "diagonal_ce": 0.7289654016494751,
+    "finite": 0.007382233627140522,
+    "endpoint_kl": 0.007219478487968445,
+    "temporal_derivative": 0.00016275531379505992
+  },
+  {
+    "step": 691,
+    "loss": 0.7057732939720154,
+    "diagonal_ce": 0.698991060256958,
+    "finite": 0.006782243028283119,
+    "endpoint_kl": 0.006573699880391359,
+    "temporal_derivative": 0.0002085433225147426
+  },
+  {
+    "step": 692,
+    "loss": 0.6249621510505676,
+    "diagonal_ce": 0.6185848712921143,
+    "finite": 0.0063772727735340595,
+    "endpoint_kl": 0.00619877502322197,
+    "temporal_derivative": 0.00017849767755251378
+  },
+  {
+    "step": 693,
+    "loss": 0.5984758734703064,
+    "diagonal_ce": 0.5930117964744568,
+    "finite": 0.005464103072881699,
+    "endpoint_kl": 0.005291546694934368,
+    "temporal_derivative": 0.00017255614511668682
+  },
+  {
+    "step": 694,
+    "loss": 0.49222299456596375,
+    "diagonal_ce": 0.4864334166049957,
+    "finite": 0.00578957749530673,
+    "endpoint_kl": 0.005691387224942446,
+    "temporal_derivative": 9.819039405556396e-05
+  },
+  {
+    "step": 695,
+    "loss": 0.6327252388000488,
+    "diagonal_ce": 0.6258072257041931,
+    "finite": 0.006917992606759071,
+    "endpoint_kl": 0.006723837461322546,
+    "temporal_derivative": 0.00019415529095567763
+  },
+  {
+    "step": 696,
+    "loss": 0.5295155048370361,
+    "diagonal_ce": 0.5225643515586853,
+    "finite": 0.006951158866286278,
+    "endpoint_kl": 0.0067443870939314365,
+    "temporal_derivative": 0.00020677178690675646
+  },
+  {
+    "step": 697,
+    "loss": 0.49342262744903564,
+    "diagonal_ce": 0.4867376685142517,
+    "finite": 0.006684945430606604,
+    "endpoint_kl": 0.00658464478328824,
+    "temporal_derivative": 0.00010030049452325329
+  },
+  {
+    "step": 698,
+    "loss": 0.5805843472480774,
+    "diagonal_ce": 0.5738478302955627,
+    "finite": 0.00673653744161129,
+    "endpoint_kl": 0.006562749855220318,
+    "temporal_derivative": 0.00017378742631990463
+  },
+  {
+    "step": 699,
+    "loss": 0.46670132875442505,
+    "diagonal_ce": 0.4598534107208252,
+    "finite": 0.006847903598099947,
+    "endpoint_kl": 0.006710242014378309,
+    "temporal_derivative": 0.00013766145275440067
+  },
+  {
+    "step": 700,
+    "loss": 0.5975049734115601,
+    "diagonal_ce": 0.592402994632721,
+    "finite": 0.005101973190903664,
+    "endpoint_kl": 0.005030322819948196,
+    "temporal_derivative": 7.165019633248448e-05
+  },
+  {
+    "step": 701,
+    "loss": 0.6967976093292236,
+    "diagonal_ce": 0.6887582540512085,
+    "finite": 0.008039385080337524,
+    "endpoint_kl": 0.007614218629896641,
+    "temporal_derivative": 0.0004251664213370532
+  },
+  {
+    "step": 702,
+    "loss": 0.5240301489830017,
+    "diagonal_ce": 0.5183899998664856,
+    "finite": 0.005640159361064434,
+    "endpoint_kl": 0.005510692484676838,
+    "temporal_derivative": 0.0001294670655624941
+  },
+  {
+    "step": 703,
+    "loss": 0.5203765630722046,
+    "diagonal_ce": 0.5143240690231323,
+    "finite": 0.00605251919478178,
+    "endpoint_kl": 0.005868270993232727,
+    "temporal_derivative": 0.00018424834706820548
+  },
+  {
+    "step": 704,
+    "loss": 0.6275042295455933,
+    "diagonal_ce": 0.6217116117477417,
+    "finite": 0.0057925996370613575,
+    "endpoint_kl": 0.00563154648989439,
+    "temporal_derivative": 0.0001610533508937806
+  },
+  {
+    "step": 705,
+    "loss": 0.7117538452148438,
+    "diagonal_ce": 0.7055310010910034,
+    "finite": 0.006222824100404978,
+    "endpoint_kl": 0.006014931946992874,
+    "temporal_derivative": 0.00020789216796401888
+  },
+  {
+    "step": 706,
+    "loss": 0.5811423063278198,
+    "diagonal_ce": 0.5746769905090332,
+    "finite": 0.0064652967266738415,
+    "endpoint_kl": 0.0063072326593101025,
+    "temporal_derivative": 0.00015806396550033242
+  },
+  {
+    "step": 707,
+    "loss": 0.6463831067085266,
+    "diagonal_ce": 0.6403030157089233,
+    "finite": 0.006080093327909708,
+    "endpoint_kl": 0.0059634968638420105,
+    "temporal_derivative": 0.00011659661686280742
+  },
+  {
+    "step": 708,
+    "loss": 0.544768214225769,
+    "diagonal_ce": 0.5389262437820435,
+    "finite": 0.0058419834822416306,
+    "endpoint_kl": 0.005698459222912788,
+    "temporal_derivative": 0.0001435242738807574
+  },
+  {
+    "step": 709,
+    "loss": 0.5567151308059692,
+    "diagonal_ce": 0.550452470779419,
+    "finite": 0.006262651178985834,
+    "endpoint_kl": 0.006068152375519276,
+    "temporal_derivative": 0.00019449902174528688
+  },
+  {
+    "step": 710,
+    "loss": 0.5951290726661682,
+    "diagonal_ce": 0.5891626477241516,
+    "finite": 0.00596642168238759,
+    "endpoint_kl": 0.005816098768264055,
+    "temporal_derivative": 0.00015032273950055242
+  },
+  {
+    "step": 711,
+    "loss": 0.49937546253204346,
+    "diagonal_ce": 0.4932955205440521,
+    "finite": 0.006079945247620344,
+    "endpoint_kl": 0.005936027504503727,
+    "temporal_derivative": 0.00014391793229151517
+  },
+  {
+    "step": 712,
+    "loss": 0.6350840926170349,
+    "diagonal_ce": 0.6297180652618408,
+    "finite": 0.005366039462387562,
+    "endpoint_kl": 0.00519173126667738,
+    "temporal_derivative": 0.0001743080938467756
+  },
+  {
+    "step": 713,
+    "loss": 0.5380554795265198,
+    "diagonal_ce": 0.5315045714378357,
+    "finite": 0.006550897844135761,
+    "endpoint_kl": 0.00633544335141778,
+    "temporal_derivative": 0.00021545434719882905
+  },
+  {
+    "step": 714,
+    "loss": 0.4232168197631836,
+    "diagonal_ce": 0.416879802942276,
+    "finite": 0.006337022874504328,
+    "endpoint_kl": 0.006210680119693279,
+    "temporal_derivative": 0.00012634284212253988
+  },
+  {
+    "step": 715,
+    "loss": 0.6033551096916199,
+    "diagonal_ce": 0.596333384513855,
+    "finite": 0.007021752186119556,
+    "endpoint_kl": 0.0069351037964224815,
+    "temporal_derivative": 8.664852066431195e-05
+  },
+  {
+    "step": 716,
+    "loss": 0.6519342660903931,
+    "diagonal_ce": 0.6449411511421204,
+    "finite": 0.006993115413933992,
+    "endpoint_kl": 0.006746980361640453,
+    "temporal_derivative": 0.0002461348776705563
+  },
+  {
+    "step": 717,
+    "loss": 0.6026148796081543,
+    "diagonal_ce": 0.5952926278114319,
+    "finite": 0.007322270423173904,
+    "endpoint_kl": 0.007178438827395439,
+    "temporal_derivative": 0.00014383165398612618
+  },
+  {
+    "step": 718,
+    "loss": 0.6189262270927429,
+    "diagonal_ce": 0.6127955317497253,
+    "finite": 0.00613071583211422,
+    "endpoint_kl": 0.006016128230839968,
+    "temporal_derivative": 0.00011458747030701488
+  },
+  {
+    "step": 719,
+    "loss": 0.6071016192436218,
+    "diagonal_ce": 0.6004580855369568,
+    "finite": 0.00664356118068099,
+    "endpoint_kl": 0.0065260957926511765,
+    "temporal_derivative": 0.00011746518430300057
+  },
+  {
+    "step": 720,
+    "loss": 0.5234673023223877,
+    "diagonal_ce": 0.5168216228485107,
+    "finite": 0.006645681336522102,
+    "endpoint_kl": 0.006454744376242161,
+    "temporal_derivative": 0.00019093717855866998
+  },
+  {
+    "step": 721,
+    "loss": 0.5153053402900696,
+    "diagonal_ce": 0.509163498878479,
+    "finite": 0.006141830701380968,
+    "endpoint_kl": 0.005945092067122459,
+    "temporal_derivative": 0.00019673860515467823
+  },
+  {
+    "step": 722,
+    "loss": 0.4959768056869507,
+    "diagonal_ce": 0.4879300892353058,
+    "finite": 0.008046726696193218,
+    "endpoint_kl": 0.007813354954123497,
+    "temporal_derivative": 0.0002333713200641796
+  },
+  {
+    "step": 723,
+    "loss": 0.49786075949668884,
+    "diagonal_ce": 0.4907471239566803,
+    "finite": 0.007113631349056959,
+    "endpoint_kl": 0.006828336510807276,
+    "temporal_derivative": 0.0002852950128726661
+  },
+  {
+    "step": 724,
+    "loss": 0.5955720543861389,
+    "diagonal_ce": 0.5894937515258789,
+    "finite": 0.00607832008972764,
+    "endpoint_kl": 0.0059068771079182625,
+    "temporal_derivative": 0.00017144298180937767
+  },
+  {
+    "step": 725,
+    "loss": 0.6649847030639648,
+    "diagonal_ce": 0.6568458676338196,
+    "finite": 0.008138840086758137,
+    "endpoint_kl": 0.007944978773593903,
+    "temporal_derivative": 0.00019386121130082756
+  },
+  {
+    "step": 726,
+    "loss": 0.5756177306175232,
+    "diagonal_ce": 0.5689859986305237,
+    "finite": 0.006631744094192982,
+    "endpoint_kl": 0.006480411626398563,
+    "temporal_derivative": 0.00015133246779441833
+  },
+  {
+    "step": 727,
+    "loss": 0.3872055411338806,
+    "diagonal_ce": 0.3805377185344696,
+    "finite": 0.006667819339782,
+    "endpoint_kl": 0.006529740523546934,
+    "temporal_derivative": 0.0001380789326503873
+  },
+  {
+    "step": 728,
+    "loss": 0.5784876346588135,
+    "diagonal_ce": 0.5715195536613464,
+    "finite": 0.006968085654079914,
+    "endpoint_kl": 0.006728297099471092,
+    "temporal_derivative": 0.0002397884672973305
+  },
+  {
+    "step": 729,
+    "loss": 0.6055986881256104,
+    "diagonal_ce": 0.5992461442947388,
+    "finite": 0.006352570839226246,
+    "endpoint_kl": 0.006224276032298803,
+    "temporal_derivative": 0.00012829496699851006
+  },
+  {
+    "step": 730,
+    "loss": 0.5975993275642395,
+    "diagonal_ce": 0.5912742018699646,
+    "finite": 0.0063251168467104435,
+    "endpoint_kl": 0.006121854763478041,
+    "temporal_derivative": 0.0002032620832324028
+  },
+  {
+    "step": 731,
+    "loss": 0.5500749945640564,
+    "diagonal_ce": 0.543350100517273,
+    "finite": 0.006724892649799585,
+    "endpoint_kl": 0.006581206806004047,
+    "temporal_derivative": 0.00014368574193213135
+  },
+  {
+    "step": 732,
+    "loss": 0.5662954449653625,
+    "diagonal_ce": 0.5612328052520752,
+    "finite": 0.0050626276060938835,
+    "endpoint_kl": 0.004950725473463535,
+    "temporal_derivative": 0.00011190225632162765
+  },
+  {
+    "step": 733,
+    "loss": 0.4771178960800171,
+    "diagonal_ce": 0.47057223320007324,
+    "finite": 0.006545654498040676,
+    "endpoint_kl": 0.006442458834499121,
+    "temporal_derivative": 0.00010319563443772495
+  },
+  {
+    "step": 734,
+    "loss": 0.6542531251907349,
+    "diagonal_ce": 0.6490411758422852,
+    "finite": 0.005211926996707916,
+    "endpoint_kl": 0.005022440105676651,
+    "temporal_derivative": 0.00018948709475807846
+  },
+  {
+    "step": 735,
+    "loss": 0.5904488563537598,
+    "diagonal_ce": 0.5841745734214783,
+    "finite": 0.006274308543652296,
+    "endpoint_kl": 0.006077418103814125,
+    "temporal_derivative": 0.00019689029431901872
+  },
+  {
+    "step": 736,
+    "loss": 0.7543730139732361,
+    "diagonal_ce": 0.7480251789093018,
+    "finite": 0.006347807589918375,
+    "endpoint_kl": 0.006188742816448212,
+    "temporal_derivative": 0.0001590648025739938
+  },
+  {
+    "step": 737,
+    "loss": 0.404967725276947,
+    "diagonal_ce": 0.39701199531555176,
+    "finite": 0.007955732755362988,
+    "endpoint_kl": 0.0077634165063500404,
+    "temporal_derivative": 0.00019231614714954048
+  },
+  {
+    "step": 738,
+    "loss": 0.45946004986763,
+    "diagonal_ce": 0.45259419083595276,
+    "finite": 0.0068658459931612015,
+    "endpoint_kl": 0.006674234755337238,
+    "temporal_derivative": 0.00019161129603162408
+  },
+  {
+    "step": 739,
+    "loss": 0.3819310665130615,
+    "diagonal_ce": 0.3757423758506775,
+    "finite": 0.006188705563545227,
+    "endpoint_kl": 0.006079625803977251,
+    "temporal_derivative": 0.00010907980322372168
+  },
+  {
+    "step": 740,
+    "loss": 0.4918018579483032,
+    "diagonal_ce": 0.4859485626220703,
+    "finite": 0.005853280890733004,
+    "endpoint_kl": 0.005764659959822893,
+    "temporal_derivative": 8.86210982571356e-05
+  },
+  {
+    "step": 741,
+    "loss": 0.6882324814796448,
+    "diagonal_ce": 0.6812557578086853,
+    "finite": 0.006976712495088577,
+    "endpoint_kl": 0.0068064481019973755,
+    "temporal_derivative": 0.0001702644512988627
+  },
+  {
+    "step": 742,
+    "loss": 0.5799226760864258,
+    "diagonal_ce": 0.5723123550415039,
+    "finite": 0.007610301487147808,
+    "endpoint_kl": 0.007447640411555767,
+    "temporal_derivative": 0.00016266087186522782
+  },
+  {
+    "step": 743,
+    "loss": 0.5793757438659668,
+    "diagonal_ce": 0.5713766813278198,
+    "finite": 0.007999061606824398,
+    "endpoint_kl": 0.007719047367572784,
+    "temporal_derivative": 0.00028001394821330905
+  },
+  {
+    "step": 744,
+    "loss": 0.6683167219161987,
+    "diagonal_ce": 0.659168004989624,
+    "finite": 0.009148703888058662,
+    "endpoint_kl": 0.008891351521015167,
+    "temporal_derivative": 0.00025735245435498655
+  },
+  {
+    "step": 745,
+    "loss": 0.4639107584953308,
+    "diagonal_ce": 0.4562855362892151,
+    "finite": 0.007625225931406021,
+    "endpoint_kl": 0.007500661537051201,
+    "temporal_derivative": 0.0001245642197318375
+  },
+  {
+    "step": 746,
+    "loss": 0.7315239906311035,
+    "diagonal_ce": 0.7248396873474121,
+    "finite": 0.006684323772788048,
+    "endpoint_kl": 0.006538374349474907,
+    "temporal_derivative": 0.00014594958338420838
+  },
+  {
+    "step": 747,
+    "loss": 0.4564017951488495,
+    "diagonal_ce": 0.44953495264053345,
+    "finite": 0.006866855081170797,
+    "endpoint_kl": 0.006754416972398758,
+    "temporal_derivative": 0.00011243797052884474
+  },
+  {
+    "step": 748,
+    "loss": 0.4491693675518036,
+    "diagonal_ce": 0.44378888607025146,
+    "finite": 0.005380480550229549,
+    "endpoint_kl": 0.005290873348712921,
+    "temporal_derivative": 8.960740524344146e-05
+  },
+  {
+    "step": 749,
+    "loss": 0.6017531752586365,
+    "diagonal_ce": 0.5943822860717773,
+    "finite": 0.00737088592723012,
+    "endpoint_kl": 0.007080678828060627,
+    "temporal_derivative": 0.00029020701185800135
+  },
+  {
+    "step": 750,
+    "loss": 0.5985428690910339,
+    "diagonal_ce": 0.5920208096504211,
+    "finite": 0.006522040814161301,
+    "endpoint_kl": 0.006371489726006985,
+    "temporal_derivative": 0.0001505513209849596
+  },
+  {
+    "step": 751,
+    "loss": 0.6297186017036438,
+    "diagonal_ce": 0.6235091686248779,
+    "finite": 0.006209445185959339,
+    "endpoint_kl": 0.006062301807105541,
+    "temporal_derivative": 0.00014714327699039131
+  },
+  {
+    "step": 752,
+    "loss": 0.6150244474411011,
+    "diagonal_ce": 0.607343316078186,
+    "finite": 0.007681143004447222,
+    "endpoint_kl": 0.007425950840115547,
+    "temporal_derivative": 0.0002551921643316746
+  },
+  {
+    "step": 753,
+    "loss": 0.5262832641601562,
+    "diagonal_ce": 0.5201354622840881,
+    "finite": 0.00614777859300375,
+    "endpoint_kl": 0.0060300822369754314,
+    "temporal_derivative": 0.00011769627599278465
+  },
+  {
+    "step": 754,
+    "loss": 0.6207644939422607,
+    "diagonal_ce": 0.6132533550262451,
+    "finite": 0.00751115009188652,
+    "endpoint_kl": 0.007278106641024351,
+    "temporal_derivative": 0.0002330433198949322
+  },
+  {
+    "step": 755,
+    "loss": 0.5525094270706177,
+    "diagonal_ce": 0.5466247200965881,
+    "finite": 0.005884718149900436,
+    "endpoint_kl": 0.005715245846658945,
+    "temporal_derivative": 0.00016947253607213497
+  },
+  {
+    "step": 756,
+    "loss": 0.5330854058265686,
+    "diagonal_ce": 0.5266293883323669,
+    "finite": 0.006456000730395317,
+    "endpoint_kl": 0.006287239957600832,
+    "temporal_derivative": 0.00016876096196938306
+  },
+  {
+    "step": 757,
+    "loss": 0.5515030026435852,
+    "diagonal_ce": 0.5455549359321594,
+    "finite": 0.0059480913914740086,
+    "endpoint_kl": 0.005797304213047028,
+    "temporal_derivative": 0.00015078704745974392
+  },
+  {
+    "step": 758,
+    "loss": 0.6009770035743713,
+    "diagonal_ce": 0.5955103635787964,
+    "finite": 0.0054666465148329735,
+    "endpoint_kl": 0.005300454329699278,
+    "temporal_derivative": 0.00016619217058178037
+  },
+  {
+    "step": 759,
+    "loss": 0.6236315369606018,
+    "diagonal_ce": 0.617308497428894,
+    "finite": 0.006323029287159443,
+    "endpoint_kl": 0.006119069177657366,
+    "temporal_derivative": 0.00020396024046931416
+  },
+  {
+    "step": 760,
+    "loss": 0.6566159129142761,
+    "diagonal_ce": 0.6500542163848877,
+    "finite": 0.006561709102243185,
+    "endpoint_kl": 0.006365290377289057,
+    "temporal_derivative": 0.00019641882681753486
+  },
+  {
+    "step": 761,
+    "loss": 0.6810170412063599,
+    "diagonal_ce": 0.6744114756584167,
+    "finite": 0.0066055599600076675,
+    "endpoint_kl": 0.0063971285708248615,
+    "temporal_derivative": 0.0002084313309751451
+  },
+  {
+    "step": 762,
+    "loss": 0.557891309261322,
+    "diagonal_ce": 0.5504947304725647,
+    "finite": 0.0073965792544186115,
+    "endpoint_kl": 0.007142190355807543,
+    "temporal_derivative": 0.0002543888404034078
+  },
+  {
+    "step": 763,
+    "loss": 0.5973039865493774,
+    "diagonal_ce": 0.591376543045044,
+    "finite": 0.0059274532832205296,
+    "endpoint_kl": 0.005727590061724186,
+    "temporal_derivative": 0.00019986323604825884
+  },
+  {
+    "step": 764,
+    "loss": 0.5323700308799744,
+    "diagonal_ce": 0.5261902809143066,
+    "finite": 0.0061797210946679115,
+    "endpoint_kl": 0.00607147254049778,
+    "temporal_derivative": 0.00010824832133948803
+  },
+  {
+    "step": 765,
+    "loss": 0.5167126655578613,
+    "diagonal_ce": 0.5111691355705261,
+    "finite": 0.005543546751141548,
+    "endpoint_kl": 0.005361110903322697,
+    "temporal_derivative": 0.00018243584781885147
+  },
+  {
+    "step": 766,
+    "loss": 0.5403987169265747,
+    "diagonal_ce": 0.5330583453178406,
+    "finite": 0.007340366952121258,
+    "endpoint_kl": 0.007121237460523844,
+    "temporal_derivative": 0.00021912925876677036
+  },
+  {
+    "step": 767,
+    "loss": 0.6710996031761169,
+    "diagonal_ce": 0.6639593243598938,
+    "finite": 0.007140303961932659,
+    "endpoint_kl": 0.00690788310021162,
+    "temporal_derivative": 0.00023242093448061496
+  },
+  {
+    "step": 768,
+    "loss": 0.5312067866325378,
+    "diagonal_ce": 0.523792564868927,
+    "finite": 0.00741425110027194,
+    "endpoint_kl": 0.007157717831432819,
+    "temporal_derivative": 0.00025653321063145995
+  },
+  {
+    "step": 769,
+    "loss": 0.5651792883872986,
+    "diagonal_ce": 0.556740403175354,
+    "finite": 0.008438902907073498,
+    "endpoint_kl": 0.0082051707431674,
+    "temporal_derivative": 0.00023373225121758878
+  },
+  {
+    "step": 770,
+    "loss": 0.5822057723999023,
+    "diagonal_ce": 0.5749062895774841,
+    "finite": 0.007299492135643959,
+    "endpoint_kl": 0.007125211879611015,
+    "temporal_derivative": 0.00017428038700018078
+  },
+  {
+    "step": 771,
+    "loss": 0.560845673084259,
+    "diagonal_ce": 0.5543158054351807,
+    "finite": 0.006529885809868574,
+    "endpoint_kl": 0.006337050348520279,
+    "temporal_derivative": 0.00019283533038105816
+  },
+  {
+    "step": 772,
+    "loss": 0.49431076645851135,
+    "diagonal_ce": 0.4870714247226715,
+    "finite": 0.007239332888275385,
+    "endpoint_kl": 0.007065800949931145,
+    "temporal_derivative": 0.00017353205475956202
+  },
+  {
+    "step": 773,
+    "loss": 0.5037099719047546,
+    "diagonal_ce": 0.4976065754890442,
+    "finite": 0.0061033740639686584,
+    "endpoint_kl": 0.005945640616118908,
+    "temporal_derivative": 0.00015773330233059824
+  },
+  {
+    "step": 774,
+    "loss": 0.4996042251586914,
+    "diagonal_ce": 0.4926053583621979,
+    "finite": 0.006998877041041851,
+    "endpoint_kl": 0.006815006025135517,
+    "temporal_derivative": 0.00018387098680250347
+  },
+  {
+    "step": 775,
+    "loss": 0.5684735774993896,
+    "diagonal_ce": 0.5619622468948364,
+    "finite": 0.006511350627988577,
+    "endpoint_kl": 0.006358871702104807,
+    "temporal_derivative": 0.00015247889677993953
+  },
+  {
+    "step": 776,
+    "loss": 0.5661039352416992,
+    "diagonal_ce": 0.5584772825241089,
+    "finite": 0.0076266322284936905,
+    "endpoint_kl": 0.007424348499625921,
+    "temporal_derivative": 0.00020228383073117584
+  },
+  {
+    "step": 777,
+    "loss": 0.5221609473228455,
+    "diagonal_ce": 0.5159362554550171,
+    "finite": 0.006224708631634712,
+    "endpoint_kl": 0.0060216947458684444,
+    "temporal_derivative": 0.00020301382755860686
+  },
+  {
+    "step": 778,
+    "loss": 0.5287834405899048,
+    "diagonal_ce": 0.5233913064002991,
+    "finite": 0.005392160732299089,
+    "endpoint_kl": 0.005290163680911064,
+    "temporal_derivative": 0.00010199718235526234
+  },
+  {
+    "step": 779,
+    "loss": 0.4701904058456421,
+    "diagonal_ce": 0.46491822600364685,
+    "finite": 0.00527219008654356,
+    "endpoint_kl": 0.0051207104697823524,
+    "temporal_derivative": 0.00015147964586503804
+  },
+  {
+    "step": 780,
+    "loss": 0.4624488651752472,
+    "diagonal_ce": 0.4555639624595642,
+    "finite": 0.006884916219860315,
+    "endpoint_kl": 0.006706260144710541,
+    "temporal_derivative": 0.000178656104253605
+  },
+  {
+    "step": 781,
+    "loss": 0.48469308018684387,
+    "diagonal_ce": 0.4788750410079956,
+    "finite": 0.005818028934299946,
+    "endpoint_kl": 0.005667214281857014,
+    "temporal_derivative": 0.00015081441961228848
+  },
+  {
+    "step": 782,
+    "loss": 0.5656440258026123,
+    "diagonal_ce": 0.5595113039016724,
+    "finite": 0.006132696755230427,
+    "endpoint_kl": 0.005967737641185522,
+    "temporal_derivative": 0.00016495928866788745
+  },
+  {
+    "step": 783,
+    "loss": 0.4859340190887451,
+    "diagonal_ce": 0.47807177901268005,
+    "finite": 0.007862230762839317,
+    "endpoint_kl": 0.007694443222135305,
+    "temporal_derivative": 0.0001677876862231642
+  },
+  {
+    "step": 784,
+    "loss": 0.5006133913993835,
+    "diagonal_ce": 0.49525725841522217,
+    "finite": 0.0053561097010970116,
+    "endpoint_kl": 0.005122537259012461,
+    "temporal_derivative": 0.00023357239842880517
+  },
+  {
+    "step": 785,
+    "loss": 0.5108626484870911,
+    "diagonal_ce": 0.5039520859718323,
+    "finite": 0.0069105420261621475,
+    "endpoint_kl": 0.0065857358276844025,
+    "temporal_derivative": 0.0003248059656471014
+  },
+  {
+    "step": 786,
+    "loss": 0.49100545048713684,
+    "diagonal_ce": 0.48329344391822815,
+    "finite": 0.0077120112255215645,
+    "endpoint_kl": 0.007434334140270948,
+    "temporal_derivative": 0.0002776772598735988
+  },
+  {
+    "step": 787,
+    "loss": 0.6744115948677063,
+    "diagonal_ce": 0.667676568031311,
+    "finite": 0.006735047325491905,
+    "endpoint_kl": 0.006527322810143232,
+    "temporal_derivative": 0.00020772470452357084
+  },
+  {
+    "step": 788,
+    "loss": 0.6340000629425049,
+    "diagonal_ce": 0.6277197003364563,
+    "finite": 0.006280337926000357,
+    "endpoint_kl": 0.006000232417136431,
+    "temporal_derivative": 0.0002801056834869087
+  },
+  {
+    "step": 789,
+    "loss": 0.5033897161483765,
+    "diagonal_ce": 0.4968414604663849,
+    "finite": 0.0065482547506690025,
+    "endpoint_kl": 0.006433076225221157,
+    "temporal_derivative": 0.00011517862731125206
+  },
+  {
+    "step": 790,
+    "loss": 0.5745237469673157,
+    "diagonal_ce": 0.568123459815979,
+    "finite": 0.006400284823030233,
+    "endpoint_kl": 0.006180522497743368,
+    "temporal_derivative": 0.00021976249990984797
+  },
+  {
+    "step": 791,
+    "loss": 0.6339640021324158,
+    "diagonal_ce": 0.6270415186882019,
+    "finite": 0.006922489497810602,
+    "endpoint_kl": 0.006715437397360802,
+    "temporal_derivative": 0.0002070519549306482
+  },
+  {
+    "step": 792,
+    "loss": 0.5034928917884827,
+    "diagonal_ce": 0.49828892946243286,
+    "finite": 0.005203988868743181,
+    "endpoint_kl": 0.005019499454647303,
+    "temporal_derivative": 0.0001844896178226918
+  },
+  {
+    "step": 793,
+    "loss": 0.47534510493278503,
+    "diagonal_ce": 0.4699709713459015,
+    "finite": 0.005374130327254534,
+    "endpoint_kl": 0.005226333625614643,
+    "temporal_derivative": 0.0001477969199186191
+  },
+  {
+    "step": 794,
+    "loss": 0.7005927562713623,
+    "diagonal_ce": 0.6922231912612915,
+    "finite": 0.008369543589651585,
+    "endpoint_kl": 0.008092479780316353,
+    "temporal_derivative": 0.00027706395485438406
+  },
+  {
+    "step": 795,
+    "loss": 0.6721974611282349,
+    "diagonal_ce": 0.6647739410400391,
+    "finite": 0.00742349261417985,
+    "endpoint_kl": 0.007126238197088242,
+    "temporal_derivative": 0.0002972545917145908
+  },
+  {
+    "step": 796,
+    "loss": 0.521242082118988,
+    "diagonal_ce": 0.5149374008178711,
+    "finite": 0.006304679438471794,
+    "endpoint_kl": 0.0061601391062140465,
+    "temporal_derivative": 0.0001445404050173238
+  },
+  {
+    "step": 797,
+    "loss": 0.464790940284729,
+    "diagonal_ce": 0.4593949317932129,
+    "finite": 0.005396013613790274,
+    "endpoint_kl": 0.005259332247078419,
+    "temporal_derivative": 0.00013668133760802448
+  },
+  {
+    "step": 798,
+    "loss": 0.44000324606895447,
+    "diagonal_ce": 0.4328745901584625,
+    "finite": 0.007128659635782242,
+    "endpoint_kl": 0.007002569735050201,
+    "temporal_derivative": 0.00012609003169927746
+  },
+  {
+    "step": 799,
+    "loss": 0.5206798315048218,
+    "diagonal_ce": 0.5104286074638367,
+    "finite": 0.010251209139823914,
+    "endpoint_kl": 0.009977282024919987,
+    "temporal_derivative": 0.0002739272895269096
+  },
+  {
+    "step": 800,
+    "loss": 0.5458317399024963,
+    "diagonal_ce": 0.537293016910553,
+    "finite": 0.008538703434169292,
+    "endpoint_kl": 0.008396850898861885,
+    "temporal_derivative": 0.0001418524916516617
+  },
+  {
+    "step": 801,
+    "loss": 0.7014637589454651,
+    "diagonal_ce": 0.6910190582275391,
+    "finite": 0.010444728657603264,
+    "endpoint_kl": 0.010175359435379505,
+    "temporal_derivative": 0.0002693694841582328
+  },
+  {
+    "step": 802,
+    "loss": 0.5920074582099915,
+    "diagonal_ce": 0.5816385746002197,
+    "finite": 0.010368897579610348,
+    "endpoint_kl": 0.010065268725156784,
+    "temporal_derivative": 0.0003036288544535637
+  },
+  {
+    "step": 803,
+    "loss": 0.6582441329956055,
+    "diagonal_ce": 0.65071040391922,
+    "finite": 0.007533753290772438,
+    "endpoint_kl": 0.0074160597287118435,
+    "temporal_derivative": 0.00011769341654144228
+  },
+  {
+    "step": 804,
+    "loss": 0.3885726034641266,
+    "diagonal_ce": 0.38102275133132935,
+    "finite": 0.0075498465448617935,
+    "endpoint_kl": 0.007416109554469585,
+    "temporal_derivative": 0.00013373717956710607
+  },
+  {
+    "step": 805,
+    "loss": 0.5789387226104736,
+    "diagonal_ce": 0.5698924660682678,
+    "finite": 0.009046250954270363,
+    "endpoint_kl": 0.008839004673063755,
+    "temporal_derivative": 0.00020724664500448853
+  },
+  {
+    "step": 806,
+    "loss": 0.5024757385253906,
+    "diagonal_ce": 0.4952532947063446,
+    "finite": 0.007222468499094248,
+    "endpoint_kl": 0.006970493588596582,
+    "temporal_derivative": 0.00025197482318617404
+  },
+  {
+    "step": 807,
+    "loss": 0.48767247796058655,
+    "diagonal_ce": 0.47976619005203247,
+    "finite": 0.007906300015747547,
+    "endpoint_kl": 0.007622030563652515,
+    "temporal_derivative": 0.0002842694811988622
+  },
+  {
+    "step": 808,
+    "loss": 0.6404882073402405,
+    "diagonal_ce": 0.6336444020271301,
+    "finite": 0.006843776907771826,
+    "endpoint_kl": 0.006581627298146486,
+    "temporal_derivative": 0.0002621496678330004
+  },
+  {
+    "step": 809,
+    "loss": 0.6679223775863647,
+    "diagonal_ce": 0.6603859066963196,
+    "finite": 0.00753645459190011,
+    "endpoint_kl": 0.007252245210111141,
+    "temporal_derivative": 0.0002842095564119518
+  },
+  {
+    "step": 810,
+    "loss": 0.43400225043296814,
+    "diagonal_ce": 0.4255297780036926,
+    "finite": 0.008472462184727192,
+    "endpoint_kl": 0.00806854572147131,
+    "temporal_derivative": 0.0004039168416056782
+  },
+  {
+    "step": 811,
+    "loss": 0.6150563359260559,
+    "diagonal_ce": 0.6099299788475037,
+    "finite": 0.005126373842358589,
+    "endpoint_kl": 0.004905483685433865,
+    "temporal_derivative": 0.00022089012782089412
+  },
+  {
+    "step": 812,
+    "loss": 0.4962144196033478,
+    "diagonal_ce": 0.49022984504699707,
+    "finite": 0.0059845601208508015,
+    "endpoint_kl": 0.005748157389461994,
+    "temporal_derivative": 0.00023640286235604435
+  },
+  {
+    "step": 813,
+    "loss": 0.4725608825683594,
+    "diagonal_ce": 0.4661290943622589,
+    "finite": 0.006431787274777889,
+    "endpoint_kl": 0.00604851683601737,
+    "temporal_derivative": 0.00038327029324136674
+  },
+  {
+    "step": 814,
+    "loss": 0.6374214291572571,
+    "diagonal_ce": 0.6320038437843323,
+    "finite": 0.005417571868747473,
+    "endpoint_kl": 0.005187882576137781,
+    "temporal_derivative": 0.00022968910343479365
+  },
+  {
+    "step": 815,
+    "loss": 0.8683335185050964,
+    "diagonal_ce": 0.858494758605957,
+    "finite": 0.009838785976171494,
+    "endpoint_kl": 0.009168129414319992,
+    "temporal_derivative": 0.0006706567946821451
+  },
+  {
+    "step": 816,
+    "loss": 0.7285875678062439,
+    "diagonal_ce": 0.7210607528686523,
+    "finite": 0.007526830304414034,
+    "endpoint_kl": 0.00714061688631773,
+    "temporal_derivative": 0.00038621327257715166
+  },
+  {
+    "step": 817,
+    "loss": 0.45883166790008545,
+    "diagonal_ce": 0.45339900255203247,
+    "finite": 0.0054326592944562435,
+    "endpoint_kl": 0.005270194262266159,
+    "temporal_derivative": 0.0001624652068130672
+  },
+  {
+    "step": 818,
+    "loss": 0.4730272591114044,
+    "diagonal_ce": 0.46475133299827576,
+    "finite": 0.008275923319160938,
+    "endpoint_kl": 0.00793920736759901,
+    "temporal_derivative": 0.00033671598066575825
+  },
+  {
+    "step": 819,
+    "loss": 0.4938074052333832,
+    "diagonal_ce": 0.4864960312843323,
+    "finite": 0.00731136417016387,
+    "endpoint_kl": 0.006980656646192074,
+    "temporal_derivative": 0.00033070764038711786
+  },
+  {
+    "step": 820,
+    "loss": 0.508192241191864,
+    "diagonal_ce": 0.5007955431938171,
+    "finite": 0.0073966821655631065,
+    "endpoint_kl": 0.007141745649278164,
+    "temporal_derivative": 0.0002549365162849426
+  },
+  {
+    "step": 821,
+    "loss": 0.44190514087677,
+    "diagonal_ce": 0.43521183729171753,
+    "finite": 0.006693313829600811,
+    "endpoint_kl": 0.006487454287707806,
+    "temporal_derivative": 0.00020585968741215765
+  },
+  {
+    "step": 822,
+    "loss": 0.571259617805481,
+    "diagonal_ce": 0.5629216432571411,
+    "finite": 0.00833796989172697,
+    "endpoint_kl": 0.007979207672178745,
+    "temporal_derivative": 0.00035876251058652997
+  },
+  {
+    "step": 823,
+    "loss": 0.4962122440338135,
+    "diagonal_ce": 0.4868086874485016,
+    "finite": 0.009403541684150696,
+    "endpoint_kl": 0.008914219215512276,
+    "temporal_derivative": 0.0004893226432614028
+  },
+  {
+    "step": 824,
+    "loss": 0.4799899458885193,
+    "diagonal_ce": 0.4693114161491394,
+    "finite": 0.010678528808057308,
+    "endpoint_kl": 0.010084062814712524,
+    "temporal_derivative": 0.0005944657023064792
+  },
+  {
+    "step": 825,
+    "loss": 0.5109338164329529,
+    "diagonal_ce": 0.5041090846061707,
+    "finite": 0.006824708078056574,
+    "endpoint_kl": 0.006614535115659237,
+    "temporal_derivative": 0.00021017296239733696
+  },
+  {
+    "step": 826,
+    "loss": 0.5997949242591858,
+    "diagonal_ce": 0.5946537852287292,
+    "finite": 0.00514113949611783,
+    "endpoint_kl": 0.004819156136363745,
+    "temporal_derivative": 0.00032198341796174645
+  },
+  {
+    "step": 827,
+    "loss": 0.5868188738822937,
+    "diagonal_ce": 0.5810263752937317,
+    "finite": 0.0057925088331103325,
+    "endpoint_kl": 0.0054613687098026276,
+    "temporal_derivative": 0.0003311402106191963
+  },
+  {
+    "step": 828,
+    "loss": 0.36921581625938416,
+    "diagonal_ce": 0.36323946714401245,
+    "finite": 0.005976347718387842,
+    "endpoint_kl": 0.005655510351061821,
+    "temporal_derivative": 0.00032083754194900393
+  },
+  {
+    "step": 829,
+    "loss": 0.5342451930046082,
+    "diagonal_ce": 0.525562584400177,
+    "finite": 0.008682633750140667,
+    "endpoint_kl": 0.008353586308658123,
+    "temporal_derivative": 0.00032904729596339166
+  },
+  {
+    "step": 830,
+    "loss": 0.6377139687538147,
+    "diagonal_ce": 0.6310611367225647,
+    "finite": 0.006652808748185635,
+    "endpoint_kl": 0.006445625796914101,
+    "temporal_derivative": 0.00020718305313494056
+  },
+  {
+    "step": 831,
+    "loss": 0.5258645415306091,
+    "diagonal_ce": 0.5178309082984924,
+    "finite": 0.008033618330955505,
+    "endpoint_kl": 0.007797186728566885,
+    "temporal_derivative": 0.00023643113672733307
+  },
+  {
+    "step": 832,
+    "loss": 0.8206322193145752,
+    "diagonal_ce": 0.8134353756904602,
+    "finite": 0.007196828257292509,
+    "endpoint_kl": 0.006859030574560165,
+    "temporal_derivative": 0.0003377975372131914
+  },
+  {
+    "step": 833,
+    "loss": 0.623615026473999,
+    "diagonal_ce": 0.6167541742324829,
+    "finite": 0.006860842928290367,
+    "endpoint_kl": 0.006571779493242502,
+    "temporal_derivative": 0.0002890635223593563
+  },
+  {
+    "step": 834,
+    "loss": 0.7170390486717224,
+    "diagonal_ce": 0.7092940211296082,
+    "finite": 0.007744998671114445,
+    "endpoint_kl": 0.007391499821096659,
+    "temporal_derivative": 0.0003534989373292774
+  },
+  {
+    "step": 835,
+    "loss": 0.6294448375701904,
+    "diagonal_ce": 0.6213563680648804,
+    "finite": 0.008088448084890842,
+    "endpoint_kl": 0.007868834771215916,
+    "temporal_derivative": 0.00021961360471323133
+  },
+  {
+    "step": 836,
+    "loss": 0.5496743321418762,
+    "diagonal_ce": 0.5400283932685852,
+    "finite": 0.009645934216678143,
+    "endpoint_kl": 0.009398608468472958,
+    "temporal_derivative": 0.00024732566089369357
+  },
+  {
+    "step": 837,
+    "loss": 0.46157389879226685,
+    "diagonal_ce": 0.4545809030532837,
+    "finite": 0.0069930097088217735,
+    "endpoint_kl": 0.006824155803769827,
+    "temporal_derivative": 0.00016885394870769233
+  },
+  {
+    "step": 838,
+    "loss": 0.5403769612312317,
+    "diagonal_ce": 0.5319427251815796,
+    "finite": 0.00843424629420042,
+    "endpoint_kl": 0.007951232604682446,
+    "temporal_derivative": 0.0004830137186218053
+  },
+  {
+    "step": 839,
+    "loss": 0.6112924218177795,
+    "diagonal_ce": 0.6018234491348267,
+    "finite": 0.009468954056501389,
+    "endpoint_kl": 0.009135615080595016,
+    "temporal_derivative": 0.000333339354256168
+  },
+  {
+    "step": 840,
+    "loss": 0.8074396848678589,
+    "diagonal_ce": 0.798734724521637,
+    "finite": 0.008704988285899162,
+    "endpoint_kl": 0.00837791245430708,
+    "temporal_derivative": 0.00032707618083804846
+  },
+  {
+    "step": 841,
+    "loss": 0.47313258051872253,
+    "diagonal_ce": 0.46434274315834045,
+    "finite": 0.008789829909801483,
+    "endpoint_kl": 0.0083462567999959,
+    "temporal_derivative": 0.000443573429947719
+  },
+  {
+    "step": 842,
+    "loss": 0.5615414977073669,
+    "diagonal_ce": 0.5518481135368347,
+    "finite": 0.009693382307887077,
+    "endpoint_kl": 0.009322533383965492,
+    "temporal_derivative": 0.0003708491276483983
+  },
+  {
+    "step": 843,
+    "loss": 0.7202215194702148,
+    "diagonal_ce": 0.7106554508209229,
+    "finite": 0.009566055610775948,
+    "endpoint_kl": 0.009187543764710426,
+    "temporal_derivative": 0.00037851170054636896
+  },
+  {
+    "step": 844,
+    "loss": 0.49068164825439453,
+    "diagonal_ce": 0.485177218914032,
+    "finite": 0.005504414439201355,
+    "endpoint_kl": 0.005269144661724567,
+    "temporal_derivative": 0.00023526980658061802
+  },
+  {
+    "step": 845,
+    "loss": 0.5485758781433105,
+    "diagonal_ce": 0.5416312217712402,
+    "finite": 0.006944680120795965,
+    "endpoint_kl": 0.006675798445940018,
+    "temporal_derivative": 0.0002688816748559475
+  },
+  {
+    "step": 846,
+    "loss": 0.46657463908195496,
+    "diagonal_ce": 0.4587354063987732,
+    "finite": 0.007839235477149487,
+    "endpoint_kl": 0.007409154437482357,
+    "temporal_derivative": 0.0004300809814594686
+  },
+  {
+    "step": 847,
+    "loss": 0.564288854598999,
+    "diagonal_ce": 0.5546944737434387,
+    "finite": 0.009594390168786049,
+    "endpoint_kl": 0.009238103404641151,
+    "temporal_derivative": 0.00035628670593723655
+  },
+  {
+    "step": 848,
+    "loss": 0.5034596920013428,
+    "diagonal_ce": 0.4964097738265991,
+    "finite": 0.007049919571727514,
+    "endpoint_kl": 0.006758876144886017,
+    "temporal_derivative": 0.00029104333953000605
+  },
+  {
+    "step": 849,
+    "loss": 0.6417283415794373,
+    "diagonal_ce": 0.6333743929862976,
+    "finite": 0.008353971876204014,
+    "endpoint_kl": 0.0080252755433321,
+    "temporal_derivative": 0.0003286963328719139
+  },
+  {
+    "step": 850,
+    "loss": 0.425902783870697,
+    "diagonal_ce": 0.41843175888061523,
+    "finite": 0.007471026852726936,
+    "endpoint_kl": 0.007227771449834108,
+    "temporal_derivative": 0.00024325534468516707
+  },
+  {
+    "step": 851,
+    "loss": 0.5721427202224731,
+    "diagonal_ce": 0.5645923018455505,
+    "finite": 0.007550405338406563,
+    "endpoint_kl": 0.007088305428624153,
+    "temporal_derivative": 0.00046209973515942693
+  },
+  {
+    "step": 852,
+    "loss": 0.5505298972129822,
+    "diagonal_ce": 0.5431909561157227,
+    "finite": 0.00733894482254982,
+    "endpoint_kl": 0.007092147134244442,
+    "temporal_derivative": 0.0002467976009938866
+  },
+  {
+    "step": 853,
+    "loss": 0.45480889081954956,
+    "diagonal_ce": 0.44671887159347534,
+    "finite": 0.008090009912848473,
+    "endpoint_kl": 0.007694855332374573,
+    "temporal_derivative": 0.00039515417302027345
+  },
+  {
+    "step": 854,
+    "loss": 0.686252772808075,
+    "diagonal_ce": 0.6759037971496582,
+    "finite": 0.010348950512707233,
+    "endpoint_kl": 0.009932338260114193,
+    "temporal_derivative": 0.0004166126309428364
+  },
+  {
+    "step": 855,
+    "loss": 0.6452425718307495,
+    "diagonal_ce": 0.6380481123924255,
+    "finite": 0.00719448272138834,
+    "endpoint_kl": 0.006828482262790203,
+    "temporal_derivative": 0.0003660003421828151
+  },
+  {
+    "step": 856,
+    "loss": 0.44711002707481384,
+    "diagonal_ce": 0.44148218631744385,
+    "finite": 0.005627852864563465,
+    "endpoint_kl": 0.005328206345438957,
+    "temporal_derivative": 0.0002996467228513211
+  },
+  {
+    "step": 857,
+    "loss": 0.44786709547042847,
+    "diagonal_ce": 0.44055527448654175,
+    "finite": 0.0073118326254189014,
+    "endpoint_kl": 0.007024463266134262,
+    "temporal_derivative": 0.00028736924286931753
+  },
+  {
+    "step": 858,
+    "loss": 0.4554111659526825,
+    "diagonal_ce": 0.4475180506706238,
+    "finite": 0.007893124595284462,
+    "endpoint_kl": 0.007500557228922844,
+    "temporal_derivative": 0.0003925678029190749
+  },
+  {
+    "step": 859,
+    "loss": 0.5017225742340088,
+    "diagonal_ce": 0.4930557310581207,
+    "finite": 0.00866684690117836,
+    "endpoint_kl": 0.008296235464513302,
+    "temporal_derivative": 0.0003706117277033627
+  },
+  {
+    "step": 860,
+    "loss": 0.5763301253318787,
+    "diagonal_ce": 0.5665328502655029,
+    "finite": 0.009797259233891964,
+    "endpoint_kl": 0.00938219390809536,
+    "temporal_derivative": 0.0004150655004195869
+  },
+  {
+    "step": 861,
+    "loss": 0.6379743218421936,
+    "diagonal_ce": 0.6286287307739258,
+    "finite": 0.009345566853880882,
+    "endpoint_kl": 0.008989551104605198,
+    "temporal_derivative": 0.0003560155746527016
+  },
+  {
+    "step": 862,
+    "loss": 0.6172125339508057,
+    "diagonal_ce": 0.6082776188850403,
+    "finite": 0.008934902027249336,
+    "endpoint_kl": 0.008603212423622608,
+    "temporal_derivative": 0.0003316898364573717
+  },
+  {
+    "step": 863,
+    "loss": 0.7508949637413025,
+    "diagonal_ce": 0.7434055209159851,
+    "finite": 0.007489439100027084,
+    "endpoint_kl": 0.007177813444286585,
+    "temporal_derivative": 0.0003116255684290081
+  },
+  {
+    "step": 864,
+    "loss": 0.5757179260253906,
+    "diagonal_ce": 0.56502366065979,
+    "finite": 0.010694258846342564,
+    "endpoint_kl": 0.010111323557794094,
+    "temporal_derivative": 0.0005829351721331477
+  },
+  {
+    "step": 865,
+    "loss": 0.5980923771858215,
+    "diagonal_ce": 0.5864629745483398,
+    "finite": 0.011629430577158928,
+    "endpoint_kl": 0.01112435758113861,
+    "temporal_derivative": 0.0005050729960203171
+  },
+  {
+    "step": 866,
+    "loss": 0.545189380645752,
+    "diagonal_ce": 0.5371460914611816,
+    "finite": 0.008043293841183186,
+    "endpoint_kl": 0.007788738235831261,
+    "temporal_derivative": 0.00025455589639022946
+  },
+  {
+    "step": 867,
+    "loss": 0.49190860986709595,
+    "diagonal_ce": 0.4826728105545044,
+    "finite": 0.009235791862010956,
+    "endpoint_kl": 0.00870696920901537,
+    "temporal_derivative": 0.0005288224201649427
+  },
+  {
+    "step": 868,
+    "loss": 0.48446160554885864,
+    "diagonal_ce": 0.4751768112182617,
+    "finite": 0.00928480364382267,
+    "endpoint_kl": 0.008828388527035713,
+    "temporal_derivative": 0.0004564150294754654
+  },
+  {
+    "step": 869,
+    "loss": 0.673206090927124,
+    "diagonal_ce": 0.6616474390029907,
+    "finite": 0.011558646336197853,
+    "endpoint_kl": 0.010946025140583515,
+    "temporal_derivative": 0.0006126208463683724
+  },
+  {
+    "step": 870,
+    "loss": 0.516822874546051,
+    "diagonal_ce": 0.5092388987541199,
+    "finite": 0.007583980448544025,
+    "endpoint_kl": 0.007236843463033438,
+    "temporal_derivative": 0.0003471370437182486
+  },
+  {
+    "step": 871,
+    "loss": 0.6296883225440979,
+    "diagonal_ce": 0.6205204725265503,
+    "finite": 0.009167875163257122,
+    "endpoint_kl": 0.008711909875273705,
+    "temporal_derivative": 0.0004559655790217221
+  },
+  {
+    "step": 872,
+    "loss": 0.5146898627281189,
+    "diagonal_ce": 0.5052259564399719,
+    "finite": 0.00946392584592104,
+    "endpoint_kl": 0.008951645344495773,
+    "temporal_derivative": 0.0005122805596329272
+  },
+  {
+    "step": 873,
+    "loss": 0.49678054451942444,
+    "diagonal_ce": 0.4869668483734131,
+    "finite": 0.00981370359659195,
+    "endpoint_kl": 0.009166297502815723,
+    "temporal_derivative": 0.0006474056863225996
+  },
+  {
+    "step": 874,
+    "loss": 0.6536794900894165,
+    "diagonal_ce": 0.6445284485816956,
+    "finite": 0.0091510359197855,
+    "endpoint_kl": 0.008699615485966206,
+    "temporal_derivative": 0.00045142046292312443
+  },
+  {
+    "step": 875,
+    "loss": 0.54280686378479,
+    "diagonal_ce": 0.5335309505462646,
+    "finite": 0.009275916032493114,
+    "endpoint_kl": 0.008837103843688965,
+    "temporal_derivative": 0.000438812596257776
+  },
+  {
+    "step": 876,
+    "loss": 0.6221470832824707,
+    "diagonal_ce": 0.6145762205123901,
+    "finite": 0.007570846937596798,
+    "endpoint_kl": 0.007105540484189987,
+    "temporal_derivative": 0.0004653065698221326
+  },
+  {
+    "step": 877,
+    "loss": 0.5513537526130676,
+    "diagonal_ce": 0.5396325588226318,
+    "finite": 0.011721203103661537,
+    "endpoint_kl": 0.011011676862835884,
+    "temporal_derivative": 0.0007095263572409749
+  },
+  {
+    "step": 878,
+    "loss": 0.5475092530250549,
+    "diagonal_ce": 0.5361601114273071,
+    "finite": 0.011349128559231758,
+    "endpoint_kl": 0.01061065774410963,
+    "temporal_derivative": 0.000738470465876162
+  },
+  {
+    "step": 879,
+    "loss": 0.42798560857772827,
+    "diagonal_ce": 0.4178236126899719,
+    "finite": 0.01016200426965952,
+    "endpoint_kl": 0.00975697860121727,
+    "temporal_derivative": 0.00040502555202692747
+  },
+  {
+    "step": 880,
+    "loss": 0.5156129598617554,
+    "diagonal_ce": 0.5070378184318542,
+    "finite": 0.00857515912503004,
+    "endpoint_kl": 0.008325573988258839,
+    "temporal_derivative": 0.0002495852531865239
+  },
+  {
+    "step": 881,
+    "loss": 0.7006323337554932,
+    "diagonal_ce": 0.6895220875740051,
+    "finite": 0.01111026294529438,
+    "endpoint_kl": 0.010680579580366611,
+    "temporal_derivative": 0.00042968333582393825
+  },
+  {
+    "step": 882,
+    "loss": 0.5118330717086792,
+    "diagonal_ce": 0.5037843585014343,
+    "finite": 0.008048713207244873,
+    "endpoint_kl": 0.0075459666550159454,
+    "temporal_derivative": 0.0005027466104365885
+  },
+  {
+    "step": 883,
+    "loss": 0.4473017156124115,
+    "diagonal_ce": 0.4379735589027405,
+    "finite": 0.009328148327767849,
+    "endpoint_kl": 0.009040833450853825,
+    "temporal_derivative": 0.0002873147022910416
+  },
+  {
+    "step": 884,
+    "loss": 0.4418970048427582,
+    "diagonal_ce": 0.4294712245464325,
+    "finite": 0.012425781227648258,
+    "endpoint_kl": 0.011873175390064716,
+    "temporal_derivative": 0.0005526060704141855
+  },
+  {
+    "step": 885,
+    "loss": 0.40901097655296326,
+    "diagonal_ce": 0.40089675784111023,
+    "finite": 0.008114207535982132,
+    "endpoint_kl": 0.007676622364670038,
+    "temporal_derivative": 0.0004375847056508064
+  },
+  {
+    "step": 886,
+    "loss": 0.7228513956069946,
+    "diagonal_ce": 0.7095255851745605,
+    "finite": 0.013325811363756657,
+    "endpoint_kl": 0.012693701311945915,
+    "temporal_derivative": 0.0006321098189800978
+  },
+  {
+    "step": 887,
+    "loss": 0.4462015628814697,
+    "diagonal_ce": 0.43565061688423157,
+    "finite": 0.010550947859883308,
+    "endpoint_kl": 0.010140853933990002,
+    "temporal_derivative": 0.0004100942169316113
+  },
+  {
+    "step": 888,
+    "loss": 0.3909236192703247,
+    "diagonal_ce": 0.37669849395751953,
+    "finite": 0.014225129038095474,
+    "endpoint_kl": 0.013666173443198204,
+    "temporal_derivative": 0.000558955711312592
+  },
+  {
+    "step": 889,
+    "loss": 0.519603967666626,
+    "diagonal_ce": 0.5080907940864563,
+    "finite": 0.011513151228427887,
+    "endpoint_kl": 0.010998659767210484,
+    "temporal_derivative": 0.0005144909955561161
+  },
+  {
+    "step": 890,
+    "loss": 0.4582783579826355,
+    "diagonal_ce": 0.44706305861473083,
+    "finite": 0.011215286329388618,
+    "endpoint_kl": 0.010884392075240612,
+    "temporal_derivative": 0.00033089410862885416
+  },
+  {
+    "step": 891,
+    "loss": 0.4765460193157196,
+    "diagonal_ce": 0.4632691442966461,
+    "finite": 0.013276886194944382,
+    "endpoint_kl": 0.012625500559806824,
+    "temporal_derivative": 0.0006513855769298971
+  },
+  {
+    "step": 892,
+    "loss": 0.5501584410667419,
+    "diagonal_ce": 0.5374748706817627,
+    "finite": 0.012683550827205181,
+    "endpoint_kl": 0.01199635211378336,
+    "temporal_derivative": 0.0006871983641758561
+  },
+  {
+    "step": 893,
+    "loss": 0.47955653071403503,
+    "diagonal_ce": 0.4712888300418854,
+    "finite": 0.008267702534794807,
+    "endpoint_kl": 0.007703795097768307,
+    "temporal_derivative": 0.0005639077280648053
+  },
+  {
+    "step": 894,
+    "loss": 0.5545480251312256,
+    "diagonal_ce": 0.544814944267273,
+    "finite": 0.00973308552056551,
+    "endpoint_kl": 0.009056994691491127,
+    "temporal_derivative": 0.0006760910036973655
+  },
+  {
+    "step": 895,
+    "loss": 0.578742504119873,
+    "diagonal_ce": 0.5672784447669983,
+    "finite": 0.011464049108326435,
+    "endpoint_kl": 0.010521016083657742,
+    "temporal_derivative": 0.0009430331992916763
+  },
+  {
+    "step": 896,
+    "loss": 0.4127531945705414,
+    "diagonal_ce": 0.4043583273887634,
+    "finite": 0.008394879288971424,
+    "endpoint_kl": 0.007956269197165966,
+    "temporal_derivative": 0.0004386103537399322
+  },
+  {
+    "step": 897,
+    "loss": 0.47598013281822205,
+    "diagonal_ce": 0.46701762080192566,
+    "finite": 0.008962525986135006,
+    "endpoint_kl": 0.008444655686616898,
+    "temporal_derivative": 0.000517869892064482
+  },
+  {
+    "step": 898,
+    "loss": 0.4252043068408966,
+    "diagonal_ce": 0.4151683747768402,
+    "finite": 0.010035919025540352,
+    "endpoint_kl": 0.009217406623065472,
+    "temporal_derivative": 0.0008185122278518975
+  },
+  {
+    "step": 899,
+    "loss": 0.5535411834716797,
+    "diagonal_ce": 0.5431433916091919,
+    "finite": 0.010397784411907196,
+    "endpoint_kl": 0.0096768569201231,
+    "temporal_derivative": 0.0007209270843304694
+  },
+  {
+    "step": 900,
+    "loss": 0.5143570303916931,
+    "diagonal_ce": 0.5049118399620056,
+    "finite": 0.00944517832249403,
+    "endpoint_kl": 0.008971506729722023,
+    "temporal_derivative": 0.00047367202932946384
+  },
+  {
+    "step": 901,
+    "loss": 0.5883057713508606,
+    "diagonal_ce": 0.580640971660614,
+    "finite": 0.007664825301617384,
+    "endpoint_kl": 0.007253825664520264,
+    "temporal_derivative": 0.0004109997535124421
+  },
+  {
+    "step": 902,
+    "loss": 0.5983043909072876,
+    "diagonal_ce": 0.5884677767753601,
+    "finite": 0.009836586192250252,
+    "endpoint_kl": 0.009244315326213837,
+    "temporal_derivative": 0.0005922709824517369
+  },
+  {
+    "step": 903,
+    "loss": 0.5799747109413147,
+    "diagonal_ce": 0.5688496828079224,
+    "finite": 0.011125046759843826,
+    "endpoint_kl": 0.01050832774490118,
+    "temporal_derivative": 0.0006167193059809506
+  },
+  {
+    "step": 904,
+    "loss": 0.662383496761322,
+    "diagonal_ce": 0.6555096507072449,
+    "finite": 0.00687383720651269,
+    "endpoint_kl": 0.006514331325888634,
+    "temporal_derivative": 0.0003595057351049036
+  },
+  {
+    "step": 905,
+    "loss": 0.8163231611251831,
+    "diagonal_ce": 0.8083826303482056,
+    "finite": 0.007940542884171009,
+    "endpoint_kl": 0.007414679508656263,
+    "temporal_derivative": 0.0005258630262687802
+  },
+  {
+    "step": 906,
+    "loss": 0.5769966244697571,
+    "diagonal_ce": 0.5692291259765625,
+    "finite": 0.007767502684146166,
+    "endpoint_kl": 0.007427796721458435,
+    "temporal_derivative": 0.000339706166414544
+  },
+  {
+    "step": 907,
+    "loss": 0.361697793006897,
+    "diagonal_ce": 0.35409390926361084,
+    "finite": 0.007603879552334547,
+    "endpoint_kl": 0.007329465355724096,
+    "temporal_derivative": 0.0002744140801951289
+  },
+  {
+    "step": 908,
+    "loss": 0.42293867468833923,
+    "diagonal_ce": 0.4164450466632843,
+    "finite": 0.006493624299764633,
+    "endpoint_kl": 0.006172505207359791,
+    "temporal_derivative": 0.00032111903419718146
+  },
+  {
+    "step": 909,
+    "loss": 0.6864267587661743,
+    "diagonal_ce": 0.6774019002914429,
+    "finite": 0.009024882689118385,
+    "endpoint_kl": 0.008544662967324257,
+    "temporal_derivative": 0.0004802195180673152
+  },
+  {
+    "step": 910,
+    "loss": 0.4508120119571686,
+    "diagonal_ce": 0.44129523634910583,
+    "finite": 0.009516778402030468,
+    "endpoint_kl": 0.00898481160402298,
+    "temporal_derivative": 0.0005319669144228101
+  },
+  {
+    "step": 911,
+    "loss": 0.609716534614563,
+    "diagonal_ce": 0.5980303883552551,
+    "finite": 0.01168613601475954,
+    "endpoint_kl": 0.01114196702837944,
+    "temporal_derivative": 0.0005441689863801003
+  },
+  {
+    "step": 912,
+    "loss": 0.6594278216362,
+    "diagonal_ce": 0.6482020616531372,
+    "finite": 0.011225748807191849,
+    "endpoint_kl": 0.010609107092022896,
+    "temporal_derivative": 0.0006166420644149184
+  },
+  {
+    "step": 913,
+    "loss": 0.6225096583366394,
+    "diagonal_ce": 0.6140554547309875,
+    "finite": 0.008454207330942154,
+    "endpoint_kl": 0.00804832112044096,
+    "temporal_derivative": 0.00040588577394373715
+  },
+  {
+    "step": 914,
+    "loss": 0.48612797260284424,
+    "diagonal_ce": 0.47533395886421204,
+    "finite": 0.010794014669954777,
+    "endpoint_kl": 0.010137263685464859,
+    "temporal_derivative": 0.0006567510426975787
+  },
+  {
+    "step": 915,
+    "loss": 0.7623146772384644,
+    "diagonal_ce": 0.7479315400123596,
+    "finite": 0.014383108355104923,
+    "endpoint_kl": 0.013748019002377987,
+    "temporal_derivative": 0.0006350891781039536
+  },
+  {
+    "step": 916,
+    "loss": 0.5060478448867798,
+    "diagonal_ce": 0.49402961134910583,
+    "finite": 0.012018253095448017,
+    "endpoint_kl": 0.011566538363695145,
+    "temporal_derivative": 0.000451714382506907
+  },
+  {
+    "step": 917,
+    "loss": 0.37790200114250183,
+    "diagonal_ce": 0.3696483075618744,
+    "finite": 0.008253691717982292,
+    "endpoint_kl": 0.007775298319756985,
+    "temporal_derivative": 0.0004783932236023247
+  },
+  {
+    "step": 918,
+    "loss": 0.5066421627998352,
+    "diagonal_ce": 0.4995475113391876,
+    "finite": 0.007094623055309057,
+    "endpoint_kl": 0.006719290744513273,
+    "temporal_derivative": 0.00037533233989961445
+  },
+  {
+    "step": 919,
+    "loss": 0.4964948892593384,
+    "diagonal_ce": 0.4877159297466278,
+    "finite": 0.008778950199484825,
+    "endpoint_kl": 0.008362410590052605,
+    "temporal_derivative": 0.00041654001688584685
+  },
+  {
+    "step": 920,
+    "loss": 0.4893357753753662,
+    "diagonal_ce": 0.47860032320022583,
+    "finite": 0.01073545403778553,
+    "endpoint_kl": 0.010097223334014416,
+    "temporal_derivative": 0.000638230238109827
+  },
+  {
+    "step": 921,
+    "loss": 0.5222805142402649,
+    "diagonal_ce": 0.5151570439338684,
+    "finite": 0.007123453542590141,
+    "endpoint_kl": 0.006444424856454134,
+    "temporal_derivative": 0.0006790284533053637
+  },
+  {
+    "step": 922,
+    "loss": 0.5982944369316101,
+    "diagonal_ce": 0.5887106657028198,
+    "finite": 0.009583796374499798,
+    "endpoint_kl": 0.009023808874189854,
+    "temporal_derivative": 0.0005599873838946223
+  },
+  {
+    "step": 923,
+    "loss": 0.5640406012535095,
+    "diagonal_ce": 0.55520099401474,
+    "finite": 0.008839624002575874,
+    "endpoint_kl": 0.00845356285572052,
+    "temporal_derivative": 0.0003860613505821675
+  },
+  {
+    "step": 924,
+    "loss": 0.7249394655227661,
+    "diagonal_ce": 0.7134636044502258,
+    "finite": 0.011475845240056515,
+    "endpoint_kl": 0.010717799887061119,
+    "temporal_derivative": 0.0007580455858260393
+  },
+  {
+    "step": 925,
+    "loss": 0.6599559783935547,
+    "diagonal_ce": 0.6498825550079346,
+    "finite": 0.010073402896523476,
+    "endpoint_kl": 0.009710069745779037,
+    "temporal_derivative": 0.0003633331216406077
+  },
+  {
+    "step": 926,
+    "loss": 0.39930611848831177,
+    "diagonal_ce": 0.3883703052997589,
+    "finite": 0.010935819707810879,
+    "endpoint_kl": 0.010451932437717915,
+    "temporal_derivative": 0.00048388727009296417
+  },
+  {
+    "step": 927,
+    "loss": 0.5806616544723511,
+    "diagonal_ce": 0.56849604845047,
+    "finite": 0.012165580876171589,
+    "endpoint_kl": 0.01166958175599575,
+    "temporal_derivative": 0.0004959987127222121
+  },
+  {
+    "step": 928,
+    "loss": 0.6633775234222412,
+    "diagonal_ce": 0.652185320854187,
+    "finite": 0.011192199774086475,
+    "endpoint_kl": 0.010797644965350628,
+    "temporal_derivative": 0.00039455521618947387
+  },
+  {
+    "step": 929,
+    "loss": 0.55518639087677,
+    "diagonal_ce": 0.5452933311462402,
+    "finite": 0.009893044829368591,
+    "endpoint_kl": 0.009374835528433323,
+    "temporal_derivative": 0.0005182095337659121
+  },
+  {
+    "step": 930,
+    "loss": 0.6146610975265503,
+    "diagonal_ce": 0.6041250824928284,
+    "finite": 0.010536043904721737,
+    "endpoint_kl": 0.010020391084253788,
+    "temporal_derivative": 0.0005156524130143225
+  },
+  {
+    "step": 931,
+    "loss": 0.6268020868301392,
+    "diagonal_ce": 0.6159090399742126,
+    "finite": 0.010893053375184536,
+    "endpoint_kl": 0.01040717400610447,
+    "temporal_derivative": 0.0004858793690800667
+  },
+  {
+    "step": 932,
+    "loss": 0.5740768909454346,
+    "diagonal_ce": 0.5653525590896606,
+    "finite": 0.008724302053451538,
+    "endpoint_kl": 0.008342497050762177,
+    "temporal_derivative": 0.0003818052355200052
+  },
+  {
+    "step": 933,
+    "loss": 0.5811651945114136,
+    "diagonal_ce": 0.5693857669830322,
+    "finite": 0.011779424734413624,
+    "endpoint_kl": 0.01104723010212183,
+    "temporal_derivative": 0.0007321944576688111
+  },
+  {
+    "step": 934,
+    "loss": 0.5265554785728455,
+    "diagonal_ce": 0.5179294347763062,
+    "finite": 0.008626045659184456,
+    "endpoint_kl": 0.008188536390662193,
+    "temporal_derivative": 0.0004375092685222626
+  },
+  {
+    "step": 935,
+    "loss": 0.4911961853504181,
+    "diagonal_ce": 0.4815870225429535,
+    "finite": 0.009609149768948555,
+    "endpoint_kl": 0.00898053590208292,
+    "temporal_derivative": 0.0006286142743192613
+  },
+  {
+    "step": 936,
+    "loss": 0.5169853568077087,
+    "diagonal_ce": 0.5078216195106506,
+    "finite": 0.009163754060864449,
+    "endpoint_kl": 0.008831633254885674,
+    "temporal_derivative": 0.00033212086418643594
+  },
+  {
+    "step": 937,
+    "loss": 0.5115331411361694,
+    "diagonal_ce": 0.504012405872345,
+    "finite": 0.007520714774727821,
+    "endpoint_kl": 0.007183499168604612,
+    "temporal_derivative": 0.000337215606123209
+  },
+  {
+    "step": 938,
+    "loss": 0.4567963480949402,
+    "diagonal_ce": 0.4435717761516571,
+    "finite": 0.013224578462541103,
+    "endpoint_kl": 0.012482861056923866,
+    "temporal_derivative": 0.0007417175802402198
+  },
+  {
+    "step": 939,
+    "loss": 0.5615968704223633,
+    "diagonal_ce": 0.5508155822753906,
+    "finite": 0.010781261138617992,
+    "endpoint_kl": 0.010373475961387157,
+    "temporal_derivative": 0.00040778485708869994
+  },
+  {
+    "step": 940,
+    "loss": 0.6482585072517395,
+    "diagonal_ce": 0.636271595954895,
+    "finite": 0.011986911296844482,
+    "endpoint_kl": 0.01147333811968565,
+    "temporal_derivative": 0.0005135730025358498
+  },
+  {
+    "step": 941,
+    "loss": 0.6911852359771729,
+    "diagonal_ce": 0.6806464791297913,
+    "finite": 0.010538770817220211,
+    "endpoint_kl": 0.009866968728601933,
+    "temporal_derivative": 0.0006718023214489222
+  },
+  {
+    "step": 942,
+    "loss": 0.5915462374687195,
+    "diagonal_ce": 0.5779669284820557,
+    "finite": 0.013579294085502625,
+    "endpoint_kl": 0.012804216705262661,
+    "temporal_derivative": 0.000775077089201659
+  },
+  {
+    "step": 943,
+    "loss": 0.598835289478302,
+    "diagonal_ce": 0.5836596488952637,
+    "finite": 0.0151756526902318,
+    "endpoint_kl": 0.013909717090427876,
+    "temporal_derivative": 0.001265935366973281
+  },
+  {
+    "step": 944,
+    "loss": 0.5102236270904541,
+    "diagonal_ce": 0.5007768869400024,
+    "finite": 0.009446714073419571,
+    "endpoint_kl": 0.00893645454198122,
+    "temporal_derivative": 0.0005102593568153679
+  },
+  {
+    "step": 945,
+    "loss": 0.6733589172363281,
+    "diagonal_ce": 0.661043643951416,
+    "finite": 0.01231527142226696,
+    "endpoint_kl": 0.011721552349627018,
+    "temporal_derivative": 0.0005937188398092985
+  },
+  {
+    "step": 946,
+    "loss": 0.4857196807861328,
+    "diagonal_ce": 0.4760691821575165,
+    "finite": 0.009650491178035736,
+    "endpoint_kl": 0.009098878130316734,
+    "temporal_derivative": 0.0005516133969649673
+  },
+  {
+    "step": 947,
+    "loss": 0.45677709579467773,
+    "diagonal_ce": 0.4460800886154175,
+    "finite": 0.010697000660002232,
+    "endpoint_kl": 0.010046880692243576,
+    "temporal_derivative": 0.0006501199677586555
+  },
+  {
+    "step": 948,
+    "loss": 0.6380586624145508,
+    "diagonal_ce": 0.6265093684196472,
+    "finite": 0.011549264192581177,
+    "endpoint_kl": 0.010869304649531841,
+    "temporal_derivative": 0.0006799596594646573
+  },
+  {
+    "step": 949,
+    "loss": 0.3228825628757477,
+    "diagonal_ce": 0.31330186128616333,
+    "finite": 0.00958070158958435,
+    "endpoint_kl": 0.009071553125977516,
+    "temporal_derivative": 0.0005091488710604608
+  },
+  {
+    "step": 950,
+    "loss": 0.6339801549911499,
+    "diagonal_ce": 0.6224325299263,
+    "finite": 0.011547640897333622,
+    "endpoint_kl": 0.011006852611899376,
+    "temporal_derivative": 0.000540788343641907
+  },
+  {
+    "step": 951,
+    "loss": 0.6410892009735107,
+    "diagonal_ce": 0.6319153904914856,
+    "finite": 0.009173829108476639,
+    "endpoint_kl": 0.008558250963687897,
+    "temporal_derivative": 0.0006155782612040639
+  },
+  {
+    "step": 952,
+    "loss": 0.4358896017074585,
+    "diagonal_ce": 0.4254833459854126,
+    "finite": 0.0104062519967556,
+    "endpoint_kl": 0.0098733427003026,
+    "temporal_derivative": 0.0005329088889993727
+  },
+  {
+    "step": 953,
+    "loss": 0.5835097432136536,
+    "diagonal_ce": 0.5714743137359619,
+    "finite": 0.01203545369207859,
+    "endpoint_kl": 0.01155008189380169,
+    "temporal_derivative": 0.00048537139082327485
+  },
+  {
+    "step": 954,
+    "loss": 0.6576416492462158,
+    "diagonal_ce": 0.6460245847702026,
+    "finite": 0.011617094278335571,
+    "endpoint_kl": 0.01104737538844347,
+    "temporal_derivative": 0.0005697188316844404
+  },
+  {
+    "step": 955,
+    "loss": 0.49867191910743713,
+    "diagonal_ce": 0.48917949199676514,
+    "finite": 0.009492424316704273,
+    "endpoint_kl": 0.009001705795526505,
+    "temporal_derivative": 0.0004907185211777687
+  },
+  {
+    "step": 956,
+    "loss": 0.5537427663803101,
+    "diagonal_ce": 0.5438318848609924,
+    "finite": 0.009910876862704754,
+    "endpoint_kl": 0.009318724274635315,
+    "temporal_derivative": 0.0005921527044847608
+  },
+  {
+    "step": 957,
+    "loss": 0.467882364988327,
+    "diagonal_ce": 0.4588051438331604,
+    "finite": 0.009077235125005245,
+    "endpoint_kl": 0.008406175300478935,
+    "temporal_derivative": 0.0006710595916956663
+  },
+  {
+    "step": 958,
+    "loss": 0.6092206835746765,
+    "diagonal_ce": 0.6007905006408691,
+    "finite": 0.008430154994130135,
+    "endpoint_kl": 0.0077461968176066875,
+    "temporal_derivative": 0.000683958176523447
+  },
+  {
+    "step": 959,
+    "loss": 0.6206538081169128,
+    "diagonal_ce": 0.6105212569236755,
+    "finite": 0.010132561437785625,
+    "endpoint_kl": 0.00951269268989563,
+    "temporal_derivative": 0.0006198686314746737
+  },
+  {
+    "step": 960,
+    "loss": 0.6476103663444519,
+    "diagonal_ce": 0.6364766359329224,
+    "finite": 0.011133750900626183,
+    "endpoint_kl": 0.010495802387595177,
+    "temporal_derivative": 0.0006379480473697186
+  },
+  {
+    "step": 961,
+    "loss": 0.6832364797592163,
+    "diagonal_ce": 0.673678457736969,
+    "finite": 0.009557998739182949,
+    "endpoint_kl": 0.009104510769248009,
+    "temporal_derivative": 0.0004534881445579231
+  },
+  {
+    "step": 962,
+    "loss": 0.45751211047172546,
+    "diagonal_ce": 0.44946587085723877,
+    "finite": 0.008046245202422142,
+    "endpoint_kl": 0.00755203515291214,
+    "temporal_derivative": 0.0004942105151712894
+  },
+  {
+    "step": 963,
+    "loss": 0.5928386449813843,
+    "diagonal_ce": 0.5797872543334961,
+    "finite": 0.01305139809846878,
+    "endpoint_kl": 0.012013716623187065,
+    "temporal_derivative": 0.0010376819409430027
+  },
+  {
+    "step": 964,
+    "loss": 0.5587843656539917,
+    "diagonal_ce": 0.5445763468742371,
+    "finite": 0.014208002015948296,
+    "endpoint_kl": 0.013375292532145977,
+    "temporal_derivative": 0.0008327097166329622
+  },
+  {
+    "step": 965,
+    "loss": 0.46640804409980774,
+    "diagonal_ce": 0.45707884430885315,
+    "finite": 0.009329213760793209,
+    "endpoint_kl": 0.008788039907813072,
+    "temporal_derivative": 0.0005411742022261024
+  },
+  {
+    "step": 966,
+    "loss": 0.6039250493049622,
+    "diagonal_ce": 0.5928581357002258,
+    "finite": 0.01106690987944603,
+    "endpoint_kl": 0.010483141988515854,
+    "temporal_derivative": 0.0005837682401761413
+  },
+  {
+    "step": 967,
+    "loss": 0.5051952004432678,
+    "diagonal_ce": 0.4909825921058655,
+    "finite": 0.014212628826498985,
+    "endpoint_kl": 0.013490366749465466,
+    "temporal_derivative": 0.0007222619606181979
+  },
+  {
+    "step": 968,
+    "loss": 0.47015687823295593,
+    "diagonal_ce": 0.45968687534332275,
+    "finite": 0.01046999916434288,
+    "endpoint_kl": 0.009745107032358646,
+    "temporal_derivative": 0.0007248919573612511
+  },
+  {
+    "step": 969,
+    "loss": 0.5291849970817566,
+    "diagonal_ce": 0.5161097645759583,
+    "finite": 0.013075213879346848,
+    "endpoint_kl": 0.012442974373698235,
+    "temporal_derivative": 0.0006322390399873257
+  },
+  {
+    "step": 970,
+    "loss": 0.43662092089653015,
+    "diagonal_ce": 0.42555469274520874,
+    "finite": 0.011066240258514881,
+    "endpoint_kl": 0.010532664135098457,
+    "temporal_derivative": 0.0005335757741704583
+  },
+  {
+    "step": 971,
+    "loss": 0.63848477602005,
+    "diagonal_ce": 0.6227151155471802,
+    "finite": 0.01576963998377323,
+    "endpoint_kl": 0.015012828633189201,
+    "temporal_derivative": 0.0007568118162453175
+  },
+  {
+    "step": 972,
+    "loss": 0.6466014981269836,
+    "diagonal_ce": 0.6331427693367004,
+    "finite": 0.013458721339702606,
+    "endpoint_kl": 0.01270546205341816,
+    "temporal_derivative": 0.0007532588206231594
+  },
+  {
+    "step": 973,
+    "loss": 0.6138940453529358,
+    "diagonal_ce": 0.6019402146339417,
+    "finite": 0.011953802779316902,
+    "endpoint_kl": 0.011122836731374264,
+    "temporal_derivative": 0.0008309661061502993
+  },
+  {
+    "step": 974,
+    "loss": 0.5808598399162292,
+    "diagonal_ce": 0.5675687193870544,
+    "finite": 0.013291142880916595,
+    "endpoint_kl": 0.012376775965094566,
+    "temporal_derivative": 0.0009143670904450119
+  },
+  {
+    "step": 975,
+    "loss": 0.5982118844985962,
+    "diagonal_ce": 0.5818549394607544,
+    "finite": 0.016356967389583588,
+    "endpoint_kl": 0.015054384246468544,
+    "temporal_derivative": 0.0013025831431150436
+  },
+  {
+    "step": 976,
+    "loss": 0.7864395380020142,
+    "diagonal_ce": 0.7702163457870483,
+    "finite": 0.01622319594025612,
+    "endpoint_kl": 0.01520242914557457,
+    "temporal_derivative": 0.00102076749317348
+  },
+  {
+    "step": 977,
+    "loss": 0.4849041700363159,
+    "diagonal_ce": 0.47609204053878784,
+    "finite": 0.008812121115624905,
+    "endpoint_kl": 0.008399061858654022,
+    "temporal_derivative": 0.0004130592569708824
+  },
+  {
+    "step": 978,
+    "loss": 0.6091609001159668,
+    "diagonal_ce": 0.5967446565628052,
+    "finite": 0.012416213750839233,
+    "endpoint_kl": 0.011685437522828579,
+    "temporal_derivative": 0.0007307759951800108
+  },
+  {
+    "step": 979,
+    "loss": 0.6677823066711426,
+    "diagonal_ce": 0.6571968197822571,
+    "finite": 0.010585504584014416,
+    "endpoint_kl": 0.009936066344380379,
+    "temporal_derivative": 0.0006494383560493588
+  },
+  {
+    "step": 980,
+    "loss": 0.3062281012535095,
+    "diagonal_ce": 0.29142439365386963,
+    "finite": 0.014803697355091572,
+    "endpoint_kl": 0.014101647771894932,
+    "temporal_derivative": 0.0007020498160272837
+  },
+  {
+    "step": 981,
+    "loss": 0.4515122175216675,
+    "diagonal_ce": 0.43831130862236023,
+    "finite": 0.013200918212532997,
+    "endpoint_kl": 0.012712215073406696,
+    "temporal_derivative": 0.000488703022710979
+  },
+  {
+    "step": 982,
+    "loss": 0.40834733843803406,
+    "diagonal_ce": 0.3953930139541626,
+    "finite": 0.01295432448387146,
+    "endpoint_kl": 0.012295601889491081,
+    "temporal_derivative": 0.0006587221287190914
+  },
+  {
+    "step": 983,
+    "loss": 0.6876580119132996,
+    "diagonal_ce": 0.6717905402183533,
+    "finite": 0.015867462381720543,
+    "endpoint_kl": 0.014915110543370247,
+    "temporal_derivative": 0.0009523520711809397
+  },
+  {
+    "step": 984,
+    "loss": 0.46936625242233276,
+    "diagonal_ce": 0.46102383732795715,
+    "finite": 0.008342410437762737,
+    "endpoint_kl": 0.007867647334933281,
+    "temporal_derivative": 0.00047476295731030405
+  },
+  {
+    "step": 985,
+    "loss": 0.530169665813446,
+    "diagonal_ce": 0.5179004669189453,
+    "finite": 0.012269210070371628,
+    "endpoint_kl": 0.011442362330853939,
+    "temporal_derivative": 0.0008268475066870451
+  },
+  {
+    "step": 986,
+    "loss": 0.4458397626876831,
+    "diagonal_ce": 0.4310212731361389,
+    "finite": 0.014818483963608742,
+    "endpoint_kl": 0.013743174262344837,
+    "temporal_derivative": 0.0010753095848485827
+  },
+  {
+    "step": 987,
+    "loss": 0.6421454548835754,
+    "diagonal_ce": 0.629138708114624,
+    "finite": 0.013006762601435184,
+    "endpoint_kl": 0.012146933004260063,
+    "temporal_derivative": 0.0008598298882134259
+  },
+  {
+    "step": 988,
+    "loss": 0.5867689251899719,
+    "diagonal_ce": 0.5750026702880859,
+    "finite": 0.011766272597014904,
+    "endpoint_kl": 0.010951208882033825,
+    "temporal_derivative": 0.0008150633657351136
+  },
+  {
+    "step": 989,
+    "loss": 0.4708298444747925,
+    "diagonal_ce": 0.4605269432067871,
+    "finite": 0.010302897542715073,
+    "endpoint_kl": 0.009669647552073002,
+    "temporal_derivative": 0.0006332499906420708
+  },
+  {
+    "step": 990,
+    "loss": 0.46157169342041016,
+    "diagonal_ce": 0.45063844323158264,
+    "finite": 0.010933245532214642,
+    "endpoint_kl": 0.010300040245056152,
+    "temporal_derivative": 0.0006332052289508283
+  },
+  {
+    "step": 991,
+    "loss": 0.6291186809539795,
+    "diagonal_ce": 0.6170802712440491,
+    "finite": 0.012038430199027061,
+    "endpoint_kl": 0.011271201074123383,
+    "temporal_derivative": 0.0007672293577343225
+  },
+  {
+    "step": 992,
+    "loss": 0.46511271595954895,
+    "diagonal_ce": 0.45547670125961304,
+    "finite": 0.009636023081839085,
+    "endpoint_kl": 0.008828794583678246,
+    "temporal_derivative": 0.0008072287309914827
+  },
+  {
+    "step": 993,
+    "loss": 0.7668812274932861,
+    "diagonal_ce": 0.7530636191368103,
+    "finite": 0.01381759624928236,
+    "endpoint_kl": 0.013062193989753723,
+    "temporal_derivative": 0.0007554021431133151
+  },
+  {
+    "step": 994,
+    "loss": 0.58637934923172,
+    "diagonal_ce": 0.5737146735191345,
+    "finite": 0.01266465988010168,
+    "endpoint_kl": 0.011771042831242085,
+    "temporal_derivative": 0.0008936169324442744
+  },
+  {
+    "step": 995,
+    "loss": 0.564429521560669,
+    "diagonal_ce": 0.5515845417976379,
+    "finite": 0.01284495647996664,
+    "endpoint_kl": 0.012125536799430847,
+    "temporal_derivative": 0.0007194195059128106
+  },
+  {
+    "step": 996,
+    "loss": 0.5453512072563171,
+    "diagonal_ce": 0.5297417044639587,
+    "finite": 0.015609495341777802,
+    "endpoint_kl": 0.014849545434117317,
+    "temporal_derivative": 0.0007599500240758061
+  },
+  {
+    "step": 997,
+    "loss": 0.43150556087493896,
+    "diagonal_ce": 0.4188826084136963,
+    "finite": 0.012622949667274952,
+    "endpoint_kl": 0.011933495290577412,
+    "temporal_derivative": 0.0006894547841511667
+  },
+  {
+    "step": 998,
+    "loss": 0.6471224427223206,
+    "diagonal_ce": 0.6307969689369202,
+    "finite": 0.01632547751069069,
+    "endpoint_kl": 0.014948908239603043,
+    "temporal_derivative": 0.0013765699695795774
+  },
+  {
+    "step": 999,
+    "loss": 0.5297579765319824,
+    "diagonal_ce": 0.5138586163520813,
+    "finite": 0.015899360179901123,
+    "endpoint_kl": 0.014915782026946545,
+    "temporal_derivative": 0.0009835772216320038
+  }
+]
diff --git a/lecture_6/verified_examples/categorical/report.json b/lecture_6/verified_examples/categorical/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..0ddc008a652989181b9a2171f698985f797fce0a
--- /dev/null
+++ b/lecture_6/verified_examples/categorical/report.json
@@ -0,0 +1,19 @@
+{
+  "method": "categorical",
+  "data_kind": "synthetic-text",
+  "train_loss_first_20_mean": 2.472597396373749,
+  "train_loss_last_20_mean": 0.5313047975301742,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "heldout_diagonal_ce_at_half_time": 0.45874327421188354,
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "unique_fraction": 0.03125,
+  "token_entropy": 2.415271520614624,
+  "mean_length": 4.0,
+  "empty_fraction": 0.0,
+  "training_support_fraction": 1.0,
+  "elapsed_seconds": 5.423348005999287
+}
diff --git a/lecture_6/verified_examples/categorical/samples.txt b/lecture_6/verified_examples/categorical/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..937c249d284d6b095fe43a5bf835a883aa4b082b
--- /dev/null
+++ b/lecture_6/verified_examples/categorical/samples.txt
@@ -0,0 +1,128 @@
+gold star moves down
+blue square moves right
+gold star moves down
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+gold star moves down
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+blue square moves right
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+red circle moves left
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+red circle moves left
+red circle moves left
+red circle moves left
+gold star moves down
+green triangle moves up
+blue square moves right
+gold star moves down
+green triangle moves up
+red circle moves left
+gold star moves down
+red circle moves left
+green triangle moves up
+red circle moves left
+red circle moves left
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+red circle moves left
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+red circle moves left
+green triangle moves up
+gold star moves down
+gold star moves down
diff --git a/lecture_6/verified_examples/consistency/config.json b/lecture_6/verified_examples/consistency/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..b9a7d699fa5b1df857e10d109dfed37060f8557c
--- /dev/null
+++ b/lecture_6/verified_examples/consistency/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "consistency",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/consistency"
+}
diff --git a/lecture_6/verified_examples/consistency/losses.json b/lecture_6/verified_examples/consistency/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..25d5bd19bb0fc9257ed9d7c600f0d77250a9a906
--- /dev/null
+++ b/lecture_6/verified_examples/consistency/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 1.881239414215088,
+    "diagonal": 1.8811585903167725,
+    "finite": 0.01615321636199951
+  },
+  {
+    "step": 1,
+    "loss": 2.4074299335479736,
+    "diagonal": 2.407341718673706,
+    "finite": 0.008822515606880188
+  },
+  {
+    "step": 2,
+    "loss": 1.7719292640686035,
+    "diagonal": 1.7718356847763062,
+    "finite": 0.006236257031559944
+  },
+  {
+    "step": 3,
+    "loss": 2.057683229446411,
+    "diagonal": 2.0574235916137695,
+    "finite": 0.01298427488654852
+  },
+  {
+    "step": 4,
+    "loss": 1.963883638381958,
+    "diagonal": 1.9636179208755493,
+    "finite": 0.010629527270793915
+  },
+  {
+    "step": 5,
+    "loss": 2.615539789199829,
+    "diagonal": 2.615230083465576,
+    "finite": 0.010325491428375244
+  },
+  {
+    "step": 6,
+    "loss": 2.1255834102630615,
+    "diagonal": 2.1251401901245117,
+    "finite": 0.012664573267102242
+  },
+  {
+    "step": 7,
+    "loss": 1.767486810684204,
+    "diagonal": 1.7669801712036133,
+    "finite": 0.012665022164583206
+  },
+  {
+    "step": 8,
+    "loss": 1.4528367519378662,
+    "diagonal": 1.4524890184402466,
+    "finite": 0.007726549636572599
+  },
+  {
+    "step": 9,
+    "loss": 1.7257788181304932,
+    "diagonal": 1.7252548933029175,
+    "finite": 0.010479367338120937
+  },
+  {
+    "step": 10,
+    "loss": 1.95924711227417,
+    "diagonal": 1.9585034847259521,
+    "finite": 0.013519860804080963
+  },
+  {
+    "step": 11,
+    "loss": 2.529228448867798,
+    "diagonal": 2.5282039642333984,
+    "finite": 0.017075449228286743
+  },
+  {
+    "step": 12,
+    "loss": 1.771782636642456,
+    "diagonal": 1.7712321281433105,
+    "finite": 0.008468667045235634
+  },
+  {
+    "step": 13,
+    "loss": 2.1209821701049805,
+    "diagonal": 2.120239734649658,
+    "finite": 0.010605484247207642
+  },
+  {
+    "step": 14,
+    "loss": 1.9700837135314941,
+    "diagonal": 1.9693301916122437,
+    "finite": 0.01004619337618351
+  },
+  {
+    "step": 15,
+    "loss": 2.0182132720947266,
+    "diagonal": 2.017030954360962,
+    "finite": 0.01477768924087286
+  },
+  {
+    "step": 16,
+    "loss": 1.7203270196914673,
+    "diagonal": 1.7187397480010986,
+    "finite": 0.018673595041036606
+  },
+  {
+    "step": 17,
+    "loss": 1.7134591341018677,
+    "diagonal": 1.712116003036499,
+    "finite": 0.014923889189958572
+  },
+  {
+    "step": 18,
+    "loss": 1.7923413515090942,
+    "diagonal": 1.7904551029205322,
+    "finite": 0.019854974001646042
+  },
+  {
+    "step": 19,
+    "loss": 2.127629518508911,
+    "diagonal": 2.1256463527679443,
+    "finite": 0.019831307232379913
+  },
+  {
+    "step": 20,
+    "loss": 2.464491605758667,
+    "diagonal": 2.461660385131836,
+    "finite": 0.026964398100972176
+  },
+  {
+    "step": 21,
+    "loss": 1.9411910772323608,
+    "diagonal": 1.9385689496994019,
+    "finite": 0.023837372660636902
+  },
+  {
+    "step": 22,
+    "loss": 1.8475085496902466,
+    "diagonal": 1.8457605838775635,
+    "finite": 0.015199398621916771
+  },
+  {
+    "step": 23,
+    "loss": 2.0957727432250977,
+    "diagonal": 2.0931921005249023,
+    "finite": 0.021504933014512062
+  },
+  {
+    "step": 24,
+    "loss": 1.7965298891067505,
+    "diagonal": 1.794575572013855,
+    "finite": 0.01563412696123123
+  },
+  {
+    "step": 25,
+    "loss": 2.364783763885498,
+    "diagonal": 2.362358331680298,
+    "finite": 0.018656764179468155
+  },
+  {
+    "step": 26,
+    "loss": 1.9623585939407349,
+    "diagonal": 1.9599099159240723,
+    "finite": 0.018138153478503227
+  },
+  {
+    "step": 27,
+    "loss": 1.7861160039901733,
+    "diagonal": 1.7844038009643555,
+    "finite": 0.012229904532432556
+  },
+  {
+    "step": 28,
+    "loss": 2.2886953353881836,
+    "diagonal": 2.2873754501342773,
+    "finite": 0.009103069081902504
+  },
+  {
+    "step": 29,
+    "loss": 1.7132554054260254,
+    "diagonal": 1.7115156650543213,
+    "finite": 0.011598210781812668
+  },
+  {
+    "step": 30,
+    "loss": 1.6582564115524292,
+    "diagonal": 1.6572401523590088,
+    "finite": 0.006556529551744461
+  },
+  {
+    "step": 31,
+    "loss": 2.1699166297912598,
+    "diagonal": 2.1684553623199463,
+    "finite": 0.009132185950875282
+  },
+  {
+    "step": 32,
+    "loss": 1.7087723016738892,
+    "diagonal": 1.707288384437561,
+    "finite": 0.008993645198643208
+  },
+  {
+    "step": 33,
+    "loss": 2.4956953525543213,
+    "diagonal": 2.4932963848114014,
+    "finite": 0.014110899530351162
+  },
+  {
+    "step": 34,
+    "loss": 2.037783145904541,
+    "diagonal": 2.0369186401367188,
+    "finite": 0.004940093494951725
+  },
+  {
+    "step": 35,
+    "loss": 2.278066635131836,
+    "diagonal": 2.2766809463500977,
+    "finite": 0.007698916830122471
+  },
+  {
+    "step": 36,
+    "loss": 2.5738632678985596,
+    "diagonal": 2.5723013877868652,
+    "finite": 0.008443180471658707
+  },
+  {
+    "step": 37,
+    "loss": 2.3178043365478516,
+    "diagonal": 2.3161797523498535,
+    "finite": 0.008550215512514114
+  },
+  {
+    "step": 38,
+    "loss": 2.0712642669677734,
+    "diagonal": 2.0702414512634277,
+    "finite": 0.005245467182248831
+  },
+  {
+    "step": 39,
+    "loss": 2.131774425506592,
+    "diagonal": 2.130467176437378,
+    "finite": 0.0065367864444851875
+  },
+  {
+    "step": 40,
+    "loss": 1.6274323463439941,
+    "diagonal": 1.6220884323120117,
+    "finite": 0.02606762945652008
+  },
+  {
+    "step": 41,
+    "loss": 2.485335350036621,
+    "diagonal": 2.4824633598327637,
+    "finite": 0.013675800524652004
+  },
+  {
+    "step": 42,
+    "loss": 2.374746322631836,
+    "diagonal": 2.372985601425171,
+    "finite": 0.008189328946173191
+  },
+  {
+    "step": 43,
+    "loss": 2.7072854042053223,
+    "diagonal": 2.7051961421966553,
+    "finite": 0.00949622318148613
+  },
+  {
+    "step": 44,
+    "loss": 1.924514889717102,
+    "diagonal": 1.9223198890686035,
+    "finite": 0.009755441918969154
+  },
+  {
+    "step": 45,
+    "loss": 2.1214792728424072,
+    "diagonal": 2.118128776550293,
+    "finite": 0.01456721592694521
+  },
+  {
+    "step": 46,
+    "loss": 1.9991445541381836,
+    "diagonal": 1.9962226152420044,
+    "finite": 0.012433824129402637
+  },
+  {
+    "step": 47,
+    "loss": 2.38021183013916,
+    "diagonal": 2.3771910667419434,
+    "finite": 0.012586122378706932
+  },
+  {
+    "step": 48,
+    "loss": 2.1636507511138916,
+    "diagonal": 2.1588706970214844,
+    "finite": 0.019510816782712936
+  },
+  {
+    "step": 49,
+    "loss": 2.2091879844665527,
+    "diagonal": 2.2049622535705566,
+    "finite": 0.01690259389579296
+  },
+  {
+    "step": 50,
+    "loss": 1.685050368309021,
+    "diagonal": 1.6784512996673584,
+    "finite": 0.02587861940264702
+  },
+  {
+    "step": 51,
+    "loss": 1.8953442573547363,
+    "diagonal": 1.889981985092163,
+    "finite": 0.020624006167054176
+  },
+  {
+    "step": 52,
+    "loss": 2.012115240097046,
+    "diagonal": 2.0061025619506836,
+    "finite": 0.022689172998070717
+  },
+  {
+    "step": 53,
+    "loss": 2.401205062866211,
+    "diagonal": 2.3950071334838867,
+    "finite": 0.02295498177409172
+  },
+  {
+    "step": 54,
+    "loss": 1.868084192276001,
+    "diagonal": 1.8569283485412598,
+    "finite": 0.04056692123413086
+  },
+  {
+    "step": 55,
+    "loss": 2.079230785369873,
+    "diagonal": 2.0744357109069824,
+    "finite": 0.01712547428905964
+  },
+  {
+    "step": 56,
+    "loss": 2.5273547172546387,
+    "diagonal": 2.5226073265075684,
+    "finite": 0.01665775291621685
+  },
+  {
+    "step": 57,
+    "loss": 2.0740890502929688,
+    "diagonal": 2.0687384605407715,
+    "finite": 0.018450509756803513
+  },
+  {
+    "step": 58,
+    "loss": 1.8487399816513062,
+    "diagonal": 1.8458020687103271,
+    "finite": 0.009959137998521328
+  },
+  {
+    "step": 59,
+    "loss": 1.6750102043151855,
+    "diagonal": 1.6714694499969482,
+    "finite": 0.011802488937973976
+  },
+  {
+    "step": 60,
+    "loss": 1.958617925643921,
+    "diagonal": 1.9550278186798096,
+    "finite": 0.011770755983889103
+  },
+  {
+    "step": 61,
+    "loss": 2.347656726837158,
+    "diagonal": 2.342689037322998,
+    "finite": 0.016024596989154816
+  },
+  {
+    "step": 62,
+    "loss": 1.817075252532959,
+    "diagonal": 1.813614010810852,
+    "finite": 0.01098816841840744
+  },
+  {
+    "step": 63,
+    "loss": 2.114687204360962,
+    "diagonal": 2.1117844581604004,
+    "finite": 0.009070908650755882
+  },
+  {
+    "step": 64,
+    "loss": 2.724186658859253,
+    "diagonal": 2.7209296226501465,
+    "finite": 0.010021822527050972
+  },
+  {
+    "step": 65,
+    "loss": 1.9726885557174683,
+    "diagonal": 1.9645116329193115,
+    "finite": 0.024778392165899277
+  },
+  {
+    "step": 66,
+    "loss": 2.092599868774414,
+    "diagonal": 2.0824968814849854,
+    "finite": 0.03015792928636074
+  },
+  {
+    "step": 67,
+    "loss": 2.0696871280670166,
+    "diagonal": 2.064326047897339,
+    "finite": 0.015767769888043404
+  },
+  {
+    "step": 68,
+    "loss": 1.992958426475525,
+    "diagonal": 1.9906378984451294,
+    "finite": 0.00672609219327569
+  },
+  {
+    "step": 69,
+    "loss": 2.865614652633667,
+    "diagonal": 2.859743595123291,
+    "finite": 0.016774727031588554
+  },
+  {
+    "step": 70,
+    "loss": 2.197512149810791,
+    "diagonal": 2.193952798843384,
+    "finite": 0.010026049800217152
+  },
+  {
+    "step": 71,
+    "loss": 2.1047286987304688,
+    "diagonal": 2.101703643798828,
+    "finite": 0.008402938023209572
+  },
+  {
+    "step": 72,
+    "loss": 1.9298306703567505,
+    "diagonal": 1.9267288446426392,
+    "finite": 0.00849807821214199
+  },
+  {
+    "step": 73,
+    "loss": 1.983368992805481,
+    "diagonal": 1.9771153926849365,
+    "finite": 0.016901757568120956
+  },
+  {
+    "step": 74,
+    "loss": 1.9280325174331665,
+    "diagonal": 1.9211957454681396,
+    "finite": 0.018231358379125595
+  },
+  {
+    "step": 75,
+    "loss": 1.7047640085220337,
+    "diagonal": 1.701912760734558,
+    "finite": 0.007503216154873371
+  },
+  {
+    "step": 76,
+    "loss": 1.688684105873108,
+    "diagonal": 1.6846201419830322,
+    "finite": 0.010555732995271683
+  },
+  {
+    "step": 77,
+    "loss": 1.9813041687011719,
+    "diagonal": 1.9772748947143555,
+    "finite": 0.010331455618143082
+  },
+  {
+    "step": 78,
+    "loss": 2.3019208908081055,
+    "diagonal": 2.297616481781006,
+    "finite": 0.010897123254835606
+  },
+  {
+    "step": 79,
+    "loss": 2.8465511798858643,
+    "diagonal": 2.8404574394226074,
+    "finite": 0.015234527178108692
+  },
+  {
+    "step": 80,
+    "loss": 1.6999318599700928,
+    "diagonal": 1.6957284212112427,
+    "finite": 0.010378769598901272
+  },
+  {
+    "step": 81,
+    "loss": 2.4896061420440674,
+    "diagonal": 2.4865100383758545,
+    "finite": 0.0075515867210924625
+  },
+  {
+    "step": 82,
+    "loss": 2.0028114318847656,
+    "diagonal": 1.9959051609039307,
+    "finite": 0.016641853377223015
+  },
+  {
+    "step": 83,
+    "loss": 2.051168203353882,
+    "diagonal": 2.0442991256713867,
+    "finite": 0.01635480858385563
+  },
+  {
+    "step": 84,
+    "loss": 1.8729591369628906,
+    "diagonal": 1.8655141592025757,
+    "finite": 0.017517540603876114
+  },
+  {
+    "step": 85,
+    "loss": 1.6645605564117432,
+    "diagonal": 1.662218689918518,
+    "finite": 0.005446256138384342
+  },
+  {
+    "step": 86,
+    "loss": 1.844451904296875,
+    "diagonal": 1.840139389038086,
+    "finite": 0.009913762100040913
+  },
+  {
+    "step": 87,
+    "loss": 1.7753764390945435,
+    "diagonal": 1.7716093063354492,
+    "finite": 0.008561606518924236
+  },
+  {
+    "step": 88,
+    "loss": 1.7970685958862305,
+    "diagonal": 1.7918801307678223,
+    "finite": 0.011659599840641022
+  },
+  {
+    "step": 89,
+    "loss": 2.233283758163452,
+    "diagonal": 2.2311456203460693,
+    "finite": 0.004751304164528847
+  },
+  {
+    "step": 90,
+    "loss": 1.9295539855957031,
+    "diagonal": 1.9221214056015015,
+    "finite": 0.0163352619856596
+  },
+  {
+    "step": 91,
+    "loss": 1.6154189109802246,
+    "diagonal": 1.6098767518997192,
+    "finite": 0.01204829290509224
+  },
+  {
+    "step": 92,
+    "loss": 1.7581130266189575,
+    "diagonal": 1.754990816116333,
+    "finite": 0.006714522372931242
+  },
+  {
+    "step": 93,
+    "loss": 1.7524147033691406,
+    "diagonal": 1.7481577396392822,
+    "finite": 0.009057275950908661
+  },
+  {
+    "step": 94,
+    "loss": 1.8072303533554077,
+    "diagonal": 1.8034403324127197,
+    "finite": 0.00797891616821289
+  },
+  {
+    "step": 95,
+    "loss": 2.0217251777648926,
+    "diagonal": 2.0181527137756348,
+    "finite": 0.007442607078701258
+  },
+  {
+    "step": 96,
+    "loss": 1.8675028085708618,
+    "diagonal": 1.8629885911941528,
+    "finite": 0.009307648055255413
+  },
+  {
+    "step": 97,
+    "loss": 2.0022804737091064,
+    "diagonal": 1.9949586391448975,
+    "finite": 0.014942752197384834
+  },
+  {
+    "step": 98,
+    "loss": 1.9277172088623047,
+    "diagonal": 1.9247832298278809,
+    "finite": 0.0059272535145282745
+  },
+  {
+    "step": 99,
+    "loss": 2.22236704826355,
+    "diagonal": 2.2181575298309326,
+    "finite": 0.0084188561886549
+  },
+  {
+    "step": 100,
+    "loss": 1.8904922008514404,
+    "diagonal": 1.8876488208770752,
+    "finite": 0.005630410276353359
+  },
+  {
+    "step": 101,
+    "loss": 1.7881730794906616,
+    "diagonal": 1.7850916385650635,
+    "finite": 0.006042087450623512
+  },
+  {
+    "step": 102,
+    "loss": 2.3612353801727295,
+    "diagonal": 2.3579747676849365,
+    "finite": 0.00633130082860589
+  },
+  {
+    "step": 103,
+    "loss": 1.613385558128357,
+    "diagonal": 1.6098605394363403,
+    "finite": 0.006778972689062357
+  },
+  {
+    "step": 104,
+    "loss": 2.160442352294922,
+    "diagonal": 2.1553452014923096,
+    "finite": 0.00970874261111021
+  },
+  {
+    "step": 105,
+    "loss": 1.62186598777771,
+    "diagonal": 1.6184227466583252,
+    "finite": 0.00649669487029314
+  },
+  {
+    "step": 106,
+    "loss": 2.011404514312744,
+    "diagonal": 2.0095748901367188,
+    "finite": 0.00341976759955287
+  },
+  {
+    "step": 107,
+    "loss": 1.8372541666030884,
+    "diagonal": 1.83420729637146,
+    "finite": 0.005642279051244259
+  },
+  {
+    "step": 108,
+    "loss": 2.078252077102661,
+    "diagonal": 2.073676109313965,
+    "finite": 0.008396453224122524
+  },
+  {
+    "step": 109,
+    "loss": 2.177382707595825,
+    "diagonal": 2.174656867980957,
+    "finite": 0.0049558887258172035
+  },
+  {
+    "step": 110,
+    "loss": 2.3901236057281494,
+    "diagonal": 2.386702299118042,
+    "finite": 0.006164505146443844
+  },
+  {
+    "step": 111,
+    "loss": 2.294813394546509,
+    "diagonal": 2.2911555767059326,
+    "finite": 0.00653182715177536
+  },
+  {
+    "step": 112,
+    "loss": 2.806048631668091,
+    "diagonal": 2.803309679031372,
+    "finite": 0.0048478771932423115
+  },
+  {
+    "step": 113,
+    "loss": 2.054903268814087,
+    "diagonal": 2.0520517826080322,
+    "finite": 0.005002600606530905
+  },
+  {
+    "step": 114,
+    "loss": 1.8173459768295288,
+    "diagonal": 1.8101502656936646,
+    "finite": 0.01251431554555893
+  },
+  {
+    "step": 115,
+    "loss": 1.9594836235046387,
+    "diagonal": 1.9562026262283325,
+    "finite": 0.005656925495713949
+  },
+  {
+    "step": 116,
+    "loss": 2.005734920501709,
+    "diagonal": 1.9952514171600342,
+    "finite": 0.01792055554687977
+  },
+  {
+    "step": 117,
+    "loss": 2.1853716373443604,
+    "diagonal": 2.1757140159606934,
+    "finite": 0.016368865966796875
+  },
+  {
+    "step": 118,
+    "loss": 1.957926869392395,
+    "diagonal": 1.9505821466445923,
+    "finite": 0.01234398689121008
+  },
+  {
+    "step": 119,
+    "loss": 2.0139551162719727,
+    "diagonal": 2.003336191177368,
+    "finite": 0.01769831031560898
+  },
+  {
+    "step": 120,
+    "loss": 2.2498624324798584,
+    "diagonal": 2.2392566204071045,
+    "finite": 0.01753036305308342
+  },
+  {
+    "step": 121,
+    "loss": 2.026120185852051,
+    "diagonal": 2.019671678543091,
+    "finite": 0.010571298189461231
+  },
+  {
+    "step": 122,
+    "loss": 1.5534930229187012,
+    "diagonal": 1.545884132385254,
+    "finite": 0.012372175231575966
+  },
+  {
+    "step": 123,
+    "loss": 1.6922738552093506,
+    "diagonal": 1.685678482055664,
+    "finite": 0.010637730360031128
+  },
+  {
+    "step": 124,
+    "loss": 2.2855703830718994,
+    "diagonal": 2.2796645164489746,
+    "finite": 0.009449370205402374
+  },
+  {
+    "step": 125,
+    "loss": 2.186481237411499,
+    "diagonal": 2.177025318145752,
+    "finite": 0.015009447932243347
+  },
+  {
+    "step": 126,
+    "loss": 1.989935040473938,
+    "diagonal": 1.9853689670562744,
+    "finite": 0.007190645672380924
+  },
+  {
+    "step": 127,
+    "loss": 1.9804713726043701,
+    "diagonal": 1.9760223627090454,
+    "finite": 0.006951655726879835
+  },
+  {
+    "step": 128,
+    "loss": 2.076155662536621,
+    "diagonal": 2.071826696395874,
+    "finite": 0.006711730267852545
+  },
+  {
+    "step": 129,
+    "loss": 2.3601725101470947,
+    "diagonal": 2.3551552295684814,
+    "finite": 0.007718919310718775
+  },
+  {
+    "step": 130,
+    "loss": 2.153022527694702,
+    "diagonal": 2.1489813327789307,
+    "finite": 0.006169657222926617
+  },
+  {
+    "step": 131,
+    "loss": 1.938570499420166,
+    "diagonal": 1.9333772659301758,
+    "finite": 0.007868492044508457
+  },
+  {
+    "step": 132,
+    "loss": 1.6375595331192017,
+    "diagonal": 1.6342521905899048,
+    "finite": 0.004973496310412884
+  },
+  {
+    "step": 133,
+    "loss": 2.198084831237793,
+    "diagonal": 2.194676399230957,
+    "finite": 0.005087040364742279
+  },
+  {
+    "step": 134,
+    "loss": 1.9020717144012451,
+    "diagonal": 1.8998339176177979,
+    "finite": 0.003315261797979474
+  },
+  {
+    "step": 135,
+    "loss": 1.8358970880508423,
+    "diagonal": 1.8303942680358887,
+    "finite": 0.00809241272509098
+  },
+  {
+    "step": 136,
+    "loss": 1.6600496768951416,
+    "diagonal": 1.6558729410171509,
+    "finite": 0.006097493693232536
+  },
+  {
+    "step": 137,
+    "loss": 1.769221305847168,
+    "diagonal": 1.7641092538833618,
+    "finite": 0.007408755831420422
+  },
+  {
+    "step": 138,
+    "loss": 2.175753593444824,
+    "diagonal": 2.1728339195251465,
+    "finite": 0.004200861789286137
+  },
+  {
+    "step": 139,
+    "loss": 2.461582660675049,
+    "diagonal": 2.4590466022491455,
+    "finite": 0.0036228036042302847
+  },
+  {
+    "step": 140,
+    "loss": 2.557246685028076,
+    "diagonal": 2.553405284881592,
+    "finite": 0.0054488228633999825
+  },
+  {
+    "step": 141,
+    "loss": 1.7989250421524048,
+    "diagonal": 1.79400634765625,
+    "finite": 0.006927773356437683
+  },
+  {
+    "step": 142,
+    "loss": 2.2288200855255127,
+    "diagonal": 2.2230706214904785,
+    "finite": 0.008041288703680038
+  },
+  {
+    "step": 143,
+    "loss": 2.5140655040740967,
+    "diagonal": 2.508553981781006,
+    "finite": 0.0076547907665371895
+  },
+  {
+    "step": 144,
+    "loss": 1.9054421186447144,
+    "diagonal": 1.9003961086273193,
+    "finite": 0.0069600660353899
+  },
+  {
+    "step": 145,
+    "loss": 1.929107904434204,
+    "diagonal": 1.925053358078003,
+    "finite": 0.0055541833862662315
+  },
+  {
+    "step": 146,
+    "loss": 2.1502773761749268,
+    "diagonal": 2.147501230239868,
+    "finite": 0.003776932368054986
+  },
+  {
+    "step": 147,
+    "loss": 1.9712258577346802,
+    "diagonal": 1.9680575132369995,
+    "finite": 0.004281620495021343
+  },
+  {
+    "step": 148,
+    "loss": 1.8826212882995605,
+    "diagonal": 1.8758128881454468,
+    "finite": 0.00913881417363882
+  },
+  {
+    "step": 149,
+    "loss": 2.0877275466918945,
+    "diagonal": 2.077165126800537,
+    "finite": 0.014083072543144226
+  },
+  {
+    "step": 150,
+    "loss": 2.3631386756896973,
+    "diagonal": 2.3577334880828857,
+    "finite": 0.007159076165407896
+  },
+  {
+    "step": 151,
+    "loss": 2.7301249504089355,
+    "diagonal": 2.7249248027801514,
+    "finite": 0.006842424161732197
+  },
+  {
+    "step": 152,
+    "loss": 2.5693306922912598,
+    "diagonal": 2.5617449283599854,
+    "finite": 0.009915973991155624
+  },
+  {
+    "step": 153,
+    "loss": 2.326662302017212,
+    "diagonal": 2.3180015087127686,
+    "finite": 0.011247685179114342
+  },
+  {
+    "step": 154,
+    "loss": 2.2451353073120117,
+    "diagonal": 2.238483190536499,
+    "finite": 0.008583294227719307
+  },
+  {
+    "step": 155,
+    "loss": 1.9088902473449707,
+    "diagonal": 1.902190923690796,
+    "finite": 0.008588927797973156
+  },
+  {
+    "step": 156,
+    "loss": 1.816026210784912,
+    "diagonal": 1.8067419528961182,
+    "finite": 0.011827089823782444
+  },
+  {
+    "step": 157,
+    "loss": 1.808577299118042,
+    "diagonal": 1.8004422187805176,
+    "finite": 0.010297505185008049
+  },
+  {
+    "step": 158,
+    "loss": 1.6354632377624512,
+    "diagonal": 1.6273505687713623,
+    "finite": 0.010204629972577095
+  },
+  {
+    "step": 159,
+    "loss": 2.0622284412384033,
+    "diagonal": 2.0512454509735107,
+    "finite": 0.013728609308600426
+  },
+  {
+    "step": 160,
+    "loss": 2.4685750007629395,
+    "diagonal": 2.4599714279174805,
+    "finite": 0.010687666945159435
+  },
+  {
+    "step": 161,
+    "loss": 1.8347046375274658,
+    "diagonal": 1.82536780834198,
+    "finite": 0.01152691151946783
+  },
+  {
+    "step": 162,
+    "loss": 2.1527230739593506,
+    "diagonal": 2.1398980617523193,
+    "finite": 0.015736091881990433
+  },
+  {
+    "step": 163,
+    "loss": 1.4884644746780396,
+    "diagonal": 1.4798765182495117,
+    "finite": 0.010473184287548065
+  },
+  {
+    "step": 164,
+    "loss": 1.867203712463379,
+    "diagonal": 1.8576138019561768,
+    "finite": 0.011624187231063843
+  },
+  {
+    "step": 165,
+    "loss": 2.1696906089782715,
+    "diagonal": 2.162623643875122,
+    "finite": 0.008514286950230598
+  },
+  {
+    "step": 166,
+    "loss": 1.8648496866226196,
+    "diagonal": 1.8568116426467896,
+    "finite": 0.009626452811062336
+  },
+  {
+    "step": 167,
+    "loss": 1.7163984775543213,
+    "diagonal": 1.7054576873779297,
+    "finite": 0.013024814426898956
+  },
+  {
+    "step": 168,
+    "loss": 1.7996673583984375,
+    "diagonal": 1.7956640720367432,
+    "finite": 0.004737605340778828
+  },
+  {
+    "step": 169,
+    "loss": 2.1534125804901123,
+    "diagonal": 2.1399736404418945,
+    "finite": 0.015810448676347733
+  },
+  {
+    "step": 170,
+    "loss": 1.9021321535110474,
+    "diagonal": 1.8959678411483765,
+    "finite": 0.007209703791886568
+  },
+  {
+    "step": 171,
+    "loss": 2.5138635635375977,
+    "diagonal": 2.506551504135132,
+    "finite": 0.008502514101564884
+  },
+  {
+    "step": 172,
+    "loss": 2.620818614959717,
+    "diagonal": 2.611875534057617,
+    "finite": 0.01033871155232191
+  },
+  {
+    "step": 173,
+    "loss": 1.9179853200912476,
+    "diagonal": 1.905147671699524,
+    "finite": 0.01475590281188488
+  },
+  {
+    "step": 174,
+    "loss": 1.9954549074172974,
+    "diagonal": 1.9880725145339966,
+    "finite": 0.00843705516308546
+  },
+  {
+    "step": 175,
+    "loss": 2.0514111518859863,
+    "diagonal": 2.0455119609832764,
+    "finite": 0.006703746970742941
+  },
+  {
+    "step": 176,
+    "loss": 1.880372166633606,
+    "diagonal": 1.8747479915618896,
+    "finite": 0.00635498994961381
+  },
+  {
+    "step": 177,
+    "loss": 2.0845470428466797,
+    "diagonal": 2.0785365104675293,
+    "finite": 0.006753398105502129
+  },
+  {
+    "step": 178,
+    "loss": 1.7245547771453857,
+    "diagonal": 1.7117815017700195,
+    "finite": 0.014271827414631844
+  },
+  {
+    "step": 179,
+    "loss": 1.8780425786972046,
+    "diagonal": 1.8727084398269653,
+    "finite": 0.005926772486418486
+  },
+  {
+    "step": 180,
+    "loss": 1.5371607542037964,
+    "diagonal": 1.5330348014831543,
+    "finite": 0.004559085704386234
+  },
+  {
+    "step": 181,
+    "loss": 2.1723713874816895,
+    "diagonal": 2.1669414043426514,
+    "finite": 0.00596713786944747
+  },
+  {
+    "step": 182,
+    "loss": 2.366961717605591,
+    "diagonal": 2.3599252700805664,
+    "finite": 0.007690013851970434
+  },
+  {
+    "step": 183,
+    "loss": 1.9503015279769897,
+    "diagonal": 1.9441004991531372,
+    "finite": 0.006740217562764883
+  },
+  {
+    "step": 184,
+    "loss": 2.387911081314087,
+    "diagonal": 2.3790290355682373,
+    "finite": 0.009602331556379795
+  },
+  {
+    "step": 185,
+    "loss": 1.855316162109375,
+    "diagonal": 1.8494133949279785,
+    "finite": 0.006347012240439653
+  },
+  {
+    "step": 186,
+    "loss": 1.8914196491241455,
+    "diagonal": 1.8836051225662231,
+    "finite": 0.008357805199921131
+  },
+  {
+    "step": 187,
+    "loss": 2.4647390842437744,
+    "diagonal": 2.450669527053833,
+    "finite": 0.014967511408030987
+  },
+  {
+    "step": 188,
+    "loss": 2.378812074661255,
+    "diagonal": 2.367891550064087,
+    "finite": 0.01155615784227848
+  },
+  {
+    "step": 189,
+    "loss": 2.685239791870117,
+    "diagonal": 2.673776626586914,
+    "finite": 0.012066471390426159
+  },
+  {
+    "step": 190,
+    "loss": 1.6510664224624634,
+    "diagonal": 1.6426329612731934,
+    "finite": 0.008830861188471317
+  },
+  {
+    "step": 191,
+    "loss": 2.121459722518921,
+    "diagonal": 2.114765167236328,
+    "finite": 0.006973616778850555
+  },
+  {
+    "step": 192,
+    "loss": 2.2412922382354736,
+    "diagonal": 2.2313268184661865,
+    "finite": 0.010326789692044258
+  },
+  {
+    "step": 193,
+    "loss": 2.7671847343444824,
+    "diagonal": 2.760830879211426,
+    "finite": 0.00655028922483325
+  },
+  {
+    "step": 194,
+    "loss": 2.1527202129364014,
+    "diagonal": 2.142171859741211,
+    "finite": 0.010818727314472198
+  },
+  {
+    "step": 195,
+    "loss": 1.3951170444488525,
+    "diagonal": 1.3869880437850952,
+    "finite": 0.008294912055134773
+  },
+  {
+    "step": 196,
+    "loss": 2.646233558654785,
+    "diagonal": 2.637115716934204,
+    "finite": 0.009256664663553238
+  },
+  {
+    "step": 197,
+    "loss": 1.65790593624115,
+    "diagonal": 1.6467254161834717,
+    "finite": 0.011293459683656693
+  },
+  {
+    "step": 198,
+    "loss": 1.8733729124069214,
+    "diagonal": 1.8655253648757935,
+    "finite": 0.007886934094130993
+  },
+  {
+    "step": 199,
+    "loss": 1.8395389318466187,
+    "diagonal": 1.8303508758544922,
+    "finite": 0.009188023395836353
+  },
+  {
+    "step": 200,
+    "loss": 2.4778902530670166,
+    "diagonal": 2.468658685684204,
+    "finite": 0.009231511503458023
+  },
+  {
+    "step": 201,
+    "loss": 2.283358335494995,
+    "diagonal": 2.2742269039154053,
+    "finite": 0.009131529368460178
+  },
+  {
+    "step": 202,
+    "loss": 2.8923981189727783,
+    "diagonal": 2.8852908611297607,
+    "finite": 0.007107233162969351
+  },
+  {
+    "step": 203,
+    "loss": 2.150853157043457,
+    "diagonal": 2.1442933082580566,
+    "finite": 0.006559805478900671
+  },
+  {
+    "step": 204,
+    "loss": 2.496417999267578,
+    "diagonal": 2.489974021911621,
+    "finite": 0.006443880498409271
+  },
+  {
+    "step": 205,
+    "loss": 2.1606695652008057,
+    "diagonal": 2.1492807865142822,
+    "finite": 0.011388745158910751
+  },
+  {
+    "step": 206,
+    "loss": 2.2307796478271484,
+    "diagonal": 2.21887469291687,
+    "finite": 0.011904919520020485
+  },
+  {
+    "step": 207,
+    "loss": 1.7147756814956665,
+    "diagonal": 1.7051002979278564,
+    "finite": 0.009675374254584312
+  },
+  {
+    "step": 208,
+    "loss": 1.7037426233291626,
+    "diagonal": 1.6979420185089111,
+    "finite": 0.0058005754835903645
+  },
+  {
+    "step": 209,
+    "loss": 1.9381842613220215,
+    "diagonal": 1.932387113571167,
+    "finite": 0.005797203630208969
+  },
+  {
+    "step": 210,
+    "loss": 1.747262716293335,
+    "diagonal": 1.7377359867095947,
+    "finite": 0.009526743553578854
+  },
+  {
+    "step": 211,
+    "loss": 1.8785076141357422,
+    "diagonal": 1.8688758611679077,
+    "finite": 0.009631756693124771
+  },
+  {
+    "step": 212,
+    "loss": 1.9058033227920532,
+    "diagonal": 1.8997259140014648,
+    "finite": 0.006077445112168789
+  },
+  {
+    "step": 213,
+    "loss": 2.3674046993255615,
+    "diagonal": 2.3577704429626465,
+    "finite": 0.009634352289140224
+  },
+  {
+    "step": 214,
+    "loss": 2.551072597503662,
+    "diagonal": 2.5441784858703613,
+    "finite": 0.006894082762300968
+  },
+  {
+    "step": 215,
+    "loss": 1.914912462234497,
+    "diagonal": 1.9032747745513916,
+    "finite": 0.011637696996331215
+  },
+  {
+    "step": 216,
+    "loss": 1.6222569942474365,
+    "diagonal": 1.6154319047927856,
+    "finite": 0.006825079210102558
+  },
+  {
+    "step": 217,
+    "loss": 1.9161101579666138,
+    "diagonal": 1.9095988273620605,
+    "finite": 0.0065113212913274765
+  },
+  {
+    "step": 218,
+    "loss": 2.374783515930176,
+    "diagonal": 2.3665659427642822,
+    "finite": 0.008217680267989635
+  },
+  {
+    "step": 219,
+    "loss": 2.125375270843506,
+    "diagonal": 2.1158130168914795,
+    "finite": 0.009562206454575062
+  },
+  {
+    "step": 220,
+    "loss": 2.0087368488311768,
+    "diagonal": 2.0063326358795166,
+    "finite": 0.0024041207507252693
+  },
+  {
+    "step": 221,
+    "loss": 1.738572120666504,
+    "diagonal": 1.7343899011611938,
+    "finite": 0.004182171542197466
+  },
+  {
+    "step": 222,
+    "loss": 1.8462599515914917,
+    "diagonal": 1.8371617794036865,
+    "finite": 0.009098227135837078
+  },
+  {
+    "step": 223,
+    "loss": 1.5233484506607056,
+    "diagonal": 1.5187339782714844,
+    "finite": 0.0046145073138177395
+  },
+  {
+    "step": 224,
+    "loss": 2.3494133949279785,
+    "diagonal": 2.3443195819854736,
+    "finite": 0.005093817599117756
+  },
+  {
+    "step": 225,
+    "loss": 2.353111743927002,
+    "diagonal": 2.3494455814361572,
+    "finite": 0.003666109871119261
+  },
+  {
+    "step": 226,
+    "loss": 1.889209270477295,
+    "diagonal": 1.8808846473693848,
+    "finite": 0.008324632421135902
+  },
+  {
+    "step": 227,
+    "loss": 2.2445008754730225,
+    "diagonal": 2.2365505695343018,
+    "finite": 0.007950334809720516
+  },
+  {
+    "step": 228,
+    "loss": 2.1303069591522217,
+    "diagonal": 2.1176178455352783,
+    "finite": 0.012689042836427689
+  },
+  {
+    "step": 229,
+    "loss": 2.3761913776397705,
+    "diagonal": 2.3691937923431396,
+    "finite": 0.006997605785727501
+  },
+  {
+    "step": 230,
+    "loss": 2.0984578132629395,
+    "diagonal": 2.092576026916504,
+    "finite": 0.005881702061742544
+  },
+  {
+    "step": 231,
+    "loss": 1.8076306581497192,
+    "diagonal": 1.8039356470108032,
+    "finite": 0.0036950528156012297
+  },
+  {
+    "step": 232,
+    "loss": 1.7846139669418335,
+    "diagonal": 1.7778358459472656,
+    "finite": 0.006778107490390539
+  },
+  {
+    "step": 233,
+    "loss": 2.302049398422241,
+    "diagonal": 2.2950267791748047,
+    "finite": 0.00702263368293643
+  },
+  {
+    "step": 234,
+    "loss": 2.3837356567382812,
+    "diagonal": 2.376727342605591,
+    "finite": 0.007008301094174385
+  },
+  {
+    "step": 235,
+    "loss": 1.5473822355270386,
+    "diagonal": 1.541824460029602,
+    "finite": 0.005557801574468613
+  },
+  {
+    "step": 236,
+    "loss": 2.4297995567321777,
+    "diagonal": 2.4211158752441406,
+    "finite": 0.008683797903358936
+  },
+  {
+    "step": 237,
+    "loss": 2.2988905906677246,
+    "diagonal": 2.2883379459381104,
+    "finite": 0.010552704334259033
+  },
+  {
+    "step": 238,
+    "loss": 2.234710216522217,
+    "diagonal": 2.2253575325012207,
+    "finite": 0.009352765046060085
+  },
+  {
+    "step": 239,
+    "loss": 1.7567732334136963,
+    "diagonal": 1.7494816780090332,
+    "finite": 0.007291542831808329
+  },
+  {
+    "step": 240,
+    "loss": 2.0040175914764404,
+    "diagonal": 1.99183189868927,
+    "finite": 0.012185647152364254
+  },
+  {
+    "step": 241,
+    "loss": 1.4485834836959839,
+    "diagonal": 1.440017580986023,
+    "finite": 0.008565947413444519
+  },
+  {
+    "step": 242,
+    "loss": 1.6491925716400146,
+    "diagonal": 1.6408276557922363,
+    "finite": 0.008364961482584476
+  },
+  {
+    "step": 243,
+    "loss": 2.921808958053589,
+    "diagonal": 2.9132137298583984,
+    "finite": 0.008595341816544533
+  },
+  {
+    "step": 244,
+    "loss": 2.635521173477173,
+    "diagonal": 2.627286195755005,
+    "finite": 0.008234876208007336
+  },
+  {
+    "step": 245,
+    "loss": 2.2179508209228516,
+    "diagonal": 2.2090771198272705,
+    "finite": 0.008873670361936092
+  },
+  {
+    "step": 246,
+    "loss": 2.226569175720215,
+    "diagonal": 2.2178351879119873,
+    "finite": 0.008733946830034256
+  },
+  {
+    "step": 247,
+    "loss": 2.148300886154175,
+    "diagonal": 2.1404852867126465,
+    "finite": 0.007815518416464329
+  },
+  {
+    "step": 248,
+    "loss": 2.4925615787506104,
+    "diagonal": 2.4841666221618652,
+    "finite": 0.008394870907068253
+  },
+  {
+    "step": 249,
+    "loss": 1.6575047969818115,
+    "diagonal": 1.6484099626541138,
+    "finite": 0.009094875305891037
+  },
+  {
+    "step": 250,
+    "loss": 2.4381601810455322,
+    "diagonal": 2.4279584884643555,
+    "finite": 0.010201576165854931
+  },
+  {
+    "step": 251,
+    "loss": 1.4077153205871582,
+    "diagonal": 1.3994723558425903,
+    "finite": 0.008242959156632423
+  },
+  {
+    "step": 252,
+    "loss": 2.6894755363464355,
+    "diagonal": 2.678314208984375,
+    "finite": 0.011161327362060547
+  },
+  {
+    "step": 253,
+    "loss": 1.457322120666504,
+    "diagonal": 1.4496970176696777,
+    "finite": 0.007625153753906488
+  },
+  {
+    "step": 254,
+    "loss": 1.5878016948699951,
+    "diagonal": 1.579617977142334,
+    "finite": 0.008183777332305908
+  },
+  {
+    "step": 255,
+    "loss": 1.9134488105773926,
+    "diagonal": 1.8980205059051514,
+    "finite": 0.015428302809596062
+  },
+  {
+    "step": 256,
+    "loss": 1.7964485883712769,
+    "diagonal": 1.7880160808563232,
+    "finite": 0.008432520553469658
+  },
+  {
+    "step": 257,
+    "loss": 2.0605385303497314,
+    "diagonal": 2.051879405975342,
+    "finite": 0.008659024722874165
+  },
+  {
+    "step": 258,
+    "loss": 2.5631089210510254,
+    "diagonal": 2.5499398708343506,
+    "finite": 0.013169120997190475
+  },
+  {
+    "step": 259,
+    "loss": 2.1354660987854004,
+    "diagonal": 2.1271185874938965,
+    "finite": 0.008347596041858196
+  },
+  {
+    "step": 260,
+    "loss": 2.0509510040283203,
+    "diagonal": 2.0449743270874023,
+    "finite": 0.005976673681288958
+  },
+  {
+    "step": 261,
+    "loss": 1.384804129600525,
+    "diagonal": 1.3708139657974243,
+    "finite": 0.013990171253681183
+  },
+  {
+    "step": 262,
+    "loss": 2.2744357585906982,
+    "diagonal": 2.2653422355651855,
+    "finite": 0.009093492291867733
+  },
+  {
+    "step": 263,
+    "loss": 2.3613343238830566,
+    "diagonal": 2.3559234142303467,
+    "finite": 0.005410919431596994
+  },
+  {
+    "step": 264,
+    "loss": 1.8894665241241455,
+    "diagonal": 1.8831753730773926,
+    "finite": 0.006291188765317202
+  },
+  {
+    "step": 265,
+    "loss": 1.883812427520752,
+    "diagonal": 1.8745818138122559,
+    "finite": 0.009230613708496094
+  },
+  {
+    "step": 266,
+    "loss": 2.03882098197937,
+    "diagonal": 2.032463312149048,
+    "finite": 0.006357695907354355
+  },
+  {
+    "step": 267,
+    "loss": 2.3156821727752686,
+    "diagonal": 2.308657646179199,
+    "finite": 0.0070246076211333275
+  },
+  {
+    "step": 268,
+    "loss": 1.5898253917694092,
+    "diagonal": 1.5859397649765015,
+    "finite": 0.003885648911818862
+  },
+  {
+    "step": 269,
+    "loss": 1.7163119316101074,
+    "diagonal": 1.7124611139297485,
+    "finite": 0.0038508588913828135
+  },
+  {
+    "step": 270,
+    "loss": 1.957336664199829,
+    "diagonal": 1.9511511325836182,
+    "finite": 0.006185516715049744
+  },
+  {
+    "step": 271,
+    "loss": 1.9132198095321655,
+    "diagonal": 1.9059242010116577,
+    "finite": 0.007295612711459398
+  },
+  {
+    "step": 272,
+    "loss": 1.7886576652526855,
+    "diagonal": 1.7827914953231812,
+    "finite": 0.005866214167326689
+  },
+  {
+    "step": 273,
+    "loss": 2.452817916870117,
+    "diagonal": 2.4420862197875977,
+    "finite": 0.010731670074164867
+  },
+  {
+    "step": 274,
+    "loss": 2.2348663806915283,
+    "diagonal": 2.230408191680908,
+    "finite": 0.0044581107795238495
+  },
+  {
+    "step": 275,
+    "loss": 1.942691445350647,
+    "diagonal": 1.938504695892334,
+    "finite": 0.004186802543699741
+  },
+  {
+    "step": 276,
+    "loss": 1.8640856742858887,
+    "diagonal": 1.8577123880386353,
+    "finite": 0.006373324431478977
+  },
+  {
+    "step": 277,
+    "loss": 2.618716239929199,
+    "diagonal": 2.607367992401123,
+    "finite": 0.011348137632012367
+  },
+  {
+    "step": 278,
+    "loss": 2.1012535095214844,
+    "diagonal": 2.094529867172241,
+    "finite": 0.00672357389703393
+  },
+  {
+    "step": 279,
+    "loss": 2.140061140060425,
+    "diagonal": 2.1339659690856934,
+    "finite": 0.006095078773796558
+  },
+  {
+    "step": 280,
+    "loss": 2.263174295425415,
+    "diagonal": 2.25649356842041,
+    "finite": 0.006680690683424473
+  },
+  {
+    "step": 281,
+    "loss": 2.575676918029785,
+    "diagonal": 2.5668392181396484,
+    "finite": 0.008837783709168434
+  },
+  {
+    "step": 282,
+    "loss": 1.9248331785202026,
+    "diagonal": 1.917274832725525,
+    "finite": 0.00755829643458128
+  },
+  {
+    "step": 283,
+    "loss": 2.0041277408599854,
+    "diagonal": 1.9935804605484009,
+    "finite": 0.010547293350100517
+  },
+  {
+    "step": 284,
+    "loss": 2.226247787475586,
+    "diagonal": 2.220019817352295,
+    "finite": 0.006227890029549599
+  },
+  {
+    "step": 285,
+    "loss": 1.5957585573196411,
+    "diagonal": 1.586573600769043,
+    "finite": 0.009184962138533592
+  },
+  {
+    "step": 286,
+    "loss": 2.0165512561798096,
+    "diagonal": 2.0083024501800537,
+    "finite": 0.008248698897659779
+  },
+  {
+    "step": 287,
+    "loss": 1.96748948097229,
+    "diagonal": 1.960606575012207,
+    "finite": 0.0068829176016151905
+  },
+  {
+    "step": 288,
+    "loss": 1.9521849155426025,
+    "diagonal": 1.9481953382492065,
+    "finite": 0.0039895386435091496
+  },
+  {
+    "step": 289,
+    "loss": 1.7515649795532227,
+    "diagonal": 1.7447550296783447,
+    "finite": 0.006809966638684273
+  },
+  {
+    "step": 290,
+    "loss": 1.524172067642212,
+    "diagonal": 1.5209555625915527,
+    "finite": 0.0032165476586669683
+  },
+  {
+    "step": 291,
+    "loss": 2.038106918334961,
+    "diagonal": 2.0332179069519043,
+    "finite": 0.004889122676104307
+  },
+  {
+    "step": 292,
+    "loss": 1.904416561126709,
+    "diagonal": 1.8981695175170898,
+    "finite": 0.006247017998248339
+  },
+  {
+    "step": 293,
+    "loss": 2.012617349624634,
+    "diagonal": 2.005619525909424,
+    "finite": 0.006997710559517145
+  },
+  {
+    "step": 294,
+    "loss": 2.035275459289551,
+    "diagonal": 2.027146577835083,
+    "finite": 0.008128772489726543
+  },
+  {
+    "step": 295,
+    "loss": 2.2506308555603027,
+    "diagonal": 2.2457094192504883,
+    "finite": 0.004921393468976021
+  },
+  {
+    "step": 296,
+    "loss": 2.2532243728637695,
+    "diagonal": 2.2471282482147217,
+    "finite": 0.0060961805284023285
+  },
+  {
+    "step": 297,
+    "loss": 2.2361865043640137,
+    "diagonal": 2.23148775100708,
+    "finite": 0.0046987226232886314
+  },
+  {
+    "step": 298,
+    "loss": 1.900981068611145,
+    "diagonal": 1.896191954612732,
+    "finite": 0.004789147526025772
+  },
+  {
+    "step": 299,
+    "loss": 2.000683546066284,
+    "diagonal": 1.9941139221191406,
+    "finite": 0.006569519639015198
+  },
+  {
+    "step": 300,
+    "loss": 2.0665323734283447,
+    "diagonal": 2.0604746341705322,
+    "finite": 0.00605784822255373
+  },
+  {
+    "step": 301,
+    "loss": 2.389099359512329,
+    "diagonal": 2.3854258060455322,
+    "finite": 0.0036736305337399244
+  },
+  {
+    "step": 302,
+    "loss": 1.9505529403686523,
+    "diagonal": 1.9456813335418701,
+    "finite": 0.0048715537413954735
+  },
+  {
+    "step": 303,
+    "loss": 1.4083733558654785,
+    "diagonal": 1.4050549268722534,
+    "finite": 0.0033183745108544827
+  },
+  {
+    "step": 304,
+    "loss": 2.4314661026000977,
+    "diagonal": 2.4224114418029785,
+    "finite": 0.009054761379957199
+  },
+  {
+    "step": 305,
+    "loss": 2.6906681060791016,
+    "diagonal": 2.6862854957580566,
+    "finite": 0.004382716491818428
+  },
+  {
+    "step": 306,
+    "loss": 2.1455163955688477,
+    "diagonal": 2.1423237323760986,
+    "finite": 0.0031925553921610117
+  },
+  {
+    "step": 307,
+    "loss": 2.029139995574951,
+    "diagonal": 2.024630069732666,
+    "finite": 0.0045099216513335705
+  },
+  {
+    "step": 308,
+    "loss": 1.8694243431091309,
+    "diagonal": 1.8619377613067627,
+    "finite": 0.007486577145755291
+  },
+  {
+    "step": 309,
+    "loss": 2.144663095474243,
+    "diagonal": 2.139084577560425,
+    "finite": 0.005578635260462761
+  },
+  {
+    "step": 310,
+    "loss": 1.8441553115844727,
+    "diagonal": 1.8376507759094238,
+    "finite": 0.00650453008711338
+  },
+  {
+    "step": 311,
+    "loss": 2.496544361114502,
+    "diagonal": 2.4914755821228027,
+    "finite": 0.005068804137408733
+  },
+  {
+    "step": 312,
+    "loss": 2.2226202487945557,
+    "diagonal": 2.2200865745544434,
+    "finite": 0.002533690771088004
+  },
+  {
+    "step": 313,
+    "loss": 2.273972511291504,
+    "diagonal": 2.2692501544952393,
+    "finite": 0.004722399637103081
+  },
+  {
+    "step": 314,
+    "loss": 1.641126275062561,
+    "diagonal": 1.6349462270736694,
+    "finite": 0.006180093623697758
+  },
+  {
+    "step": 315,
+    "loss": 1.613788366317749,
+    "diagonal": 1.6033172607421875,
+    "finite": 0.010471160523593426
+  },
+  {
+    "step": 316,
+    "loss": 1.8922069072723389,
+    "diagonal": 1.8863961696624756,
+    "finite": 0.005810761358588934
+  },
+  {
+    "step": 317,
+    "loss": 1.7929702997207642,
+    "diagonal": 1.7866461277008057,
+    "finite": 0.006324189715087414
+  },
+  {
+    "step": 318,
+    "loss": 1.6635043621063232,
+    "diagonal": 1.6574102640151978,
+    "finite": 0.0060940878465771675
+  },
+  {
+    "step": 319,
+    "loss": 1.9124842882156372,
+    "diagonal": 1.9053966999053955,
+    "finite": 0.00708754314109683
+  },
+  {
+    "step": 320,
+    "loss": 2.0303406715393066,
+    "diagonal": 2.024876356124878,
+    "finite": 0.005464410409331322
+  },
+  {
+    "step": 321,
+    "loss": 2.4486429691314697,
+    "diagonal": 2.441096067428589,
+    "finite": 0.007546901702880859
+  },
+  {
+    "step": 322,
+    "loss": 1.9860453605651855,
+    "diagonal": 1.9815154075622559,
+    "finite": 0.0045299045741558075
+  },
+  {
+    "step": 323,
+    "loss": 1.950666069984436,
+    "diagonal": 1.946563482284546,
+    "finite": 0.004102607257664204
+  },
+  {
+    "step": 324,
+    "loss": 1.940383791923523,
+    "diagonal": 1.9376280307769775,
+    "finite": 0.0027557704597711563
+  },
+  {
+    "step": 325,
+    "loss": 1.8196722269058228,
+    "diagonal": 1.8156129121780396,
+    "finite": 0.004059328231960535
+  },
+  {
+    "step": 326,
+    "loss": 1.5954018831253052,
+    "diagonal": 1.5911102294921875,
+    "finite": 0.004291686695069075
+  },
+  {
+    "step": 327,
+    "loss": 1.965671420097351,
+    "diagonal": 1.962570071220398,
+    "finite": 0.0031013786792755127
+  },
+  {
+    "step": 328,
+    "loss": 1.878713607788086,
+    "diagonal": 1.874489665031433,
+    "finite": 0.004223999101668596
+  },
+  {
+    "step": 329,
+    "loss": 2.3875858783721924,
+    "diagonal": 2.3834152221679688,
+    "finite": 0.004170617088675499
+  },
+  {
+    "step": 330,
+    "loss": 2.2981598377227783,
+    "diagonal": 2.292085647583008,
+    "finite": 0.006074086297303438
+  },
+  {
+    "step": 331,
+    "loss": 1.9743467569351196,
+    "diagonal": 1.969230055809021,
+    "finite": 0.005116726271808147
+  },
+  {
+    "step": 332,
+    "loss": 1.939888834953308,
+    "diagonal": 1.927074909210205,
+    "finite": 0.012813965789973736
+  },
+  {
+    "step": 333,
+    "loss": 2.3946871757507324,
+    "diagonal": 2.387632131576538,
+    "finite": 0.007054948713630438
+  },
+  {
+    "step": 334,
+    "loss": 2.3210866451263428,
+    "diagonal": 2.3169240951538086,
+    "finite": 0.004162639379501343
+  },
+  {
+    "step": 335,
+    "loss": 1.9768381118774414,
+    "diagonal": 1.9675517082214355,
+    "finite": 0.009286426939070225
+  },
+  {
+    "step": 336,
+    "loss": 1.855751872062683,
+    "diagonal": 1.8486286401748657,
+    "finite": 0.007123273331671953
+  },
+  {
+    "step": 337,
+    "loss": 1.8301057815551758,
+    "diagonal": 1.8181769847869873,
+    "finite": 0.011928831227123737
+  },
+  {
+    "step": 338,
+    "loss": 2.1494126319885254,
+    "diagonal": 2.1347789764404297,
+    "finite": 0.014633651822805405
+  },
+  {
+    "step": 339,
+    "loss": 2.0763561725616455,
+    "diagonal": 2.0692200660705566,
+    "finite": 0.007136031053960323
+  },
+  {
+    "step": 340,
+    "loss": 1.800588607788086,
+    "diagonal": 1.794834017753601,
+    "finite": 0.005754578858613968
+  },
+  {
+    "step": 341,
+    "loss": 2.169344186782837,
+    "diagonal": 2.161560297012329,
+    "finite": 0.007783820852637291
+  },
+  {
+    "step": 342,
+    "loss": 1.963373064994812,
+    "diagonal": 1.9554011821746826,
+    "finite": 0.007971922867000103
+  },
+  {
+    "step": 343,
+    "loss": 2.0636348724365234,
+    "diagonal": 2.056135416030884,
+    "finite": 0.0074994307942688465
+  },
+  {
+    "step": 344,
+    "loss": 1.8398830890655518,
+    "diagonal": 1.8310303688049316,
+    "finite": 0.008852696046233177
+  },
+  {
+    "step": 345,
+    "loss": 2.7008399963378906,
+    "diagonal": 2.6942293643951416,
+    "finite": 0.006610640324652195
+  },
+  {
+    "step": 346,
+    "loss": 2.018587350845337,
+    "diagonal": 2.0093235969543457,
+    "finite": 0.009263770654797554
+  },
+  {
+    "step": 347,
+    "loss": 1.8606603145599365,
+    "diagonal": 1.852900743484497,
+    "finite": 0.007759541738778353
+  },
+  {
+    "step": 348,
+    "loss": 2.269880533218384,
+    "diagonal": 2.262639045715332,
+    "finite": 0.007241442333906889
+  },
+  {
+    "step": 349,
+    "loss": 1.9484275579452515,
+    "diagonal": 1.9394125938415527,
+    "finite": 0.009014926850795746
+  },
+  {
+    "step": 350,
+    "loss": 2.3428854942321777,
+    "diagonal": 2.3334097862243652,
+    "finite": 0.009475650265812874
+  },
+  {
+    "step": 351,
+    "loss": 1.810739517211914,
+    "diagonal": 1.7972159385681152,
+    "finite": 0.013523567467927933
+  },
+  {
+    "step": 352,
+    "loss": 1.8453116416931152,
+    "diagonal": 1.8393115997314453,
+    "finite": 0.006000094581395388
+  },
+  {
+    "step": 353,
+    "loss": 1.7077094316482544,
+    "diagonal": 1.6986172199249268,
+    "finite": 0.009092167019844055
+  },
+  {
+    "step": 354,
+    "loss": 2.3980319499969482,
+    "diagonal": 2.392561435699463,
+    "finite": 0.005470497999340296
+  },
+  {
+    "step": 355,
+    "loss": 1.7214291095733643,
+    "diagonal": 1.714237928390503,
+    "finite": 0.007191237062215805
+  },
+  {
+    "step": 356,
+    "loss": 2.0001096725463867,
+    "diagonal": 1.990814447402954,
+    "finite": 0.009295342490077019
+  },
+  {
+    "step": 357,
+    "loss": 2.029215097427368,
+    "diagonal": 2.0223889350891113,
+    "finite": 0.0068261874839663506
+  },
+  {
+    "step": 358,
+    "loss": 2.059049129486084,
+    "diagonal": 2.054063558578491,
+    "finite": 0.004985500127077103
+  },
+  {
+    "step": 359,
+    "loss": 2.0292043685913086,
+    "diagonal": 2.022836685180664,
+    "finite": 0.006367606110870838
+  },
+  {
+    "step": 360,
+    "loss": 1.9706333875656128,
+    "diagonal": 1.9644427299499512,
+    "finite": 0.006190671119838953
+  },
+  {
+    "step": 361,
+    "loss": 1.8455424308776855,
+    "diagonal": 1.8410156965255737,
+    "finite": 0.0045266784727573395
+  },
+  {
+    "step": 362,
+    "loss": 2.273508310317993,
+    "diagonal": 2.2660717964172363,
+    "finite": 0.0074365390464663506
+  },
+  {
+    "step": 363,
+    "loss": 2.338421583175659,
+    "diagonal": 2.333094835281372,
+    "finite": 0.005326798651367426
+  },
+  {
+    "step": 364,
+    "loss": 1.9210765361785889,
+    "diagonal": 1.9158339500427246,
+    "finite": 0.00524259964004159
+  },
+  {
+    "step": 365,
+    "loss": 1.9375760555267334,
+    "diagonal": 1.9333820343017578,
+    "finite": 0.004193965345621109
+  },
+  {
+    "step": 366,
+    "loss": 2.0787320137023926,
+    "diagonal": 2.07220458984375,
+    "finite": 0.006527449935674667
+  },
+  {
+    "step": 367,
+    "loss": 1.694779634475708,
+    "diagonal": 1.6889772415161133,
+    "finite": 0.005802438594400883
+  },
+  {
+    "step": 368,
+    "loss": 2.4577114582061768,
+    "diagonal": 2.4526381492614746,
+    "finite": 0.005073331296443939
+  },
+  {
+    "step": 369,
+    "loss": 1.9108037948608398,
+    "diagonal": 1.90712308883667,
+    "finite": 0.0036807421129196882
+  },
+  {
+    "step": 370,
+    "loss": 1.7729231119155884,
+    "diagonal": 1.7631787061691284,
+    "finite": 0.00974438525736332
+  },
+  {
+    "step": 371,
+    "loss": 2.0125274658203125,
+    "diagonal": 2.0056304931640625,
+    "finite": 0.00689705228433013
+  },
+  {
+    "step": 372,
+    "loss": 2.1770613193511963,
+    "diagonal": 2.169684886932373,
+    "finite": 0.007376428693532944
+  },
+  {
+    "step": 373,
+    "loss": 2.0460410118103027,
+    "diagonal": 2.0376651287078857,
+    "finite": 0.008375802077353
+  },
+  {
+    "step": 374,
+    "loss": 1.9479656219482422,
+    "diagonal": 1.9387397766113281,
+    "finite": 0.00922579225152731
+  },
+  {
+    "step": 375,
+    "loss": 2.07041597366333,
+    "diagonal": 2.066014528274536,
+    "finite": 0.004401417449116707
+  },
+  {
+    "step": 376,
+    "loss": 2.1105690002441406,
+    "diagonal": 2.104990005493164,
+    "finite": 0.00557895191013813
+  },
+  {
+    "step": 377,
+    "loss": 1.7732861042022705,
+    "diagonal": 1.7698891162872314,
+    "finite": 0.0033970351796597242
+  },
+  {
+    "step": 378,
+    "loss": 2.080380439758301,
+    "diagonal": 2.0747854709625244,
+    "finite": 0.005595009308308363
+  },
+  {
+    "step": 379,
+    "loss": 1.8076719045639038,
+    "diagonal": 1.8021907806396484,
+    "finite": 0.005481078289449215
+  },
+  {
+    "step": 380,
+    "loss": 1.8415640592575073,
+    "diagonal": 1.8361018896102905,
+    "finite": 0.005462141241878271
+  },
+  {
+    "step": 381,
+    "loss": 2.348223924636841,
+    "diagonal": 2.3450775146484375,
+    "finite": 0.003146506380289793
+  },
+  {
+    "step": 382,
+    "loss": 2.300726890563965,
+    "diagonal": 2.2962565422058105,
+    "finite": 0.0044702342711389065
+  },
+  {
+    "step": 383,
+    "loss": 2.115729570388794,
+    "diagonal": 2.111478328704834,
+    "finite": 0.004251179285347462
+  },
+  {
+    "step": 384,
+    "loss": 1.8182569742202759,
+    "diagonal": 1.809410572052002,
+    "finite": 0.00884645152837038
+  },
+  {
+    "step": 385,
+    "loss": 1.9982818365097046,
+    "diagonal": 1.9896047115325928,
+    "finite": 0.008677120320498943
+  },
+  {
+    "step": 386,
+    "loss": 2.9919798374176025,
+    "diagonal": 2.9853086471557617,
+    "finite": 0.006671219132840633
+  },
+  {
+    "step": 387,
+    "loss": 1.724153995513916,
+    "diagonal": 1.7169899940490723,
+    "finite": 0.007164054084569216
+  },
+  {
+    "step": 388,
+    "loss": 2.2687060832977295,
+    "diagonal": 2.263532876968384,
+    "finite": 0.00517322588711977
+  },
+  {
+    "step": 389,
+    "loss": 1.9898653030395508,
+    "diagonal": 1.9850497245788574,
+    "finite": 0.004815582651644945
+  },
+  {
+    "step": 390,
+    "loss": 2.110089063644409,
+    "diagonal": 2.1016643047332764,
+    "finite": 0.008424780331552029
+  },
+  {
+    "step": 391,
+    "loss": 2.6232762336730957,
+    "diagonal": 2.615631341934204,
+    "finite": 0.007644908502697945
+  },
+  {
+    "step": 392,
+    "loss": 1.9777827262878418,
+    "diagonal": 1.9674067497253418,
+    "finite": 0.010376006364822388
+  },
+  {
+    "step": 393,
+    "loss": 2.2008323669433594,
+    "diagonal": 2.1873779296875,
+    "finite": 0.013454390689730644
+  },
+  {
+    "step": 394,
+    "loss": 1.7956429719924927,
+    "diagonal": 1.7895848751068115,
+    "finite": 0.006058120168745518
+  },
+  {
+    "step": 395,
+    "loss": 2.467538356781006,
+    "diagonal": 2.462198257446289,
+    "finite": 0.005340097472071648
+  },
+  {
+    "step": 396,
+    "loss": 2.440443277359009,
+    "diagonal": 2.4362432956695557,
+    "finite": 0.004200009163469076
+  },
+  {
+    "step": 397,
+    "loss": 2.7287139892578125,
+    "diagonal": 2.7242343425750732,
+    "finite": 0.004479733295738697
+  },
+  {
+    "step": 398,
+    "loss": 2.039721727371216,
+    "diagonal": 2.0304696559906006,
+    "finite": 0.009252052754163742
+  },
+  {
+    "step": 399,
+    "loss": 2.25966215133667,
+    "diagonal": 2.2530651092529297,
+    "finite": 0.00659699272364378
+  },
+  {
+    "step": 400,
+    "loss": 2.187924385070801,
+    "diagonal": 2.1806857585906982,
+    "finite": 0.007238650228828192
+  },
+  {
+    "step": 401,
+    "loss": 1.7688220739364624,
+    "diagonal": 1.7603098154067993,
+    "finite": 0.008512262254953384
+  },
+  {
+    "step": 402,
+    "loss": 2.2988436222076416,
+    "diagonal": 2.293897867202759,
+    "finite": 0.004945860244333744
+  },
+  {
+    "step": 403,
+    "loss": 2.0167386531829834,
+    "diagonal": 2.007181406021118,
+    "finite": 0.009557308629155159
+  },
+  {
+    "step": 404,
+    "loss": 1.8716903924942017,
+    "diagonal": 1.8661377429962158,
+    "finite": 0.005552605725824833
+  },
+  {
+    "step": 405,
+    "loss": 1.9492645263671875,
+    "diagonal": 1.9430047273635864,
+    "finite": 0.0062597934156656265
+  },
+  {
+    "step": 406,
+    "loss": 1.9504241943359375,
+    "diagonal": 1.9402658939361572,
+    "finite": 0.010158331133425236
+  },
+  {
+    "step": 407,
+    "loss": 2.1792404651641846,
+    "diagonal": 2.171837568283081,
+    "finite": 0.0074028633534908295
+  },
+  {
+    "step": 408,
+    "loss": 1.8119360208511353,
+    "diagonal": 1.8041419982910156,
+    "finite": 0.007794033735990524
+  },
+  {
+    "step": 409,
+    "loss": 1.895190715789795,
+    "diagonal": 1.8864113092422485,
+    "finite": 0.008779352530837059
+  },
+  {
+    "step": 410,
+    "loss": 2.007307529449463,
+    "diagonal": 1.9988294839859009,
+    "finite": 0.008477939292788506
+  },
+  {
+    "step": 411,
+    "loss": 1.9552077054977417,
+    "diagonal": 1.9480669498443604,
+    "finite": 0.007140704430639744
+  },
+  {
+    "step": 412,
+    "loss": 2.156730890274048,
+    "diagonal": 2.1473257541656494,
+    "finite": 0.009405179880559444
+  },
+  {
+    "step": 413,
+    "loss": 2.3949952125549316,
+    "diagonal": 2.3881890773773193,
+    "finite": 0.006806227378547192
+  },
+  {
+    "step": 414,
+    "loss": 2.002082347869873,
+    "diagonal": 1.9949361085891724,
+    "finite": 0.007146256975829601
+  },
+  {
+    "step": 415,
+    "loss": 1.9694310426712036,
+    "diagonal": 1.9645795822143555,
+    "finite": 0.004851441830396652
+  },
+  {
+    "step": 416,
+    "loss": 2.0092966556549072,
+    "diagonal": 2.0058062076568604,
+    "finite": 0.0034905329812318087
+  },
+  {
+    "step": 417,
+    "loss": 2.4774954319000244,
+    "diagonal": 2.4732935428619385,
+    "finite": 0.004201801028102636
+  },
+  {
+    "step": 418,
+    "loss": 2.178900718688965,
+    "diagonal": 2.174746513366699,
+    "finite": 0.00415425468236208
+  },
+  {
+    "step": 419,
+    "loss": 2.018204927444458,
+    "diagonal": 2.0124714374542236,
+    "finite": 0.005733593832701445
+  },
+  {
+    "step": 420,
+    "loss": 2.119637966156006,
+    "diagonal": 2.1119959354400635,
+    "finite": 0.007641941774636507
+  },
+  {
+    "step": 421,
+    "loss": 2.1901094913482666,
+    "diagonal": 2.183743953704834,
+    "finite": 0.006365516223013401
+  },
+  {
+    "step": 422,
+    "loss": 1.967562198638916,
+    "diagonal": 1.95685875415802,
+    "finite": 0.010703438892960548
+  },
+  {
+    "step": 423,
+    "loss": 2.3420276641845703,
+    "diagonal": 2.3357720375061035,
+    "finite": 0.006255625281482935
+  },
+  {
+    "step": 424,
+    "loss": 2.061359167098999,
+    "diagonal": 2.0537009239196777,
+    "finite": 0.00765815656632185
+  },
+  {
+    "step": 425,
+    "loss": 1.564027190208435,
+    "diagonal": 1.555377721786499,
+    "finite": 0.00864945538341999
+  },
+  {
+    "step": 426,
+    "loss": 1.727946400642395,
+    "diagonal": 1.7219995260238647,
+    "finite": 0.005946816876530647
+  },
+  {
+    "step": 427,
+    "loss": 2.4141905307769775,
+    "diagonal": 2.407195806503296,
+    "finite": 0.006994651630520821
+  },
+  {
+    "step": 428,
+    "loss": 1.6931225061416626,
+    "diagonal": 1.6817152500152588,
+    "finite": 0.011407280340790749
+  },
+  {
+    "step": 429,
+    "loss": 1.916613221168518,
+    "diagonal": 1.909224033355713,
+    "finite": 0.007389235310256481
+  },
+  {
+    "step": 430,
+    "loss": 2.159193277359009,
+    "diagonal": 2.154599666595459,
+    "finite": 0.004593544639647007
+  },
+  {
+    "step": 431,
+    "loss": 2.024857521057129,
+    "diagonal": 2.018491506576538,
+    "finite": 0.00636594183743
+  },
+  {
+    "step": 432,
+    "loss": 2.014115571975708,
+    "diagonal": 2.010021924972534,
+    "finite": 0.004093548748642206
+  },
+  {
+    "step": 433,
+    "loss": 1.9533406496047974,
+    "diagonal": 1.9471962451934814,
+    "finite": 0.006144422572106123
+  },
+  {
+    "step": 434,
+    "loss": 2.3007047176361084,
+    "diagonal": 2.29356050491333,
+    "finite": 0.0071443007327616215
+  },
+  {
+    "step": 435,
+    "loss": 2.3349688053131104,
+    "diagonal": 2.3288285732269287,
+    "finite": 0.006140243262052536
+  },
+  {
+    "step": 436,
+    "loss": 1.7390187978744507,
+    "diagonal": 1.7342642545700073,
+    "finite": 0.004754521418362856
+  },
+  {
+    "step": 437,
+    "loss": 1.6620395183563232,
+    "diagonal": 1.6511800289154053,
+    "finite": 0.010859515517950058
+  },
+  {
+    "step": 438,
+    "loss": 1.836198329925537,
+    "diagonal": 1.827623724937439,
+    "finite": 0.008574627339839935
+  },
+  {
+    "step": 439,
+    "loss": 1.6645406484603882,
+    "diagonal": 1.6584663391113281,
+    "finite": 0.006074345204979181
+  },
+  {
+    "step": 440,
+    "loss": 1.4017661809921265,
+    "diagonal": 1.396641731262207,
+    "finite": 0.005124456249177456
+  },
+  {
+    "step": 441,
+    "loss": 1.9686977863311768,
+    "diagonal": 1.9579997062683105,
+    "finite": 0.010698119178414345
+  },
+  {
+    "step": 442,
+    "loss": 2.30591082572937,
+    "diagonal": 2.300153970718384,
+    "finite": 0.00575688760727644
+  },
+  {
+    "step": 443,
+    "loss": 2.2807557582855225,
+    "diagonal": 2.2755722999572754,
+    "finite": 0.005183381959795952
+  },
+  {
+    "step": 444,
+    "loss": 2.3856658935546875,
+    "diagonal": 2.378664016723633,
+    "finite": 0.007001940160989761
+  },
+  {
+    "step": 445,
+    "loss": 1.5388200283050537,
+    "diagonal": 1.5319006443023682,
+    "finite": 0.00691938353702426
+  },
+  {
+    "step": 446,
+    "loss": 1.745944857597351,
+    "diagonal": 1.738552212715149,
+    "finite": 0.007392649073153734
+  },
+  {
+    "step": 447,
+    "loss": 1.5935150384902954,
+    "diagonal": 1.5880311727523804,
+    "finite": 0.00548381544649601
+  },
+  {
+    "step": 448,
+    "loss": 2.0504329204559326,
+    "diagonal": 2.0420470237731934,
+    "finite": 0.008385910652577877
+  },
+  {
+    "step": 449,
+    "loss": 2.5114340782165527,
+    "diagonal": 2.50616455078125,
+    "finite": 0.005269639194011688
+  },
+  {
+    "step": 450,
+    "loss": 2.2247021198272705,
+    "diagonal": 2.218641519546509,
+    "finite": 0.006060498300939798
+  },
+  {
+    "step": 451,
+    "loss": 2.0002026557922363,
+    "diagonal": 1.9904260635375977,
+    "finite": 0.00977658573538065
+  },
+  {
+    "step": 452,
+    "loss": 2.4536800384521484,
+    "diagonal": 2.446505546569824,
+    "finite": 0.007174528203904629
+  },
+  {
+    "step": 453,
+    "loss": 1.6149582862854004,
+    "diagonal": 1.6073482036590576,
+    "finite": 0.007610050030052662
+  },
+  {
+    "step": 454,
+    "loss": 2.203500270843506,
+    "diagonal": 2.195777654647827,
+    "finite": 0.007722525391727686
+  },
+  {
+    "step": 455,
+    "loss": 1.6643110513687134,
+    "diagonal": 1.6552461385726929,
+    "finite": 0.009064910933375359
+  },
+  {
+    "step": 456,
+    "loss": 2.0640640258789062,
+    "diagonal": 2.0535778999328613,
+    "finite": 0.010486159473657608
+  },
+  {
+    "step": 457,
+    "loss": 2.327677011489868,
+    "diagonal": 2.3177478313446045,
+    "finite": 0.009929096326231956
+  },
+  {
+    "step": 458,
+    "loss": 1.5590897798538208,
+    "diagonal": 1.5442146062850952,
+    "finite": 0.014875139109790325
+  },
+  {
+    "step": 459,
+    "loss": 2.2562952041625977,
+    "diagonal": 2.2440402507781982,
+    "finite": 0.01225507166236639
+  },
+  {
+    "step": 460,
+    "loss": 2.109283924102783,
+    "diagonal": 2.0948586463928223,
+    "finite": 0.014425275847315788
+  },
+  {
+    "step": 461,
+    "loss": 2.352003335952759,
+    "diagonal": 2.333096981048584,
+    "finite": 0.018906405195593834
+  },
+  {
+    "step": 462,
+    "loss": 2.073280096054077,
+    "diagonal": 2.0640933513641357,
+    "finite": 0.009186748415231705
+  },
+  {
+    "step": 463,
+    "loss": 1.7083669900894165,
+    "diagonal": 1.6954216957092285,
+    "finite": 0.012945292517542839
+  },
+  {
+    "step": 464,
+    "loss": 2.0319671630859375,
+    "diagonal": 2.019035577774048,
+    "finite": 0.012931637465953827
+  },
+  {
+    "step": 465,
+    "loss": 2.702360153198242,
+    "diagonal": 2.6967923641204834,
+    "finite": 0.0055676791816949844
+  },
+  {
+    "step": 466,
+    "loss": 2.679790735244751,
+    "diagonal": 2.6757683753967285,
+    "finite": 0.004022246226668358
+  },
+  {
+    "step": 467,
+    "loss": 2.4015612602233887,
+    "diagonal": 2.3952713012695312,
+    "finite": 0.006289985030889511
+  },
+  {
+    "step": 468,
+    "loss": 2.180419921875,
+    "diagonal": 2.1719841957092285,
+    "finite": 0.008435776457190514
+  },
+  {
+    "step": 469,
+    "loss": 1.9249286651611328,
+    "diagonal": 1.9211652278900146,
+    "finite": 0.003763399086892605
+  },
+  {
+    "step": 470,
+    "loss": 2.035311698913574,
+    "diagonal": 2.020407199859619,
+    "finite": 0.014904579147696495
+  },
+  {
+    "step": 471,
+    "loss": 2.183136463165283,
+    "diagonal": 2.176699161529541,
+    "finite": 0.006437249947339296
+  },
+  {
+    "step": 472,
+    "loss": 2.3228719234466553,
+    "diagonal": 2.313347339630127,
+    "finite": 0.009524518623948097
+  },
+  {
+    "step": 473,
+    "loss": 2.1890833377838135,
+    "diagonal": 2.1805994510650635,
+    "finite": 0.00848392304033041
+  },
+  {
+    "step": 474,
+    "loss": 2.1169486045837402,
+    "diagonal": 2.1081507205963135,
+    "finite": 0.008797917515039444
+  },
+  {
+    "step": 475,
+    "loss": 2.291107416152954,
+    "diagonal": 2.2738394737243652,
+    "finite": 0.017268000170588493
+  },
+  {
+    "step": 476,
+    "loss": 2.120911121368408,
+    "diagonal": 2.110136032104492,
+    "finite": 0.010775052011013031
+  },
+  {
+    "step": 477,
+    "loss": 1.5739099979400635,
+    "diagonal": 1.5650969743728638,
+    "finite": 0.008813075721263885
+  },
+  {
+    "step": 478,
+    "loss": 2.2059743404388428,
+    "diagonal": 2.193880558013916,
+    "finite": 0.012093683704733849
+  },
+  {
+    "step": 479,
+    "loss": 1.862579345703125,
+    "diagonal": 1.8563947677612305,
+    "finite": 0.006184563506394625
+  },
+  {
+    "step": 480,
+    "loss": 2.0863699913024902,
+    "diagonal": 2.0789520740509033,
+    "finite": 0.007417829241603613
+  },
+  {
+    "step": 481,
+    "loss": 2.296679973602295,
+    "diagonal": 2.281668186187744,
+    "finite": 0.015011713840067387
+  },
+  {
+    "step": 482,
+    "loss": 1.970301866531372,
+    "diagonal": 1.9576740264892578,
+    "finite": 0.012627815827727318
+  },
+  {
+    "step": 483,
+    "loss": 2.418764114379883,
+    "diagonal": 2.4078495502471924,
+    "finite": 0.010914681479334831
+  },
+  {
+    "step": 484,
+    "loss": 1.711957335472107,
+    "diagonal": 1.7067400217056274,
+    "finite": 0.0052173081785440445
+  },
+  {
+    "step": 485,
+    "loss": 1.8037736415863037,
+    "diagonal": 1.7995446920394897,
+    "finite": 0.004228899721056223
+  },
+  {
+    "step": 486,
+    "loss": 1.8639556169509888,
+    "diagonal": 1.8581762313842773,
+    "finite": 0.005779404193162918
+  },
+  {
+    "step": 487,
+    "loss": 2.4599976539611816,
+    "diagonal": 2.455212354660034,
+    "finite": 0.0047852639108896255
+  },
+  {
+    "step": 488,
+    "loss": 2.3103928565979004,
+    "diagonal": 2.305323600769043,
+    "finite": 0.005069202743470669
+  },
+  {
+    "step": 489,
+    "loss": 1.7198923826217651,
+    "diagonal": 1.7141704559326172,
+    "finite": 0.005721895024180412
+  },
+  {
+    "step": 490,
+    "loss": 2.4117820262908936,
+    "diagonal": 2.406486988067627,
+    "finite": 0.005295108538120985
+  },
+  {
+    "step": 491,
+    "loss": 2.098436117172241,
+    "diagonal": 2.0927860736846924,
+    "finite": 0.005650083068758249
+  },
+  {
+    "step": 492,
+    "loss": 1.8502333164215088,
+    "diagonal": 1.8415567874908447,
+    "finite": 0.008676571771502495
+  },
+  {
+    "step": 493,
+    "loss": 1.7233378887176514,
+    "diagonal": 1.7157033681869507,
+    "finite": 0.007634463254362345
+  },
+  {
+    "step": 494,
+    "loss": 1.8219789266586304,
+    "diagonal": 1.8139923810958862,
+    "finite": 0.007986582815647125
+  },
+  {
+    "step": 495,
+    "loss": 2.411931037902832,
+    "diagonal": 2.405125617980957,
+    "finite": 0.00680542504414916
+  },
+  {
+    "step": 496,
+    "loss": 2.025477886199951,
+    "diagonal": 2.015699863433838,
+    "finite": 0.009777910076081753
+  },
+  {
+    "step": 497,
+    "loss": 2.243192672729492,
+    "diagonal": 2.2377967834472656,
+    "finite": 0.00539578590542078
+  },
+  {
+    "step": 498,
+    "loss": 1.8605490922927856,
+    "diagonal": 1.8492718935012817,
+    "finite": 0.011277181096374989
+  },
+  {
+    "step": 499,
+    "loss": 2.0411553382873535,
+    "diagonal": 2.029963254928589,
+    "finite": 0.011192191392183304
+  },
+  {
+    "step": 500,
+    "loss": 2.5308845043182373,
+    "diagonal": 2.515584707260132,
+    "finite": 0.015299799852073193
+  },
+  {
+    "step": 501,
+    "loss": 1.975253939628601,
+    "diagonal": 1.963702917098999,
+    "finite": 0.011551021598279476
+  },
+  {
+    "step": 502,
+    "loss": 1.6222418546676636,
+    "diagonal": 1.6140598058700562,
+    "finite": 0.008182084187865257
+  },
+  {
+    "step": 503,
+    "loss": 2.175450563430786,
+    "diagonal": 2.1611101627349854,
+    "finite": 0.014340471476316452
+  },
+  {
+    "step": 504,
+    "loss": 2.431959390640259,
+    "diagonal": 2.4202358722686768,
+    "finite": 0.011723574250936508
+  },
+  {
+    "step": 505,
+    "loss": 1.68399178981781,
+    "diagonal": 1.671166181564331,
+    "finite": 0.012825561687350273
+  },
+  {
+    "step": 506,
+    "loss": 1.7209086418151855,
+    "diagonal": 1.7111681699752808,
+    "finite": 0.0097404969856143
+  },
+  {
+    "step": 507,
+    "loss": 2.016660690307617,
+    "diagonal": 2.004392147064209,
+    "finite": 0.012268458493053913
+  },
+  {
+    "step": 508,
+    "loss": 1.992977499961853,
+    "diagonal": 1.985053300857544,
+    "finite": 0.00792415626347065
+  },
+  {
+    "step": 509,
+    "loss": 2.2713534832000732,
+    "diagonal": 2.2666730880737305,
+    "finite": 0.004680448677390814
+  },
+  {
+    "step": 510,
+    "loss": 1.4288183450698853,
+    "diagonal": 1.4226136207580566,
+    "finite": 0.006204688921570778
+  },
+  {
+    "step": 511,
+    "loss": 2.212817907333374,
+    "diagonal": 2.2077441215515137,
+    "finite": 0.005073705222457647
+  },
+  {
+    "step": 512,
+    "loss": 2.4167230129241943,
+    "diagonal": 2.404086112976074,
+    "finite": 0.01263679563999176
+  },
+  {
+    "step": 513,
+    "loss": 2.2751829624176025,
+    "diagonal": 2.268994092941284,
+    "finite": 0.006188839673995972
+  },
+  {
+    "step": 514,
+    "loss": 2.2455592155456543,
+    "diagonal": 2.2396624088287354,
+    "finite": 0.005896883085370064
+  },
+  {
+    "step": 515,
+    "loss": 1.5094513893127441,
+    "diagonal": 1.4955456256866455,
+    "finite": 0.013905721716582775
+  },
+  {
+    "step": 516,
+    "loss": 2.1094467639923096,
+    "diagonal": 2.1000912189483643,
+    "finite": 0.00935547985136509
+  },
+  {
+    "step": 517,
+    "loss": 1.4711207151412964,
+    "diagonal": 1.4647639989852905,
+    "finite": 0.006356675177812576
+  },
+  {
+    "step": 518,
+    "loss": 1.9459742307662964,
+    "diagonal": 1.93837571144104,
+    "finite": 0.007598511874675751
+  },
+  {
+    "step": 519,
+    "loss": 2.6562557220458984,
+    "diagonal": 2.643899917602539,
+    "finite": 0.012355777435004711
+  },
+  {
+    "step": 520,
+    "loss": 1.6905474662780762,
+    "diagonal": 1.6828025579452515,
+    "finite": 0.007744892034679651
+  },
+  {
+    "step": 521,
+    "loss": 2.2099709510803223,
+    "diagonal": 2.202058792114258,
+    "finite": 0.007912113331258297
+  },
+  {
+    "step": 522,
+    "loss": 2.0329647064208984,
+    "diagonal": 2.0239524841308594,
+    "finite": 0.009012121707201004
+  },
+  {
+    "step": 523,
+    "loss": 1.8396121263504028,
+    "diagonal": 1.83468759059906,
+    "finite": 0.004924487322568893
+  },
+  {
+    "step": 524,
+    "loss": 2.1226775646209717,
+    "diagonal": 2.114725112915039,
+    "finite": 0.007952457293868065
+  },
+  {
+    "step": 525,
+    "loss": 1.598312258720398,
+    "diagonal": 1.5936181545257568,
+    "finite": 0.004694054834544659
+  },
+  {
+    "step": 526,
+    "loss": 2.693274736404419,
+    "diagonal": 2.6850638389587402,
+    "finite": 0.008210791274905205
+  },
+  {
+    "step": 527,
+    "loss": 2.5780694484710693,
+    "diagonal": 2.5659327507019043,
+    "finite": 0.01213668193668127
+  },
+  {
+    "step": 528,
+    "loss": 1.7394458055496216,
+    "diagonal": 1.7310113906860352,
+    "finite": 0.008434384129941463
+  },
+  {
+    "step": 529,
+    "loss": 1.8062313795089722,
+    "diagonal": 1.795627474784851,
+    "finite": 0.010603947564959526
+  },
+  {
+    "step": 530,
+    "loss": 2.255556106567383,
+    "diagonal": 2.2483582496643066,
+    "finite": 0.007197927683591843
+  },
+  {
+    "step": 531,
+    "loss": 2.3359215259552,
+    "diagonal": 2.3269824981689453,
+    "finite": 0.008939003571867943
+  },
+  {
+    "step": 532,
+    "loss": 1.7841894626617432,
+    "diagonal": 1.7710708379745483,
+    "finite": 0.013118642382323742
+  },
+  {
+    "step": 533,
+    "loss": 1.8442432880401611,
+    "diagonal": 1.8337156772613525,
+    "finite": 0.010527633130550385
+  },
+  {
+    "step": 534,
+    "loss": 2.7300655841827393,
+    "diagonal": 2.715921401977539,
+    "finite": 0.014144252985715866
+  },
+  {
+    "step": 535,
+    "loss": 2.0388810634613037,
+    "diagonal": 2.0228688716888428,
+    "finite": 0.0160122811794281
+  },
+  {
+    "step": 536,
+    "loss": 1.9011547565460205,
+    "diagonal": 1.8931586742401123,
+    "finite": 0.00799608789384365
+  },
+  {
+    "step": 537,
+    "loss": 2.2120871543884277,
+    "diagonal": 2.202312707901001,
+    "finite": 0.00977448932826519
+  },
+  {
+    "step": 538,
+    "loss": 1.7921943664550781,
+    "diagonal": 1.7788337469100952,
+    "finite": 0.013360599055886269
+  },
+  {
+    "step": 539,
+    "loss": 2.3162760734558105,
+    "diagonal": 2.3084702491760254,
+    "finite": 0.007805740460753441
+  },
+  {
+    "step": 540,
+    "loss": 1.8439741134643555,
+    "diagonal": 1.840050220489502,
+    "finite": 0.003923871088773012
+  },
+  {
+    "step": 541,
+    "loss": 1.8743062019348145,
+    "diagonal": 1.8663064241409302,
+    "finite": 0.00799974799156189
+  },
+  {
+    "step": 542,
+    "loss": 2.4446403980255127,
+    "diagonal": 2.440732955932617,
+    "finite": 0.00390750914812088
+  },
+  {
+    "step": 543,
+    "loss": 1.8024802207946777,
+    "diagonal": 1.797904133796692,
+    "finite": 0.0045760320499539375
+  },
+  {
+    "step": 544,
+    "loss": 2.0412464141845703,
+    "diagonal": 2.034679889678955,
+    "finite": 0.006566451396793127
+  },
+  {
+    "step": 545,
+    "loss": 2.257228374481201,
+    "diagonal": 2.25331449508667,
+    "finite": 0.0039138272404670715
+  },
+  {
+    "step": 546,
+    "loss": 1.8518651723861694,
+    "diagonal": 1.8457396030426025,
+    "finite": 0.00612551998347044
+  },
+  {
+    "step": 547,
+    "loss": 2.2974565029144287,
+    "diagonal": 2.2894740104675293,
+    "finite": 0.007982414215803146
+  },
+  {
+    "step": 548,
+    "loss": 1.7026586532592773,
+    "diagonal": 1.697054147720337,
+    "finite": 0.0056045386008918285
+  },
+  {
+    "step": 549,
+    "loss": 1.7297202348709106,
+    "diagonal": 1.7242748737335205,
+    "finite": 0.005445405840873718
+  },
+  {
+    "step": 550,
+    "loss": 1.692755937576294,
+    "diagonal": 1.686866044998169,
+    "finite": 0.005889908876270056
+  },
+  {
+    "step": 551,
+    "loss": 2.5191478729248047,
+    "diagonal": 2.5122904777526855,
+    "finite": 0.006857471540570259
+  },
+  {
+    "step": 552,
+    "loss": 2.1959421634674072,
+    "diagonal": 2.1892452239990234,
+    "finite": 0.006696927826851606
+  },
+  {
+    "step": 553,
+    "loss": 2.2266664505004883,
+    "diagonal": 2.21927547454834,
+    "finite": 0.007390899583697319
+  },
+  {
+    "step": 554,
+    "loss": 1.863173484802246,
+    "diagonal": 1.8556838035583496,
+    "finite": 0.007489665877074003
+  },
+  {
+    "step": 555,
+    "loss": 1.7363340854644775,
+    "diagonal": 1.729435682296753,
+    "finite": 0.006898392457515001
+  },
+  {
+    "step": 556,
+    "loss": 1.6535212993621826,
+    "diagonal": 1.6462295055389404,
+    "finite": 0.007291829213500023
+  },
+  {
+    "step": 557,
+    "loss": 2.1461634635925293,
+    "diagonal": 2.139427423477173,
+    "finite": 0.006736076902598143
+  },
+  {
+    "step": 558,
+    "loss": 2.0174601078033447,
+    "diagonal": 2.010201930999756,
+    "finite": 0.0072581833228468895
+  },
+  {
+    "step": 559,
+    "loss": 2.4054338932037354,
+    "diagonal": 2.397420883178711,
+    "finite": 0.008013080805540085
+  },
+  {
+    "step": 560,
+    "loss": 2.1937942504882812,
+    "diagonal": 2.1863222122192383,
+    "finite": 0.007472041063010693
+  },
+  {
+    "step": 561,
+    "loss": 1.9530812501907349,
+    "diagonal": 1.9458496570587158,
+    "finite": 0.007231564726680517
+  },
+  {
+    "step": 562,
+    "loss": 1.7972456216812134,
+    "diagonal": 1.7877733707427979,
+    "finite": 0.00947230402380228
+  },
+  {
+    "step": 563,
+    "loss": 1.2912105321884155,
+    "diagonal": 1.282741904258728,
+    "finite": 0.008468655869364738
+  },
+  {
+    "step": 564,
+    "loss": 1.9877923727035522,
+    "diagonal": 1.9786787033081055,
+    "finite": 0.009113660082221031
+  },
+  {
+    "step": 565,
+    "loss": 1.579285740852356,
+    "diagonal": 1.575366497039795,
+    "finite": 0.003919233568012714
+  },
+  {
+    "step": 566,
+    "loss": 2.1553890705108643,
+    "diagonal": 2.152086019515991,
+    "finite": 0.003302960656583309
+  },
+  {
+    "step": 567,
+    "loss": 1.968859314918518,
+    "diagonal": 1.9654157161712646,
+    "finite": 0.003443563124164939
+  },
+  {
+    "step": 568,
+    "loss": 2.3837296962738037,
+    "diagonal": 2.3785252571105957,
+    "finite": 0.00520451320335269
+  },
+  {
+    "step": 569,
+    "loss": 1.8742094039916992,
+    "diagonal": 1.8703148365020752,
+    "finite": 0.0038945190608501434
+  },
+  {
+    "step": 570,
+    "loss": 2.126477003097534,
+    "diagonal": 2.117642879486084,
+    "finite": 0.008834198117256165
+  },
+  {
+    "step": 571,
+    "loss": 2.2853763103485107,
+    "diagonal": 2.2747976779937744,
+    "finite": 0.010578656569123268
+  },
+  {
+    "step": 572,
+    "loss": 2.8703386783599854,
+    "diagonal": 2.8628249168395996,
+    "finite": 0.007513795979321003
+  },
+  {
+    "step": 573,
+    "loss": 2.1963114738464355,
+    "diagonal": 2.1908109188079834,
+    "finite": 0.005500527564436197
+  },
+  {
+    "step": 574,
+    "loss": 2.1068875789642334,
+    "diagonal": 2.0987637042999268,
+    "finite": 0.008123810403048992
+  },
+  {
+    "step": 575,
+    "loss": 1.8773950338363647,
+    "diagonal": 1.8684940338134766,
+    "finite": 0.008901004679501057
+  },
+  {
+    "step": 576,
+    "loss": 1.8674840927124023,
+    "diagonal": 1.8640438318252563,
+    "finite": 0.0034402820747345686
+  },
+  {
+    "step": 577,
+    "loss": 1.8358170986175537,
+    "diagonal": 1.833003282546997,
+    "finite": 0.0028138323687016964
+  },
+  {
+    "step": 578,
+    "loss": 2.4868807792663574,
+    "diagonal": 2.4813730716705322,
+    "finite": 0.0055077699944376945
+  },
+  {
+    "step": 579,
+    "loss": 1.9883031845092773,
+    "diagonal": 1.9830986261367798,
+    "finite": 0.005204601678997278
+  },
+  {
+    "step": 580,
+    "loss": 1.896122932434082,
+    "diagonal": 1.8930552005767822,
+    "finite": 0.003067761892452836
+  },
+  {
+    "step": 581,
+    "loss": 2.3603477478027344,
+    "diagonal": 2.356288194656372,
+    "finite": 0.0040596299804747105
+  },
+  {
+    "step": 582,
+    "loss": 1.3645461797714233,
+    "diagonal": 1.3620312213897705,
+    "finite": 0.0025149546563625336
+  },
+  {
+    "step": 583,
+    "loss": 1.754150390625,
+    "diagonal": 1.7473409175872803,
+    "finite": 0.00680943951010704
+  },
+  {
+    "step": 584,
+    "loss": 1.9564539194107056,
+    "diagonal": 1.9519927501678467,
+    "finite": 0.004461127333343029
+  },
+  {
+    "step": 585,
+    "loss": 2.1384425163269043,
+    "diagonal": 2.1318793296813965,
+    "finite": 0.00656325276941061
+  },
+  {
+    "step": 586,
+    "loss": 1.6948304176330566,
+    "diagonal": 1.6894174814224243,
+    "finite": 0.00541291106492281
+  },
+  {
+    "step": 587,
+    "loss": 2.101137638092041,
+    "diagonal": 2.0976104736328125,
+    "finite": 0.0035271283704787493
+  },
+  {
+    "step": 588,
+    "loss": 1.8671610355377197,
+    "diagonal": 1.8618195056915283,
+    "finite": 0.005341501906514168
+  },
+  {
+    "step": 589,
+    "loss": 2.134585380554199,
+    "diagonal": 2.1301286220550537,
+    "finite": 0.004456690978258848
+  },
+  {
+    "step": 590,
+    "loss": 2.1874067783355713,
+    "diagonal": 2.183161735534668,
+    "finite": 0.004244989715516567
+  },
+  {
+    "step": 591,
+    "loss": 2.187169075012207,
+    "diagonal": 2.1832661628723145,
+    "finite": 0.0039029947947710752
+  },
+  {
+    "step": 592,
+    "loss": 1.815953254699707,
+    "diagonal": 1.8108644485473633,
+    "finite": 0.005088769365102053
+  },
+  {
+    "step": 593,
+    "loss": 2.3617050647735596,
+    "diagonal": 2.355567455291748,
+    "finite": 0.006137545220553875
+  },
+  {
+    "step": 594,
+    "loss": 2.1952426433563232,
+    "diagonal": 2.1898560523986816,
+    "finite": 0.005386570934206247
+  },
+  {
+    "step": 595,
+    "loss": 1.8083688020706177,
+    "diagonal": 1.8030200004577637,
+    "finite": 0.005348748993128538
+  },
+  {
+    "step": 596,
+    "loss": 2.571892023086548,
+    "diagonal": 2.5637857913970947,
+    "finite": 0.008106173947453499
+  },
+  {
+    "step": 597,
+    "loss": 2.209651231765747,
+    "diagonal": 2.2020957469940186,
+    "finite": 0.0075553725473582745
+  },
+  {
+    "step": 598,
+    "loss": 1.8276022672653198,
+    "diagonal": 1.8172227144241333,
+    "finite": 0.01037961058318615
+  },
+  {
+    "step": 599,
+    "loss": 2.0322251319885254,
+    "diagonal": 2.027454376220703,
+    "finite": 0.0047706603072583675
+  },
+  {
+    "step": 600,
+    "loss": 1.9793190956115723,
+    "diagonal": 1.9734385013580322,
+    "finite": 0.0058805919252336025
+  },
+  {
+    "step": 601,
+    "loss": 2.020580768585205,
+    "diagonal": 2.0125367641448975,
+    "finite": 0.008043949492275715
+  },
+  {
+    "step": 602,
+    "loss": 2.12809419631958,
+    "diagonal": 2.1209876537323,
+    "finite": 0.007106549572199583
+  },
+  {
+    "step": 603,
+    "loss": 2.1967122554779053,
+    "diagonal": 2.192791700363159,
+    "finite": 0.003920483402907848
+  },
+  {
+    "step": 604,
+    "loss": 1.682094693183899,
+    "diagonal": 1.675797462463379,
+    "finite": 0.006297288928180933
+  },
+  {
+    "step": 605,
+    "loss": 1.8949006795883179,
+    "diagonal": 1.890212893486023,
+    "finite": 0.004687751643359661
+  },
+  {
+    "step": 606,
+    "loss": 2.1210997104644775,
+    "diagonal": 2.1150848865509033,
+    "finite": 0.0060149189084768295
+  },
+  {
+    "step": 607,
+    "loss": 2.1607539653778076,
+    "diagonal": 2.155393362045288,
+    "finite": 0.005360659211874008
+  },
+  {
+    "step": 608,
+    "loss": 2.0952353477478027,
+    "diagonal": 2.090662717819214,
+    "finite": 0.004572519101202488
+  },
+  {
+    "step": 609,
+    "loss": 1.8704148530960083,
+    "diagonal": 1.8668040037155151,
+    "finite": 0.0036108004860579967
+  },
+  {
+    "step": 610,
+    "loss": 1.975009560585022,
+    "diagonal": 1.9698201417922974,
+    "finite": 0.005189392250031233
+  },
+  {
+    "step": 611,
+    "loss": 2.1499319076538086,
+    "diagonal": 2.1446635723114014,
+    "finite": 0.0052683474496006966
+  },
+  {
+    "step": 612,
+    "loss": 1.720009446144104,
+    "diagonal": 1.71488618850708,
+    "finite": 0.005123300477862358
+  },
+  {
+    "step": 613,
+    "loss": 2.2352800369262695,
+    "diagonal": 2.2298338413238525,
+    "finite": 0.005446154158562422
+  },
+  {
+    "step": 614,
+    "loss": 2.2346343994140625,
+    "diagonal": 2.2287838459014893,
+    "finite": 0.00585045013576746
+  },
+  {
+    "step": 615,
+    "loss": 1.7313355207443237,
+    "diagonal": 1.7260236740112305,
+    "finite": 0.005311889573931694
+  },
+  {
+    "step": 616,
+    "loss": 1.9946975708007812,
+    "diagonal": 1.9891138076782227,
+    "finite": 0.0055838110856711864
+  },
+  {
+    "step": 617,
+    "loss": 1.9361292123794556,
+    "diagonal": 1.9299843311309814,
+    "finite": 0.006144895683974028
+  },
+  {
+    "step": 618,
+    "loss": 1.9718455076217651,
+    "diagonal": 1.9651157855987549,
+    "finite": 0.006729714572429657
+  },
+  {
+    "step": 619,
+    "loss": 1.7187691926956177,
+    "diagonal": 1.713587760925293,
+    "finite": 0.0051814536564052105
+  },
+  {
+    "step": 620,
+    "loss": 1.9708908796310425,
+    "diagonal": 1.9663969278335571,
+    "finite": 0.004493975546211004
+  },
+  {
+    "step": 621,
+    "loss": 2.1843202114105225,
+    "diagonal": 2.179480791091919,
+    "finite": 0.0048394883051514626
+  },
+  {
+    "step": 622,
+    "loss": 1.7852381467819214,
+    "diagonal": 1.7755112648010254,
+    "finite": 0.009726827964186668
+  },
+  {
+    "step": 623,
+    "loss": 1.93149733543396,
+    "diagonal": 1.9246447086334229,
+    "finite": 0.006852633785456419
+  },
+  {
+    "step": 624,
+    "loss": 1.4093738794326782,
+    "diagonal": 1.4034738540649414,
+    "finite": 0.005900019779801369
+  },
+  {
+    "step": 625,
+    "loss": 2.1435251235961914,
+    "diagonal": 2.138284206390381,
+    "finite": 0.005240798462182283
+  },
+  {
+    "step": 626,
+    "loss": 2.1208155155181885,
+    "diagonal": 2.1130194664001465,
+    "finite": 0.0077960193157196045
+  },
+  {
+    "step": 627,
+    "loss": 2.049349069595337,
+    "diagonal": 2.0424180030822754,
+    "finite": 0.006931006908416748
+  },
+  {
+    "step": 628,
+    "loss": 2.04067325592041,
+    "diagonal": 2.027679681777954,
+    "finite": 0.01299351453781128
+  },
+  {
+    "step": 629,
+    "loss": 2.204730987548828,
+    "diagonal": 2.1980934143066406,
+    "finite": 0.006637503858655691
+  },
+  {
+    "step": 630,
+    "loss": 1.6407777070999146,
+    "diagonal": 1.635524034500122,
+    "finite": 0.005253632552921772
+  },
+  {
+    "step": 631,
+    "loss": 1.9835739135742188,
+    "diagonal": 1.9779659509658813,
+    "finite": 0.005607928615063429
+  },
+  {
+    "step": 632,
+    "loss": 1.8286635875701904,
+    "diagonal": 1.8232290744781494,
+    "finite": 0.005434460937976837
+  },
+  {
+    "step": 633,
+    "loss": 1.7331678867340088,
+    "diagonal": 1.7289890050888062,
+    "finite": 0.004178882110863924
+  },
+  {
+    "step": 634,
+    "loss": 1.800109624862671,
+    "diagonal": 1.7936131954193115,
+    "finite": 0.006496468558907509
+  },
+  {
+    "step": 635,
+    "loss": 1.7693283557891846,
+    "diagonal": 1.766675353050232,
+    "finite": 0.0026529785245656967
+  },
+  {
+    "step": 636,
+    "loss": 2.624246835708618,
+    "diagonal": 2.6191043853759766,
+    "finite": 0.005142538342624903
+  },
+  {
+    "step": 637,
+    "loss": 1.8727859258651733,
+    "diagonal": 1.8678191900253296,
+    "finite": 0.004966705106198788
+  },
+  {
+    "step": 638,
+    "loss": 2.007819890975952,
+    "diagonal": 2.0004546642303467,
+    "finite": 0.007365212310105562
+  },
+  {
+    "step": 639,
+    "loss": 1.4488247632980347,
+    "diagonal": 1.4442903995513916,
+    "finite": 0.004534382373094559
+  },
+  {
+    "step": 640,
+    "loss": 1.7950657606124878,
+    "diagonal": 1.7895642518997192,
+    "finite": 0.0055014886893332005
+  },
+  {
+    "step": 641,
+    "loss": 2.097874879837036,
+    "diagonal": 2.0914227962493896,
+    "finite": 0.006452185567468405
+  },
+  {
+    "step": 642,
+    "loss": 2.4136171340942383,
+    "diagonal": 2.407135248184204,
+    "finite": 0.006481776013970375
+  },
+  {
+    "step": 643,
+    "loss": 2.066760301589966,
+    "diagonal": 2.059277057647705,
+    "finite": 0.0074833594262599945
+  },
+  {
+    "step": 644,
+    "loss": 2.1210947036743164,
+    "diagonal": 2.116262197494507,
+    "finite": 0.004832420498132706
+  },
+  {
+    "step": 645,
+    "loss": 1.9989583492279053,
+    "diagonal": 1.9929296970367432,
+    "finite": 0.006028661038726568
+  },
+  {
+    "step": 646,
+    "loss": 2.4046785831451416,
+    "diagonal": 2.399171829223633,
+    "finite": 0.005506666377186775
+  },
+  {
+    "step": 647,
+    "loss": 1.6981596946716309,
+    "diagonal": 1.6923630237579346,
+    "finite": 0.005796716548502445
+  },
+  {
+    "step": 648,
+    "loss": 2.286414623260498,
+    "diagonal": 2.2801780700683594,
+    "finite": 0.006236585322767496
+  },
+  {
+    "step": 649,
+    "loss": 2.0757906436920166,
+    "diagonal": 2.071510076522827,
+    "finite": 0.004280518740415573
+  },
+  {
+    "step": 650,
+    "loss": 1.7763301134109497,
+    "diagonal": 1.769273281097412,
+    "finite": 0.0070567866787314415
+  },
+  {
+    "step": 651,
+    "loss": 2.0094192028045654,
+    "diagonal": 2.0020999908447266,
+    "finite": 0.007319251075387001
+  },
+  {
+    "step": 652,
+    "loss": 1.8093301057815552,
+    "diagonal": 1.8038312196731567,
+    "finite": 0.005498887971043587
+  },
+  {
+    "step": 653,
+    "loss": 1.9507066011428833,
+    "diagonal": 1.9445788860321045,
+    "finite": 0.006127679254859686
+  },
+  {
+    "step": 654,
+    "loss": 2.082595109939575,
+    "diagonal": 2.078031301498413,
+    "finite": 0.004563828464597464
+  },
+  {
+    "step": 655,
+    "loss": 2.1376593112945557,
+    "diagonal": 2.1347806453704834,
+    "finite": 0.00287876115180552
+  },
+  {
+    "step": 656,
+    "loss": 2.0438079833984375,
+    "diagonal": 2.0338666439056396,
+    "finite": 0.009941305965185165
+  },
+  {
+    "step": 657,
+    "loss": 2.122253656387329,
+    "diagonal": 2.118105888366699,
+    "finite": 0.004147717729210854
+  },
+  {
+    "step": 658,
+    "loss": 1.8654481172561646,
+    "diagonal": 1.8571505546569824,
+    "finite": 0.008297613821923733
+  },
+  {
+    "step": 659,
+    "loss": 2.6171822547912598,
+    "diagonal": 2.613403558731079,
+    "finite": 0.0037787866313010454
+  },
+  {
+    "step": 660,
+    "loss": 1.8676378726959229,
+    "diagonal": 1.861709713935852,
+    "finite": 0.0059282006695866585
+  },
+  {
+    "step": 661,
+    "loss": 1.7486732006072998,
+    "diagonal": 1.743569016456604,
+    "finite": 0.005104174837470055
+  },
+  {
+    "step": 662,
+    "loss": 1.7295546531677246,
+    "diagonal": 1.724605679512024,
+    "finite": 0.00494893454015255
+  },
+  {
+    "step": 663,
+    "loss": 2.054314136505127,
+    "diagonal": 2.0486676692962646,
+    "finite": 0.005646504927426577
+  },
+  {
+    "step": 664,
+    "loss": 1.749793529510498,
+    "diagonal": 1.7440218925476074,
+    "finite": 0.0057716635055840015
+  },
+  {
+    "step": 665,
+    "loss": 1.8851302862167358,
+    "diagonal": 1.8753453493118286,
+    "finite": 0.009784983471035957
+  },
+  {
+    "step": 666,
+    "loss": 2.0438573360443115,
+    "diagonal": 2.035395383834839,
+    "finite": 0.008461968973279
+  },
+  {
+    "step": 667,
+    "loss": 2.2287790775299072,
+    "diagonal": 2.222740650177002,
+    "finite": 0.00603841245174408
+  },
+  {
+    "step": 668,
+    "loss": 2.3854267597198486,
+    "diagonal": 2.3792901039123535,
+    "finite": 0.006136565934866667
+  },
+  {
+    "step": 669,
+    "loss": 2.2882652282714844,
+    "diagonal": 2.279902935028076,
+    "finite": 0.008362258784472942
+  },
+  {
+    "step": 670,
+    "loss": 1.2919152975082397,
+    "diagonal": 1.285685658454895,
+    "finite": 0.006229649763554335
+  },
+  {
+    "step": 671,
+    "loss": 1.8687490224838257,
+    "diagonal": 1.8652429580688477,
+    "finite": 0.0035061209928244352
+  },
+  {
+    "step": 672,
+    "loss": 2.1595237255096436,
+    "diagonal": 2.153512716293335,
+    "finite": 0.006011047400534153
+  },
+  {
+    "step": 673,
+    "loss": 2.3166322708129883,
+    "diagonal": 2.3097259998321533,
+    "finite": 0.006906301248818636
+  },
+  {
+    "step": 674,
+    "loss": 1.6078686714172363,
+    "diagonal": 1.605613112449646,
+    "finite": 0.002255550120025873
+  },
+  {
+    "step": 675,
+    "loss": 1.779620885848999,
+    "diagonal": 1.7718819379806519,
+    "finite": 0.007738950662314892
+  },
+  {
+    "step": 676,
+    "loss": 1.7711288928985596,
+    "diagonal": 1.7663872241973877,
+    "finite": 0.004741675220429897
+  },
+  {
+    "step": 677,
+    "loss": 1.978440761566162,
+    "diagonal": 1.9663269519805908,
+    "finite": 0.012113766744732857
+  },
+  {
+    "step": 678,
+    "loss": 2.3141140937805176,
+    "diagonal": 2.306460380554199,
+    "finite": 0.007653802167624235
+  },
+  {
+    "step": 679,
+    "loss": 1.8266406059265137,
+    "diagonal": 1.8154141902923584,
+    "finite": 0.011226420290768147
+  },
+  {
+    "step": 680,
+    "loss": 2.8343865871429443,
+    "diagonal": 2.8295159339904785,
+    "finite": 0.004870544653385878
+  },
+  {
+    "step": 681,
+    "loss": 2.635573148727417,
+    "diagonal": 2.6273903846740723,
+    "finite": 0.008182734251022339
+  },
+  {
+    "step": 682,
+    "loss": 1.698946475982666,
+    "diagonal": 1.6932919025421143,
+    "finite": 0.005654570180922747
+  },
+  {
+    "step": 683,
+    "loss": 1.894181489944458,
+    "diagonal": 1.884448766708374,
+    "finite": 0.00973268412053585
+  },
+  {
+    "step": 684,
+    "loss": 2.125640630722046,
+    "diagonal": 2.119110345840454,
+    "finite": 0.006530316546559334
+  },
+  {
+    "step": 685,
+    "loss": 2.3143863677978516,
+    "diagonal": 2.302266836166382,
+    "finite": 0.012119458988308907
+  },
+  {
+    "step": 686,
+    "loss": 1.7437865734100342,
+    "diagonal": 1.7404258251190186,
+    "finite": 0.0033607911318540573
+  },
+  {
+    "step": 687,
+    "loss": 1.8479008674621582,
+    "diagonal": 1.840409517288208,
+    "finite": 0.007491299882531166
+  },
+  {
+    "step": 688,
+    "loss": 1.678659439086914,
+    "diagonal": 1.6736242771148682,
+    "finite": 0.005035165697336197
+  },
+  {
+    "step": 689,
+    "loss": 1.4374454021453857,
+    "diagonal": 1.4307888746261597,
+    "finite": 0.006656548008322716
+  },
+  {
+    "step": 690,
+    "loss": 1.9372516870498657,
+    "diagonal": 1.9300041198730469,
+    "finite": 0.0072475639171898365
+  },
+  {
+    "step": 691,
+    "loss": 2.1521689891815186,
+    "diagonal": 2.1476924419403076,
+    "finite": 0.004476618021726608
+  },
+  {
+    "step": 692,
+    "loss": 1.5403282642364502,
+    "diagonal": 1.5354564189910889,
+    "finite": 0.004871843382716179
+  },
+  {
+    "step": 693,
+    "loss": 1.7446105480194092,
+    "diagonal": 1.7377136945724487,
+    "finite": 0.006896807812154293
+  },
+  {
+    "step": 694,
+    "loss": 2.6978189945220947,
+    "diagonal": 2.6929574012756348,
+    "finite": 0.004861640278249979
+  },
+  {
+    "step": 695,
+    "loss": 2.0601539611816406,
+    "diagonal": 2.0525753498077393,
+    "finite": 0.007578653749078512
+  },
+  {
+    "step": 696,
+    "loss": 1.730013370513916,
+    "diagonal": 1.7237675189971924,
+    "finite": 0.006245824974030256
+  },
+  {
+    "step": 697,
+    "loss": 1.6800864934921265,
+    "diagonal": 1.6731733083724976,
+    "finite": 0.006913156248629093
+  },
+  {
+    "step": 698,
+    "loss": 2.1627449989318848,
+    "diagonal": 2.156909465789795,
+    "finite": 0.0058354963548481464
+  },
+  {
+    "step": 699,
+    "loss": 2.1441237926483154,
+    "diagonal": 2.137552261352539,
+    "finite": 0.006571487989276648
+  },
+  {
+    "step": 700,
+    "loss": 2.1075751781463623,
+    "diagonal": 2.100717782974243,
+    "finite": 0.0068574631586670876
+  },
+  {
+    "step": 701,
+    "loss": 1.648510217666626,
+    "diagonal": 1.6445273160934448,
+    "finite": 0.003982941620051861
+  },
+  {
+    "step": 702,
+    "loss": 1.8406813144683838,
+    "diagonal": 1.834101915359497,
+    "finite": 0.006579395849257708
+  },
+  {
+    "step": 703,
+    "loss": 1.7834868431091309,
+    "diagonal": 1.7780940532684326,
+    "finite": 0.00539280753582716
+  },
+  {
+    "step": 704,
+    "loss": 1.6994082927703857,
+    "diagonal": 1.693514347076416,
+    "finite": 0.00589400390163064
+  },
+  {
+    "step": 705,
+    "loss": 2.4373793601989746,
+    "diagonal": 2.431887626647949,
+    "finite": 0.005491722375154495
+  },
+  {
+    "step": 706,
+    "loss": 1.7587212324142456,
+    "diagonal": 1.7527209520339966,
+    "finite": 0.006000306457281113
+  },
+  {
+    "step": 707,
+    "loss": 2.0083141326904297,
+    "diagonal": 2.0025382041931152,
+    "finite": 0.00577582698315382
+  },
+  {
+    "step": 708,
+    "loss": 1.759575605392456,
+    "diagonal": 1.7554794549942017,
+    "finite": 0.004096195567399263
+  },
+  {
+    "step": 709,
+    "loss": 1.3376433849334717,
+    "diagonal": 1.3342907428741455,
+    "finite": 0.0033526550978422165
+  },
+  {
+    "step": 710,
+    "loss": 1.7508176565170288,
+    "diagonal": 1.7403435707092285,
+    "finite": 0.010474035516381264
+  },
+  {
+    "step": 711,
+    "loss": 1.9376566410064697,
+    "diagonal": 1.931555151939392,
+    "finite": 0.006101526319980621
+  },
+  {
+    "step": 712,
+    "loss": 1.659649133682251,
+    "diagonal": 1.653057336807251,
+    "finite": 0.006591778714209795
+  },
+  {
+    "step": 713,
+    "loss": 1.7029740810394287,
+    "diagonal": 1.695430874824524,
+    "finite": 0.007543206214904785
+  },
+  {
+    "step": 714,
+    "loss": 2.323324203491211,
+    "diagonal": 2.3157601356506348,
+    "finite": 0.007564072497189045
+  },
+  {
+    "step": 715,
+    "loss": 2.0026330947875977,
+    "diagonal": 1.9954485893249512,
+    "finite": 0.0071844481863081455
+  },
+  {
+    "step": 716,
+    "loss": 2.141779899597168,
+    "diagonal": 2.1345467567443848,
+    "finite": 0.007233242504298687
+  },
+  {
+    "step": 717,
+    "loss": 2.1449568271636963,
+    "diagonal": 2.138232469558716,
+    "finite": 0.006724271457642317
+  },
+  {
+    "step": 718,
+    "loss": 1.8547711372375488,
+    "diagonal": 1.8458553552627563,
+    "finite": 0.008915744721889496
+  },
+  {
+    "step": 719,
+    "loss": 1.2650774717330933,
+    "diagonal": 1.2584517002105713,
+    "finite": 0.0066257803700864315
+  },
+  {
+    "step": 720,
+    "loss": 1.6640739440917969,
+    "diagonal": 1.6570460796356201,
+    "finite": 0.007027921732515097
+  },
+  {
+    "step": 721,
+    "loss": 2.2513346672058105,
+    "diagonal": 2.2423384189605713,
+    "finite": 0.008996183052659035
+  },
+  {
+    "step": 722,
+    "loss": 1.890546202659607,
+    "diagonal": 1.8810884952545166,
+    "finite": 0.009457756765186787
+  },
+  {
+    "step": 723,
+    "loss": 1.7466117143630981,
+    "diagonal": 1.735784649848938,
+    "finite": 0.01082710549235344
+  },
+  {
+    "step": 724,
+    "loss": 1.7738007307052612,
+    "diagonal": 1.7660706043243408,
+    "finite": 0.007730133831501007
+  },
+  {
+    "step": 725,
+    "loss": 1.8414866924285889,
+    "diagonal": 1.8339468240737915,
+    "finite": 0.00753986369818449
+  },
+  {
+    "step": 726,
+    "loss": 2.1181955337524414,
+    "diagonal": 2.108943223953247,
+    "finite": 0.009252356365323067
+  },
+  {
+    "step": 727,
+    "loss": 2.128582715988159,
+    "diagonal": 2.1188509464263916,
+    "finite": 0.009731820784509182
+  },
+  {
+    "step": 728,
+    "loss": 1.948030948638916,
+    "diagonal": 1.938826322555542,
+    "finite": 0.009204614907503128
+  },
+  {
+    "step": 729,
+    "loss": 2.0794405937194824,
+    "diagonal": 2.070708751678467,
+    "finite": 0.008731958456337452
+  },
+  {
+    "step": 730,
+    "loss": 1.6077979803085327,
+    "diagonal": 1.6009905338287354,
+    "finite": 0.006807468831539154
+  },
+  {
+    "step": 731,
+    "loss": 1.9330549240112305,
+    "diagonal": 1.9259161949157715,
+    "finite": 0.0071387807838618755
+  },
+  {
+    "step": 732,
+    "loss": 2.103903293609619,
+    "diagonal": 2.095912218093872,
+    "finite": 0.007990958169102669
+  },
+  {
+    "step": 733,
+    "loss": 2.5030605792999268,
+    "diagonal": 2.4968478679656982,
+    "finite": 0.006212642416357994
+  },
+  {
+    "step": 734,
+    "loss": 2.240203380584717,
+    "diagonal": 2.2329297065734863,
+    "finite": 0.0072735887952148914
+  },
+  {
+    "step": 735,
+    "loss": 2.7362232208251953,
+    "diagonal": 2.730072259902954,
+    "finite": 0.0061510116793215275
+  },
+  {
+    "step": 736,
+    "loss": 1.781625747680664,
+    "diagonal": 1.7740941047668457,
+    "finite": 0.007531650364398956
+  },
+  {
+    "step": 737,
+    "loss": 1.2895389795303345,
+    "diagonal": 1.2816672325134277,
+    "finite": 0.007871708832681179
+  },
+  {
+    "step": 738,
+    "loss": 2.2433853149414062,
+    "diagonal": 2.237771987915039,
+    "finite": 0.005613438785076141
+  },
+  {
+    "step": 739,
+    "loss": 1.8789705038070679,
+    "diagonal": 1.872882604598999,
+    "finite": 0.006087875925004482
+  },
+  {
+    "step": 740,
+    "loss": 1.948357343673706,
+    "diagonal": 1.9435604810714722,
+    "finite": 0.00479687238112092
+  },
+  {
+    "step": 741,
+    "loss": 1.5961788892745972,
+    "diagonal": 1.5881760120391846,
+    "finite": 0.008002904243767262
+  },
+  {
+    "step": 742,
+    "loss": 2.002485752105713,
+    "diagonal": 1.997851848602295,
+    "finite": 0.004633941687643528
+  },
+  {
+    "step": 743,
+    "loss": 2.438206911087036,
+    "diagonal": 2.430872917175293,
+    "finite": 0.00733403954654932
+  },
+  {
+    "step": 744,
+    "loss": 1.975594162940979,
+    "diagonal": 1.9695888757705688,
+    "finite": 0.006005322560667992
+  },
+  {
+    "step": 745,
+    "loss": 2.1268060207366943,
+    "diagonal": 2.1211142539978027,
+    "finite": 0.005691826343536377
+  },
+  {
+    "step": 746,
+    "loss": 1.782223105430603,
+    "diagonal": 1.7772735357284546,
+    "finite": 0.004949544090777636
+  },
+  {
+    "step": 747,
+    "loss": 1.7979165315628052,
+    "diagonal": 1.7931383848190308,
+    "finite": 0.004778099711984396
+  },
+  {
+    "step": 748,
+    "loss": 2.1057403087615967,
+    "diagonal": 2.102466106414795,
+    "finite": 0.003274116665124893
+  },
+  {
+    "step": 749,
+    "loss": 1.7275848388671875,
+    "diagonal": 1.722902774810791,
+    "finite": 0.004682070575654507
+  },
+  {
+    "step": 750,
+    "loss": 1.306839942932129,
+    "diagonal": 1.3011326789855957,
+    "finite": 0.005707206204533577
+  },
+  {
+    "step": 751,
+    "loss": 1.6141952276229858,
+    "diagonal": 1.6062816381454468,
+    "finite": 0.007913634181022644
+  },
+  {
+    "step": 752,
+    "loss": 2.122910976409912,
+    "diagonal": 2.1136932373046875,
+    "finite": 0.009217689745128155
+  },
+  {
+    "step": 753,
+    "loss": 1.8249799013137817,
+    "diagonal": 1.8213857412338257,
+    "finite": 0.0035941246896982193
+  },
+  {
+    "step": 754,
+    "loss": 2.5917773246765137,
+    "diagonal": 2.5865392684936523,
+    "finite": 0.005238174926489592
+  },
+  {
+    "step": 755,
+    "loss": 2.209143877029419,
+    "diagonal": 2.204399347305298,
+    "finite": 0.004744448699057102
+  },
+  {
+    "step": 756,
+    "loss": 2.192124605178833,
+    "diagonal": 2.1867942810058594,
+    "finite": 0.005330209620296955
+  },
+  {
+    "step": 757,
+    "loss": 1.738287091255188,
+    "diagonal": 1.7325929403305054,
+    "finite": 0.00569410715252161
+  },
+  {
+    "step": 758,
+    "loss": 2.3392088413238525,
+    "diagonal": 2.3350470066070557,
+    "finite": 0.004161944147199392
+  },
+  {
+    "step": 759,
+    "loss": 2.2939515113830566,
+    "diagonal": 2.2892284393310547,
+    "finite": 0.004723032470792532
+  },
+  {
+    "step": 760,
+    "loss": 2.4321680068969727,
+    "diagonal": 2.4250192642211914,
+    "finite": 0.007148852106183767
+  },
+  {
+    "step": 761,
+    "loss": 2.293063163757324,
+    "diagonal": 2.2877020835876465,
+    "finite": 0.005361190531402826
+  },
+  {
+    "step": 762,
+    "loss": 2.6228866577148438,
+    "diagonal": 2.6161818504333496,
+    "finite": 0.006704900413751602
+  },
+  {
+    "step": 763,
+    "loss": 1.7353596687316895,
+    "diagonal": 1.7289533615112305,
+    "finite": 0.006406293250620365
+  },
+  {
+    "step": 764,
+    "loss": 1.6696988344192505,
+    "diagonal": 1.6636171340942383,
+    "finite": 0.006081658881157637
+  },
+  {
+    "step": 765,
+    "loss": 1.5101841688156128,
+    "diagonal": 1.5057549476623535,
+    "finite": 0.004429265856742859
+  },
+  {
+    "step": 766,
+    "loss": 2.415306568145752,
+    "diagonal": 2.4047417640686035,
+    "finite": 0.010564712807536125
+  },
+  {
+    "step": 767,
+    "loss": 1.9474496841430664,
+    "diagonal": 1.943483591079712,
+    "finite": 0.003966057673096657
+  },
+  {
+    "step": 768,
+    "loss": 2.454699993133545,
+    "diagonal": 2.4485301971435547,
+    "finite": 0.0061698537319898605
+  },
+  {
+    "step": 769,
+    "loss": 1.9444549083709717,
+    "diagonal": 1.9370546340942383,
+    "finite": 0.007400296628475189
+  },
+  {
+    "step": 770,
+    "loss": 1.792833685874939,
+    "diagonal": 1.7857012748718262,
+    "finite": 0.007132372818887234
+  },
+  {
+    "step": 771,
+    "loss": 1.5899534225463867,
+    "diagonal": 1.583806037902832,
+    "finite": 0.006147430278360844
+  },
+  {
+    "step": 772,
+    "loss": 1.550452470779419,
+    "diagonal": 1.5454163551330566,
+    "finite": 0.0050360579043626785
+  },
+  {
+    "step": 773,
+    "loss": 1.9195595979690552,
+    "diagonal": 1.9127922058105469,
+    "finite": 0.006767410784959793
+  },
+  {
+    "step": 774,
+    "loss": 1.5374549627304077,
+    "diagonal": 1.526513695716858,
+    "finite": 0.010941240936517715
+  },
+  {
+    "step": 775,
+    "loss": 2.137174606323242,
+    "diagonal": 2.1291112899780273,
+    "finite": 0.00806337408721447
+  },
+  {
+    "step": 776,
+    "loss": 1.7625435590744019,
+    "diagonal": 1.7541120052337646,
+    "finite": 0.008431547321379185
+  },
+  {
+    "step": 777,
+    "loss": 2.0955657958984375,
+    "diagonal": 2.0881967544555664,
+    "finite": 0.007369019091129303
+  },
+  {
+    "step": 778,
+    "loss": 2.0525894165039062,
+    "diagonal": 2.043576240539551,
+    "finite": 0.009013096801936626
+  },
+  {
+    "step": 779,
+    "loss": 1.5084648132324219,
+    "diagonal": 1.5011513233184814,
+    "finite": 0.00731351925060153
+  },
+  {
+    "step": 780,
+    "loss": 2.349583148956299,
+    "diagonal": 2.342094659805298,
+    "finite": 0.007488553877919912
+  },
+  {
+    "step": 781,
+    "loss": 1.4190928936004639,
+    "diagonal": 1.405361294746399,
+    "finite": 0.013731622137129307
+  },
+  {
+    "step": 782,
+    "loss": 2.005479335784912,
+    "diagonal": 2.0008652210235596,
+    "finite": 0.00461419764906168
+  },
+  {
+    "step": 783,
+    "loss": 1.9208663702011108,
+    "diagonal": 1.916703462600708,
+    "finite": 0.004162866156548262
+  },
+  {
+    "step": 784,
+    "loss": 1.454882025718689,
+    "diagonal": 1.4509929418563843,
+    "finite": 0.0038890414871275425
+  },
+  {
+    "step": 785,
+    "loss": 2.1659226417541504,
+    "diagonal": 2.161909580230713,
+    "finite": 0.0040131318382918835
+  },
+  {
+    "step": 786,
+    "loss": 2.4931700229644775,
+    "diagonal": 2.4854114055633545,
+    "finite": 0.007758652325719595
+  },
+  {
+    "step": 787,
+    "loss": 2.5477514266967773,
+    "diagonal": 2.5421812534332275,
+    "finite": 0.005570101086050272
+  },
+  {
+    "step": 788,
+    "loss": 1.9104939699172974,
+    "diagonal": 1.9055588245391846,
+    "finite": 0.004935156553983688
+  },
+  {
+    "step": 789,
+    "loss": 1.7075920104980469,
+    "diagonal": 1.7028599977493286,
+    "finite": 0.004732006695121527
+  },
+  {
+    "step": 790,
+    "loss": 2.3911170959472656,
+    "diagonal": 2.3851115703582764,
+    "finite": 0.006005442701280117
+  },
+  {
+    "step": 791,
+    "loss": 2.4830539226531982,
+    "diagonal": 2.4756689071655273,
+    "finite": 0.00738504296168685
+  },
+  {
+    "step": 792,
+    "loss": 2.2475664615631104,
+    "diagonal": 2.2418389320373535,
+    "finite": 0.005727474577724934
+  },
+  {
+    "step": 793,
+    "loss": 1.7762629985809326,
+    "diagonal": 1.7732470035552979,
+    "finite": 0.0030159451998770237
+  },
+  {
+    "step": 794,
+    "loss": 2.1188857555389404,
+    "diagonal": 2.115260601043701,
+    "finite": 0.0036251554265618324
+  },
+  {
+    "step": 795,
+    "loss": 2.0544984340667725,
+    "diagonal": 2.0490474700927734,
+    "finite": 0.005450950004160404
+  },
+  {
+    "step": 796,
+    "loss": 2.257817029953003,
+    "diagonal": 2.2539758682250977,
+    "finite": 0.0038410837296396494
+  },
+  {
+    "step": 797,
+    "loss": 2.3050827980041504,
+    "diagonal": 2.296907424926758,
+    "finite": 0.00817535538226366
+  },
+  {
+    "step": 798,
+    "loss": 1.95125150680542,
+    "diagonal": 1.9455831050872803,
+    "finite": 0.005668411031365395
+  },
+  {
+    "step": 799,
+    "loss": 2.0623135566711426,
+    "diagonal": 2.0591371059417725,
+    "finite": 0.0031763596925884485
+  },
+  {
+    "step": 800,
+    "loss": 1.7189072370529175,
+    "diagonal": 1.7159430980682373,
+    "finite": 0.002964171115309
+  },
+  {
+    "step": 801,
+    "loss": 1.5931485891342163,
+    "diagonal": 1.5875892639160156,
+    "finite": 0.005559383891522884
+  },
+  {
+    "step": 802,
+    "loss": 2.167768716812134,
+    "diagonal": 2.164050817489624,
+    "finite": 0.0037180096842348576
+  },
+  {
+    "step": 803,
+    "loss": 1.9262232780456543,
+    "diagonal": 1.9214653968811035,
+    "finite": 0.004757833667099476
+  },
+  {
+    "step": 804,
+    "loss": 2.2563962936401367,
+    "diagonal": 2.2501227855682373,
+    "finite": 0.006273478735238314
+  },
+  {
+    "step": 805,
+    "loss": 2.2783522605895996,
+    "diagonal": 2.2692315578460693,
+    "finite": 0.0091206394135952
+  },
+  {
+    "step": 806,
+    "loss": 2.3136260509490967,
+    "diagonal": 2.3089213371276855,
+    "finite": 0.00470462953671813
+  },
+  {
+    "step": 807,
+    "loss": 2.060377359390259,
+    "diagonal": 2.0548579692840576,
+    "finite": 0.005519348196685314
+  },
+  {
+    "step": 808,
+    "loss": 1.774039387702942,
+    "diagonal": 1.7679924964904785,
+    "finite": 0.006046892609447241
+  },
+  {
+    "step": 809,
+    "loss": 2.509331226348877,
+    "diagonal": 2.5048646926879883,
+    "finite": 0.004466548562049866
+  },
+  {
+    "step": 810,
+    "loss": 2.290938138961792,
+    "diagonal": 2.2800254821777344,
+    "finite": 0.010912624187767506
+  },
+  {
+    "step": 811,
+    "loss": 1.7181105613708496,
+    "diagonal": 1.712920069694519,
+    "finite": 0.005190529860556126
+  },
+  {
+    "step": 812,
+    "loss": 1.5163989067077637,
+    "diagonal": 1.5074653625488281,
+    "finite": 0.00893351435661316
+  },
+  {
+    "step": 813,
+    "loss": 2.0864930152893066,
+    "diagonal": 2.07761287689209,
+    "finite": 0.008880175650119781
+  },
+  {
+    "step": 814,
+    "loss": 2.1407809257507324,
+    "diagonal": 2.1357667446136475,
+    "finite": 0.005014191847294569
+  },
+  {
+    "step": 815,
+    "loss": 2.5078654289245605,
+    "diagonal": 2.5032846927642822,
+    "finite": 0.004580697510391474
+  },
+  {
+    "step": 816,
+    "loss": 1.9046326875686646,
+    "diagonal": 1.898199200630188,
+    "finite": 0.006433447822928429
+  },
+  {
+    "step": 817,
+    "loss": 2.075646162033081,
+    "diagonal": 2.066567897796631,
+    "finite": 0.009078256785869598
+  },
+  {
+    "step": 818,
+    "loss": 1.5838682651519775,
+    "diagonal": 1.5754097700119019,
+    "finite": 0.00845853891223669
+  },
+  {
+    "step": 819,
+    "loss": 1.9921783208847046,
+    "diagonal": 1.9843356609344482,
+    "finite": 0.007842715829610825
+  },
+  {
+    "step": 820,
+    "loss": 1.6868318319320679,
+    "diagonal": 1.677316665649414,
+    "finite": 0.009515178389847279
+  },
+  {
+    "step": 821,
+    "loss": 1.7922790050506592,
+    "diagonal": 1.7819750308990479,
+    "finite": 0.010303983464837074
+  },
+  {
+    "step": 822,
+    "loss": 2.134582042694092,
+    "diagonal": 2.1268794536590576,
+    "finite": 0.007702667731791735
+  },
+  {
+    "step": 823,
+    "loss": 2.0526998043060303,
+    "diagonal": 2.0425057411193848,
+    "finite": 0.010194017551839352
+  },
+  {
+    "step": 824,
+    "loss": 2.00771427154541,
+    "diagonal": 1.9990986585617065,
+    "finite": 0.008615671657025814
+  },
+  {
+    "step": 825,
+    "loss": 2.1976048946380615,
+    "diagonal": 2.191138744354248,
+    "finite": 0.006466209422796965
+  },
+  {
+    "step": 826,
+    "loss": 2.2500617504119873,
+    "diagonal": 2.2436718940734863,
+    "finite": 0.006389792542904615
+  },
+  {
+    "step": 827,
+    "loss": 2.273470401763916,
+    "diagonal": 2.26760196685791,
+    "finite": 0.005868390668183565
+  },
+  {
+    "step": 828,
+    "loss": 2.3060550689697266,
+    "diagonal": 2.299844264984131,
+    "finite": 0.006210862658917904
+  },
+  {
+    "step": 829,
+    "loss": 1.7593616247177124,
+    "diagonal": 1.7543179988861084,
+    "finite": 0.0050436826422810555
+  },
+  {
+    "step": 830,
+    "loss": 2.1292200088500977,
+    "diagonal": 2.123286247253418,
+    "finite": 0.005933643318712711
+  },
+  {
+    "step": 831,
+    "loss": 1.769597053527832,
+    "diagonal": 1.764378547668457,
+    "finite": 0.005218455567955971
+  },
+  {
+    "step": 832,
+    "loss": 1.863714575767517,
+    "diagonal": 1.8580131530761719,
+    "finite": 0.005701390560716391
+  },
+  {
+    "step": 833,
+    "loss": 1.996195912361145,
+    "diagonal": 1.9885690212249756,
+    "finite": 0.007626866921782494
+  },
+  {
+    "step": 834,
+    "loss": 1.615433692932129,
+    "diagonal": 1.6067360639572144,
+    "finite": 0.00869759265333414
+  },
+  {
+    "step": 835,
+    "loss": 2.481062173843384,
+    "diagonal": 2.474365234375,
+    "finite": 0.0066969916224479675
+  },
+  {
+    "step": 836,
+    "loss": 1.155924677848816,
+    "diagonal": 1.1519275903701782,
+    "finite": 0.003997143357992172
+  },
+  {
+    "step": 837,
+    "loss": 2.1799559593200684,
+    "diagonal": 2.173403263092041,
+    "finite": 0.006552690640091896
+  },
+  {
+    "step": 838,
+    "loss": 1.9683843851089478,
+    "diagonal": 1.9612832069396973,
+    "finite": 0.007101221475750208
+  },
+  {
+    "step": 839,
+    "loss": 2.1209933757781982,
+    "diagonal": 2.1140849590301514,
+    "finite": 0.006908484268933535
+  },
+  {
+    "step": 840,
+    "loss": 1.508777141571045,
+    "diagonal": 1.499984622001648,
+    "finite": 0.008792524226009846
+  },
+  {
+    "step": 841,
+    "loss": 2.077442169189453,
+    "diagonal": 2.071442127227783,
+    "finite": 0.005999922752380371
+  },
+  {
+    "step": 842,
+    "loss": 1.540261149406433,
+    "diagonal": 1.5315873622894287,
+    "finite": 0.008673821575939655
+  },
+  {
+    "step": 843,
+    "loss": 2.0800087451934814,
+    "diagonal": 2.074113368988037,
+    "finite": 0.005895333830267191
+  },
+  {
+    "step": 844,
+    "loss": 2.356522560119629,
+    "diagonal": 2.349797248840332,
+    "finite": 0.006725313141942024
+  },
+  {
+    "step": 845,
+    "loss": 1.9515668153762817,
+    "diagonal": 1.943807601928711,
+    "finite": 0.007759228814393282
+  },
+  {
+    "step": 846,
+    "loss": 1.6347891092300415,
+    "diagonal": 1.6295537948608398,
+    "finite": 0.0052353013306856155
+  },
+  {
+    "step": 847,
+    "loss": 2.0352275371551514,
+    "diagonal": 2.027801275253296,
+    "finite": 0.007426189258694649
+  },
+  {
+    "step": 848,
+    "loss": 2.4729766845703125,
+    "diagonal": 2.4675474166870117,
+    "finite": 0.005429229699075222
+  },
+  {
+    "step": 849,
+    "loss": 2.0738914012908936,
+    "diagonal": 2.0677011013031006,
+    "finite": 0.006190414074808359
+  },
+  {
+    "step": 850,
+    "loss": 1.94800865650177,
+    "diagonal": 1.9426970481872559,
+    "finite": 0.005311550572514534
+  },
+  {
+    "step": 851,
+    "loss": 2.069654703140259,
+    "diagonal": 2.062124729156494,
+    "finite": 0.007529897149652243
+  },
+  {
+    "step": 852,
+    "loss": 2.2162282466888428,
+    "diagonal": 2.2117528915405273,
+    "finite": 0.004475461784750223
+  },
+  {
+    "step": 853,
+    "loss": 2.3131141662597656,
+    "diagonal": 2.308640480041504,
+    "finite": 0.004473656415939331
+  },
+  {
+    "step": 854,
+    "loss": 2.228078603744507,
+    "diagonal": 2.223780870437622,
+    "finite": 0.004297847393900156
+  },
+  {
+    "step": 855,
+    "loss": 2.160705089569092,
+    "diagonal": 2.1552274227142334,
+    "finite": 0.005477674771100283
+  },
+  {
+    "step": 856,
+    "loss": 2.0659265518188477,
+    "diagonal": 2.0615649223327637,
+    "finite": 0.004361534956842661
+  },
+  {
+    "step": 857,
+    "loss": 2.2021467685699463,
+    "diagonal": 2.196413516998291,
+    "finite": 0.0057331654243171215
+  },
+  {
+    "step": 858,
+    "loss": 2.3521652221679688,
+    "diagonal": 2.348240613937378,
+    "finite": 0.00392469298094511
+  },
+  {
+    "step": 859,
+    "loss": 2.216602087020874,
+    "diagonal": 2.2062253952026367,
+    "finite": 0.010376792401075363
+  },
+  {
+    "step": 860,
+    "loss": 1.469002366065979,
+    "diagonal": 1.4589953422546387,
+    "finite": 0.010006967931985855
+  },
+  {
+    "step": 861,
+    "loss": 1.8014602661132812,
+    "diagonal": 1.7979635000228882,
+    "finite": 0.0034968224354088306
+  },
+  {
+    "step": 862,
+    "loss": 1.683030128479004,
+    "diagonal": 1.6785773038864136,
+    "finite": 0.004452825989574194
+  },
+  {
+    "step": 863,
+    "loss": 1.9171565771102905,
+    "diagonal": 1.91256582736969,
+    "finite": 0.004590711556375027
+  },
+  {
+    "step": 864,
+    "loss": 2.541316509246826,
+    "diagonal": 2.537203311920166,
+    "finite": 0.004113123286515474
+  },
+  {
+    "step": 865,
+    "loss": 1.9833335876464844,
+    "diagonal": 1.977429986000061,
+    "finite": 0.005903627257794142
+  },
+  {
+    "step": 866,
+    "loss": 1.5490047931671143,
+    "diagonal": 1.541230320930481,
+    "finite": 0.007774497848004103
+  },
+  {
+    "step": 867,
+    "loss": 1.9691249132156372,
+    "diagonal": 1.960224986076355,
+    "finite": 0.008899925276637077
+  },
+  {
+    "step": 868,
+    "loss": 2.3244662284851074,
+    "diagonal": 2.317866563796997,
+    "finite": 0.006599775981158018
+  },
+  {
+    "step": 869,
+    "loss": 2.0816869735717773,
+    "diagonal": 2.071857213973999,
+    "finite": 0.009829706512391567
+  },
+  {
+    "step": 870,
+    "loss": 2.074404716491699,
+    "diagonal": 2.065882444381714,
+    "finite": 0.008522368967533112
+  },
+  {
+    "step": 871,
+    "loss": 1.5652587413787842,
+    "diagonal": 1.557342767715454,
+    "finite": 0.0079159801825881
+  },
+  {
+    "step": 872,
+    "loss": 1.4527019262313843,
+    "diagonal": 1.4445194005966187,
+    "finite": 0.008182556368410587
+  },
+  {
+    "step": 873,
+    "loss": 2.107520580291748,
+    "diagonal": 2.0998668670654297,
+    "finite": 0.0076536997221410275
+  },
+  {
+    "step": 874,
+    "loss": 2.11698579788208,
+    "diagonal": 2.109123945236206,
+    "finite": 0.007861936464905739
+  },
+  {
+    "step": 875,
+    "loss": 2.3119072914123535,
+    "diagonal": 2.300797939300537,
+    "finite": 0.011109327897429466
+  },
+  {
+    "step": 876,
+    "loss": 1.742004632949829,
+    "diagonal": 1.7326011657714844,
+    "finite": 0.009403500705957413
+  },
+  {
+    "step": 877,
+    "loss": 2.2812654972076416,
+    "diagonal": 2.2731058597564697,
+    "finite": 0.008159580640494823
+  },
+  {
+    "step": 878,
+    "loss": 1.9543133974075317,
+    "diagonal": 1.9455735683441162,
+    "finite": 0.008739838376641273
+  },
+  {
+    "step": 879,
+    "loss": 1.8587136268615723,
+    "diagonal": 1.8488725423812866,
+    "finite": 0.009841072373092175
+  },
+  {
+    "step": 880,
+    "loss": 2.127117872238159,
+    "diagonal": 2.1171960830688477,
+    "finite": 0.009921744465827942
+  },
+  {
+    "step": 881,
+    "loss": 2.2754061222076416,
+    "diagonal": 2.268171787261963,
+    "finite": 0.007234419230371714
+  },
+  {
+    "step": 882,
+    "loss": 1.732622504234314,
+    "diagonal": 1.7263436317443848,
+    "finite": 0.006278837565332651
+  },
+  {
+    "step": 883,
+    "loss": 2.5854780673980713,
+    "diagonal": 2.5757758617401123,
+    "finite": 0.009702138602733612
+  },
+  {
+    "step": 884,
+    "loss": 2.4753875732421875,
+    "diagonal": 2.467388868331909,
+    "finite": 0.007998792454600334
+  },
+  {
+    "step": 885,
+    "loss": 2.0171587467193604,
+    "diagonal": 2.008286952972412,
+    "finite": 0.00887170061469078
+  },
+  {
+    "step": 886,
+    "loss": 2.2860846519470215,
+    "diagonal": 2.2808823585510254,
+    "finite": 0.005202412139624357
+  },
+  {
+    "step": 887,
+    "loss": 2.1039586067199707,
+    "diagonal": 2.0961403846740723,
+    "finite": 0.007818161509931087
+  },
+  {
+    "step": 888,
+    "loss": 2.814418077468872,
+    "diagonal": 2.809069871902466,
+    "finite": 0.005348238628357649
+  },
+  {
+    "step": 889,
+    "loss": 1.861763596534729,
+    "diagonal": 1.8558166027069092,
+    "finite": 0.005946971941739321
+  },
+  {
+    "step": 890,
+    "loss": 1.6239781379699707,
+    "diagonal": 1.6150826215744019,
+    "finite": 0.008895485661923885
+  },
+  {
+    "step": 891,
+    "loss": 1.9253123998641968,
+    "diagonal": 1.9178799390792847,
+    "finite": 0.007432491518557072
+  },
+  {
+    "step": 892,
+    "loss": 1.9905576705932617,
+    "diagonal": 1.9832580089569092,
+    "finite": 0.0072997077368199825
+  },
+  {
+    "step": 893,
+    "loss": 1.9234344959259033,
+    "diagonal": 1.915791392326355,
+    "finite": 0.0076430561020970345
+  },
+  {
+    "step": 894,
+    "loss": 2.0842714309692383,
+    "diagonal": 2.079011917114258,
+    "finite": 0.0052595664747059345
+  },
+  {
+    "step": 895,
+    "loss": 1.7699493169784546,
+    "diagonal": 1.7617896795272827,
+    "finite": 0.008159607648849487
+  },
+  {
+    "step": 896,
+    "loss": 1.741724967956543,
+    "diagonal": 1.734112024307251,
+    "finite": 0.007612919434905052
+  },
+  {
+    "step": 897,
+    "loss": 2.1579270362854004,
+    "diagonal": 2.1484251022338867,
+    "finite": 0.009501968510448933
+  },
+  {
+    "step": 898,
+    "loss": 1.987532615661621,
+    "diagonal": 1.9823063611984253,
+    "finite": 0.005226310808211565
+  },
+  {
+    "step": 899,
+    "loss": 1.9275000095367432,
+    "diagonal": 1.921574354171753,
+    "finite": 0.005925650708377361
+  },
+  {
+    "step": 900,
+    "loss": 1.9562829732894897,
+    "diagonal": 1.950613260269165,
+    "finite": 0.005669698119163513
+  },
+  {
+    "step": 901,
+    "loss": 2.295862913131714,
+    "diagonal": 2.290499210357666,
+    "finite": 0.005363595671951771
+  },
+  {
+    "step": 902,
+    "loss": 2.192216157913208,
+    "diagonal": 2.1852309703826904,
+    "finite": 0.006985093932598829
+  },
+  {
+    "step": 903,
+    "loss": 1.9834312200546265,
+    "diagonal": 1.977140188217163,
+    "finite": 0.006291035562753677
+  },
+  {
+    "step": 904,
+    "loss": 1.4087636470794678,
+    "diagonal": 1.4031553268432617,
+    "finite": 0.005608367267996073
+  },
+  {
+    "step": 905,
+    "loss": 1.4837005138397217,
+    "diagonal": 1.4764606952667236,
+    "finite": 0.007239809259772301
+  },
+  {
+    "step": 906,
+    "loss": 1.926641821861267,
+    "diagonal": 1.9201979637145996,
+    "finite": 0.006443818099796772
+  },
+  {
+    "step": 907,
+    "loss": 1.475005030632019,
+    "diagonal": 1.4684562683105469,
+    "finite": 0.00654881726950407
+  },
+  {
+    "step": 908,
+    "loss": 1.7499579191207886,
+    "diagonal": 1.7425380945205688,
+    "finite": 0.0074198017828166485
+  },
+  {
+    "step": 909,
+    "loss": 1.8251079320907593,
+    "diagonal": 1.8145992755889893,
+    "finite": 0.010508597828447819
+  },
+  {
+    "step": 910,
+    "loss": 1.3775111436843872,
+    "diagonal": 1.3709594011306763,
+    "finite": 0.006551714614033699
+  },
+  {
+    "step": 911,
+    "loss": 1.8522742986679077,
+    "diagonal": 1.8442511558532715,
+    "finite": 0.008023136295378208
+  },
+  {
+    "step": 912,
+    "loss": 2.461961507797241,
+    "diagonal": 2.4546761512756348,
+    "finite": 0.007285313680768013
+  },
+  {
+    "step": 913,
+    "loss": 1.9969903230667114,
+    "diagonal": 1.9892661571502686,
+    "finite": 0.007724205497652292
+  },
+  {
+    "step": 914,
+    "loss": 1.8660286664962769,
+    "diagonal": 1.8610706329345703,
+    "finite": 0.004957998171448708
+  },
+  {
+    "step": 915,
+    "loss": 1.5854932069778442,
+    "diagonal": 1.5795514583587646,
+    "finite": 0.005941764917224646
+  },
+  {
+    "step": 916,
+    "loss": 2.6301074028015137,
+    "diagonal": 2.624769687652588,
+    "finite": 0.005337642505764961
+  },
+  {
+    "step": 917,
+    "loss": 2.2655296325683594,
+    "diagonal": 2.2612619400024414,
+    "finite": 0.004267702344805002
+  },
+  {
+    "step": 918,
+    "loss": 2.101053237915039,
+    "diagonal": 2.0968551635742188,
+    "finite": 0.004198078997433186
+  },
+  {
+    "step": 919,
+    "loss": 1.9347102642059326,
+    "diagonal": 1.9300252199172974,
+    "finite": 0.004685059655457735
+  },
+  {
+    "step": 920,
+    "loss": 1.9494528770446777,
+    "diagonal": 1.9436936378479004,
+    "finite": 0.0057592145167291164
+  },
+  {
+    "step": 921,
+    "loss": 2.336277484893799,
+    "diagonal": 2.329616069793701,
+    "finite": 0.0066615198738873005
+  },
+  {
+    "step": 922,
+    "loss": 1.954535722732544,
+    "diagonal": 1.9482393264770508,
+    "finite": 0.006296358071267605
+  },
+  {
+    "step": 923,
+    "loss": 2.0550265312194824,
+    "diagonal": 2.048739433288574,
+    "finite": 0.00628703972324729
+  },
+  {
+    "step": 924,
+    "loss": 2.0318350791931152,
+    "diagonal": 2.0248730182647705,
+    "finite": 0.00696213822811842
+  },
+  {
+    "step": 925,
+    "loss": 1.9660046100616455,
+    "diagonal": 1.956935167312622,
+    "finite": 0.009069479070603848
+  },
+  {
+    "step": 926,
+    "loss": 2.0734779834747314,
+    "diagonal": 2.0655527114868164,
+    "finite": 0.007925178855657578
+  },
+  {
+    "step": 927,
+    "loss": 1.6084320545196533,
+    "diagonal": 1.5998321771621704,
+    "finite": 0.008599866181612015
+  },
+  {
+    "step": 928,
+    "loss": 1.6447995901107788,
+    "diagonal": 1.6373639106750488,
+    "finite": 0.007435621693730354
+  },
+  {
+    "step": 929,
+    "loss": 1.6693131923675537,
+    "diagonal": 1.6610101461410522,
+    "finite": 0.00830299686640501
+  },
+  {
+    "step": 930,
+    "loss": 1.6996442079544067,
+    "diagonal": 1.6907932758331299,
+    "finite": 0.008850956335663795
+  },
+  {
+    "step": 931,
+    "loss": 2.2495224475860596,
+    "diagonal": 2.2430646419525146,
+    "finite": 0.006457732990384102
+  },
+  {
+    "step": 932,
+    "loss": 2.300321102142334,
+    "diagonal": 2.2945570945739746,
+    "finite": 0.005763913504779339
+  },
+  {
+    "step": 933,
+    "loss": 1.987220048904419,
+    "diagonal": 1.9797075986862183,
+    "finite": 0.007512503769248724
+  },
+  {
+    "step": 934,
+    "loss": 2.5345802307128906,
+    "diagonal": 2.529358386993408,
+    "finite": 0.005221900530159473
+  },
+  {
+    "step": 935,
+    "loss": 2.458115339279175,
+    "diagonal": 2.4533865451812744,
+    "finite": 0.004728903062641621
+  },
+  {
+    "step": 936,
+    "loss": 1.753570795059204,
+    "diagonal": 1.7466315031051636,
+    "finite": 0.006939318496733904
+  },
+  {
+    "step": 937,
+    "loss": 1.9293204545974731,
+    "diagonal": 1.9217579364776611,
+    "finite": 0.0075625088065862656
+  },
+  {
+    "step": 938,
+    "loss": 2.304271936416626,
+    "diagonal": 2.2958593368530273,
+    "finite": 0.008412709459662437
+  },
+  {
+    "step": 939,
+    "loss": 1.4372721910476685,
+    "diagonal": 1.4295244216918945,
+    "finite": 0.00774775817990303
+  },
+  {
+    "step": 940,
+    "loss": 2.1913223266601562,
+    "diagonal": 2.1846537590026855,
+    "finite": 0.006668653339147568
+  },
+  {
+    "step": 941,
+    "loss": 1.8067079782485962,
+    "diagonal": 1.8013099431991577,
+    "finite": 0.005398083943873644
+  },
+  {
+    "step": 942,
+    "loss": 2.062845230102539,
+    "diagonal": 2.0529391765594482,
+    "finite": 0.009905941784381866
+  },
+  {
+    "step": 943,
+    "loss": 2.7191715240478516,
+    "diagonal": 2.7133333683013916,
+    "finite": 0.00583805562928319
+  },
+  {
+    "step": 944,
+    "loss": 1.9609198570251465,
+    "diagonal": 1.954097032546997,
+    "finite": 0.006822807248681784
+  },
+  {
+    "step": 945,
+    "loss": 1.7404640913009644,
+    "diagonal": 1.7342784404754639,
+    "finite": 0.006185600999742746
+  },
+  {
+    "step": 946,
+    "loss": 1.3662742376327515,
+    "diagonal": 1.3608684539794922,
+    "finite": 0.005405833013355732
+  },
+  {
+    "step": 947,
+    "loss": 2.22236967086792,
+    "diagonal": 2.2137646675109863,
+    "finite": 0.00860499031841755
+  },
+  {
+    "step": 948,
+    "loss": 1.816084861755371,
+    "diagonal": 1.8074463605880737,
+    "finite": 0.008638456463813782
+  },
+  {
+    "step": 949,
+    "loss": 1.6765403747558594,
+    "diagonal": 1.6679954528808594,
+    "finite": 0.00854489952325821
+  },
+  {
+    "step": 950,
+    "loss": 1.7869385480880737,
+    "diagonal": 1.7796778678894043,
+    "finite": 0.007260672748088837
+  },
+  {
+    "step": 951,
+    "loss": 2.0151000022888184,
+    "diagonal": 2.0067782402038574,
+    "finite": 0.008321678265929222
+  },
+  {
+    "step": 952,
+    "loss": 1.8129479885101318,
+    "diagonal": 1.8033373355865479,
+    "finite": 0.009610692970454693
+  },
+  {
+    "step": 953,
+    "loss": 2.4404094219207764,
+    "diagonal": 2.43257212638855,
+    "finite": 0.0078373858705163
+  },
+  {
+    "step": 954,
+    "loss": 2.2655117511749268,
+    "diagonal": 2.2584388256073,
+    "finite": 0.0070729684084653854
+  },
+  {
+    "step": 955,
+    "loss": 2.411543369293213,
+    "diagonal": 2.4042866230010986,
+    "finite": 0.0072567397728562355
+  },
+  {
+    "step": 956,
+    "loss": 1.5450687408447266,
+    "diagonal": 1.5398683547973633,
+    "finite": 0.005200420506298542
+  },
+  {
+    "step": 957,
+    "loss": 2.534381866455078,
+    "diagonal": 2.528963088989258,
+    "finite": 0.005418713670223951
+  },
+  {
+    "step": 958,
+    "loss": 1.9815154075622559,
+    "diagonal": 1.9761240482330322,
+    "finite": 0.005391373299062252
+  },
+  {
+    "step": 959,
+    "loss": 2.0288984775543213,
+    "diagonal": 2.024475574493408,
+    "finite": 0.004422827158123255
+  },
+  {
+    "step": 960,
+    "loss": 2.134570360183716,
+    "diagonal": 2.130849599838257,
+    "finite": 0.0037207244895398617
+  },
+  {
+    "step": 961,
+    "loss": 1.711187481880188,
+    "diagonal": 1.707606315612793,
+    "finite": 0.003581204917281866
+  },
+  {
+    "step": 962,
+    "loss": 2.2564406394958496,
+    "diagonal": 2.252589702606201,
+    "finite": 0.0038508931174874306
+  },
+  {
+    "step": 963,
+    "loss": 1.9742932319641113,
+    "diagonal": 1.9706238508224487,
+    "finite": 0.003669335041195154
+  },
+  {
+    "step": 964,
+    "loss": 2.2859814167022705,
+    "diagonal": 2.2800352573394775,
+    "finite": 0.0059461938217282295
+  },
+  {
+    "step": 965,
+    "loss": 1.5509730577468872,
+    "diagonal": 1.5440137386322021,
+    "finite": 0.006959373597055674
+  },
+  {
+    "step": 966,
+    "loss": 1.9456220865249634,
+    "diagonal": 1.9419662952423096,
+    "finite": 0.003655832726508379
+  },
+  {
+    "step": 967,
+    "loss": 1.6508032083511353,
+    "diagonal": 1.6433874368667603,
+    "finite": 0.007415730506181717
+  },
+  {
+    "step": 968,
+    "loss": 2.3008508682250977,
+    "diagonal": 2.291957378387451,
+    "finite": 0.008893474005162716
+  },
+  {
+    "step": 969,
+    "loss": 2.2110111713409424,
+    "diagonal": 2.20518159866333,
+    "finite": 0.00582959596067667
+  },
+  {
+    "step": 970,
+    "loss": 2.3075144290924072,
+    "diagonal": 2.3031699657440186,
+    "finite": 0.004344497807323933
+  },
+  {
+    "step": 971,
+    "loss": 2.3451151847839355,
+    "diagonal": 2.3408102989196777,
+    "finite": 0.004304923582822084
+  },
+  {
+    "step": 972,
+    "loss": 1.6341997385025024,
+    "diagonal": 1.6241275072097778,
+    "finite": 0.010072187520563602
+  },
+  {
+    "step": 973,
+    "loss": 1.5080598592758179,
+    "diagonal": 1.4997389316558838,
+    "finite": 0.008320893160998821
+  },
+  {
+    "step": 974,
+    "loss": 1.7857425212860107,
+    "diagonal": 1.7790906429290771,
+    "finite": 0.006651856005191803
+  },
+  {
+    "step": 975,
+    "loss": 1.9607775211334229,
+    "diagonal": 1.9554802179336548,
+    "finite": 0.0052973306737840176
+  },
+  {
+    "step": 976,
+    "loss": 2.049257755279541,
+    "diagonal": 2.0450124740600586,
+    "finite": 0.004245303571224213
+  },
+  {
+    "step": 977,
+    "loss": 1.9974161386489868,
+    "diagonal": 1.9927676916122437,
+    "finite": 0.004648448433727026
+  },
+  {
+    "step": 978,
+    "loss": 2.0100278854370117,
+    "diagonal": 2.00469970703125,
+    "finite": 0.0053281937725842
+  },
+  {
+    "step": 979,
+    "loss": 1.5950969457626343,
+    "diagonal": 1.5881996154785156,
+    "finite": 0.006897321902215481
+  },
+  {
+    "step": 980,
+    "loss": 2.5924253463745117,
+    "diagonal": 2.5883264541625977,
+    "finite": 0.00409884424880147
+  },
+  {
+    "step": 981,
+    "loss": 2.2570908069610596,
+    "diagonal": 2.2524073123931885,
+    "finite": 0.0046835835091769695
+  },
+  {
+    "step": 982,
+    "loss": 1.8047523498535156,
+    "diagonal": 1.797721266746521,
+    "finite": 0.007031040731817484
+  },
+  {
+    "step": 983,
+    "loss": 1.871487021446228,
+    "diagonal": 1.8664624691009521,
+    "finite": 0.005024557467550039
+  },
+  {
+    "step": 984,
+    "loss": 2.2769863605499268,
+    "diagonal": 2.2717692852020264,
+    "finite": 0.005217062775045633
+  },
+  {
+    "step": 985,
+    "loss": 1.69822096824646,
+    "diagonal": 1.6919407844543457,
+    "finite": 0.006280226167291403
+  },
+  {
+    "step": 986,
+    "loss": 1.774708867073059,
+    "diagonal": 1.7678110599517822,
+    "finite": 0.006897821091115475
+  },
+  {
+    "step": 987,
+    "loss": 2.453325033187866,
+    "diagonal": 2.4479401111602783,
+    "finite": 0.0053849113173782825
+  },
+  {
+    "step": 988,
+    "loss": 1.8869962692260742,
+    "diagonal": 1.8814806938171387,
+    "finite": 0.005515590775758028
+  },
+  {
+    "step": 989,
+    "loss": 1.9235477447509766,
+    "diagonal": 1.9166964292526245,
+    "finite": 0.006851363927125931
+  },
+  {
+    "step": 990,
+    "loss": 1.8394001722335815,
+    "diagonal": 1.8344818353652954,
+    "finite": 0.004918287042528391
+  },
+  {
+    "step": 991,
+    "loss": 2.566101312637329,
+    "diagonal": 2.5602288246154785,
+    "finite": 0.005872549954801798
+  },
+  {
+    "step": 992,
+    "loss": 1.8257126808166504,
+    "diagonal": 1.8194561004638672,
+    "finite": 0.006256620865315199
+  },
+  {
+    "step": 993,
+    "loss": 1.7570180892944336,
+    "diagonal": 1.748375654220581,
+    "finite": 0.008642397820949554
+  },
+  {
+    "step": 994,
+    "loss": 1.3178638219833374,
+    "diagonal": 1.3095500469207764,
+    "finite": 0.008313780650496483
+  },
+  {
+    "step": 995,
+    "loss": 1.657672643661499,
+    "diagonal": 1.6504147052764893,
+    "finite": 0.00725799473002553
+  },
+  {
+    "step": 996,
+    "loss": 2.241704225540161,
+    "diagonal": 2.2317206859588623,
+    "finite": 0.00998347532004118
+  },
+  {
+    "step": 997,
+    "loss": 1.883762001991272,
+    "diagonal": 1.8783564567565918,
+    "finite": 0.005405598320066929
+  },
+  {
+    "step": 998,
+    "loss": 1.7516298294067383,
+    "diagonal": 1.7456185817718506,
+    "finite": 0.006011239252984524
+  },
+  {
+    "step": 999,
+    "loss": 2.2188775539398193,
+    "diagonal": 2.2112302780151367,
+    "finite": 0.007647322490811348
+  }
+]
diff --git a/lecture_6/verified_examples/consistency/report.json b/lecture_6/verified_examples/consistency/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..68a6fbcd601747560f1129a3c54dc1b57214e9e7
--- /dev/null
+++ b/lecture_6/verified_examples/consistency/report.json
@@ -0,0 +1,23 @@
+{
+  "method": "consistency",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 1.9746342718601226,
+  "train_loss_last_20_mean": 1.979964154958725,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "finite_samples": true,
+  "mean_distance_to_center": 0.7534297704696655,
+  "mode_fractions": [
+    0.265625,
+    0.25,
+    0.2421875,
+    0.2421875
+  ],
+  "mode_entropy": 1.3855692148208618,
+  "mean_target_log_density": -7.795166492462158,
+  "elapsed_seconds": 3.6416576160045224
+}
diff --git a/lecture_6/verified_examples/consistency/samples.txt b/lecture_6/verified_examples/consistency/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..2ecd2c5ae98544c1399fab8c333a3bb33b6fe1c5
--- /dev/null
+++ b/lecture_6/verified_examples/consistency/samples.txt
@@ -0,0 +1,128 @@
+-1.3468293 1.9925021
+-1.9144447 1.9564545
+-1.8007749 -2.0338287
+-1.9767884 0.2636437
+0.4644759 -1.6100454
+-1.8300068 2.0076437
+1.8318725 -1.9341205
+-2.0396407 -1.7563149
+-2.0363870 -1.9806333
+1.0769628 1.7889115
+0.1340955 1.3456073
+1.7798740 -0.5705347
+2.0481019 0.6637622
+0.5697179 -0.0764643
+-1.6694670 -2.1333323
+1.8878694 -2.1138554
+1.3903328 1.7709353
+1.3510761 -1.8566105
+0.3830533 0.7458028
+1.8123627 -2.1073432
+-1.8500829 1.9188887
+-1.9960229 -0.9180380
+-2.0363288 -1.9042180
+-1.7602494 -1.8083441
+0.1228525 -2.1484063
+-1.9425657 0.6813170
+0.9867452 0.2309941
+-0.5291872 -2.0708153
+-1.9266198 1.5953822
+-0.5012224 -1.9294865
+-1.2689531 -1.5546137
+-1.5741237 -1.8497179
+-0.2626170 -1.6006305
+-1.9871480 -2.1482060
+2.0151453 1.6644613
+-0.1489909 -2.0024414
+2.0573957 1.4528581
+-0.2505112 1.9968579
+1.7871954 0.6475998
+1.8512402 -0.2385958
+0.1899848 1.9513735
+-1.9870937 -0.6491414
+-0.2206627 -1.5287057
+1.6779035 1.0743937
+-2.0382123 -2.1339107
+-0.7100272 1.9262421
+-1.6801538 -1.8067182
+1.8546274 -2.1622596
+1.5299554 1.2159443
+-1.9548271 1.3845929
+0.4502607 2.0001235
+-0.0262713 -0.3656653
+0.9616735 -1.0734054
+0.8062696 1.8239052
+-0.4521321 1.8881189
+-1.4971223 1.4280133
+1.2114744 -1.1458678
+-0.5043197 1.1818823
+-2.0388222 -1.5035791
+-1.3591039 0.9025277
+-2.0305381 -0.3237583
+1.2204367 1.9129956
+0.3672223 1.9162316
+2.0437796 0.6819464
+1.7619469 -1.9899399
+1.7444496 -1.7915529
+0.0078025 -1.0781103
+1.8828144 -2.0743697
+-1.9811914 -2.1016579
+-1.9607775 -0.8501123
+1.8939016 1.3304422
+1.7166512 0.3390130
+-0.0189792 -0.1771857
+-0.6227967 1.3938310
+1.9738953 1.8059912
+0.0466411 -2.0397491
+1.7655673 -1.9929256
+1.8075031 -1.8748856
+1.9316881 1.7332070
+1.6287178 -1.4561557
+-1.1077086 1.9380562
+1.8720345 1.2524481
+1.5174096 1.3109862
+-1.0241457 0.1447840
+-1.4152889 -0.7302222
+-1.7965597 -0.9746199
+1.1624088 1.3963469
+-0.4442409 1.4740853
+-1.5870914 1.7438629
+-0.2185191 -0.1900957
+1.6071042 1.2579901
+-1.4373560 1.5747277
+1.4849627 -1.7022858
+1.4948187 1.8095267
+-1.9391402 0.7429604
+-1.0735885 1.5553175
+-0.5654426 1.1886865
+1.4643161 -2.1554084
+-2.0169582 0.1357105
+1.1027896 -2.1490393
+-1.9470890 -2.0728121
+-1.9837592 0.9692687
+-0.8680381 2.0148981
+-1.6903710 -1.3934293
+-2.0227857 -1.9842577
+-1.8039379 1.8491473
+0.8419592 -2.0827856
+1.3736886 -2.1311660
+-1.6144994 -1.8624021
+-1.2275145 1.6786437
+-0.7562458 -2.1603642
+1.5444539 1.1505903
+0.6380618 0.8644766
+1.3242871 -2.1602378
+1.8642752 -1.8713832
+-1.7034441 -1.0856594
+1.6279490 1.2668343
+1.7643193 1.6216198
+1.0740453 -0.7010343
+-1.8715028 -2.0824487
+1.4197307 -1.6388113
+-1.6448362 0.3884219
+-1.9149169 1.7842357
+1.8479285 1.3923659
+1.4299746 -2.1582410
+-1.3168693 1.5584388
+-1.4611561 1.2482233
+1.8228297 -2.0618267
diff --git a/lecture_6/verified_examples/consistency/teacher_losses.json b/lecture_6/verified_examples/consistency/teacher_losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..3ff375a40b898f709a65c41934258725cfb7ef43
--- /dev/null
+++ b/lecture_6/verified_examples/consistency/teacher_losses.json
@@ -0,0 +1,4002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.901901960372925
+  },
+  {
+    "step": 1,
+    "loss": 4.030956745147705
+  },
+  {
+    "step": 2,
+    "loss": 3.7361669540405273
+  },
+  {
+    "step": 3,
+    "loss": 3.1736671924591064
+  },
+  {
+    "step": 4,
+    "loss": 3.2819948196411133
+  },
+  {
+    "step": 5,
+    "loss": 2.6870734691619873
+  },
+  {
+    "step": 6,
+    "loss": 3.2287180423736572
+  },
+  {
+    "step": 7,
+    "loss": 3.540705919265747
+  },
+  {
+    "step": 8,
+    "loss": 2.320319652557373
+  },
+  {
+    "step": 9,
+    "loss": 3.2631494998931885
+  },
+  {
+    "step": 10,
+    "loss": 3.2428276538848877
+  },
+  {
+    "step": 11,
+    "loss": 3.1067261695861816
+  },
+  {
+    "step": 12,
+    "loss": 2.9945061206817627
+  },
+  {
+    "step": 13,
+    "loss": 3.429009199142456
+  },
+  {
+    "step": 14,
+    "loss": 3.202871084213257
+  },
+  {
+    "step": 15,
+    "loss": 3.343949317932129
+  },
+  {
+    "step": 16,
+    "loss": 3.338503837585449
+  },
+  {
+    "step": 17,
+    "loss": 2.27468204498291
+  },
+  {
+    "step": 18,
+    "loss": 3.2059783935546875
+  },
+  {
+    "step": 19,
+    "loss": 3.2105021476745605
+  },
+  {
+    "step": 20,
+    "loss": 3.607123374938965
+  },
+  {
+    "step": 21,
+    "loss": 2.5147407054901123
+  },
+  {
+    "step": 22,
+    "loss": 2.4429540634155273
+  },
+  {
+    "step": 23,
+    "loss": 2.693626880645752
+  },
+  {
+    "step": 24,
+    "loss": 2.922039031982422
+  },
+  {
+    "step": 25,
+    "loss": 3.412623405456543
+  },
+  {
+    "step": 26,
+    "loss": 3.049421548843384
+  },
+  {
+    "step": 27,
+    "loss": 3.4507718086242676
+  },
+  {
+    "step": 28,
+    "loss": 3.2085723876953125
+  },
+  {
+    "step": 29,
+    "loss": 3.431762933731079
+  },
+  {
+    "step": 30,
+    "loss": 3.186777114868164
+  },
+  {
+    "step": 31,
+    "loss": 2.358400821685791
+  },
+  {
+    "step": 32,
+    "loss": 2.739171028137207
+  },
+  {
+    "step": 33,
+    "loss": 3.3288445472717285
+  },
+  {
+    "step": 34,
+    "loss": 2.9850246906280518
+  },
+  {
+    "step": 35,
+    "loss": 2.979214906692505
+  },
+  {
+    "step": 36,
+    "loss": 3.4282126426696777
+  },
+  {
+    "step": 37,
+    "loss": 2.3601138591766357
+  },
+  {
+    "step": 38,
+    "loss": 2.754340410232544
+  },
+  {
+    "step": 39,
+    "loss": 2.772657871246338
+  },
+  {
+    "step": 40,
+    "loss": 3.816230535507202
+  },
+  {
+    "step": 41,
+    "loss": 2.872300624847412
+  },
+  {
+    "step": 42,
+    "loss": 3.0081868171691895
+  },
+  {
+    "step": 43,
+    "loss": 2.6166443824768066
+  },
+  {
+    "step": 44,
+    "loss": 2.4548749923706055
+  },
+  {
+    "step": 45,
+    "loss": 2.7366158962249756
+  },
+  {
+    "step": 46,
+    "loss": 2.7148921489715576
+  },
+  {
+    "step": 47,
+    "loss": 2.800400972366333
+  },
+  {
+    "step": 48,
+    "loss": 2.9447460174560547
+  },
+  {
+    "step": 49,
+    "loss": 2.708866834640503
+  },
+  {
+    "step": 50,
+    "loss": 2.883293628692627
+  },
+  {
+    "step": 51,
+    "loss": 2.8611910343170166
+  },
+  {
+    "step": 52,
+    "loss": 2.477092742919922
+  },
+  {
+    "step": 53,
+    "loss": 2.551604986190796
+  },
+  {
+    "step": 54,
+    "loss": 2.338512897491455
+  },
+  {
+    "step": 55,
+    "loss": 3.476226329803467
+  },
+  {
+    "step": 56,
+    "loss": 2.717756509780884
+  },
+  {
+    "step": 57,
+    "loss": 2.5666332244873047
+  },
+  {
+    "step": 58,
+    "loss": 2.3942244052886963
+  },
+  {
+    "step": 59,
+    "loss": 2.3049826622009277
+  },
+  {
+    "step": 60,
+    "loss": 2.817511796951294
+  },
+  {
+    "step": 61,
+    "loss": 2.9381887912750244
+  },
+  {
+    "step": 62,
+    "loss": 3.0970544815063477
+  },
+  {
+    "step": 63,
+    "loss": 2.7542073726654053
+  },
+  {
+    "step": 64,
+    "loss": 2.95668625831604
+  },
+  {
+    "step": 65,
+    "loss": 3.3345565795898438
+  },
+  {
+    "step": 66,
+    "loss": 3.0203516483306885
+  },
+  {
+    "step": 67,
+    "loss": 3.0535619258880615
+  },
+  {
+    "step": 68,
+    "loss": 2.2485365867614746
+  },
+  {
+    "step": 69,
+    "loss": 3.313269853591919
+  },
+  {
+    "step": 70,
+    "loss": 3.151857614517212
+  },
+  {
+    "step": 71,
+    "loss": 3.3004636764526367
+  },
+  {
+    "step": 72,
+    "loss": 3.13859224319458
+  },
+  {
+    "step": 73,
+    "loss": 2.831691026687622
+  },
+  {
+    "step": 74,
+    "loss": 2.824505090713501
+  },
+  {
+    "step": 75,
+    "loss": 3.2724480628967285
+  },
+  {
+    "step": 76,
+    "loss": 3.3112194538116455
+  },
+  {
+    "step": 77,
+    "loss": 3.5525429248809814
+  },
+  {
+    "step": 78,
+    "loss": 3.02317214012146
+  },
+  {
+    "step": 79,
+    "loss": 2.3117425441741943
+  },
+  {
+    "step": 80,
+    "loss": 2.52921986579895
+  },
+  {
+    "step": 81,
+    "loss": 3.346832752227783
+  },
+  {
+    "step": 82,
+    "loss": 2.557271957397461
+  },
+  {
+    "step": 83,
+    "loss": 2.8063182830810547
+  },
+  {
+    "step": 84,
+    "loss": 3.1693220138549805
+  },
+  {
+    "step": 85,
+    "loss": 2.1511852741241455
+  },
+  {
+    "step": 86,
+    "loss": 2.3931725025177
+  },
+  {
+    "step": 87,
+    "loss": 2.7104268074035645
+  },
+  {
+    "step": 88,
+    "loss": 3.144993305206299
+  },
+  {
+    "step": 89,
+    "loss": 2.5371882915496826
+  },
+  {
+    "step": 90,
+    "loss": 2.635395050048828
+  },
+  {
+    "step": 91,
+    "loss": 2.9128007888793945
+  },
+  {
+    "step": 92,
+    "loss": 2.091165781021118
+  },
+  {
+    "step": 93,
+    "loss": 2.678255081176758
+  },
+  {
+    "step": 94,
+    "loss": 3.1458537578582764
+  },
+  {
+    "step": 95,
+    "loss": 3.0256667137145996
+  },
+  {
+    "step": 96,
+    "loss": 3.504319906234741
+  },
+  {
+    "step": 97,
+    "loss": 2.4840328693389893
+  },
+  {
+    "step": 98,
+    "loss": 3.156357765197754
+  },
+  {
+    "step": 99,
+    "loss": 2.409656047821045
+  },
+  {
+    "step": 100,
+    "loss": 2.607604503631592
+  },
+  {
+    "step": 101,
+    "loss": 3.1481847763061523
+  },
+  {
+    "step": 102,
+    "loss": 2.3221395015716553
+  },
+  {
+    "step": 103,
+    "loss": 2.7403645515441895
+  },
+  {
+    "step": 104,
+    "loss": 2.9177207946777344
+  },
+  {
+    "step": 105,
+    "loss": 3.1296420097351074
+  },
+  {
+    "step": 106,
+    "loss": 2.714864492416382
+  },
+  {
+    "step": 107,
+    "loss": 2.2136282920837402
+  },
+  {
+    "step": 108,
+    "loss": 3.0324344635009766
+  },
+  {
+    "step": 109,
+    "loss": 2.8028464317321777
+  },
+  {
+    "step": 110,
+    "loss": 3.500157356262207
+  },
+  {
+    "step": 111,
+    "loss": 3.659149646759033
+  },
+  {
+    "step": 112,
+    "loss": 2.6796770095825195
+  },
+  {
+    "step": 113,
+    "loss": 4.001369476318359
+  },
+  {
+    "step": 114,
+    "loss": 3.12492299079895
+  },
+  {
+    "step": 115,
+    "loss": 2.186939239501953
+  },
+  {
+    "step": 116,
+    "loss": 3.0609922409057617
+  },
+  {
+    "step": 117,
+    "loss": 2.7359426021575928
+  },
+  {
+    "step": 118,
+    "loss": 2.8246054649353027
+  },
+  {
+    "step": 119,
+    "loss": 2.0663673877716064
+  },
+  {
+    "step": 120,
+    "loss": 2.82535719871521
+  },
+  {
+    "step": 121,
+    "loss": 2.7651166915893555
+  },
+  {
+    "step": 122,
+    "loss": 2.3627724647521973
+  },
+  {
+    "step": 123,
+    "loss": 3.1746630668640137
+  },
+  {
+    "step": 124,
+    "loss": 2.2432596683502197
+  },
+  {
+    "step": 125,
+    "loss": 2.632728338241577
+  },
+  {
+    "step": 126,
+    "loss": 3.509660005569458
+  },
+  {
+    "step": 127,
+    "loss": 2.6030969619750977
+  },
+  {
+    "step": 128,
+    "loss": 2.819704532623291
+  },
+  {
+    "step": 129,
+    "loss": 2.7884159088134766
+  },
+  {
+    "step": 130,
+    "loss": 3.066481590270996
+  },
+  {
+    "step": 131,
+    "loss": 2.5375585556030273
+  },
+  {
+    "step": 132,
+    "loss": 2.6820192337036133
+  },
+  {
+    "step": 133,
+    "loss": 2.8677313327789307
+  },
+  {
+    "step": 134,
+    "loss": 3.295163631439209
+  },
+  {
+    "step": 135,
+    "loss": 3.008159637451172
+  },
+  {
+    "step": 136,
+    "loss": 2.6790380477905273
+  },
+  {
+    "step": 137,
+    "loss": 3.2993409633636475
+  },
+  {
+    "step": 138,
+    "loss": 2.3291473388671875
+  },
+  {
+    "step": 139,
+    "loss": 3.2662582397460938
+  },
+  {
+    "step": 140,
+    "loss": 3.1028847694396973
+  },
+  {
+    "step": 141,
+    "loss": 3.5241870880126953
+  },
+  {
+    "step": 142,
+    "loss": 2.6248207092285156
+  },
+  {
+    "step": 143,
+    "loss": 3.289806365966797
+  },
+  {
+    "step": 144,
+    "loss": 2.761228322982788
+  },
+  {
+    "step": 145,
+    "loss": 2.6195461750030518
+  },
+  {
+    "step": 146,
+    "loss": 3.2968337535858154
+  },
+  {
+    "step": 147,
+    "loss": 2.2302370071411133
+  },
+  {
+    "step": 148,
+    "loss": 2.7895140647888184
+  },
+  {
+    "step": 149,
+    "loss": 3.0598552227020264
+  },
+  {
+    "step": 150,
+    "loss": 2.991975784301758
+  },
+  {
+    "step": 151,
+    "loss": 2.758124589920044
+  },
+  {
+    "step": 152,
+    "loss": 2.8041367530822754
+  },
+  {
+    "step": 153,
+    "loss": 2.7885689735412598
+  },
+  {
+    "step": 154,
+    "loss": 2.642705202102661
+  },
+  {
+    "step": 155,
+    "loss": 3.208401679992676
+  },
+  {
+    "step": 156,
+    "loss": 2.890425205230713
+  },
+  {
+    "step": 157,
+    "loss": 3.0730347633361816
+  },
+  {
+    "step": 158,
+    "loss": 2.9297609329223633
+  },
+  {
+    "step": 159,
+    "loss": 3.1628060340881348
+  },
+  {
+    "step": 160,
+    "loss": 2.235241174697876
+  },
+  {
+    "step": 161,
+    "loss": 3.431405544281006
+  },
+  {
+    "step": 162,
+    "loss": 3.1083548069000244
+  },
+  {
+    "step": 163,
+    "loss": 2.592428207397461
+  },
+  {
+    "step": 164,
+    "loss": 2.538461923599243
+  },
+  {
+    "step": 165,
+    "loss": 2.8032314777374268
+  },
+  {
+    "step": 166,
+    "loss": 2.8171889781951904
+  },
+  {
+    "step": 167,
+    "loss": 2.857837677001953
+  },
+  {
+    "step": 168,
+    "loss": 2.95976185798645
+  },
+  {
+    "step": 169,
+    "loss": 2.500030994415283
+  },
+  {
+    "step": 170,
+    "loss": 2.632225513458252
+  },
+  {
+    "step": 171,
+    "loss": 2.696317672729492
+  },
+  {
+    "step": 172,
+    "loss": 2.671130657196045
+  },
+  {
+    "step": 173,
+    "loss": 3.2583823204040527
+  },
+  {
+    "step": 174,
+    "loss": 2.750561237335205
+  },
+  {
+    "step": 175,
+    "loss": 2.7291007041931152
+  },
+  {
+    "step": 176,
+    "loss": 2.5894086360931396
+  },
+  {
+    "step": 177,
+    "loss": 2.551658868789673
+  },
+  {
+    "step": 178,
+    "loss": 2.7688674926757812
+  },
+  {
+    "step": 179,
+    "loss": 2.5460314750671387
+  },
+  {
+    "step": 180,
+    "loss": 2.573371648788452
+  },
+  {
+    "step": 181,
+    "loss": 2.5819363594055176
+  },
+  {
+    "step": 182,
+    "loss": 2.7828993797302246
+  },
+  {
+    "step": 183,
+    "loss": 2.3213307857513428
+  },
+  {
+    "step": 184,
+    "loss": 2.626124382019043
+  },
+  {
+    "step": 185,
+    "loss": 2.0648884773254395
+  },
+  {
+    "step": 186,
+    "loss": 2.6399617195129395
+  },
+  {
+    "step": 187,
+    "loss": 2.4929964542388916
+  },
+  {
+    "step": 188,
+    "loss": 2.738865613937378
+  },
+  {
+    "step": 189,
+    "loss": 2.869166851043701
+  },
+  {
+    "step": 190,
+    "loss": 2.6773924827575684
+  },
+  {
+    "step": 191,
+    "loss": 3.207840919494629
+  },
+  {
+    "step": 192,
+    "loss": 2.593851327896118
+  },
+  {
+    "step": 193,
+    "loss": 3.145773410797119
+  },
+  {
+    "step": 194,
+    "loss": 2.6272592544555664
+  },
+  {
+    "step": 195,
+    "loss": 3.2182958126068115
+  },
+  {
+    "step": 196,
+    "loss": 2.6175713539123535
+  },
+  {
+    "step": 197,
+    "loss": 2.102283000946045
+  },
+  {
+    "step": 198,
+    "loss": 2.3725454807281494
+  },
+  {
+    "step": 199,
+    "loss": 2.310814142227173
+  },
+  {
+    "step": 200,
+    "loss": 2.554727077484131
+  },
+  {
+    "step": 201,
+    "loss": 2.290694236755371
+  },
+  {
+    "step": 202,
+    "loss": 2.0614757537841797
+  },
+  {
+    "step": 203,
+    "loss": 2.4946200847625732
+  },
+  {
+    "step": 204,
+    "loss": 3.1302361488342285
+  },
+  {
+    "step": 205,
+    "loss": 2.4278793334960938
+  },
+  {
+    "step": 206,
+    "loss": 2.7277281284332275
+  },
+  {
+    "step": 207,
+    "loss": 1.6022748947143555
+  },
+  {
+    "step": 208,
+    "loss": 2.2651426792144775
+  },
+  {
+    "step": 209,
+    "loss": 2.446990489959717
+  },
+  {
+    "step": 210,
+    "loss": 2.829681634902954
+  },
+  {
+    "step": 211,
+    "loss": 2.8909616470336914
+  },
+  {
+    "step": 212,
+    "loss": 2.6464128494262695
+  },
+  {
+    "step": 213,
+    "loss": 3.0840983390808105
+  },
+  {
+    "step": 214,
+    "loss": 2.442357063293457
+  },
+  {
+    "step": 215,
+    "loss": 3.077253580093384
+  },
+  {
+    "step": 216,
+    "loss": 3.0163815021514893
+  },
+  {
+    "step": 217,
+    "loss": 3.3182713985443115
+  },
+  {
+    "step": 218,
+    "loss": 2.6422321796417236
+  },
+  {
+    "step": 219,
+    "loss": 2.7757790088653564
+  },
+  {
+    "step": 220,
+    "loss": 2.817136287689209
+  },
+  {
+    "step": 221,
+    "loss": 2.7244391441345215
+  },
+  {
+    "step": 222,
+    "loss": 3.3463165760040283
+  },
+  {
+    "step": 223,
+    "loss": 2.5178160667419434
+  },
+  {
+    "step": 224,
+    "loss": 2.3083720207214355
+  },
+  {
+    "step": 225,
+    "loss": 2.6672210693359375
+  },
+  {
+    "step": 226,
+    "loss": 2.953312635421753
+  },
+  {
+    "step": 227,
+    "loss": 2.245347023010254
+  },
+  {
+    "step": 228,
+    "loss": 2.6127264499664307
+  },
+  {
+    "step": 229,
+    "loss": 2.3829171657562256
+  },
+  {
+    "step": 230,
+    "loss": 1.9589905738830566
+  },
+  {
+    "step": 231,
+    "loss": 2.7865824699401855
+  },
+  {
+    "step": 232,
+    "loss": 2.784212589263916
+  },
+  {
+    "step": 233,
+    "loss": 2.638892412185669
+  },
+  {
+    "step": 234,
+    "loss": 2.2629337310791016
+  },
+  {
+    "step": 235,
+    "loss": 2.3170275688171387
+  },
+  {
+    "step": 236,
+    "loss": 2.3931238651275635
+  },
+  {
+    "step": 237,
+    "loss": 2.5577549934387207
+  },
+  {
+    "step": 238,
+    "loss": 2.67926025390625
+  },
+  {
+    "step": 239,
+    "loss": 2.399914026260376
+  },
+  {
+    "step": 240,
+    "loss": 2.719255208969116
+  },
+  {
+    "step": 241,
+    "loss": 2.645662784576416
+  },
+  {
+    "step": 242,
+    "loss": 2.1666066646575928
+  },
+  {
+    "step": 243,
+    "loss": 2.710801839828491
+  },
+  {
+    "step": 244,
+    "loss": 2.2600297927856445
+  },
+  {
+    "step": 245,
+    "loss": 2.4880356788635254
+  },
+  {
+    "step": 246,
+    "loss": 2.333265542984009
+  },
+  {
+    "step": 247,
+    "loss": 2.3228213787078857
+  },
+  {
+    "step": 248,
+    "loss": 2.98348331451416
+  },
+  {
+    "step": 249,
+    "loss": 2.44199538230896
+  },
+  {
+    "step": 250,
+    "loss": 2.6789755821228027
+  },
+  {
+    "step": 251,
+    "loss": 2.432734489440918
+  },
+  {
+    "step": 252,
+    "loss": 2.3950858116149902
+  },
+  {
+    "step": 253,
+    "loss": 3.024618148803711
+  },
+  {
+    "step": 254,
+    "loss": 2.7950377464294434
+  },
+  {
+    "step": 255,
+    "loss": 2.6282715797424316
+  },
+  {
+    "step": 256,
+    "loss": 2.5368154048919678
+  },
+  {
+    "step": 257,
+    "loss": 2.5300967693328857
+  },
+  {
+    "step": 258,
+    "loss": 2.71651029586792
+  },
+  {
+    "step": 259,
+    "loss": 2.345527172088623
+  },
+  {
+    "step": 260,
+    "loss": 1.991959571838379
+  },
+  {
+    "step": 261,
+    "loss": 2.2183401584625244
+  },
+  {
+    "step": 262,
+    "loss": 2.7822048664093018
+  },
+  {
+    "step": 263,
+    "loss": 2.955565929412842
+  },
+  {
+    "step": 264,
+    "loss": 2.171292781829834
+  },
+  {
+    "step": 265,
+    "loss": 3.007766008377075
+  },
+  {
+    "step": 266,
+    "loss": 2.5466020107269287
+  },
+  {
+    "step": 267,
+    "loss": 2.4173848628997803
+  },
+  {
+    "step": 268,
+    "loss": 2.6756205558776855
+  },
+  {
+    "step": 269,
+    "loss": 2.4434726238250732
+  },
+  {
+    "step": 270,
+    "loss": 2.3825483322143555
+  },
+  {
+    "step": 271,
+    "loss": 2.5813300609588623
+  },
+  {
+    "step": 272,
+    "loss": 2.342559814453125
+  },
+  {
+    "step": 273,
+    "loss": 2.664748191833496
+  },
+  {
+    "step": 274,
+    "loss": 2.8664631843566895
+  },
+  {
+    "step": 275,
+    "loss": 2.8220643997192383
+  },
+  {
+    "step": 276,
+    "loss": 2.6016016006469727
+  },
+  {
+    "step": 277,
+    "loss": 2.292630672454834
+  },
+  {
+    "step": 278,
+    "loss": 2.3435916900634766
+  },
+  {
+    "step": 279,
+    "loss": 2.225806474685669
+  },
+  {
+    "step": 280,
+    "loss": 2.861757755279541
+  },
+  {
+    "step": 281,
+    "loss": 2.4925742149353027
+  },
+  {
+    "step": 282,
+    "loss": 2.3195114135742188
+  },
+  {
+    "step": 283,
+    "loss": 2.723316192626953
+  },
+  {
+    "step": 284,
+    "loss": 2.3318111896514893
+  },
+  {
+    "step": 285,
+    "loss": 2.3740956783294678
+  },
+  {
+    "step": 286,
+    "loss": 2.7161083221435547
+  },
+  {
+    "step": 287,
+    "loss": 1.8623343706130981
+  },
+  {
+    "step": 288,
+    "loss": 3.0774383544921875
+  },
+  {
+    "step": 289,
+    "loss": 2.684474468231201
+  },
+  {
+    "step": 290,
+    "loss": 2.1260976791381836
+  },
+  {
+    "step": 291,
+    "loss": 2.633331775665283
+  },
+  {
+    "step": 292,
+    "loss": 3.048750400543213
+  },
+  {
+    "step": 293,
+    "loss": 2.1517202854156494
+  },
+  {
+    "step": 294,
+    "loss": 2.703066349029541
+  },
+  {
+    "step": 295,
+    "loss": 2.2772347927093506
+  },
+  {
+    "step": 296,
+    "loss": 2.532550573348999
+  },
+  {
+    "step": 297,
+    "loss": 2.5133583545684814
+  },
+  {
+    "step": 298,
+    "loss": 2.2637734413146973
+  },
+  {
+    "step": 299,
+    "loss": 2.8052215576171875
+  },
+  {
+    "step": 300,
+    "loss": 2.3975658416748047
+  },
+  {
+    "step": 301,
+    "loss": 2.142946720123291
+  },
+  {
+    "step": 302,
+    "loss": 2.3383138179779053
+  },
+  {
+    "step": 303,
+    "loss": 2.956615924835205
+  },
+  {
+    "step": 304,
+    "loss": 2.268173933029175
+  },
+  {
+    "step": 305,
+    "loss": 2.2826666831970215
+  },
+  {
+    "step": 306,
+    "loss": 2.504539728164673
+  },
+  {
+    "step": 307,
+    "loss": 2.5966529846191406
+  },
+  {
+    "step": 308,
+    "loss": 1.9715884923934937
+  },
+  {
+    "step": 309,
+    "loss": 2.8570797443389893
+  },
+  {
+    "step": 310,
+    "loss": 2.3709073066711426
+  },
+  {
+    "step": 311,
+    "loss": 2.3691515922546387
+  },
+  {
+    "step": 312,
+    "loss": 2.5264945030212402
+  },
+  {
+    "step": 313,
+    "loss": 2.853039503097534
+  },
+  {
+    "step": 314,
+    "loss": 2.6715211868286133
+  },
+  {
+    "step": 315,
+    "loss": 2.4609460830688477
+  },
+  {
+    "step": 316,
+    "loss": 2.3723304271698
+  },
+  {
+    "step": 317,
+    "loss": 2.623749017715454
+  },
+  {
+    "step": 318,
+    "loss": 2.3588414192199707
+  },
+  {
+    "step": 319,
+    "loss": 2.2384724617004395
+  },
+  {
+    "step": 320,
+    "loss": 2.6265077590942383
+  },
+  {
+    "step": 321,
+    "loss": 2.3127033710479736
+  },
+  {
+    "step": 322,
+    "loss": 2.5432920455932617
+  },
+  {
+    "step": 323,
+    "loss": 2.902012348175049
+  },
+  {
+    "step": 324,
+    "loss": 2.2379114627838135
+  },
+  {
+    "step": 325,
+    "loss": 2.8483102321624756
+  },
+  {
+    "step": 326,
+    "loss": 3.0475165843963623
+  },
+  {
+    "step": 327,
+    "loss": 2.2012202739715576
+  },
+  {
+    "step": 328,
+    "loss": 3.10513973236084
+  },
+  {
+    "step": 329,
+    "loss": 2.7302069664001465
+  },
+  {
+    "step": 330,
+    "loss": 2.05947208404541
+  },
+  {
+    "step": 331,
+    "loss": 2.0735864639282227
+  },
+  {
+    "step": 332,
+    "loss": 2.351263999938965
+  },
+  {
+    "step": 333,
+    "loss": 2.1889426708221436
+  },
+  {
+    "step": 334,
+    "loss": 1.893702745437622
+  },
+  {
+    "step": 335,
+    "loss": 2.886248826980591
+  },
+  {
+    "step": 336,
+    "loss": 2.281409502029419
+  },
+  {
+    "step": 337,
+    "loss": 2.278639793395996
+  },
+  {
+    "step": 338,
+    "loss": 2.7411670684814453
+  },
+  {
+    "step": 339,
+    "loss": 2.242872714996338
+  },
+  {
+    "step": 340,
+    "loss": 2.567128896713257
+  },
+  {
+    "step": 341,
+    "loss": 2.1635279655456543
+  },
+  {
+    "step": 342,
+    "loss": 2.7505345344543457
+  },
+  {
+    "step": 343,
+    "loss": 2.4954588413238525
+  },
+  {
+    "step": 344,
+    "loss": 2.4626471996307373
+  },
+  {
+    "step": 345,
+    "loss": 2.457416296005249
+  },
+  {
+    "step": 346,
+    "loss": 2.4571924209594727
+  },
+  {
+    "step": 347,
+    "loss": 2.3100287914276123
+  },
+  {
+    "step": 348,
+    "loss": 2.4437308311462402
+  },
+  {
+    "step": 349,
+    "loss": 2.0501744747161865
+  },
+  {
+    "step": 350,
+    "loss": 2.1469335556030273
+  },
+  {
+    "step": 351,
+    "loss": 2.464240550994873
+  },
+  {
+    "step": 352,
+    "loss": 1.8512563705444336
+  },
+  {
+    "step": 353,
+    "loss": 2.4845597743988037
+  },
+  {
+    "step": 354,
+    "loss": 2.224407434463501
+  },
+  {
+    "step": 355,
+    "loss": 2.5380733013153076
+  },
+  {
+    "step": 356,
+    "loss": 2.51659893989563
+  },
+  {
+    "step": 357,
+    "loss": 2.0740654468536377
+  },
+  {
+    "step": 358,
+    "loss": 2.069371461868286
+  },
+  {
+    "step": 359,
+    "loss": 2.823765516281128
+  },
+  {
+    "step": 360,
+    "loss": 2.5208475589752197
+  },
+  {
+    "step": 361,
+    "loss": 2.116133213043213
+  },
+  {
+    "step": 362,
+    "loss": 2.556251049041748
+  },
+  {
+    "step": 363,
+    "loss": 2.223443031311035
+  },
+  {
+    "step": 364,
+    "loss": 2.6511716842651367
+  },
+  {
+    "step": 365,
+    "loss": 1.691718339920044
+  },
+  {
+    "step": 366,
+    "loss": 2.411846160888672
+  },
+  {
+    "step": 367,
+    "loss": 2.582014799118042
+  },
+  {
+    "step": 368,
+    "loss": 2.2078142166137695
+  },
+  {
+    "step": 369,
+    "loss": 2.609196662902832
+  },
+  {
+    "step": 370,
+    "loss": 2.444159984588623
+  },
+  {
+    "step": 371,
+    "loss": 2.0085737705230713
+  },
+  {
+    "step": 372,
+    "loss": 2.4077141284942627
+  },
+  {
+    "step": 373,
+    "loss": 2.8086421489715576
+  },
+  {
+    "step": 374,
+    "loss": 2.359715700149536
+  },
+  {
+    "step": 375,
+    "loss": 2.343597888946533
+  },
+  {
+    "step": 376,
+    "loss": 1.948641061782837
+  },
+  {
+    "step": 377,
+    "loss": 2.3641631603240967
+  },
+  {
+    "step": 378,
+    "loss": 2.0386908054351807
+  },
+  {
+    "step": 379,
+    "loss": 2.9259984493255615
+  },
+  {
+    "step": 380,
+    "loss": 2.6643362045288086
+  },
+  {
+    "step": 381,
+    "loss": 2.8584165573120117
+  },
+  {
+    "step": 382,
+    "loss": 2.6431076526641846
+  },
+  {
+    "step": 383,
+    "loss": 2.8262100219726562
+  },
+  {
+    "step": 384,
+    "loss": 2.1087937355041504
+  },
+  {
+    "step": 385,
+    "loss": 2.412994861602783
+  },
+  {
+    "step": 386,
+    "loss": 2.452765703201294
+  },
+  {
+    "step": 387,
+    "loss": 2.2612946033477783
+  },
+  {
+    "step": 388,
+    "loss": 2.9486331939697266
+  },
+  {
+    "step": 389,
+    "loss": 2.2730305194854736
+  },
+  {
+    "step": 390,
+    "loss": 2.526773691177368
+  },
+  {
+    "step": 391,
+    "loss": 2.397615909576416
+  },
+  {
+    "step": 392,
+    "loss": 2.3714022636413574
+  },
+  {
+    "step": 393,
+    "loss": 2.501068353652954
+  },
+  {
+    "step": 394,
+    "loss": 2.101055860519409
+  },
+  {
+    "step": 395,
+    "loss": 1.8332078456878662
+  },
+  {
+    "step": 396,
+    "loss": 2.620009183883667
+  },
+  {
+    "step": 397,
+    "loss": 2.6437087059020996
+  },
+  {
+    "step": 398,
+    "loss": 2.1969316005706787
+  },
+  {
+    "step": 399,
+    "loss": 2.578944444656372
+  },
+  {
+    "step": 400,
+    "loss": 2.8199615478515625
+  },
+  {
+    "step": 401,
+    "loss": 1.9555848836898804
+  },
+  {
+    "step": 402,
+    "loss": 2.3566293716430664
+  },
+  {
+    "step": 403,
+    "loss": 1.9274892807006836
+  },
+  {
+    "step": 404,
+    "loss": 2.3533687591552734
+  },
+  {
+    "step": 405,
+    "loss": 2.3114140033721924
+  },
+  {
+    "step": 406,
+    "loss": 2.3387277126312256
+  },
+  {
+    "step": 407,
+    "loss": 2.3504040241241455
+  },
+  {
+    "step": 408,
+    "loss": 2.694427490234375
+  },
+  {
+    "step": 409,
+    "loss": 2.370358467102051
+  },
+  {
+    "step": 410,
+    "loss": 1.8371087312698364
+  },
+  {
+    "step": 411,
+    "loss": 2.34598970413208
+  },
+  {
+    "step": 412,
+    "loss": 2.001140832901001
+  },
+  {
+    "step": 413,
+    "loss": 2.0652122497558594
+  },
+  {
+    "step": 414,
+    "loss": 2.631736993789673
+  },
+  {
+    "step": 415,
+    "loss": 2.3046376705169678
+  },
+  {
+    "step": 416,
+    "loss": 2.365978240966797
+  },
+  {
+    "step": 417,
+    "loss": 2.047502040863037
+  },
+  {
+    "step": 418,
+    "loss": 2.6210899353027344
+  },
+  {
+    "step": 419,
+    "loss": 2.1412880420684814
+  },
+  {
+    "step": 420,
+    "loss": 2.2439045906066895
+  },
+  {
+    "step": 421,
+    "loss": 2.1576952934265137
+  },
+  {
+    "step": 422,
+    "loss": 2.051438331604004
+  },
+  {
+    "step": 423,
+    "loss": 2.0313544273376465
+  },
+  {
+    "step": 424,
+    "loss": 3.118997573852539
+  },
+  {
+    "step": 425,
+    "loss": 2.471263885498047
+  },
+  {
+    "step": 426,
+    "loss": 1.698156714439392
+  },
+  {
+    "step": 427,
+    "loss": 2.799497365951538
+  },
+  {
+    "step": 428,
+    "loss": 2.1427876949310303
+  },
+  {
+    "step": 429,
+    "loss": 2.820594549179077
+  },
+  {
+    "step": 430,
+    "loss": 1.9575327634811401
+  },
+  {
+    "step": 431,
+    "loss": 2.6089365482330322
+  },
+  {
+    "step": 432,
+    "loss": 2.0574324131011963
+  },
+  {
+    "step": 433,
+    "loss": 2.868596315383911
+  },
+  {
+    "step": 434,
+    "loss": 2.1540873050689697
+  },
+  {
+    "step": 435,
+    "loss": 2.039017677307129
+  },
+  {
+    "step": 436,
+    "loss": 2.4460833072662354
+  },
+  {
+    "step": 437,
+    "loss": 2.5863380432128906
+  },
+  {
+    "step": 438,
+    "loss": 2.5211329460144043
+  },
+  {
+    "step": 439,
+    "loss": 2.0439255237579346
+  },
+  {
+    "step": 440,
+    "loss": 2.083531141281128
+  },
+  {
+    "step": 441,
+    "loss": 2.2036032676696777
+  },
+  {
+    "step": 442,
+    "loss": 2.1617541313171387
+  },
+  {
+    "step": 443,
+    "loss": 2.2706785202026367
+  },
+  {
+    "step": 444,
+    "loss": 2.3687477111816406
+  },
+  {
+    "step": 445,
+    "loss": 2.1419553756713867
+  },
+  {
+    "step": 446,
+    "loss": 2.3326170444488525
+  },
+  {
+    "step": 447,
+    "loss": 2.0808708667755127
+  },
+  {
+    "step": 448,
+    "loss": 2.309194803237915
+  },
+  {
+    "step": 449,
+    "loss": 2.8360342979431152
+  },
+  {
+    "step": 450,
+    "loss": 2.3126049041748047
+  },
+  {
+    "step": 451,
+    "loss": 2.2485318183898926
+  },
+  {
+    "step": 452,
+    "loss": 2.6139726638793945
+  },
+  {
+    "step": 453,
+    "loss": 2.174654483795166
+  },
+  {
+    "step": 454,
+    "loss": 2.4408035278320312
+  },
+  {
+    "step": 455,
+    "loss": 2.3054635524749756
+  },
+  {
+    "step": 456,
+    "loss": 2.500479221343994
+  },
+  {
+    "step": 457,
+    "loss": 2.712820053100586
+  },
+  {
+    "step": 458,
+    "loss": 2.3475780487060547
+  },
+  {
+    "step": 459,
+    "loss": 2.476759910583496
+  },
+  {
+    "step": 460,
+    "loss": 2.163086175918579
+  },
+  {
+    "step": 461,
+    "loss": 2.1306872367858887
+  },
+  {
+    "step": 462,
+    "loss": 2.569213390350342
+  },
+  {
+    "step": 463,
+    "loss": 1.9032127857208252
+  },
+  {
+    "step": 464,
+    "loss": 2.670799493789673
+  },
+  {
+    "step": 465,
+    "loss": 2.116924285888672
+  },
+  {
+    "step": 466,
+    "loss": 2.200054883956909
+  },
+  {
+    "step": 467,
+    "loss": 2.726794719696045
+  },
+  {
+    "step": 468,
+    "loss": 2.4743218421936035
+  },
+  {
+    "step": 469,
+    "loss": 2.1093218326568604
+  },
+  {
+    "step": 470,
+    "loss": 1.994795322418213
+  },
+  {
+    "step": 471,
+    "loss": 2.4643502235412598
+  },
+  {
+    "step": 472,
+    "loss": 2.4895074367523193
+  },
+  {
+    "step": 473,
+    "loss": 2.212019920349121
+  },
+  {
+    "step": 474,
+    "loss": 1.9118317365646362
+  },
+  {
+    "step": 475,
+    "loss": 1.9181571006774902
+  },
+  {
+    "step": 476,
+    "loss": 2.6781809329986572
+  },
+  {
+    "step": 477,
+    "loss": 1.9821468591690063
+  },
+  {
+    "step": 478,
+    "loss": 2.641598701477051
+  },
+  {
+    "step": 479,
+    "loss": 2.110565185546875
+  },
+  {
+    "step": 480,
+    "loss": 2.528163194656372
+  },
+  {
+    "step": 481,
+    "loss": 2.2186732292175293
+  },
+  {
+    "step": 482,
+    "loss": 1.94599187374115
+  },
+  {
+    "step": 483,
+    "loss": 2.3718581199645996
+  },
+  {
+    "step": 484,
+    "loss": 2.222639560699463
+  },
+  {
+    "step": 485,
+    "loss": 2.4093661308288574
+  },
+  {
+    "step": 486,
+    "loss": 2.54209041595459
+  },
+  {
+    "step": 487,
+    "loss": 2.024200201034546
+  },
+  {
+    "step": 488,
+    "loss": 2.5153119564056396
+  },
+  {
+    "step": 489,
+    "loss": 1.658121943473816
+  },
+  {
+    "step": 490,
+    "loss": 2.2563576698303223
+  },
+  {
+    "step": 491,
+    "loss": 2.3844380378723145
+  },
+  {
+    "step": 492,
+    "loss": 2.1449241638183594
+  },
+  {
+    "step": 493,
+    "loss": 2.2108402252197266
+  },
+  {
+    "step": 494,
+    "loss": 2.344649314880371
+  },
+  {
+    "step": 495,
+    "loss": 2.548719644546509
+  },
+  {
+    "step": 496,
+    "loss": 1.7746530771255493
+  },
+  {
+    "step": 497,
+    "loss": 2.309767246246338
+  },
+  {
+    "step": 498,
+    "loss": 2.0731115341186523
+  },
+  {
+    "step": 499,
+    "loss": 2.5398313999176025
+  },
+  {
+    "step": 500,
+    "loss": 2.091824769973755
+  },
+  {
+    "step": 501,
+    "loss": 1.9239593744277954
+  },
+  {
+    "step": 502,
+    "loss": 1.9768168926239014
+  },
+  {
+    "step": 503,
+    "loss": 2.260188341140747
+  },
+  {
+    "step": 504,
+    "loss": 2.553421974182129
+  },
+  {
+    "step": 505,
+    "loss": 2.4699223041534424
+  },
+  {
+    "step": 506,
+    "loss": 2.630557060241699
+  },
+  {
+    "step": 507,
+    "loss": 2.0340492725372314
+  },
+  {
+    "step": 508,
+    "loss": 2.028682231903076
+  },
+  {
+    "step": 509,
+    "loss": 2.45908260345459
+  },
+  {
+    "step": 510,
+    "loss": 2.2142536640167236
+  },
+  {
+    "step": 511,
+    "loss": 2.4662668704986572
+  },
+  {
+    "step": 512,
+    "loss": 2.27579927444458
+  },
+  {
+    "step": 513,
+    "loss": 2.2575185298919678
+  },
+  {
+    "step": 514,
+    "loss": 2.6080620288848877
+  },
+  {
+    "step": 515,
+    "loss": 2.5972297191619873
+  },
+  {
+    "step": 516,
+    "loss": 2.1600301265716553
+  },
+  {
+    "step": 517,
+    "loss": 1.9268064498901367
+  },
+  {
+    "step": 518,
+    "loss": 2.278988838195801
+  },
+  {
+    "step": 519,
+    "loss": 2.4084134101867676
+  },
+  {
+    "step": 520,
+    "loss": 2.7133266925811768
+  },
+  {
+    "step": 521,
+    "loss": 2.123317003250122
+  },
+  {
+    "step": 522,
+    "loss": 2.0050742626190186
+  },
+  {
+    "step": 523,
+    "loss": 2.311730146408081
+  },
+  {
+    "step": 524,
+    "loss": 2.100144624710083
+  },
+  {
+    "step": 525,
+    "loss": 2.182567834854126
+  },
+  {
+    "step": 526,
+    "loss": 2.6850223541259766
+  },
+  {
+    "step": 527,
+    "loss": 2.64558482170105
+  },
+  {
+    "step": 528,
+    "loss": 2.065207004547119
+  },
+  {
+    "step": 529,
+    "loss": 2.57641339302063
+  },
+  {
+    "step": 530,
+    "loss": 2.37033748626709
+  },
+  {
+    "step": 531,
+    "loss": 2.3202273845672607
+  },
+  {
+    "step": 532,
+    "loss": 2.5949063301086426
+  },
+  {
+    "step": 533,
+    "loss": 2.621664047241211
+  },
+  {
+    "step": 534,
+    "loss": 2.4353041648864746
+  },
+  {
+    "step": 535,
+    "loss": 2.0931382179260254
+  },
+  {
+    "step": 536,
+    "loss": 2.1506476402282715
+  },
+  {
+    "step": 537,
+    "loss": 2.0098910331726074
+  },
+  {
+    "step": 538,
+    "loss": 1.8340765237808228
+  },
+  {
+    "step": 539,
+    "loss": 2.3008437156677246
+  },
+  {
+    "step": 540,
+    "loss": 2.4273364543914795
+  },
+  {
+    "step": 541,
+    "loss": 2.4804060459136963
+  },
+  {
+    "step": 542,
+    "loss": 2.25795841217041
+  },
+  {
+    "step": 543,
+    "loss": 2.357149600982666
+  },
+  {
+    "step": 544,
+    "loss": 2.1500396728515625
+  },
+  {
+    "step": 545,
+    "loss": 2.459463596343994
+  },
+  {
+    "step": 546,
+    "loss": 2.2286086082458496
+  },
+  {
+    "step": 547,
+    "loss": 2.4219624996185303
+  },
+  {
+    "step": 548,
+    "loss": 2.686821222305298
+  },
+  {
+    "step": 549,
+    "loss": 2.2649004459381104
+  },
+  {
+    "step": 550,
+    "loss": 2.307349920272827
+  },
+  {
+    "step": 551,
+    "loss": 1.8991062641143799
+  },
+  {
+    "step": 552,
+    "loss": 1.9229987859725952
+  },
+  {
+    "step": 553,
+    "loss": 2.5056543350219727
+  },
+  {
+    "step": 554,
+    "loss": 2.1609060764312744
+  },
+  {
+    "step": 555,
+    "loss": 1.9778512716293335
+  },
+  {
+    "step": 556,
+    "loss": 2.471957206726074
+  },
+  {
+    "step": 557,
+    "loss": 1.8614418506622314
+  },
+  {
+    "step": 558,
+    "loss": 2.335939884185791
+  },
+  {
+    "step": 559,
+    "loss": 1.712602972984314
+  },
+  {
+    "step": 560,
+    "loss": 2.4900341033935547
+  },
+  {
+    "step": 561,
+    "loss": 2.3448946475982666
+  },
+  {
+    "step": 562,
+    "loss": 2.333690643310547
+  },
+  {
+    "step": 563,
+    "loss": 2.3033447265625
+  },
+  {
+    "step": 564,
+    "loss": 1.985489010810852
+  },
+  {
+    "step": 565,
+    "loss": 2.1400845050811768
+  },
+  {
+    "step": 566,
+    "loss": 2.6713786125183105
+  },
+  {
+    "step": 567,
+    "loss": 2.2288951873779297
+  },
+  {
+    "step": 568,
+    "loss": 1.8685835599899292
+  },
+  {
+    "step": 569,
+    "loss": 1.8806357383728027
+  },
+  {
+    "step": 570,
+    "loss": 2.147825241088867
+  },
+  {
+    "step": 571,
+    "loss": 1.928283452987671
+  },
+  {
+    "step": 572,
+    "loss": 1.8230233192443848
+  },
+  {
+    "step": 573,
+    "loss": 1.8360440731048584
+  },
+  {
+    "step": 574,
+    "loss": 2.6959915161132812
+  },
+  {
+    "step": 575,
+    "loss": 1.9693267345428467
+  },
+  {
+    "step": 576,
+    "loss": 2.7600269317626953
+  },
+  {
+    "step": 577,
+    "loss": 2.2720563411712646
+  },
+  {
+    "step": 578,
+    "loss": 2.299776077270508
+  },
+  {
+    "step": 579,
+    "loss": 2.212860584259033
+  },
+  {
+    "step": 580,
+    "loss": 2.3061680793762207
+  },
+  {
+    "step": 581,
+    "loss": 2.2603089809417725
+  },
+  {
+    "step": 582,
+    "loss": 2.0869574546813965
+  },
+  {
+    "step": 583,
+    "loss": 2.23502254486084
+  },
+  {
+    "step": 584,
+    "loss": 2.2090988159179688
+  },
+  {
+    "step": 585,
+    "loss": 2.244767427444458
+  },
+  {
+    "step": 586,
+    "loss": 2.256420135498047
+  },
+  {
+    "step": 587,
+    "loss": 1.9098711013793945
+  },
+  {
+    "step": 588,
+    "loss": 2.3755404949188232
+  },
+  {
+    "step": 589,
+    "loss": 2.6855807304382324
+  },
+  {
+    "step": 590,
+    "loss": 2.460073471069336
+  },
+  {
+    "step": 591,
+    "loss": 1.8837049007415771
+  },
+  {
+    "step": 592,
+    "loss": 2.081373929977417
+  },
+  {
+    "step": 593,
+    "loss": 2.1925439834594727
+  },
+  {
+    "step": 594,
+    "loss": 1.9564194679260254
+  },
+  {
+    "step": 595,
+    "loss": 2.205615758895874
+  },
+  {
+    "step": 596,
+    "loss": 2.478692054748535
+  },
+  {
+    "step": 597,
+    "loss": 2.0080032348632812
+  },
+  {
+    "step": 598,
+    "loss": 2.469820976257324
+  },
+  {
+    "step": 599,
+    "loss": 1.8856621980667114
+  },
+  {
+    "step": 600,
+    "loss": 1.6023671627044678
+  },
+  {
+    "step": 601,
+    "loss": 2.1479015350341797
+  },
+  {
+    "step": 602,
+    "loss": 2.306637763977051
+  },
+  {
+    "step": 603,
+    "loss": 2.2650392055511475
+  },
+  {
+    "step": 604,
+    "loss": 2.517967939376831
+  },
+  {
+    "step": 605,
+    "loss": 2.248115062713623
+  },
+  {
+    "step": 606,
+    "loss": 2.1899242401123047
+  },
+  {
+    "step": 607,
+    "loss": 2.3952863216400146
+  },
+  {
+    "step": 608,
+    "loss": 2.0763449668884277
+  },
+  {
+    "step": 609,
+    "loss": 2.3016607761383057
+  },
+  {
+    "step": 610,
+    "loss": 2.283357858657837
+  },
+  {
+    "step": 611,
+    "loss": 1.9581166505813599
+  },
+  {
+    "step": 612,
+    "loss": 2.4603822231292725
+  },
+  {
+    "step": 613,
+    "loss": 2.20369553565979
+  },
+  {
+    "step": 614,
+    "loss": 2.3975698947906494
+  },
+  {
+    "step": 615,
+    "loss": 2.3169641494750977
+  },
+  {
+    "step": 616,
+    "loss": 2.176382303237915
+  },
+  {
+    "step": 617,
+    "loss": 2.343982219696045
+  },
+  {
+    "step": 618,
+    "loss": 1.8763999938964844
+  },
+  {
+    "step": 619,
+    "loss": 2.083078384399414
+  },
+  {
+    "step": 620,
+    "loss": 1.902529239654541
+  },
+  {
+    "step": 621,
+    "loss": 2.0607450008392334
+  },
+  {
+    "step": 622,
+    "loss": 2.078382730484009
+  },
+  {
+    "step": 623,
+    "loss": 2.4523744583129883
+  },
+  {
+    "step": 624,
+    "loss": 2.1366493701934814
+  },
+  {
+    "step": 625,
+    "loss": 2.0985474586486816
+  },
+  {
+    "step": 626,
+    "loss": 2.5543007850646973
+  },
+  {
+    "step": 627,
+    "loss": 2.5027101039886475
+  },
+  {
+    "step": 628,
+    "loss": 2.8813798427581787
+  },
+  {
+    "step": 629,
+    "loss": 2.3890798091888428
+  },
+  {
+    "step": 630,
+    "loss": 1.9115877151489258
+  },
+  {
+    "step": 631,
+    "loss": 1.8879164457321167
+  },
+  {
+    "step": 632,
+    "loss": 2.415476083755493
+  },
+  {
+    "step": 633,
+    "loss": 2.3512673377990723
+  },
+  {
+    "step": 634,
+    "loss": 2.330165147781372
+  },
+  {
+    "step": 635,
+    "loss": 2.368882179260254
+  },
+  {
+    "step": 636,
+    "loss": 1.8848557472229004
+  },
+  {
+    "step": 637,
+    "loss": 2.5454752445220947
+  },
+  {
+    "step": 638,
+    "loss": 2.4458537101745605
+  },
+  {
+    "step": 639,
+    "loss": 2.3046398162841797
+  },
+  {
+    "step": 640,
+    "loss": 2.293977737426758
+  },
+  {
+    "step": 641,
+    "loss": 2.0221903324127197
+  },
+  {
+    "step": 642,
+    "loss": 1.678128719329834
+  },
+  {
+    "step": 643,
+    "loss": 2.55545711517334
+  },
+  {
+    "step": 644,
+    "loss": 2.0510752201080322
+  },
+  {
+    "step": 645,
+    "loss": 1.8273422718048096
+  },
+  {
+    "step": 646,
+    "loss": 2.4667928218841553
+  },
+  {
+    "step": 647,
+    "loss": 2.062159538269043
+  },
+  {
+    "step": 648,
+    "loss": 1.8708369731903076
+  },
+  {
+    "step": 649,
+    "loss": 1.8367586135864258
+  },
+  {
+    "step": 650,
+    "loss": 2.3304603099823
+  },
+  {
+    "step": 651,
+    "loss": 2.2214672565460205
+  },
+  {
+    "step": 652,
+    "loss": 2.156398057937622
+  },
+  {
+    "step": 653,
+    "loss": 1.802478551864624
+  },
+  {
+    "step": 654,
+    "loss": 2.1194801330566406
+  },
+  {
+    "step": 655,
+    "loss": 1.832618236541748
+  },
+  {
+    "step": 656,
+    "loss": 2.7607004642486572
+  },
+  {
+    "step": 657,
+    "loss": 1.5378355979919434
+  },
+  {
+    "step": 658,
+    "loss": 2.871095895767212
+  },
+  {
+    "step": 659,
+    "loss": 2.1772589683532715
+  },
+  {
+    "step": 660,
+    "loss": 2.378739356994629
+  },
+  {
+    "step": 661,
+    "loss": 1.9543912410736084
+  },
+  {
+    "step": 662,
+    "loss": 1.7253490686416626
+  },
+  {
+    "step": 663,
+    "loss": 2.3326663970947266
+  },
+  {
+    "step": 664,
+    "loss": 2.0331671237945557
+  },
+  {
+    "step": 665,
+    "loss": 2.8661580085754395
+  },
+  {
+    "step": 666,
+    "loss": 2.4486398696899414
+  },
+  {
+    "step": 667,
+    "loss": 2.2856521606445312
+  },
+  {
+    "step": 668,
+    "loss": 2.0959157943725586
+  },
+  {
+    "step": 669,
+    "loss": 1.828498363494873
+  },
+  {
+    "step": 670,
+    "loss": 2.580878257751465
+  },
+  {
+    "step": 671,
+    "loss": 2.111854076385498
+  },
+  {
+    "step": 672,
+    "loss": 2.3081603050231934
+  },
+  {
+    "step": 673,
+    "loss": 2.1535303592681885
+  },
+  {
+    "step": 674,
+    "loss": 2.4697322845458984
+  },
+  {
+    "step": 675,
+    "loss": 1.8599785566329956
+  },
+  {
+    "step": 676,
+    "loss": 2.156494140625
+  },
+  {
+    "step": 677,
+    "loss": 2.1473135948181152
+  },
+  {
+    "step": 678,
+    "loss": 1.5099081993103027
+  },
+  {
+    "step": 679,
+    "loss": 2.241101026535034
+  },
+  {
+    "step": 680,
+    "loss": 2.242471694946289
+  },
+  {
+    "step": 681,
+    "loss": 2.042699098587036
+  },
+  {
+    "step": 682,
+    "loss": 2.1123008728027344
+  },
+  {
+    "step": 683,
+    "loss": 2.017486095428467
+  },
+  {
+    "step": 684,
+    "loss": 2.0131030082702637
+  },
+  {
+    "step": 685,
+    "loss": 1.8260565996170044
+  },
+  {
+    "step": 686,
+    "loss": 1.8099098205566406
+  },
+  {
+    "step": 687,
+    "loss": 1.9493796825408936
+  },
+  {
+    "step": 688,
+    "loss": 1.7958455085754395
+  },
+  {
+    "step": 689,
+    "loss": 2.12551212310791
+  },
+  {
+    "step": 690,
+    "loss": 1.8851398229599
+  },
+  {
+    "step": 691,
+    "loss": 2.169377326965332
+  },
+  {
+    "step": 692,
+    "loss": 2.345599412918091
+  },
+  {
+    "step": 693,
+    "loss": 2.6371800899505615
+  },
+  {
+    "step": 694,
+    "loss": 2.054779291152954
+  },
+  {
+    "step": 695,
+    "loss": 1.8875532150268555
+  },
+  {
+    "step": 696,
+    "loss": 1.899794101715088
+  },
+  {
+    "step": 697,
+    "loss": 1.9862229824066162
+  },
+  {
+    "step": 698,
+    "loss": 2.069486141204834
+  },
+  {
+    "step": 699,
+    "loss": 2.5258560180664062
+  },
+  {
+    "step": 700,
+    "loss": 2.138136863708496
+  },
+  {
+    "step": 701,
+    "loss": 1.7787747383117676
+  },
+  {
+    "step": 702,
+    "loss": 2.3944613933563232
+  },
+  {
+    "step": 703,
+    "loss": 2.2432310581207275
+  },
+  {
+    "step": 704,
+    "loss": 2.23433780670166
+  },
+  {
+    "step": 705,
+    "loss": 2.3525569438934326
+  },
+  {
+    "step": 706,
+    "loss": 1.683660626411438
+  },
+  {
+    "step": 707,
+    "loss": 1.928051233291626
+  },
+  {
+    "step": 708,
+    "loss": 2.214559316635132
+  },
+  {
+    "step": 709,
+    "loss": 2.444596290588379
+  },
+  {
+    "step": 710,
+    "loss": 2.5637311935424805
+  },
+  {
+    "step": 711,
+    "loss": 2.094400405883789
+  },
+  {
+    "step": 712,
+    "loss": 2.1752796173095703
+  },
+  {
+    "step": 713,
+    "loss": 2.1646933555603027
+  },
+  {
+    "step": 714,
+    "loss": 2.3239498138427734
+  },
+  {
+    "step": 715,
+    "loss": 2.528728485107422
+  },
+  {
+    "step": 716,
+    "loss": 1.7567914724349976
+  },
+  {
+    "step": 717,
+    "loss": 1.8295328617095947
+  },
+  {
+    "step": 718,
+    "loss": 2.579841375350952
+  },
+  {
+    "step": 719,
+    "loss": 1.9017343521118164
+  },
+  {
+    "step": 720,
+    "loss": 2.507222890853882
+  },
+  {
+    "step": 721,
+    "loss": 2.127558946609497
+  },
+  {
+    "step": 722,
+    "loss": 2.1579627990722656
+  },
+  {
+    "step": 723,
+    "loss": 1.957413673400879
+  },
+  {
+    "step": 724,
+    "loss": 1.7173194885253906
+  },
+  {
+    "step": 725,
+    "loss": 1.8139698505401611
+  },
+  {
+    "step": 726,
+    "loss": 2.3142149448394775
+  },
+  {
+    "step": 727,
+    "loss": 2.4957833290100098
+  },
+  {
+    "step": 728,
+    "loss": 2.096470832824707
+  },
+  {
+    "step": 729,
+    "loss": 2.1391425132751465
+  },
+  {
+    "step": 730,
+    "loss": 2.0562264919281006
+  },
+  {
+    "step": 731,
+    "loss": 1.704184651374817
+  },
+  {
+    "step": 732,
+    "loss": 2.186826467514038
+  },
+  {
+    "step": 733,
+    "loss": 2.098335027694702
+  },
+  {
+    "step": 734,
+    "loss": 1.9378281831741333
+  },
+  {
+    "step": 735,
+    "loss": 1.9070260524749756
+  },
+  {
+    "step": 736,
+    "loss": 2.5211658477783203
+  },
+  {
+    "step": 737,
+    "loss": 1.8523521423339844
+  },
+  {
+    "step": 738,
+    "loss": 2.3545069694519043
+  },
+  {
+    "step": 739,
+    "loss": 1.715818166732788
+  },
+  {
+    "step": 740,
+    "loss": 1.9143247604370117
+  },
+  {
+    "step": 741,
+    "loss": 1.833640456199646
+  },
+  {
+    "step": 742,
+    "loss": 3.0031652450561523
+  },
+  {
+    "step": 743,
+    "loss": 1.5467760562896729
+  },
+  {
+    "step": 744,
+    "loss": 1.8195242881774902
+  },
+  {
+    "step": 745,
+    "loss": 1.785135269165039
+  },
+  {
+    "step": 746,
+    "loss": 2.0208964347839355
+  },
+  {
+    "step": 747,
+    "loss": 1.799407958984375
+  },
+  {
+    "step": 748,
+    "loss": 2.357728958129883
+  },
+  {
+    "step": 749,
+    "loss": 2.19157338142395
+  },
+  {
+    "step": 750,
+    "loss": 1.7044637203216553
+  },
+  {
+    "step": 751,
+    "loss": 2.1935999393463135
+  },
+  {
+    "step": 752,
+    "loss": 1.8042278289794922
+  },
+  {
+    "step": 753,
+    "loss": 2.340193271636963
+  },
+  {
+    "step": 754,
+    "loss": 1.8830957412719727
+  },
+  {
+    "step": 755,
+    "loss": 2.1636412143707275
+  },
+  {
+    "step": 756,
+    "loss": 2.573277473449707
+  },
+  {
+    "step": 757,
+    "loss": 2.185680866241455
+  },
+  {
+    "step": 758,
+    "loss": 2.005404472351074
+  },
+  {
+    "step": 759,
+    "loss": 2.041130304336548
+  },
+  {
+    "step": 760,
+    "loss": 2.069777250289917
+  },
+  {
+    "step": 761,
+    "loss": 1.942754864692688
+  },
+  {
+    "step": 762,
+    "loss": 2.273555278778076
+  },
+  {
+    "step": 763,
+    "loss": 1.8626675605773926
+  },
+  {
+    "step": 764,
+    "loss": 3.090045690536499
+  },
+  {
+    "step": 765,
+    "loss": 1.6991760730743408
+  },
+  {
+    "step": 766,
+    "loss": 1.9688661098480225
+  },
+  {
+    "step": 767,
+    "loss": 2.0735771656036377
+  },
+  {
+    "step": 768,
+    "loss": 1.9161018133163452
+  },
+  {
+    "step": 769,
+    "loss": 1.935367226600647
+  },
+  {
+    "step": 770,
+    "loss": 2.512490749359131
+  },
+  {
+    "step": 771,
+    "loss": 1.9653754234313965
+  },
+  {
+    "step": 772,
+    "loss": 1.9006037712097168
+  },
+  {
+    "step": 773,
+    "loss": 2.1403775215148926
+  },
+  {
+    "step": 774,
+    "loss": 1.9985692501068115
+  },
+  {
+    "step": 775,
+    "loss": 2.2423832416534424
+  },
+  {
+    "step": 776,
+    "loss": 2.272416114807129
+  },
+  {
+    "step": 777,
+    "loss": 1.6806894540786743
+  },
+  {
+    "step": 778,
+    "loss": 1.6961314678192139
+  },
+  {
+    "step": 779,
+    "loss": 2.070193290710449
+  },
+  {
+    "step": 780,
+    "loss": 2.30169415473938
+  },
+  {
+    "step": 781,
+    "loss": 1.498708963394165
+  },
+  {
+    "step": 782,
+    "loss": 2.672607898712158
+  },
+  {
+    "step": 783,
+    "loss": 2.000545024871826
+  },
+  {
+    "step": 784,
+    "loss": 2.1863222122192383
+  },
+  {
+    "step": 785,
+    "loss": 1.955033302307129
+  },
+  {
+    "step": 786,
+    "loss": 2.0105948448181152
+  },
+  {
+    "step": 787,
+    "loss": 2.3913588523864746
+  },
+  {
+    "step": 788,
+    "loss": 2.0229620933532715
+  },
+  {
+    "step": 789,
+    "loss": 2.0052614212036133
+  },
+  {
+    "step": 790,
+    "loss": 2.718447685241699
+  },
+  {
+    "step": 791,
+    "loss": 2.2307233810424805
+  },
+  {
+    "step": 792,
+    "loss": 2.1480185985565186
+  },
+  {
+    "step": 793,
+    "loss": 2.508347988128662
+  },
+  {
+    "step": 794,
+    "loss": 1.927217960357666
+  },
+  {
+    "step": 795,
+    "loss": 2.075195789337158
+  },
+  {
+    "step": 796,
+    "loss": 2.0269381999969482
+  },
+  {
+    "step": 797,
+    "loss": 1.7403855323791504
+  },
+  {
+    "step": 798,
+    "loss": 2.3028817176818848
+  },
+  {
+    "step": 799,
+    "loss": 2.2278242111206055
+  },
+  {
+    "step": 800,
+    "loss": 2.3212714195251465
+  },
+  {
+    "step": 801,
+    "loss": 2.1449832916259766
+  },
+  {
+    "step": 802,
+    "loss": 1.9621870517730713
+  },
+  {
+    "step": 803,
+    "loss": 2.1465606689453125
+  },
+  {
+    "step": 804,
+    "loss": 2.28023624420166
+  },
+  {
+    "step": 805,
+    "loss": 2.3931326866149902
+  },
+  {
+    "step": 806,
+    "loss": 1.9575012922286987
+  },
+  {
+    "step": 807,
+    "loss": 2.2189478874206543
+  },
+  {
+    "step": 808,
+    "loss": 2.313659906387329
+  },
+  {
+    "step": 809,
+    "loss": 1.785354495048523
+  },
+  {
+    "step": 810,
+    "loss": 2.360384941101074
+  },
+  {
+    "step": 811,
+    "loss": 1.5126988887786865
+  },
+  {
+    "step": 812,
+    "loss": 2.0700507164001465
+  },
+  {
+    "step": 813,
+    "loss": 2.364596128463745
+  },
+  {
+    "step": 814,
+    "loss": 1.7121427059173584
+  },
+  {
+    "step": 815,
+    "loss": 2.4048376083374023
+  },
+  {
+    "step": 816,
+    "loss": 2.1315109729766846
+  },
+  {
+    "step": 817,
+    "loss": 2.0960779190063477
+  },
+  {
+    "step": 818,
+    "loss": 2.1370670795440674
+  },
+  {
+    "step": 819,
+    "loss": 2.2387843132019043
+  },
+  {
+    "step": 820,
+    "loss": 2.6564176082611084
+  },
+  {
+    "step": 821,
+    "loss": 2.3899805545806885
+  },
+  {
+    "step": 822,
+    "loss": 1.8396912813186646
+  },
+  {
+    "step": 823,
+    "loss": 1.849434494972229
+  },
+  {
+    "step": 824,
+    "loss": 2.4848148822784424
+  },
+  {
+    "step": 825,
+    "loss": 2.300788640975952
+  },
+  {
+    "step": 826,
+    "loss": 1.6741901636123657
+  },
+  {
+    "step": 827,
+    "loss": 1.9888312816619873
+  },
+  {
+    "step": 828,
+    "loss": 2.1556782722473145
+  },
+  {
+    "step": 829,
+    "loss": 2.0511889457702637
+  },
+  {
+    "step": 830,
+    "loss": 2.110619068145752
+  },
+  {
+    "step": 831,
+    "loss": 1.8331103324890137
+  },
+  {
+    "step": 832,
+    "loss": 2.0915446281433105
+  },
+  {
+    "step": 833,
+    "loss": 1.3950932025909424
+  },
+  {
+    "step": 834,
+    "loss": 2.5744056701660156
+  },
+  {
+    "step": 835,
+    "loss": 2.351382255554199
+  },
+  {
+    "step": 836,
+    "loss": 2.207592248916626
+  },
+  {
+    "step": 837,
+    "loss": 2.0599913597106934
+  },
+  {
+    "step": 838,
+    "loss": 2.4455690383911133
+  },
+  {
+    "step": 839,
+    "loss": 2.037224769592285
+  },
+  {
+    "step": 840,
+    "loss": 2.1246533393859863
+  },
+  {
+    "step": 841,
+    "loss": 2.539519786834717
+  },
+  {
+    "step": 842,
+    "loss": 2.3089704513549805
+  },
+  {
+    "step": 843,
+    "loss": 1.8031303882598877
+  },
+  {
+    "step": 844,
+    "loss": 2.1725902557373047
+  },
+  {
+    "step": 845,
+    "loss": 1.9818854331970215
+  },
+  {
+    "step": 846,
+    "loss": 2.469529151916504
+  },
+  {
+    "step": 847,
+    "loss": 1.6893788576126099
+  },
+  {
+    "step": 848,
+    "loss": 1.9128904342651367
+  },
+  {
+    "step": 849,
+    "loss": 2.3154168128967285
+  },
+  {
+    "step": 850,
+    "loss": 1.864374041557312
+  },
+  {
+    "step": 851,
+    "loss": 2.139346122741699
+  },
+  {
+    "step": 852,
+    "loss": 1.9899048805236816
+  },
+  {
+    "step": 853,
+    "loss": 1.8425148725509644
+  },
+  {
+    "step": 854,
+    "loss": 2.196641445159912
+  },
+  {
+    "step": 855,
+    "loss": 2.084127187728882
+  },
+  {
+    "step": 856,
+    "loss": 2.589137077331543
+  },
+  {
+    "step": 857,
+    "loss": 1.9049241542816162
+  },
+  {
+    "step": 858,
+    "loss": 2.1088719367980957
+  },
+  {
+    "step": 859,
+    "loss": 1.8666791915893555
+  },
+  {
+    "step": 860,
+    "loss": 2.291273355484009
+  },
+  {
+    "step": 861,
+    "loss": 2.7720913887023926
+  },
+  {
+    "step": 862,
+    "loss": 2.0325875282287598
+  },
+  {
+    "step": 863,
+    "loss": 2.1262521743774414
+  },
+  {
+    "step": 864,
+    "loss": 2.1930947303771973
+  },
+  {
+    "step": 865,
+    "loss": 2.0483975410461426
+  },
+  {
+    "step": 866,
+    "loss": 2.1810200214385986
+  },
+  {
+    "step": 867,
+    "loss": 2.0406017303466797
+  },
+  {
+    "step": 868,
+    "loss": 1.9476172924041748
+  },
+  {
+    "step": 869,
+    "loss": 2.3409388065338135
+  },
+  {
+    "step": 870,
+    "loss": 2.2193973064422607
+  },
+  {
+    "step": 871,
+    "loss": 2.135343313217163
+  },
+  {
+    "step": 872,
+    "loss": 2.0815932750701904
+  },
+  {
+    "step": 873,
+    "loss": 2.2342116832733154
+  },
+  {
+    "step": 874,
+    "loss": 1.839571237564087
+  },
+  {
+    "step": 875,
+    "loss": 2.225438356399536
+  },
+  {
+    "step": 876,
+    "loss": 2.303863525390625
+  },
+  {
+    "step": 877,
+    "loss": 1.9251621961593628
+  },
+  {
+    "step": 878,
+    "loss": 2.1342930793762207
+  },
+  {
+    "step": 879,
+    "loss": 2.1234943866729736
+  },
+  {
+    "step": 880,
+    "loss": 2.137087821960449
+  },
+  {
+    "step": 881,
+    "loss": 1.9579668045043945
+  },
+  {
+    "step": 882,
+    "loss": 2.0309898853302
+  },
+  {
+    "step": 883,
+    "loss": 1.799654245376587
+  },
+  {
+    "step": 884,
+    "loss": 2.4847488403320312
+  },
+  {
+    "step": 885,
+    "loss": 2.6662018299102783
+  },
+  {
+    "step": 886,
+    "loss": 1.9268032312393188
+  },
+  {
+    "step": 887,
+    "loss": 2.043844223022461
+  },
+  {
+    "step": 888,
+    "loss": 2.038583278656006
+  },
+  {
+    "step": 889,
+    "loss": 2.393343925476074
+  },
+  {
+    "step": 890,
+    "loss": 2.155910015106201
+  },
+  {
+    "step": 891,
+    "loss": 2.047548532485962
+  },
+  {
+    "step": 892,
+    "loss": 2.4230449199676514
+  },
+  {
+    "step": 893,
+    "loss": 1.7401704788208008
+  },
+  {
+    "step": 894,
+    "loss": 2.0996835231781006
+  },
+  {
+    "step": 895,
+    "loss": 1.96319580078125
+  },
+  {
+    "step": 896,
+    "loss": 1.9458671808242798
+  },
+  {
+    "step": 897,
+    "loss": 2.0543224811553955
+  },
+  {
+    "step": 898,
+    "loss": 2.5579683780670166
+  },
+  {
+    "step": 899,
+    "loss": 2.102567434310913
+  },
+  {
+    "step": 900,
+    "loss": 1.797571063041687
+  },
+  {
+    "step": 901,
+    "loss": 2.612189292907715
+  },
+  {
+    "step": 902,
+    "loss": 1.8275275230407715
+  },
+  {
+    "step": 903,
+    "loss": 2.3661575317382812
+  },
+  {
+    "step": 904,
+    "loss": 2.412741184234619
+  },
+  {
+    "step": 905,
+    "loss": 1.7417240142822266
+  },
+  {
+    "step": 906,
+    "loss": 1.9783049821853638
+  },
+  {
+    "step": 907,
+    "loss": 3.020042896270752
+  },
+  {
+    "step": 908,
+    "loss": 2.264007568359375
+  },
+  {
+    "step": 909,
+    "loss": 2.6521012783050537
+  },
+  {
+    "step": 910,
+    "loss": 1.8450102806091309
+  },
+  {
+    "step": 911,
+    "loss": 2.0339226722717285
+  },
+  {
+    "step": 912,
+    "loss": 1.9741251468658447
+  },
+  {
+    "step": 913,
+    "loss": 2.638288736343384
+  },
+  {
+    "step": 914,
+    "loss": 2.128150463104248
+  },
+  {
+    "step": 915,
+    "loss": 2.2978391647338867
+  },
+  {
+    "step": 916,
+    "loss": 2.329345226287842
+  },
+  {
+    "step": 917,
+    "loss": 1.7687416076660156
+  },
+  {
+    "step": 918,
+    "loss": 1.7877784967422485
+  },
+  {
+    "step": 919,
+    "loss": 2.0238168239593506
+  },
+  {
+    "step": 920,
+    "loss": 2.0090293884277344
+  },
+  {
+    "step": 921,
+    "loss": 2.5923585891723633
+  },
+  {
+    "step": 922,
+    "loss": 2.2417752742767334
+  },
+  {
+    "step": 923,
+    "loss": 2.1116175651550293
+  },
+  {
+    "step": 924,
+    "loss": 1.826296091079712
+  },
+  {
+    "step": 925,
+    "loss": 1.888626217842102
+  },
+  {
+    "step": 926,
+    "loss": 1.9428234100341797
+  },
+  {
+    "step": 927,
+    "loss": 1.937356948852539
+  },
+  {
+    "step": 928,
+    "loss": 2.575594902038574
+  },
+  {
+    "step": 929,
+    "loss": 2.1356945037841797
+  },
+  {
+    "step": 930,
+    "loss": 2.0911166667938232
+  },
+  {
+    "step": 931,
+    "loss": 2.0979466438293457
+  },
+  {
+    "step": 932,
+    "loss": 2.5593225955963135
+  },
+  {
+    "step": 933,
+    "loss": 1.8475861549377441
+  },
+  {
+    "step": 934,
+    "loss": 1.9928505420684814
+  },
+  {
+    "step": 935,
+    "loss": 1.6050671339035034
+  },
+  {
+    "step": 936,
+    "loss": 2.3365602493286133
+  },
+  {
+    "step": 937,
+    "loss": 1.6974786520004272
+  },
+  {
+    "step": 938,
+    "loss": 2.5650625228881836
+  },
+  {
+    "step": 939,
+    "loss": 2.400352954864502
+  },
+  {
+    "step": 940,
+    "loss": 2.04494571685791
+  },
+  {
+    "step": 941,
+    "loss": 1.9382586479187012
+  },
+  {
+    "step": 942,
+    "loss": 2.147663116455078
+  },
+  {
+    "step": 943,
+    "loss": 1.8787052631378174
+  },
+  {
+    "step": 944,
+    "loss": 2.428316593170166
+  },
+  {
+    "step": 945,
+    "loss": 2.1108169555664062
+  },
+  {
+    "step": 946,
+    "loss": 1.6542246341705322
+  },
+  {
+    "step": 947,
+    "loss": 2.0597152709960938
+  },
+  {
+    "step": 948,
+    "loss": 2.3472602367401123
+  },
+  {
+    "step": 949,
+    "loss": 1.8338260650634766
+  },
+  {
+    "step": 950,
+    "loss": 1.7510230541229248
+  },
+  {
+    "step": 951,
+    "loss": 1.7876065969467163
+  },
+  {
+    "step": 952,
+    "loss": 2.431952714920044
+  },
+  {
+    "step": 953,
+    "loss": 1.9844751358032227
+  },
+  {
+    "step": 954,
+    "loss": 1.6035586595535278
+  },
+  {
+    "step": 955,
+    "loss": 2.2497174739837646
+  },
+  {
+    "step": 956,
+    "loss": 2.1397483348846436
+  },
+  {
+    "step": 957,
+    "loss": 2.418480396270752
+  },
+  {
+    "step": 958,
+    "loss": 2.0681729316711426
+  },
+  {
+    "step": 959,
+    "loss": 2.1492745876312256
+  },
+  {
+    "step": 960,
+    "loss": 2.292433023452759
+  },
+  {
+    "step": 961,
+    "loss": 1.993412733078003
+  },
+  {
+    "step": 962,
+    "loss": 1.9851655960083008
+  },
+  {
+    "step": 963,
+    "loss": 2.1893622875213623
+  },
+  {
+    "step": 964,
+    "loss": 2.258875608444214
+  },
+  {
+    "step": 965,
+    "loss": 2.1283998489379883
+  },
+  {
+    "step": 966,
+    "loss": 1.8134756088256836
+  },
+  {
+    "step": 967,
+    "loss": 1.8318551778793335
+  },
+  {
+    "step": 968,
+    "loss": 2.4340434074401855
+  },
+  {
+    "step": 969,
+    "loss": 1.9633982181549072
+  },
+  {
+    "step": 970,
+    "loss": 2.085658311843872
+  },
+  {
+    "step": 971,
+    "loss": 1.3723973035812378
+  },
+  {
+    "step": 972,
+    "loss": 3.041292667388916
+  },
+  {
+    "step": 973,
+    "loss": 2.3183510303497314
+  },
+  {
+    "step": 974,
+    "loss": 1.9262609481811523
+  },
+  {
+    "step": 975,
+    "loss": 2.1205694675445557
+  },
+  {
+    "step": 976,
+    "loss": 1.4980692863464355
+  },
+  {
+    "step": 977,
+    "loss": 2.5546534061431885
+  },
+  {
+    "step": 978,
+    "loss": 2.7014734745025635
+  },
+  {
+    "step": 979,
+    "loss": 1.676489233970642
+  },
+  {
+    "step": 980,
+    "loss": 1.5694572925567627
+  },
+  {
+    "step": 981,
+    "loss": 2.120713233947754
+  },
+  {
+    "step": 982,
+    "loss": 2.21758770942688
+  },
+  {
+    "step": 983,
+    "loss": 1.9932773113250732
+  },
+  {
+    "step": 984,
+    "loss": 2.172217607498169
+  },
+  {
+    "step": 985,
+    "loss": 1.980347990989685
+  },
+  {
+    "step": 986,
+    "loss": 2.1737043857574463
+  },
+  {
+    "step": 987,
+    "loss": 2.1837902069091797
+  },
+  {
+    "step": 988,
+    "loss": 1.7776117324829102
+  },
+  {
+    "step": 989,
+    "loss": 2.1192994117736816
+  },
+  {
+    "step": 990,
+    "loss": 1.7178640365600586
+  },
+  {
+    "step": 991,
+    "loss": 2.1105740070343018
+  },
+  {
+    "step": 992,
+    "loss": 1.9493019580841064
+  },
+  {
+    "step": 993,
+    "loss": 2.4504644870758057
+  },
+  {
+    "step": 994,
+    "loss": 2.0112550258636475
+  },
+  {
+    "step": 995,
+    "loss": 2.2686667442321777
+  },
+  {
+    "step": 996,
+    "loss": 2.4370152950286865
+  },
+  {
+    "step": 997,
+    "loss": 1.8057717084884644
+  },
+  {
+    "step": 998,
+    "loss": 1.7339015007019043
+  },
+  {
+    "step": 999,
+    "loss": 1.915513038635254
+  }
+]
diff --git a/lecture_6/verified_examples/diamond/config.json b/lecture_6/verified_examples/diamond/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..6e94cb6425640252d5a74337da1e3a1a5ed1e29f
--- /dev/null
+++ b/lecture_6/verified_examples/diamond/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "diamond",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/diamond"
+}
diff --git a/lecture_6/verified_examples/diamond/losses.json b/lecture_6/verified_examples/diamond/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..c2096304763db226d144efeb3ac30c0dc3a8c76d
--- /dev/null
+++ b/lecture_6/verified_examples/diamond/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.080327272415161,
+    "diagonal": 2.056464433670044,
+    "finite": 5.965699195861816
+  },
+  {
+    "step": 1,
+    "loss": 1.8715240955352783,
+    "diagonal": 1.8342814445495605,
+    "finite": 4.655324935913086
+  },
+  {
+    "step": 2,
+    "loss": 2.9865360260009766,
+    "diagonal": 2.915417432785034,
+    "finite": 5.926540374755859
+  },
+  {
+    "step": 3,
+    "loss": 2.1039342880249023,
+    "diagonal": 2.020564079284668,
+    "finite": 5.21063232421875
+  },
+  {
+    "step": 4,
+    "loss": 1.8709266185760498,
+    "diagonal": 1.7710766792297363,
+    "finite": 4.992499828338623
+  },
+  {
+    "step": 5,
+    "loss": 1.8860721588134766,
+    "diagonal": 1.7783820629119873,
+    "finite": 4.487088203430176
+  },
+  {
+    "step": 6,
+    "loss": 2.367471694946289,
+    "diagonal": 2.212195634841919,
+    "finite": 5.545575141906738
+  },
+  {
+    "step": 7,
+    "loss": 2.110466718673706,
+    "diagonal": 1.899509072303772,
+    "finite": 6.592423439025879
+  },
+  {
+    "step": 8,
+    "loss": 2.7838892936706543,
+    "diagonal": 2.5764899253845215,
+    "finite": 5.761096477508545
+  },
+  {
+    "step": 9,
+    "loss": 2.50335955619812,
+    "diagonal": 2.301736354827881,
+    "finite": 5.040578365325928
+  },
+  {
+    "step": 10,
+    "loss": 2.4258296489715576,
+    "diagonal": 2.205160140991211,
+    "finite": 5.015215873718262
+  },
+  {
+    "step": 11,
+    "loss": 2.031750202178955,
+    "diagonal": 1.7775309085845947,
+    "finite": 5.296234130859375
+  },
+  {
+    "step": 12,
+    "loss": 2.4716742038726807,
+    "diagonal": 2.179248809814453,
+    "finite": 5.623564720153809
+  },
+  {
+    "step": 13,
+    "loss": 2.544217586517334,
+    "diagonal": 2.1976702213287354,
+    "finite": 6.188347339630127
+  },
+  {
+    "step": 14,
+    "loss": 2.519691228866577,
+    "diagonal": 2.14823317527771,
+    "finite": 6.190966606140137
+  },
+  {
+    "step": 15,
+    "loss": 2.476119041442871,
+    "diagonal": 2.126493453979492,
+    "finite": 5.4629011154174805
+  },
+  {
+    "step": 16,
+    "loss": 2.0146560668945312,
+    "diagonal": 1.751603126525879,
+    "finite": 3.8684237003326416
+  },
+  {
+    "step": 17,
+    "loss": 2.280181407928467,
+    "diagonal": 1.8986132144927979,
+    "finite": 5.299557685852051
+  },
+  {
+    "step": 18,
+    "loss": 2.137885093688965,
+    "diagonal": 1.792881965637207,
+    "finite": 4.539514064788818
+  },
+  {
+    "step": 19,
+    "loss": 2.540311813354492,
+    "diagonal": 1.8699058294296265,
+    "finite": 8.380075454711914
+  },
+  {
+    "step": 20,
+    "loss": 1.807712197303772,
+    "diagonal": 1.5028796195983887,
+    "finite": 3.6289589405059814
+  },
+  {
+    "step": 21,
+    "loss": 2.966386556625366,
+    "diagonal": 2.3949224948883057,
+    "finite": 6.49390983581543
+  },
+  {
+    "step": 22,
+    "loss": 2.238159418106079,
+    "diagonal": 1.9151029586791992,
+    "finite": 3.5114831924438477
+  },
+  {
+    "step": 23,
+    "loss": 2.297393321990967,
+    "diagonal": 1.9416476488113403,
+    "finite": 3.705684185028076
+  },
+  {
+    "step": 24,
+    "loss": 2.4061946868896484,
+    "diagonal": 1.777160406112671,
+    "finite": 6.290343284606934
+  },
+  {
+    "step": 25,
+    "loss": 2.502042293548584,
+    "diagonal": 1.8165645599365234,
+    "finite": 6.591132640838623
+  },
+  {
+    "step": 26,
+    "loss": 2.254347085952759,
+    "diagonal": 1.7690680027008057,
+    "finite": 4.493325233459473
+  },
+  {
+    "step": 27,
+    "loss": 1.9266891479492188,
+    "diagonal": 1.327656626701355,
+    "finite": 5.348505020141602
+  },
+  {
+    "step": 28,
+    "loss": 2.059523820877075,
+    "diagonal": 1.5828306674957275,
+    "finite": 4.109424591064453
+  },
+  {
+    "step": 29,
+    "loss": 1.9558680057525635,
+    "diagonal": 1.3787559270858765,
+    "finite": 4.809267997741699
+  },
+  {
+    "step": 30,
+    "loss": 2.3176729679107666,
+    "diagonal": 1.7975150346755981,
+    "finite": 4.194822788238525
+  },
+  {
+    "step": 31,
+    "loss": 2.0186004638671875,
+    "diagonal": 1.585619330406189,
+    "finite": 3.3826658725738525
+  },
+  {
+    "step": 32,
+    "loss": 1.9400081634521484,
+    "diagonal": 1.4087971448898315,
+    "finite": 4.024325847625732
+  },
+  {
+    "step": 33,
+    "loss": 1.8950978517532349,
+    "diagonal": 1.460667610168457,
+    "finite": 3.1943397521972656
+  },
+  {
+    "step": 34,
+    "loss": 2.1946959495544434,
+    "diagonal": 1.6952846050262451,
+    "finite": 3.5672237873077393
+  },
+  {
+    "step": 35,
+    "loss": 2.0139989852905273,
+    "diagonal": 1.3908246755599976,
+    "finite": 4.327599048614502
+  },
+  {
+    "step": 36,
+    "loss": 2.088778257369995,
+    "diagonal": 1.4551743268966675,
+    "finite": 4.2811079025268555
+  },
+  {
+    "step": 37,
+    "loss": 1.9851064682006836,
+    "diagonal": 1.515373706817627,
+    "finite": 3.0903468132019043
+  },
+  {
+    "step": 38,
+    "loss": 2.0838382244110107,
+    "diagonal": 1.4585132598876953,
+    "finite": 4.008492946624756
+  },
+  {
+    "step": 39,
+    "loss": 1.6857731342315674,
+    "diagonal": 1.249065637588501,
+    "finite": 2.729421854019165
+  },
+  {
+    "step": 40,
+    "loss": 1.9347741603851318,
+    "diagonal": 1.366797924041748,
+    "finite": 3.4632694721221924
+  },
+  {
+    "step": 41,
+    "loss": 2.0834832191467285,
+    "diagonal": 1.5916030406951904,
+    "finite": 2.927858591079712
+  },
+  {
+    "step": 42,
+    "loss": 1.8512924909591675,
+    "diagonal": 1.234822154045105,
+    "finite": 3.584129810333252
+  },
+  {
+    "step": 43,
+    "loss": 2.367610454559326,
+    "diagonal": 1.6952871084213257,
+    "finite": 3.8200182914733887
+  },
+  {
+    "step": 44,
+    "loss": 1.8071006536483765,
+    "diagonal": 1.1807199716567993,
+    "finite": 3.4798924922943115
+  },
+  {
+    "step": 45,
+    "loss": 1.7915928363800049,
+    "diagonal": 1.3260574340820312,
+    "finite": 2.530083417892456
+  },
+  {
+    "step": 46,
+    "loss": 1.663568139076233,
+    "diagonal": 1.1769580841064453,
+    "finite": 2.588351249694824
+  },
+  {
+    "step": 47,
+    "loss": 1.8454008102416992,
+    "diagonal": 1.261635422706604,
+    "finite": 3.04044508934021
+  },
+  {
+    "step": 48,
+    "loss": 2.2269468307495117,
+    "diagonal": 1.4507890939712524,
+    "finite": 3.959988594055176
+  },
+  {
+    "step": 49,
+    "loss": 1.7457581758499146,
+    "diagonal": 1.1541876792907715,
+    "finite": 2.957852363586426
+  },
+  {
+    "step": 50,
+    "loss": 1.527773141860962,
+    "diagonal": 0.9629292488098145,
+    "finite": 2.7688426971435547
+  },
+  {
+    "step": 51,
+    "loss": 1.8496654033660889,
+    "diagonal": 1.1715234518051147,
+    "finite": 3.2602977752685547
+  },
+  {
+    "step": 52,
+    "loss": 1.8445152044296265,
+    "diagonal": 1.1742252111434937,
+    "finite": 3.161745309829712
+  },
+  {
+    "step": 53,
+    "loss": 1.1960961818695068,
+    "diagonal": 0.7766737937927246,
+    "finite": 1.941770315170288
+  },
+  {
+    "step": 54,
+    "loss": 1.9111366271972656,
+    "diagonal": 1.2260866165161133,
+    "finite": 3.113863468170166
+  },
+  {
+    "step": 55,
+    "loss": 1.6444380283355713,
+    "diagonal": 0.9643753170967102,
+    "finite": 3.035993814468384
+  },
+  {
+    "step": 56,
+    "loss": 2.018948554992676,
+    "diagonal": 1.317234992980957,
+    "finite": 3.077690839767456
+  },
+  {
+    "step": 57,
+    "loss": 1.8277992010116577,
+    "diagonal": 1.086755633354187,
+    "finite": 3.194153308868408
+  },
+  {
+    "step": 58,
+    "loss": 1.7494373321533203,
+    "diagonal": 1.0502030849456787,
+    "finite": 2.962857246398926
+  },
+  {
+    "step": 59,
+    "loss": 1.659290075302124,
+    "diagonal": 1.1444039344787598,
+    "finite": 2.1453592777252197
+  },
+  {
+    "step": 60,
+    "loss": 1.3217287063598633,
+    "diagonal": 0.7238349914550781,
+    "finite": 2.4503839015960693
+  },
+  {
+    "step": 61,
+    "loss": 1.5872502326965332,
+    "diagonal": 0.8531435132026672,
+    "finite": 2.9601075649261475
+  },
+  {
+    "step": 62,
+    "loss": 1.9397869110107422,
+    "diagonal": 1.30082368850708,
+    "finite": 2.5355682373046875
+  },
+  {
+    "step": 63,
+    "loss": 2.0501198768615723,
+    "diagonal": 1.0707749128341675,
+    "finite": 3.825566053390503
+  },
+  {
+    "step": 64,
+    "loss": 1.7948627471923828,
+    "diagonal": 1.039899468421936,
+    "finite": 2.90370512008667
+  },
+  {
+    "step": 65,
+    "loss": 1.785428762435913,
+    "diagonal": 1.1801258325576782,
+    "finite": 2.292814016342163
+  },
+  {
+    "step": 66,
+    "loss": 1.460768699645996,
+    "diagonal": 0.9490221738815308,
+    "finite": 1.9095021486282349
+  },
+  {
+    "step": 67,
+    "loss": 1.729675054550171,
+    "diagonal": 0.9267734885215759,
+    "finite": 2.951843738555908
+  },
+  {
+    "step": 68,
+    "loss": 1.7413363456726074,
+    "diagonal": 0.8211891055107117,
+    "finite": 3.333866834640503
+  },
+  {
+    "step": 69,
+    "loss": 1.8197827339172363,
+    "diagonal": 1.0628561973571777,
+    "finite": 2.7033088207244873
+  },
+  {
+    "step": 70,
+    "loss": 2.0776543617248535,
+    "diagonal": 1.2358672618865967,
+    "finite": 2.9640393257141113
+  },
+  {
+    "step": 71,
+    "loss": 1.4564778804779053,
+    "diagonal": 0.821898341178894,
+    "finite": 2.2034010887145996
+  },
+  {
+    "step": 72,
+    "loss": 1.6385316848754883,
+    "diagonal": 0.9166842699050903,
+    "finite": 2.4720804691314697
+  },
+  {
+    "step": 73,
+    "loss": 1.748450517654419,
+    "diagonal": 0.9783521294593811,
+    "finite": 2.6016838550567627
+  },
+  {
+    "step": 74,
+    "loss": 1.9503884315490723,
+    "diagonal": 1.1697207689285278,
+    "finite": 2.6022253036499023
+  },
+  {
+    "step": 75,
+    "loss": 2.044670343399048,
+    "diagonal": 0.9664904475212097,
+    "finite": 3.546644687652588
+  },
+  {
+    "step": 76,
+    "loss": 1.857006549835205,
+    "diagonal": 0.9787057042121887,
+    "finite": 2.851626396179199
+  },
+  {
+    "step": 77,
+    "loss": 2.454728126525879,
+    "diagonal": 1.4950534105300903,
+    "finite": 3.0758800506591797
+  },
+  {
+    "step": 78,
+    "loss": 1.710190773010254,
+    "diagonal": 0.9535477161407471,
+    "finite": 2.394439697265625
+  },
+  {
+    "step": 79,
+    "loss": 2.4620840549468994,
+    "diagonal": 1.5443347692489624,
+    "finite": 2.867966651916504
+  },
+  {
+    "step": 80,
+    "loss": 1.4616942405700684,
+    "diagonal": 0.7413040995597839,
+    "finite": 2.223426342010498
+  },
+  {
+    "step": 81,
+    "loss": 1.866640329360962,
+    "diagonal": 0.9593105316162109,
+    "finite": 2.766249179840088
+  },
+  {
+    "step": 82,
+    "loss": 2.008094549179077,
+    "diagonal": 1.1171073913574219,
+    "finite": 2.6836965084075928
+  },
+  {
+    "step": 83,
+    "loss": 2.7916979789733887,
+    "diagonal": 1.5700740814208984,
+    "finite": 3.6357858180999756
+  },
+  {
+    "step": 84,
+    "loss": 1.770770788192749,
+    "diagonal": 0.9092247486114502,
+    "finite": 2.533959150314331
+  },
+  {
+    "step": 85,
+    "loss": 1.6405411958694458,
+    "diagonal": 0.8018954396247864,
+    "finite": 2.4379236698150635
+  },
+  {
+    "step": 86,
+    "loss": 2.112616539001465,
+    "diagonal": 0.9562491774559021,
+    "finite": 3.32289457321167
+  },
+  {
+    "step": 87,
+    "loss": 1.8579542636871338,
+    "diagonal": 1.0376036167144775,
+    "finite": 2.3305416107177734
+  },
+  {
+    "step": 88,
+    "loss": 1.8904156684875488,
+    "diagonal": 0.9394108653068542,
+    "finite": 2.6713619232177734
+  },
+  {
+    "step": 89,
+    "loss": 2.2700538635253906,
+    "diagonal": 1.173506259918213,
+    "finite": 3.0459649562835693
+  },
+  {
+    "step": 90,
+    "loss": 2.618079900741577,
+    "diagonal": 1.4694538116455078,
+    "finite": 3.1555662155151367
+  },
+  {
+    "step": 91,
+    "loss": 1.8152046203613281,
+    "diagonal": 0.8580344915390015,
+    "finite": 2.6010055541992188
+  },
+  {
+    "step": 92,
+    "loss": 2.2415504455566406,
+    "diagonal": 0.9681417346000671,
+    "finite": 3.4231417179107666
+  },
+  {
+    "step": 93,
+    "loss": 2.124730110168457,
+    "diagonal": 1.012542963027954,
+    "finite": 2.957944869995117
+  },
+  {
+    "step": 94,
+    "loss": 1.8408746719360352,
+    "diagonal": 1.0088285207748413,
+    "finite": 2.1895949840545654
+  },
+  {
+    "step": 95,
+    "loss": 2.0219523906707764,
+    "diagonal": 0.8794246912002563,
+    "finite": 2.975332498550415
+  },
+  {
+    "step": 96,
+    "loss": 2.442654609680176,
+    "diagonal": 1.259329080581665,
+    "finite": 3.0498080253601074
+  },
+  {
+    "step": 97,
+    "loss": 2.1232380867004395,
+    "diagonal": 0.9872011542320251,
+    "finite": 2.8980536460876465
+  },
+  {
+    "step": 98,
+    "loss": 1.9894232749938965,
+    "diagonal": 0.9884514808654785,
+    "finite": 2.5277066230773926
+  },
+  {
+    "step": 99,
+    "loss": 1.9956324100494385,
+    "diagonal": 1.000972867012024,
+    "finite": 2.4866487979888916
+  },
+  {
+    "step": 100,
+    "loss": 2.0304317474365234,
+    "diagonal": 0.9070467948913574,
+    "finite": 2.7806556224823
+  },
+  {
+    "step": 101,
+    "loss": 1.9706175327301025,
+    "diagonal": 0.8717832565307617,
+    "finite": 2.6932213306427
+  },
+  {
+    "step": 102,
+    "loss": 1.8045474290847778,
+    "diagonal": 0.9437490701675415,
+    "finite": 2.0893163681030273
+  },
+  {
+    "step": 103,
+    "loss": 1.9111151695251465,
+    "diagonal": 0.8340110182762146,
+    "finite": 2.5891928672790527
+  },
+  {
+    "step": 104,
+    "loss": 1.8727110624313354,
+    "diagonal": 0.785049557685852,
+    "finite": 2.589670419692993
+  },
+  {
+    "step": 105,
+    "loss": 2.1223108768463135,
+    "diagonal": 0.9320765733718872,
+    "finite": 2.8071563243865967
+  },
+  {
+    "step": 106,
+    "loss": 2.247990131378174,
+    "diagonal": 0.9921044111251831,
+    "finite": 2.934312582015991
+  },
+  {
+    "step": 107,
+    "loss": 1.5081270933151245,
+    "diagonal": 0.8372349739074707,
+    "finite": 1.5529910326004028
+  },
+  {
+    "step": 108,
+    "loss": 1.958130955696106,
+    "diagonal": 0.8397068977355957,
+    "finite": 2.565192937850952
+  },
+  {
+    "step": 109,
+    "loss": 2.3184828758239746,
+    "diagonal": 1.149475336074829,
+    "finite": 2.6568355560302734
+  },
+  {
+    "step": 110,
+    "loss": 2.143239974975586,
+    "diagonal": 1.0700218677520752,
+    "finite": 2.4171576499938965
+  },
+  {
+    "step": 111,
+    "loss": 2.170891284942627,
+    "diagonal": 1.0128458738327026,
+    "finite": 2.5849227905273438
+  },
+  {
+    "step": 112,
+    "loss": 1.6097108125686646,
+    "diagonal": 0.6654136776924133,
+    "finite": 2.0891530513763428
+  },
+  {
+    "step": 113,
+    "loss": 2.0410521030426025,
+    "diagonal": 0.8960147500038147,
+    "finite": 2.5110466480255127
+  },
+  {
+    "step": 114,
+    "loss": 2.054234027862549,
+    "diagonal": 0.9428838491439819,
+    "finite": 2.41597843170166
+  },
+  {
+    "step": 115,
+    "loss": 1.7259612083435059,
+    "diagonal": 0.7503249645233154,
+    "finite": 2.1026644706726074
+  },
+  {
+    "step": 116,
+    "loss": 2.3050990104675293,
+    "diagonal": 1.0072333812713623,
+    "finite": 2.77321720123291
+  },
+  {
+    "step": 117,
+    "loss": 2.652418613433838,
+    "diagonal": 1.2108190059661865,
+    "finite": 3.05423641204834
+  },
+  {
+    "step": 118,
+    "loss": 1.6261088848114014,
+    "diagonal": 0.6726818084716797,
+    "finite": 2.002997875213623
+  },
+  {
+    "step": 119,
+    "loss": 2.069293975830078,
+    "diagonal": 0.9146934151649475,
+    "finite": 2.4054176807403564
+  },
+  {
+    "step": 120,
+    "loss": 2.783855676651001,
+    "diagonal": 1.257970929145813,
+    "finite": 3.1526544094085693
+  },
+  {
+    "step": 121,
+    "loss": 2.1872339248657227,
+    "diagonal": 0.7118402719497681,
+    "finite": 3.0233476161956787
+  },
+  {
+    "step": 122,
+    "loss": 2.6855063438415527,
+    "diagonal": 1.2202303409576416,
+    "finite": 2.978203535079956
+  },
+  {
+    "step": 123,
+    "loss": 2.4445438385009766,
+    "diagonal": 0.8628416061401367,
+    "finite": 3.188915967941284
+  },
+  {
+    "step": 124,
+    "loss": 2.0066986083984375,
+    "diagonal": 0.8450333476066589,
+    "finite": 2.3233304023742676
+  },
+  {
+    "step": 125,
+    "loss": 2.595425844192505,
+    "diagonal": 0.9806872606277466,
+    "finite": 3.2038464546203613
+  },
+  {
+    "step": 126,
+    "loss": 2.0755562782287598,
+    "diagonal": 0.9941872358322144,
+    "finite": 2.128678798675537
+  },
+  {
+    "step": 127,
+    "loss": 2.021669626235962,
+    "diagonal": 0.7706322073936462,
+    "finite": 2.443432569503784
+  },
+  {
+    "step": 128,
+    "loss": 2.684040069580078,
+    "diagonal": 1.0635286569595337,
+    "finite": 3.1405258178710938
+  },
+  {
+    "step": 129,
+    "loss": 2.2216122150421143,
+    "diagonal": 0.9220776557922363,
+    "finite": 2.4991049766540527
+  },
+  {
+    "step": 130,
+    "loss": 2.3482699394226074,
+    "diagonal": 1.207087755203247,
+    "finite": 2.177828311920166
+  },
+  {
+    "step": 131,
+    "loss": 1.7929835319519043,
+    "diagonal": 0.8386451005935669,
+    "finite": 1.8074591159820557
+  },
+  {
+    "step": 132,
+    "loss": 2.233462333679199,
+    "diagonal": 1.0035163164138794,
+    "finite": 2.3119287490844727
+  },
+  {
+    "step": 133,
+    "loss": 1.9779136180877686,
+    "diagonal": 0.8093388676643372,
+    "finite": 2.1801764965057373
+  },
+  {
+    "step": 134,
+    "loss": 2.6462841033935547,
+    "diagonal": 0.9693564772605896,
+    "finite": 3.105421304702759
+  },
+  {
+    "step": 135,
+    "loss": 2.303938150405884,
+    "diagonal": 0.9241620898246765,
+    "finite": 2.5363528728485107
+  },
+  {
+    "step": 136,
+    "loss": 2.9786767959594727,
+    "diagonal": 1.0062167644500732,
+    "finite": 3.5993800163269043
+  },
+  {
+    "step": 137,
+    "loss": 2.2499375343322754,
+    "diagonal": 0.8145933747291565,
+    "finite": 2.6002612113952637
+  },
+  {
+    "step": 138,
+    "loss": 2.511960506439209,
+    "diagonal": 0.8480494022369385,
+    "finite": 2.9926462173461914
+  },
+  {
+    "step": 139,
+    "loss": 2.53525972366333,
+    "diagonal": 1.1368833780288696,
+    "finite": 2.497100830078125
+  },
+  {
+    "step": 140,
+    "loss": 3.206238269805908,
+    "diagonal": 1.2101719379425049,
+    "finite": 3.5391247272491455
+  },
+  {
+    "step": 141,
+    "loss": 2.0471854209899902,
+    "diagonal": 0.8501387238502502,
+    "finite": 2.1074764728546143
+  },
+  {
+    "step": 142,
+    "loss": 2.198131561279297,
+    "diagonal": 0.8779327273368835,
+    "finite": 2.308039903640747
+  },
+  {
+    "step": 143,
+    "loss": 2.0514814853668213,
+    "diagonal": 0.8516251444816589,
+    "finite": 2.0830838680267334
+  },
+  {
+    "step": 144,
+    "loss": 2.5470151901245117,
+    "diagonal": 0.9256941080093384,
+    "finite": 2.7953810691833496
+  },
+  {
+    "step": 145,
+    "loss": 1.9039788246154785,
+    "diagonal": 0.6351089477539062,
+    "finite": 2.172722339630127
+  },
+  {
+    "step": 146,
+    "loss": 2.648256778717041,
+    "diagonal": 1.0322695970535278,
+    "finite": 2.7482776641845703
+  },
+  {
+    "step": 147,
+    "loss": 1.9005413055419922,
+    "diagonal": 0.5993967652320862,
+    "finite": 2.1978790760040283
+  },
+  {
+    "step": 148,
+    "loss": 2.579347610473633,
+    "diagonal": 1.0032434463500977,
+    "finite": 2.644469976425171
+  },
+  {
+    "step": 149,
+    "loss": 2.3401122093200684,
+    "diagonal": 0.8252768516540527,
+    "finite": 2.5247256755828857
+  },
+  {
+    "step": 150,
+    "loss": 2.389678478240967,
+    "diagonal": 0.9324997663497925,
+    "finite": 2.4125475883483887
+  },
+  {
+    "step": 151,
+    "loss": 2.5831754207611084,
+    "diagonal": 0.918746292591095,
+    "finite": 2.7375481128692627
+  },
+  {
+    "step": 152,
+    "loss": 2.5781185626983643,
+    "diagonal": 0.8320703506469727,
+    "finite": 2.853019952774048
+  },
+  {
+    "step": 153,
+    "loss": 2.593092441558838,
+    "diagonal": 1.0649118423461914,
+    "finite": 2.4808125495910645
+  },
+  {
+    "step": 154,
+    "loss": 2.452791929244995,
+    "diagonal": 1.020471215248108,
+    "finite": 2.310194730758667
+  },
+  {
+    "step": 155,
+    "loss": 2.8387956619262695,
+    "diagonal": 1.0362868309020996,
+    "finite": 2.8886356353759766
+  },
+  {
+    "step": 156,
+    "loss": 2.5640738010406494,
+    "diagonal": 0.9900859594345093,
+    "finite": 2.506350040435791
+  },
+  {
+    "step": 157,
+    "loss": 2.3076155185699463,
+    "diagonal": 0.8343207240104675,
+    "finite": 2.331162452697754
+  },
+  {
+    "step": 158,
+    "loss": 2.6277194023132324,
+    "diagonal": 1.1372398138046265,
+    "finite": 2.3435213565826416
+  },
+  {
+    "step": 159,
+    "loss": 2.36454439163208,
+    "diagonal": 0.9725632667541504,
+    "finite": 2.1749703884124756
+  },
+  {
+    "step": 160,
+    "loss": 2.7050576210021973,
+    "diagonal": 0.991622805595398,
+    "finite": 2.6606128215789795
+  },
+  {
+    "step": 161,
+    "loss": 2.581010341644287,
+    "diagonal": 0.7533634901046753,
+    "finite": 2.8204429149627686
+  },
+  {
+    "step": 162,
+    "loss": 3.5275802612304688,
+    "diagonal": 1.0477008819580078,
+    "finite": 3.8034958839416504
+  },
+  {
+    "step": 163,
+    "loss": 2.519084930419922,
+    "diagonal": 0.7433750629425049,
+    "finite": 2.7068748474121094
+  },
+  {
+    "step": 164,
+    "loss": 2.998176097869873,
+    "diagonal": 1.1252968311309814,
+    "finite": 2.837695837020874
+  },
+  {
+    "step": 165,
+    "loss": 2.147568702697754,
+    "diagonal": 0.5904175043106079,
+    "finite": 2.345107078552246
+  },
+  {
+    "step": 166,
+    "loss": 2.7852303981781006,
+    "diagonal": 1.0154995918273926,
+    "finite": 2.6492977142333984
+  },
+  {
+    "step": 167,
+    "loss": 2.0283615589141846,
+    "diagonal": 0.6773627400398254,
+    "finite": 2.0104148387908936
+  },
+  {
+    "step": 168,
+    "loss": 2.523789882659912,
+    "diagonal": 0.9004831910133362,
+    "finite": 2.401341438293457
+  },
+  {
+    "step": 169,
+    "loss": 2.902803897857666,
+    "diagonal": 1.055741786956787,
+    "finite": 2.7162675857543945
+  },
+  {
+    "step": 170,
+    "loss": 2.277998447418213,
+    "diagonal": 0.8750753402709961,
+    "finite": 2.0510571002960205
+  },
+  {
+    "step": 171,
+    "loss": 2.657273292541504,
+    "diagonal": 0.8320488333702087,
+    "finite": 2.652942419052124
+  },
+  {
+    "step": 172,
+    "loss": 2.619497299194336,
+    "diagonal": 1.0731773376464844,
+    "finite": 2.2345664501190186
+  },
+  {
+    "step": 173,
+    "loss": 2.517427682876587,
+    "diagonal": 0.7774151563644409,
+    "finite": 2.5000181198120117
+  },
+  {
+    "step": 174,
+    "loss": 2.7561511993408203,
+    "diagonal": 0.963334858417511,
+    "finite": 2.561166286468506
+  },
+  {
+    "step": 175,
+    "loss": 2.9006528854370117,
+    "diagonal": 1.0632448196411133,
+    "finite": 2.609954833984375
+  },
+  {
+    "step": 176,
+    "loss": 3.0346431732177734,
+    "diagonal": 0.9343959093093872,
+    "finite": 2.9664511680603027
+  },
+  {
+    "step": 177,
+    "loss": 2.2177090644836426,
+    "diagonal": 0.9052619934082031,
+    "finite": 1.8433246612548828
+  },
+  {
+    "step": 178,
+    "loss": 2.567275047302246,
+    "diagonal": 0.8226606845855713,
+    "finite": 2.436612367630005
+  },
+  {
+    "step": 179,
+    "loss": 2.0386219024658203,
+    "diagonal": 0.7311766147613525,
+    "finite": 1.815895915031433
+  },
+  {
+    "step": 180,
+    "loss": 2.3427557945251465,
+    "diagonal": 0.7520596385002136,
+    "finite": 2.197094202041626
+  },
+  {
+    "step": 181,
+    "loss": 2.536961793899536,
+    "diagonal": 0.7816475629806519,
+    "finite": 2.4111459255218506
+  },
+  {
+    "step": 182,
+    "loss": 2.614482879638672,
+    "diagonal": 0.8915086984634399,
+    "finite": 2.353790044784546
+  },
+  {
+    "step": 183,
+    "loss": 2.164091110229492,
+    "diagonal": 0.7824001312255859,
+    "finite": 1.8772976398468018
+  },
+  {
+    "step": 184,
+    "loss": 2.3819873332977295,
+    "diagonal": 0.8368000388145447,
+    "finite": 2.0880908966064453
+  },
+  {
+    "step": 185,
+    "loss": 2.3063697814941406,
+    "diagonal": 0.7370427846908569,
+    "finite": 2.1093106269836426
+  },
+  {
+    "step": 186,
+    "loss": 2.361765146255493,
+    "diagonal": 0.7352332472801208,
+    "finite": 2.1745078563690186
+  },
+  {
+    "step": 187,
+    "loss": 2.4749388694763184,
+    "diagonal": 0.8504050970077515,
+    "finite": 2.1602842807769775
+  },
+  {
+    "step": 188,
+    "loss": 2.429891586303711,
+    "diagonal": 0.7093949913978577,
+    "finite": 2.275789260864258
+  },
+  {
+    "step": 189,
+    "loss": 2.290937900543213,
+    "diagonal": 0.8490381836891174,
+    "finite": 1.8972363471984863
+  },
+  {
+    "step": 190,
+    "loss": 2.725126266479492,
+    "diagonal": 0.9903890490531921,
+    "finite": 2.2705984115600586
+  },
+  {
+    "step": 191,
+    "loss": 2.7798783779144287,
+    "diagonal": 0.8689637780189514,
+    "finite": 2.4881701469421387
+  },
+  {
+    "step": 192,
+    "loss": 3.219513416290283,
+    "diagonal": 1.2041839361190796,
+    "finite": 2.610530376434326
+  },
+  {
+    "step": 193,
+    "loss": 3.0613789558410645,
+    "diagonal": 0.9028545618057251,
+    "finite": 2.7816033363342285
+  },
+  {
+    "step": 194,
+    "loss": 2.6059608459472656,
+    "diagonal": 0.8689157962799072,
+    "finite": 2.226980686187744
+  },
+  {
+    "step": 195,
+    "loss": 2.9173271656036377,
+    "diagonal": 0.9264369606971741,
+    "finite": 2.539400815963745
+  },
+  {
+    "step": 196,
+    "loss": 2.662320137023926,
+    "diagonal": 0.9228529930114746,
+    "finite": 2.2074456214904785
+  },
+  {
+    "step": 197,
+    "loss": 2.9002318382263184,
+    "diagonal": 0.9330731630325317,
+    "finite": 2.483786106109619
+  },
+  {
+    "step": 198,
+    "loss": 3.3409016132354736,
+    "diagonal": 1.2560627460479736,
+    "finite": 2.6191442012786865
+  },
+  {
+    "step": 199,
+    "loss": 2.867421865463257,
+    "diagonal": 0.9491916298866272,
+    "finite": 2.3977878093719482
+  },
+  {
+    "step": 200,
+    "loss": 3.14803147315979,
+    "diagonal": 0.9352052211761475,
+    "finite": 2.7522714138031006
+  },
+  {
+    "step": 201,
+    "loss": 2.809864044189453,
+    "diagonal": 0.9356178045272827,
+    "finite": 2.3196117877960205
+  },
+  {
+    "step": 202,
+    "loss": 3.4791297912597656,
+    "diagonal": 1.1518033742904663,
+    "finite": 2.8661656379699707
+  },
+  {
+    "step": 203,
+    "loss": 2.6021924018859863,
+    "diagonal": 0.8772385120391846,
+    "finite": 2.1139140129089355
+  },
+  {
+    "step": 204,
+    "loss": 2.3076493740081787,
+    "diagonal": 0.7047523856163025,
+    "finite": 1.9547525644302368
+  },
+  {
+    "step": 205,
+    "loss": 2.975985527038574,
+    "diagonal": 0.7904229164123535,
+    "finite": 2.6523818969726562
+  },
+  {
+    "step": 206,
+    "loss": 3.338993549346924,
+    "diagonal": 0.9392980337142944,
+    "finite": 2.8981828689575195
+  },
+  {
+    "step": 207,
+    "loss": 3.317416191101074,
+    "diagonal": 0.713433027267456,
+    "finite": 3.1297874450683594
+  },
+  {
+    "step": 208,
+    "loss": 3.013190984725952,
+    "diagonal": 0.8108375072479248,
+    "finite": 2.6343941688537598
+  },
+  {
+    "step": 209,
+    "loss": 2.966444492340088,
+    "diagonal": 0.9171585440635681,
+    "finite": 2.4396262168884277
+  },
+  {
+    "step": 210,
+    "loss": 2.8686270713806152,
+    "diagonal": 0.9335922002792358,
+    "finite": 2.2926955223083496
+  },
+  {
+    "step": 211,
+    "loss": 2.9980649948120117,
+    "diagonal": 0.8839740753173828,
+    "finite": 2.4930317401885986
+  },
+  {
+    "step": 212,
+    "loss": 2.9408586025238037,
+    "diagonal": 0.8260352611541748,
+    "finite": 2.482187032699585
+  },
+  {
+    "step": 213,
+    "loss": 3.735307216644287,
+    "diagonal": 1.0248994827270508,
+    "finite": 3.1663641929626465
+  },
+  {
+    "step": 214,
+    "loss": 2.8148598670959473,
+    "diagonal": 0.8530353903770447,
+    "finite": 2.281191110610962
+  },
+  {
+    "step": 215,
+    "loss": 2.865077018737793,
+    "diagonal": 0.9275180697441101,
+    "finite": 2.2425451278686523
+  },
+  {
+    "step": 216,
+    "loss": 3.2991816997528076,
+    "diagonal": 0.9711962342262268,
+    "finite": 2.682011127471924
+  },
+  {
+    "step": 217,
+    "loss": 2.9791815280914307,
+    "diagonal": 0.7828938961029053,
+    "finite": 2.518678665161133
+  },
+  {
+    "step": 218,
+    "loss": 3.4168198108673096,
+    "diagonal": 1.0599117279052734,
+    "finite": 2.6905343532562256
+  },
+  {
+    "step": 219,
+    "loss": 3.3218085765838623,
+    "diagonal": 1.0317747592926025,
+    "finite": 2.602311134338379
+  },
+  {
+    "step": 220,
+    "loss": 3.6174559593200684,
+    "diagonal": 1.2050583362579346,
+    "finite": 2.728956460952759
+  },
+  {
+    "step": 221,
+    "loss": 2.962249279022217,
+    "diagonal": 0.6952266693115234,
+    "finite": 2.5529534816741943
+  },
+  {
+    "step": 222,
+    "loss": 3.7052807807922363,
+    "diagonal": 1.1227308511734009,
+    "finite": 2.895235538482666
+  },
+  {
+    "step": 223,
+    "loss": 3.086362600326538,
+    "diagonal": 0.9910956025123596,
+    "finite": 2.338467597961426
+  },
+  {
+    "step": 224,
+    "loss": 3.143139123916626,
+    "diagonal": 0.8410286903381348,
+    "finite": 2.5579006671905518
+  },
+  {
+    "step": 225,
+    "loss": 2.77530574798584,
+    "diagonal": 0.7608188390731812,
+    "finite": 2.22841477394104
+  },
+  {
+    "step": 226,
+    "loss": 2.905191659927368,
+    "diagonal": 1.0437568426132202,
+    "finite": 2.0500383377075195
+  },
+  {
+    "step": 227,
+    "loss": 3.3794403076171875,
+    "diagonal": 0.9070271253585815,
+    "finite": 2.7109792232513428
+  },
+  {
+    "step": 228,
+    "loss": 2.9704384803771973,
+    "diagonal": 0.798693835735321,
+    "finite": 2.3709001541137695
+  },
+  {
+    "step": 229,
+    "loss": 3.399567127227783,
+    "diagonal": 0.8075264692306519,
+    "finite": 2.8174352645874023
+  },
+  {
+    "step": 230,
+    "loss": 3.19222354888916,
+    "diagonal": 0.9108181595802307,
+    "finite": 2.4690535068511963
+  },
+  {
+    "step": 231,
+    "loss": 2.945072650909424,
+    "diagonal": 0.8673146963119507,
+    "finite": 2.2389633655548096
+  },
+  {
+    "step": 232,
+    "loss": 3.006713390350342,
+    "diagonal": 0.646007776260376,
+    "finite": 2.5329458713531494
+  },
+  {
+    "step": 233,
+    "loss": 3.8613009452819824,
+    "diagonal": 1.053436279296875,
+    "finite": 2.9998555183410645
+  },
+  {
+    "step": 234,
+    "loss": 3.726621389389038,
+    "diagonal": 0.8758566379547119,
+    "finite": 3.032728433609009
+  },
+  {
+    "step": 235,
+    "loss": 3.7117104530334473,
+    "diagonal": 1.1848678588867188,
+    "finite": 2.6767399311065674
+  },
+  {
+    "step": 236,
+    "loss": 3.631537437438965,
+    "diagonal": 0.9242914915084839,
+    "finite": 2.8557448387145996
+  },
+  {
+    "step": 237,
+    "loss": 4.49794340133667,
+    "diagonal": 1.1560871601104736,
+    "finite": 3.5103530883789062
+  },
+  {
+    "step": 238,
+    "loss": 3.4846622943878174,
+    "diagonal": 0.9637852311134338,
+    "finite": 2.6369009017944336
+  },
+  {
+    "step": 239,
+    "loss": 3.414393186569214,
+    "diagonal": 1.040189266204834,
+    "finite": 2.4731290340423584
+  },
+  {
+    "step": 240,
+    "loss": 3.2264251708984375,
+    "diagonal": 0.9440125226974487,
+    "finite": 2.367648124694824
+  },
+  {
+    "step": 241,
+    "loss": 3.803272247314453,
+    "diagonal": 1.0820732116699219,
+    "finite": 2.8111560344696045
+  },
+  {
+    "step": 242,
+    "loss": 3.005114793777466,
+    "diagonal": 0.8388201594352722,
+    "finite": 2.2286980152130127
+  },
+  {
+    "step": 243,
+    "loss": 3.6987621784210205,
+    "diagonal": 0.9573696255683899,
+    "finite": 2.8088037967681885
+  },
+  {
+    "step": 244,
+    "loss": 2.9220550060272217,
+    "diagonal": 0.6109940409660339,
+    "finite": 2.3582253456115723
+  },
+  {
+    "step": 245,
+    "loss": 4.269009590148926,
+    "diagonal": 1.3487162590026855,
+    "finite": 2.967777729034424
+  },
+  {
+    "step": 246,
+    "loss": 3.6963882446289062,
+    "diagonal": 0.8525829315185547,
+    "finite": 2.878345489501953
+  },
+  {
+    "step": 247,
+    "loss": 3.7524733543395996,
+    "diagonal": 0.9213043451309204,
+    "finite": 2.854001045227051
+  },
+  {
+    "step": 248,
+    "loss": 3.74052095413208,
+    "diagonal": 1.1122310161590576,
+    "finite": 2.638845443725586
+  },
+  {
+    "step": 249,
+    "loss": 3.60844087600708,
+    "diagonal": 1.0325835943222046,
+    "finite": 2.575857400894165
+  },
+  {
+    "step": 250,
+    "loss": 2.952346086502075,
+    "diagonal": 0.7526775002479553,
+    "finite": 2.1996686458587646
+  },
+  {
+    "step": 251,
+    "loss": 3.4022514820098877,
+    "diagonal": 0.8645398020744324,
+    "finite": 2.5377116203308105
+  },
+  {
+    "step": 252,
+    "loss": 3.3817050457000732,
+    "diagonal": 0.9382588863372803,
+    "finite": 2.443446159362793
+  },
+  {
+    "step": 253,
+    "loss": 2.662409782409668,
+    "diagonal": 0.6981817483901978,
+    "finite": 1.9642280340194702
+  },
+  {
+    "step": 254,
+    "loss": 3.190229892730713,
+    "diagonal": 0.8211589455604553,
+    "finite": 2.3690710067749023
+  },
+  {
+    "step": 255,
+    "loss": 3.3622233867645264,
+    "diagonal": 0.7735185623168945,
+    "finite": 2.588704824447632
+  },
+  {
+    "step": 256,
+    "loss": 3.3013079166412354,
+    "diagonal": 0.8365981578826904,
+    "finite": 2.464709758758545
+  },
+  {
+    "step": 257,
+    "loss": 3.4028775691986084,
+    "diagonal": 0.9866762161254883,
+    "finite": 2.41620135307312
+  },
+  {
+    "step": 258,
+    "loss": 2.943171262741089,
+    "diagonal": 0.7144858837127686,
+    "finite": 2.2286853790283203
+  },
+  {
+    "step": 259,
+    "loss": 3.2399611473083496,
+    "diagonal": 0.9330205321311951,
+    "finite": 2.3069405555725098
+  },
+  {
+    "step": 260,
+    "loss": 3.5745420455932617,
+    "diagonal": 0.8816245794296265,
+    "finite": 2.692917585372925
+  },
+  {
+    "step": 261,
+    "loss": 2.85662841796875,
+    "diagonal": 0.7005254030227661,
+    "finite": 2.1561031341552734
+  },
+  {
+    "step": 262,
+    "loss": 2.91953182220459,
+    "diagonal": 0.8082310557365417,
+    "finite": 2.1113007068634033
+  },
+  {
+    "step": 263,
+    "loss": 3.3957624435424805,
+    "diagonal": 0.9764472842216492,
+    "finite": 2.4193150997161865
+  },
+  {
+    "step": 264,
+    "loss": 3.3578898906707764,
+    "diagonal": 0.8724799156188965,
+    "finite": 2.48540997505188
+  },
+  {
+    "step": 265,
+    "loss": 3.101560592651367,
+    "diagonal": 0.7132701277732849,
+    "finite": 2.3882904052734375
+  },
+  {
+    "step": 266,
+    "loss": 3.180098056793213,
+    "diagonal": 0.8940357565879822,
+    "finite": 2.286062240600586
+  },
+  {
+    "step": 267,
+    "loss": 3.132765293121338,
+    "diagonal": 0.828273355960846,
+    "finite": 2.3044919967651367
+  },
+  {
+    "step": 268,
+    "loss": 4.154946327209473,
+    "diagonal": 1.1469649076461792,
+    "finite": 3.007981300354004
+  },
+  {
+    "step": 269,
+    "loss": 3.493069648742676,
+    "diagonal": 1.1871215105056763,
+    "finite": 2.305948257446289
+  },
+  {
+    "step": 270,
+    "loss": 2.647104263305664,
+    "diagonal": 0.7950908541679382,
+    "finite": 1.8520134687423706
+  },
+  {
+    "step": 271,
+    "loss": 4.449309349060059,
+    "diagonal": 1.2653886079788208,
+    "finite": 3.1839206218719482
+  },
+  {
+    "step": 272,
+    "loss": 3.1357061862945557,
+    "diagonal": 0.5950931906700134,
+    "finite": 2.5406129360198975
+  },
+  {
+    "step": 273,
+    "loss": 2.647395133972168,
+    "diagonal": 0.7311984896659851,
+    "finite": 1.916196584701538
+  },
+  {
+    "step": 274,
+    "loss": 3.393550395965576,
+    "diagonal": 0.8670810461044312,
+    "finite": 2.5264694690704346
+  },
+  {
+    "step": 275,
+    "loss": 3.8322222232818604,
+    "diagonal": 1.135833978652954,
+    "finite": 2.6963882446289062
+  },
+  {
+    "step": 276,
+    "loss": 2.236339807510376,
+    "diagonal": 0.653386652469635,
+    "finite": 1.5829532146453857
+  },
+  {
+    "step": 277,
+    "loss": 2.4448814392089844,
+    "diagonal": 0.5892728567123413,
+    "finite": 1.855608582496643
+  },
+  {
+    "step": 278,
+    "loss": 3.4114561080932617,
+    "diagonal": 0.9638335704803467,
+    "finite": 2.447622537612915
+  },
+  {
+    "step": 279,
+    "loss": 3.084589958190918,
+    "diagonal": 0.8089631795883179,
+    "finite": 2.2756266593933105
+  },
+  {
+    "step": 280,
+    "loss": 2.6066412925720215,
+    "diagonal": 0.7305526733398438,
+    "finite": 1.8760885000228882
+  },
+  {
+    "step": 281,
+    "loss": 3.2372372150421143,
+    "diagonal": 0.9014651775360107,
+    "finite": 2.3357720375061035
+  },
+  {
+    "step": 282,
+    "loss": 2.761110782623291,
+    "diagonal": 0.6133607625961304,
+    "finite": 2.14775013923645
+  },
+  {
+    "step": 283,
+    "loss": 4.000961780548096,
+    "diagonal": 0.9677699208259583,
+    "finite": 3.033191680908203
+  },
+  {
+    "step": 284,
+    "loss": 2.0115997791290283,
+    "diagonal": 0.6824787259101868,
+    "finite": 1.3291211128234863
+  },
+  {
+    "step": 285,
+    "loss": 3.4548442363739014,
+    "diagonal": 0.9581773281097412,
+    "finite": 2.49666690826416
+  },
+  {
+    "step": 286,
+    "loss": 3.0426101684570312,
+    "diagonal": 0.7877770662307739,
+    "finite": 2.254833221435547
+  },
+  {
+    "step": 287,
+    "loss": 3.1218783855438232,
+    "diagonal": 0.8794006705284119,
+    "finite": 2.2424776554107666
+  },
+  {
+    "step": 288,
+    "loss": 2.8854727745056152,
+    "diagonal": 0.8238155245780945,
+    "finite": 2.061657190322876
+  },
+  {
+    "step": 289,
+    "loss": 2.9036502838134766,
+    "diagonal": 0.7832050323486328,
+    "finite": 2.1204452514648438
+  },
+  {
+    "step": 290,
+    "loss": 2.474527597427368,
+    "diagonal": 0.6512319445610046,
+    "finite": 1.8232955932617188
+  },
+  {
+    "step": 291,
+    "loss": 3.2290382385253906,
+    "diagonal": 0.9058753252029419,
+    "finite": 2.323162794113159
+  },
+  {
+    "step": 292,
+    "loss": 3.291020393371582,
+    "diagonal": 0.8550958037376404,
+    "finite": 2.435924530029297
+  },
+  {
+    "step": 293,
+    "loss": 3.5037338733673096,
+    "diagonal": 0.8229410648345947,
+    "finite": 2.680792808532715
+  },
+  {
+    "step": 294,
+    "loss": 3.3407535552978516,
+    "diagonal": 1.0300017595291138,
+    "finite": 2.3107519149780273
+  },
+  {
+    "step": 295,
+    "loss": 2.8304314613342285,
+    "diagonal": 0.8143342137336731,
+    "finite": 2.0160973072052
+  },
+  {
+    "step": 296,
+    "loss": 2.8771579265594482,
+    "diagonal": 0.716425895690918,
+    "finite": 2.1607320308685303
+  },
+  {
+    "step": 297,
+    "loss": 3.1982390880584717,
+    "diagonal": 0.6713454723358154,
+    "finite": 2.5268936157226562
+  },
+  {
+    "step": 298,
+    "loss": 3.678957939147949,
+    "diagonal": 1.0567163228988647,
+    "finite": 2.622241497039795
+  },
+  {
+    "step": 299,
+    "loss": 2.2854039669036865,
+    "diagonal": 0.8082032203674316,
+    "finite": 1.4772007465362549
+  },
+  {
+    "step": 300,
+    "loss": 2.8685765266418457,
+    "diagonal": 0.7233554124832153,
+    "finite": 2.14522123336792
+  },
+  {
+    "step": 301,
+    "loss": 2.9653613567352295,
+    "diagonal": 0.6037448048591614,
+    "finite": 2.361616611480713
+  },
+  {
+    "step": 302,
+    "loss": 2.704193115234375,
+    "diagonal": 0.6631712913513184,
+    "finite": 2.0410218238830566
+  },
+  {
+    "step": 303,
+    "loss": 2.748263359069824,
+    "diagonal": 0.5594954490661621,
+    "finite": 2.188767910003662
+  },
+  {
+    "step": 304,
+    "loss": 3.0642433166503906,
+    "diagonal": 0.6495922803878784,
+    "finite": 2.4146511554718018
+  },
+  {
+    "step": 305,
+    "loss": 3.406822681427002,
+    "diagonal": 0.9118653535842896,
+    "finite": 2.494957447052002
+  },
+  {
+    "step": 306,
+    "loss": 2.757894992828369,
+    "diagonal": 0.7252731323242188,
+    "finite": 2.0326218605041504
+  },
+  {
+    "step": 307,
+    "loss": 2.107809066772461,
+    "diagonal": 0.6364184617996216,
+    "finite": 1.4713904857635498
+  },
+  {
+    "step": 308,
+    "loss": 2.5768163204193115,
+    "diagonal": 0.6794875264167786,
+    "finite": 1.8973288536071777
+  },
+  {
+    "step": 309,
+    "loss": 2.9444687366485596,
+    "diagonal": 0.7061646580696106,
+    "finite": 2.2383041381835938
+  },
+  {
+    "step": 310,
+    "loss": 3.0838234424591064,
+    "diagonal": 0.7309378981590271,
+    "finite": 2.3528854846954346
+  },
+  {
+    "step": 311,
+    "loss": 2.6083433628082275,
+    "diagonal": 0.7109441161155701,
+    "finite": 1.8973991870880127
+  },
+  {
+    "step": 312,
+    "loss": 3.384094715118408,
+    "diagonal": 0.7780665755271912,
+    "finite": 2.6060280799865723
+  },
+  {
+    "step": 313,
+    "loss": 2.4720892906188965,
+    "diagonal": 0.6745973825454712,
+    "finite": 1.7974919080734253
+  },
+  {
+    "step": 314,
+    "loss": 3.1548166275024414,
+    "diagonal": 0.7566414475440979,
+    "finite": 2.3981752395629883
+  },
+  {
+    "step": 315,
+    "loss": 3.444862127304077,
+    "diagonal": 0.8021439909934998,
+    "finite": 2.6427180767059326
+  },
+  {
+    "step": 316,
+    "loss": 2.503535747528076,
+    "diagonal": 0.5829640626907349,
+    "finite": 1.9205718040466309
+  },
+  {
+    "step": 317,
+    "loss": 2.384934186935425,
+    "diagonal": 0.829306423664093,
+    "finite": 1.555627703666687
+  },
+  {
+    "step": 318,
+    "loss": 2.3129754066467285,
+    "diagonal": 0.5586205124855042,
+    "finite": 1.7543548345565796
+  },
+  {
+    "step": 319,
+    "loss": 2.891058921813965,
+    "diagonal": 0.7464748620986938,
+    "finite": 2.1445839405059814
+  },
+  {
+    "step": 320,
+    "loss": 1.9624526500701904,
+    "diagonal": 0.5317832827568054,
+    "finite": 1.4306693077087402
+  },
+  {
+    "step": 321,
+    "loss": 2.4872374534606934,
+    "diagonal": 0.6679551005363464,
+    "finite": 1.8192824125289917
+  },
+  {
+    "step": 322,
+    "loss": 2.7473292350769043,
+    "diagonal": 0.8558773994445801,
+    "finite": 1.8914518356323242
+  },
+  {
+    "step": 323,
+    "loss": 2.825028896331787,
+    "diagonal": 0.7058027982711792,
+    "finite": 2.1192259788513184
+  },
+  {
+    "step": 324,
+    "loss": 2.814131736755371,
+    "diagonal": 0.6139545440673828,
+    "finite": 2.2001771926879883
+  },
+  {
+    "step": 325,
+    "loss": 3.213475465774536,
+    "diagonal": 0.830361545085907,
+    "finite": 2.3831138610839844
+  },
+  {
+    "step": 326,
+    "loss": 2.7594919204711914,
+    "diagonal": 0.714724600315094,
+    "finite": 2.044767379760742
+  },
+  {
+    "step": 327,
+    "loss": 3.5738272666931152,
+    "diagonal": 0.7187577486038208,
+    "finite": 2.855069637298584
+  },
+  {
+    "step": 328,
+    "loss": 2.398308277130127,
+    "diagonal": 0.6713802814483643,
+    "finite": 1.7269279956817627
+  },
+  {
+    "step": 329,
+    "loss": 2.988121509552002,
+    "diagonal": 0.92741858959198,
+    "finite": 2.0607028007507324
+  },
+  {
+    "step": 330,
+    "loss": 2.415222644805908,
+    "diagonal": 0.7436871528625488,
+    "finite": 1.6715354919433594
+  },
+  {
+    "step": 331,
+    "loss": 2.2441604137420654,
+    "diagonal": 0.659432053565979,
+    "finite": 1.5847283601760864
+  },
+  {
+    "step": 332,
+    "loss": 2.5522241592407227,
+    "diagonal": 0.6161725521087646,
+    "finite": 1.936051607131958
+  },
+  {
+    "step": 333,
+    "loss": 2.8625454902648926,
+    "diagonal": 0.7279447317123413,
+    "finite": 2.1346006393432617
+  },
+  {
+    "step": 334,
+    "loss": 1.7747435569763184,
+    "diagonal": 0.48848578333854675,
+    "finite": 1.2862577438354492
+  },
+  {
+    "step": 335,
+    "loss": 2.7680742740631104,
+    "diagonal": 0.8286821842193604,
+    "finite": 1.93939208984375
+  },
+  {
+    "step": 336,
+    "loss": 2.408215045928955,
+    "diagonal": 0.7432608604431152,
+    "finite": 1.6649543046951294
+  },
+  {
+    "step": 337,
+    "loss": 2.063063383102417,
+    "diagonal": 0.6205558776855469,
+    "finite": 1.4425075054168701
+  },
+  {
+    "step": 338,
+    "loss": 2.4182562828063965,
+    "diagonal": 0.6462013721466064,
+    "finite": 1.7720547914505005
+  },
+  {
+    "step": 339,
+    "loss": 2.0885701179504395,
+    "diagonal": 0.5015758275985718,
+    "finite": 1.5869941711425781
+  },
+  {
+    "step": 340,
+    "loss": 2.933748245239258,
+    "diagonal": 0.696994423866272,
+    "finite": 2.2367539405822754
+  },
+  {
+    "step": 341,
+    "loss": 2.839259624481201,
+    "diagonal": 0.6978873610496521,
+    "finite": 2.1413722038269043
+  },
+  {
+    "step": 342,
+    "loss": 2.8074123859405518,
+    "diagonal": 0.6884104609489441,
+    "finite": 2.119001865386963
+  },
+  {
+    "step": 343,
+    "loss": 2.632213592529297,
+    "diagonal": 0.6835949420928955,
+    "finite": 1.9486186504364014
+  },
+  {
+    "step": 344,
+    "loss": 2.814265012741089,
+    "diagonal": 0.8222665786743164,
+    "finite": 1.9919984340667725
+  },
+  {
+    "step": 345,
+    "loss": 3.2149319648742676,
+    "diagonal": 0.6734422445297241,
+    "finite": 2.541489839553833
+  },
+  {
+    "step": 346,
+    "loss": 2.798049211502075,
+    "diagonal": 0.885669469833374,
+    "finite": 1.9123797416687012
+  },
+  {
+    "step": 347,
+    "loss": 2.5847935676574707,
+    "diagonal": 0.6331280469894409,
+    "finite": 1.9516656398773193
+  },
+  {
+    "step": 348,
+    "loss": 2.7366299629211426,
+    "diagonal": 0.5449637174606323,
+    "finite": 2.1916661262512207
+  },
+  {
+    "step": 349,
+    "loss": 2.4168872833251953,
+    "diagonal": 0.7157797813415527,
+    "finite": 1.701107382774353
+  },
+  {
+    "step": 350,
+    "loss": 2.8873531818389893,
+    "diagonal": 0.768693208694458,
+    "finite": 2.1186599731445312
+  },
+  {
+    "step": 351,
+    "loss": 2.628934144973755,
+    "diagonal": 0.6504562497138977,
+    "finite": 1.9784778356552124
+  },
+  {
+    "step": 352,
+    "loss": 2.8819284439086914,
+    "diagonal": 0.7170901894569397,
+    "finite": 2.1648383140563965
+  },
+  {
+    "step": 353,
+    "loss": 2.4022369384765625,
+    "diagonal": 0.572262704372406,
+    "finite": 1.8299741744995117
+  },
+  {
+    "step": 354,
+    "loss": 2.6261916160583496,
+    "diagonal": 0.7275859117507935,
+    "finite": 1.8986058235168457
+  },
+  {
+    "step": 355,
+    "loss": 2.8579773902893066,
+    "diagonal": 0.6966850757598877,
+    "finite": 2.161292314529419
+  },
+  {
+    "step": 356,
+    "loss": 2.9682912826538086,
+    "diagonal": 0.7811243534088135,
+    "finite": 2.187166929244995
+  },
+  {
+    "step": 357,
+    "loss": 3.0335240364074707,
+    "diagonal": 0.7696720361709595,
+    "finite": 2.263852119445801
+  },
+  {
+    "step": 358,
+    "loss": 2.6824440956115723,
+    "diagonal": 0.8074890375137329,
+    "finite": 1.874955177307129
+  },
+  {
+    "step": 359,
+    "loss": 2.7111129760742188,
+    "diagonal": 0.805139422416687,
+    "finite": 1.9059735536575317
+  },
+  {
+    "step": 360,
+    "loss": 2.331998109817505,
+    "diagonal": 0.527125358581543,
+    "finite": 1.804872751235962
+  },
+  {
+    "step": 361,
+    "loss": 2.434558629989624,
+    "diagonal": 0.6849799156188965,
+    "finite": 1.7495787143707275
+  },
+  {
+    "step": 362,
+    "loss": 2.616589069366455,
+    "diagonal": 0.7045353651046753,
+    "finite": 1.9120535850524902
+  },
+  {
+    "step": 363,
+    "loss": 3.027801036834717,
+    "diagonal": 0.8714495897293091,
+    "finite": 2.156351327896118
+  },
+  {
+    "step": 364,
+    "loss": 2.470891237258911,
+    "diagonal": 0.4629688262939453,
+    "finite": 2.007922410964966
+  },
+  {
+    "step": 365,
+    "loss": 2.284836530685425,
+    "diagonal": 0.6635348200798035,
+    "finite": 1.6213016510009766
+  },
+  {
+    "step": 366,
+    "loss": 3.0310864448547363,
+    "diagonal": 0.5781864523887634,
+    "finite": 2.452899932861328
+  },
+  {
+    "step": 367,
+    "loss": 2.3544671535491943,
+    "diagonal": 0.6765562891960144,
+    "finite": 1.6779109239578247
+  },
+  {
+    "step": 368,
+    "loss": 2.6557798385620117,
+    "diagonal": 0.6262803673744202,
+    "finite": 2.0294995307922363
+  },
+  {
+    "step": 369,
+    "loss": 2.4820330142974854,
+    "diagonal": 0.7350013852119446,
+    "finite": 1.747031569480896
+  },
+  {
+    "step": 370,
+    "loss": 2.480393171310425,
+    "diagonal": 0.6388868093490601,
+    "finite": 1.8415063619613647
+  },
+  {
+    "step": 371,
+    "loss": 2.2587780952453613,
+    "diagonal": 0.6831933259963989,
+    "finite": 1.5755846500396729
+  },
+  {
+    "step": 372,
+    "loss": 2.0889129638671875,
+    "diagonal": 0.44541382789611816,
+    "finite": 1.6434991359710693
+  },
+  {
+    "step": 373,
+    "loss": 1.7858476638793945,
+    "diagonal": 0.535743236541748,
+    "finite": 1.2501044273376465
+  },
+  {
+    "step": 374,
+    "loss": 2.4538636207580566,
+    "diagonal": 0.6140691041946411,
+    "finite": 1.839794397354126
+  },
+  {
+    "step": 375,
+    "loss": 2.0777018070220947,
+    "diagonal": 0.56426602602005,
+    "finite": 1.5134358406066895
+  },
+  {
+    "step": 376,
+    "loss": 2.372851848602295,
+    "diagonal": 0.5914450883865356,
+    "finite": 1.7814066410064697
+  },
+  {
+    "step": 377,
+    "loss": 2.6070375442504883,
+    "diagonal": 0.7678441405296326,
+    "finite": 1.839193344116211
+  },
+  {
+    "step": 378,
+    "loss": 2.073981285095215,
+    "diagonal": 0.4710460901260376,
+    "finite": 1.6029353141784668
+  },
+  {
+    "step": 379,
+    "loss": 2.6602635383605957,
+    "diagonal": 0.6549380421638489,
+    "finite": 2.0053255558013916
+  },
+  {
+    "step": 380,
+    "loss": 2.3741674423217773,
+    "diagonal": 0.5258317589759827,
+    "finite": 1.8483357429504395
+  },
+  {
+    "step": 381,
+    "loss": 2.4366493225097656,
+    "diagonal": 0.6438911557197571,
+    "finite": 1.7927581071853638
+  },
+  {
+    "step": 382,
+    "loss": 2.2274250984191895,
+    "diagonal": 0.6357913613319397,
+    "finite": 1.5916337966918945
+  },
+  {
+    "step": 383,
+    "loss": 2.2899231910705566,
+    "diagonal": 0.6281841397285461,
+    "finite": 1.6617391109466553
+  },
+  {
+    "step": 384,
+    "loss": 1.9454278945922852,
+    "diagonal": 0.5883185863494873,
+    "finite": 1.3571093082427979
+  },
+  {
+    "step": 385,
+    "loss": 2.6015138626098633,
+    "diagonal": 0.5452820062637329,
+    "finite": 2.05623197555542
+  },
+  {
+    "step": 386,
+    "loss": 2.9191195964813232,
+    "diagonal": 0.5684798359870911,
+    "finite": 2.350639820098877
+  },
+  {
+    "step": 387,
+    "loss": 2.8368422985076904,
+    "diagonal": 0.7038396000862122,
+    "finite": 2.133002758026123
+  },
+  {
+    "step": 388,
+    "loss": 3.052126884460449,
+    "diagonal": 0.801026463508606,
+    "finite": 2.2511003017425537
+  },
+  {
+    "step": 389,
+    "loss": 2.9275190830230713,
+    "diagonal": 0.6376922726631165,
+    "finite": 2.2898268699645996
+  },
+  {
+    "step": 390,
+    "loss": 2.3753037452697754,
+    "diagonal": 0.6847795844078064,
+    "finite": 1.6905242204666138
+  },
+  {
+    "step": 391,
+    "loss": 2.323244333267212,
+    "diagonal": 0.38631004095077515,
+    "finite": 1.9369343519210815
+  },
+  {
+    "step": 392,
+    "loss": 2.1098623275756836,
+    "diagonal": 0.5145366191864014,
+    "finite": 1.5953258275985718
+  },
+  {
+    "step": 393,
+    "loss": 2.3265628814697266,
+    "diagonal": 0.6441688537597656,
+    "finite": 1.6823941469192505
+  },
+  {
+    "step": 394,
+    "loss": 2.791036367416382,
+    "diagonal": 0.8000615239143372,
+    "finite": 1.9909749031066895
+  },
+  {
+    "step": 395,
+    "loss": 2.0553219318389893,
+    "diagonal": 0.5016929507255554,
+    "finite": 1.553628921508789
+  },
+  {
+    "step": 396,
+    "loss": 2.095684766769409,
+    "diagonal": 0.6941717863082886,
+    "finite": 1.4015129804611206
+  },
+  {
+    "step": 397,
+    "loss": 2.31033992767334,
+    "diagonal": 0.4569605588912964,
+    "finite": 1.853379249572754
+  },
+  {
+    "step": 398,
+    "loss": 2.456418037414551,
+    "diagonal": 0.6923935413360596,
+    "finite": 1.7640244960784912
+  },
+  {
+    "step": 399,
+    "loss": 2.847670316696167,
+    "diagonal": 0.5348839163780212,
+    "finite": 2.312786340713501
+  },
+  {
+    "step": 400,
+    "loss": 2.298306941986084,
+    "diagonal": 0.5848121643066406,
+    "finite": 1.7134947776794434
+  },
+  {
+    "step": 401,
+    "loss": 2.58920955657959,
+    "diagonal": 0.6636963486671448,
+    "finite": 1.9255131483078003
+  },
+  {
+    "step": 402,
+    "loss": 2.6485257148742676,
+    "diagonal": 0.6572068929672241,
+    "finite": 1.9913188219070435
+  },
+  {
+    "step": 403,
+    "loss": 2.9138948917388916,
+    "diagonal": 0.6980233192443848,
+    "finite": 2.215871572494507
+  },
+  {
+    "step": 404,
+    "loss": 1.963123083114624,
+    "diagonal": 0.4862986207008362,
+    "finite": 1.476824402809143
+  },
+  {
+    "step": 405,
+    "loss": 2.514176607131958,
+    "diagonal": 0.5952569842338562,
+    "finite": 1.918919563293457
+  },
+  {
+    "step": 406,
+    "loss": 1.8562556505203247,
+    "diagonal": 0.3427967131137848,
+    "finite": 1.5134589672088623
+  },
+  {
+    "step": 407,
+    "loss": 2.380326747894287,
+    "diagonal": 0.7199180722236633,
+    "finite": 1.660408616065979
+  },
+  {
+    "step": 408,
+    "loss": 2.095728874206543,
+    "diagonal": 0.48921704292297363,
+    "finite": 1.6065118312835693
+  },
+  {
+    "step": 409,
+    "loss": 2.819413661956787,
+    "diagonal": 0.6013084650039673,
+    "finite": 2.2181050777435303
+  },
+  {
+    "step": 410,
+    "loss": 3.0144543647766113,
+    "diagonal": 0.7662005424499512,
+    "finite": 2.24825382232666
+  },
+  {
+    "step": 411,
+    "loss": 1.9142873287200928,
+    "diagonal": 0.41086453199386597,
+    "finite": 1.5034228563308716
+  },
+  {
+    "step": 412,
+    "loss": 2.2684571743011475,
+    "diagonal": 0.4802837669849396,
+    "finite": 1.7881734371185303
+  },
+  {
+    "step": 413,
+    "loss": 2.4272990226745605,
+    "diagonal": 0.6449647545814514,
+    "finite": 1.7823342084884644
+  },
+  {
+    "step": 414,
+    "loss": 2.1699323654174805,
+    "diagonal": 0.6428174376487732,
+    "finite": 1.527114987373352
+  },
+  {
+    "step": 415,
+    "loss": 2.0342907905578613,
+    "diagonal": 0.38474294543266296,
+    "finite": 1.649547815322876
+  },
+  {
+    "step": 416,
+    "loss": 2.194796562194824,
+    "diagonal": 0.5081348419189453,
+    "finite": 1.6866616010665894
+  },
+  {
+    "step": 417,
+    "loss": 2.4977030754089355,
+    "diagonal": 0.6975991129875183,
+    "finite": 1.800104022026062
+  },
+  {
+    "step": 418,
+    "loss": 2.69108510017395,
+    "diagonal": 0.6248018741607666,
+    "finite": 2.0662832260131836
+  },
+  {
+    "step": 419,
+    "loss": 1.864540934562683,
+    "diagonal": 0.5012005567550659,
+    "finite": 1.3633403778076172
+  },
+  {
+    "step": 420,
+    "loss": 2.554413080215454,
+    "diagonal": 0.6370112299919128,
+    "finite": 1.9174017906188965
+  },
+  {
+    "step": 421,
+    "loss": 1.8769716024398804,
+    "diagonal": 0.39277467131614685,
+    "finite": 1.4841969013214111
+  },
+  {
+    "step": 422,
+    "loss": 2.0840108394622803,
+    "diagonal": 0.5293439626693726,
+    "finite": 1.5546668767929077
+  },
+  {
+    "step": 423,
+    "loss": 2.4410171508789062,
+    "diagonal": 0.7049098610877991,
+    "finite": 1.736107349395752
+  },
+  {
+    "step": 424,
+    "loss": 2.508213758468628,
+    "diagonal": 0.5774896740913391,
+    "finite": 1.9307241439819336
+  },
+  {
+    "step": 425,
+    "loss": 1.989100694656372,
+    "diagonal": 0.45901668071746826,
+    "finite": 1.5300840139389038
+  },
+  {
+    "step": 426,
+    "loss": 1.8992754220962524,
+    "diagonal": 0.48442959785461426,
+    "finite": 1.4148458242416382
+  },
+  {
+    "step": 427,
+    "loss": 2.1973419189453125,
+    "diagonal": 0.5938986539840698,
+    "finite": 1.6034433841705322
+  },
+  {
+    "step": 428,
+    "loss": 2.6568031311035156,
+    "diagonal": 0.5130007863044739,
+    "finite": 2.1438024044036865
+  },
+  {
+    "step": 429,
+    "loss": 1.8485629558563232,
+    "diagonal": 0.49338775873184204,
+    "finite": 1.355175256729126
+  },
+  {
+    "step": 430,
+    "loss": 1.9077483415603638,
+    "diagonal": 0.4364762306213379,
+    "finite": 1.4712721109390259
+  },
+  {
+    "step": 431,
+    "loss": 2.461954355239868,
+    "diagonal": 0.5205764174461365,
+    "finite": 1.941377878189087
+  },
+  {
+    "step": 432,
+    "loss": 1.7904045581817627,
+    "diagonal": 0.5944273471832275,
+    "finite": 1.1959772109985352
+  },
+  {
+    "step": 433,
+    "loss": 2.030365467071533,
+    "diagonal": 0.5489309430122375,
+    "finite": 1.4814344644546509
+  },
+  {
+    "step": 434,
+    "loss": 2.246659994125366,
+    "diagonal": 0.6214115619659424,
+    "finite": 1.6252484321594238
+  },
+  {
+    "step": 435,
+    "loss": 2.137162685394287,
+    "diagonal": 0.4995384216308594,
+    "finite": 1.6376243829727173
+  },
+  {
+    "step": 436,
+    "loss": 1.8216140270233154,
+    "diagonal": 0.4274722933769226,
+    "finite": 1.3941417932510376
+  },
+  {
+    "step": 437,
+    "loss": 2.295783519744873,
+    "diagonal": 0.6955350637435913,
+    "finite": 1.6002484560012817
+  },
+  {
+    "step": 438,
+    "loss": 1.9829866886138916,
+    "diagonal": 0.45193928480148315,
+    "finite": 1.5310473442077637
+  },
+  {
+    "step": 439,
+    "loss": 1.6892468929290771,
+    "diagonal": 0.39557209610939026,
+    "finite": 1.2936748266220093
+  },
+  {
+    "step": 440,
+    "loss": 2.7333295345306396,
+    "diagonal": 0.652646005153656,
+    "finite": 2.080683469772339
+  },
+  {
+    "step": 441,
+    "loss": 2.311506748199463,
+    "diagonal": 0.63555908203125,
+    "finite": 1.6759477853775024
+  },
+  {
+    "step": 442,
+    "loss": 2.164836883544922,
+    "diagonal": 0.4441465139389038,
+    "finite": 1.7206904888153076
+  },
+  {
+    "step": 443,
+    "loss": 1.8741931915283203,
+    "diagonal": 0.48928993940353394,
+    "finite": 1.3849031925201416
+  },
+  {
+    "step": 444,
+    "loss": 2.4021008014678955,
+    "diagonal": 0.4411018490791321,
+    "finite": 1.9609988927841187
+  },
+  {
+    "step": 445,
+    "loss": 1.8955529928207397,
+    "diagonal": 0.5417985916137695,
+    "finite": 1.3537544012069702
+  },
+  {
+    "step": 446,
+    "loss": 1.5974538326263428,
+    "diagonal": 0.35005703568458557,
+    "finite": 1.2473968267440796
+  },
+  {
+    "step": 447,
+    "loss": 2.0042216777801514,
+    "diagonal": 0.41327643394470215,
+    "finite": 1.5909452438354492
+  },
+  {
+    "step": 448,
+    "loss": 2.269690752029419,
+    "diagonal": 0.540905237197876,
+    "finite": 1.728785514831543
+  },
+  {
+    "step": 449,
+    "loss": 2.6814045906066895,
+    "diagonal": 0.6560143828392029,
+    "finite": 2.025390148162842
+  },
+  {
+    "step": 450,
+    "loss": 1.9786845445632935,
+    "diagonal": 0.6248337030410767,
+    "finite": 1.3538508415222168
+  },
+  {
+    "step": 451,
+    "loss": 2.2369842529296875,
+    "diagonal": 0.5048373341560364,
+    "finite": 1.7321468591690063
+  },
+  {
+    "step": 452,
+    "loss": 2.1909689903259277,
+    "diagonal": 0.44287291169166565,
+    "finite": 1.748095989227295
+  },
+  {
+    "step": 453,
+    "loss": 2.463780641555786,
+    "diagonal": 0.6026948094367981,
+    "finite": 1.8610858917236328
+  },
+  {
+    "step": 454,
+    "loss": 2.060962438583374,
+    "diagonal": 0.5592678785324097,
+    "finite": 1.5016945600509644
+  },
+  {
+    "step": 455,
+    "loss": 2.8387138843536377,
+    "diagonal": 0.6965658068656921,
+    "finite": 2.142148017883301
+  },
+  {
+    "step": 456,
+    "loss": 2.076584815979004,
+    "diagonal": 0.593130886554718,
+    "finite": 1.4834538698196411
+  },
+  {
+    "step": 457,
+    "loss": 1.853830099105835,
+    "diagonal": 0.5103033781051636,
+    "finite": 1.3435267210006714
+  },
+  {
+    "step": 458,
+    "loss": 1.756991982460022,
+    "diagonal": 0.3064364194869995,
+    "finite": 1.4505555629730225
+  },
+  {
+    "step": 459,
+    "loss": 1.8500642776489258,
+    "diagonal": 0.5230219960212708,
+    "finite": 1.3270422220230103
+  },
+  {
+    "step": 460,
+    "loss": 1.8558170795440674,
+    "diagonal": 0.5137669444084167,
+    "finite": 1.3420501947402954
+  },
+  {
+    "step": 461,
+    "loss": 2.520923614501953,
+    "diagonal": 0.4578236937522888,
+    "finite": 2.0630998611450195
+  },
+  {
+    "step": 462,
+    "loss": 1.755030632019043,
+    "diagonal": 0.4533664584159851,
+    "finite": 1.301664113998413
+  },
+  {
+    "step": 463,
+    "loss": 2.233903408050537,
+    "diagonal": 0.4292997121810913,
+    "finite": 1.8046035766601562
+  },
+  {
+    "step": 464,
+    "loss": 1.9402692317962646,
+    "diagonal": 0.5402290225028992,
+    "finite": 1.4000402688980103
+  },
+  {
+    "step": 465,
+    "loss": 1.9335980415344238,
+    "diagonal": 0.44389647245407104,
+    "finite": 1.489701509475708
+  },
+  {
+    "step": 466,
+    "loss": 2.434683322906494,
+    "diagonal": 0.714552104473114,
+    "finite": 1.7201311588287354
+  },
+  {
+    "step": 467,
+    "loss": 2.2832419872283936,
+    "diagonal": 0.5081120133399963,
+    "finite": 1.775130033493042
+  },
+  {
+    "step": 468,
+    "loss": 1.8610355854034424,
+    "diagonal": 0.5055415034294128,
+    "finite": 1.3554940223693848
+  },
+  {
+    "step": 469,
+    "loss": 2.3129594326019287,
+    "diagonal": 0.5093218088150024,
+    "finite": 1.8036376237869263
+  },
+  {
+    "step": 470,
+    "loss": 2.0459015369415283,
+    "diagonal": 0.5582764744758606,
+    "finite": 1.487625002861023
+  },
+  {
+    "step": 471,
+    "loss": 2.1509900093078613,
+    "diagonal": 0.529517412185669,
+    "finite": 1.6214724779129028
+  },
+  {
+    "step": 472,
+    "loss": 1.8793716430664062,
+    "diagonal": 0.3970387578010559,
+    "finite": 1.4823329448699951
+  },
+  {
+    "step": 473,
+    "loss": 1.9643702507019043,
+    "diagonal": 0.45693308115005493,
+    "finite": 1.5074372291564941
+  },
+  {
+    "step": 474,
+    "loss": 2.182363271713257,
+    "diagonal": 0.5494606494903564,
+    "finite": 1.6329026222229004
+  },
+  {
+    "step": 475,
+    "loss": 2.206139087677002,
+    "diagonal": 0.5048481225967407,
+    "finite": 1.7012909650802612
+  },
+  {
+    "step": 476,
+    "loss": 2.2827773094177246,
+    "diagonal": 0.6801878809928894,
+    "finite": 1.6025893688201904
+  },
+  {
+    "step": 477,
+    "loss": 1.9505953788757324,
+    "diagonal": 0.4894642233848572,
+    "finite": 1.46113121509552
+  },
+  {
+    "step": 478,
+    "loss": 1.8914653062820435,
+    "diagonal": 0.5906418561935425,
+    "finite": 1.300823450088501
+  },
+  {
+    "step": 479,
+    "loss": 1.3096659183502197,
+    "diagonal": 0.3320852220058441,
+    "finite": 0.9775806665420532
+  },
+  {
+    "step": 480,
+    "loss": 1.387244462966919,
+    "diagonal": 0.3896382451057434,
+    "finite": 0.9976061582565308
+  },
+  {
+    "step": 481,
+    "loss": 2.1612558364868164,
+    "diagonal": 0.7597150802612305,
+    "finite": 1.4015406370162964
+  },
+  {
+    "step": 482,
+    "loss": 2.121443748474121,
+    "diagonal": 0.5289245247840881,
+    "finite": 1.5925191640853882
+  },
+  {
+    "step": 483,
+    "loss": 1.9772045612335205,
+    "diagonal": 0.38854244351387024,
+    "finite": 1.5886621475219727
+  },
+  {
+    "step": 484,
+    "loss": 2.6311511993408203,
+    "diagonal": 0.7100571393966675,
+    "finite": 1.9210939407348633
+  },
+  {
+    "step": 485,
+    "loss": 2.1533443927764893,
+    "diagonal": 0.5736485123634338,
+    "finite": 1.5796959400177002
+  },
+  {
+    "step": 486,
+    "loss": 1.173994541168213,
+    "diagonal": 0.3050035834312439,
+    "finite": 0.8689910173416138
+  },
+  {
+    "step": 487,
+    "loss": 1.6350537538528442,
+    "diagonal": 0.3789179027080536,
+    "finite": 1.2561358213424683
+  },
+  {
+    "step": 488,
+    "loss": 2.061067819595337,
+    "diagonal": 0.4443642795085907,
+    "finite": 1.6167035102844238
+  },
+  {
+    "step": 489,
+    "loss": 2.0695037841796875,
+    "diagonal": 0.5548694729804993,
+    "finite": 1.514634370803833
+  },
+  {
+    "step": 490,
+    "loss": 1.5372987985610962,
+    "diagonal": 0.4168151915073395,
+    "finite": 1.120483636856079
+  },
+  {
+    "step": 491,
+    "loss": 1.528831958770752,
+    "diagonal": 0.37078535556793213,
+    "finite": 1.1580466032028198
+  },
+  {
+    "step": 492,
+    "loss": 2.1823463439941406,
+    "diagonal": 0.5651756525039673,
+    "finite": 1.617170810699463
+  },
+  {
+    "step": 493,
+    "loss": 1.5836460590362549,
+    "diagonal": 0.5826979875564575,
+    "finite": 1.0009480714797974
+  },
+  {
+    "step": 494,
+    "loss": 2.0753173828125,
+    "diagonal": 0.462859570980072,
+    "finite": 1.6124577522277832
+  },
+  {
+    "step": 495,
+    "loss": 1.3848627805709839,
+    "diagonal": 0.4509739577770233,
+    "finite": 0.9338887929916382
+  },
+  {
+    "step": 496,
+    "loss": 2.115591526031494,
+    "diagonal": 0.5651230812072754,
+    "finite": 1.5504684448242188
+  },
+  {
+    "step": 497,
+    "loss": 2.0324575901031494,
+    "diagonal": 0.5470284819602966,
+    "finite": 1.485429048538208
+  },
+  {
+    "step": 498,
+    "loss": 2.2905213832855225,
+    "diagonal": 0.6199541091918945,
+    "finite": 1.670567274093628
+  },
+  {
+    "step": 499,
+    "loss": 1.4736266136169434,
+    "diagonal": 0.4574805498123169,
+    "finite": 1.0161460638046265
+  },
+  {
+    "step": 500,
+    "loss": 1.9589192867279053,
+    "diagonal": 0.559274435043335,
+    "finite": 1.3996448516845703
+  },
+  {
+    "step": 501,
+    "loss": 2.006267547607422,
+    "diagonal": 0.6261279582977295,
+    "finite": 1.380139708518982
+  },
+  {
+    "step": 502,
+    "loss": 1.801804542541504,
+    "diagonal": 0.46594002842903137,
+    "finite": 1.335864543914795
+  },
+  {
+    "step": 503,
+    "loss": 1.789513111114502,
+    "diagonal": 0.5089958310127258,
+    "finite": 1.2805172204971313
+  },
+  {
+    "step": 504,
+    "loss": 1.7504487037658691,
+    "diagonal": 0.5188172459602356,
+    "finite": 1.2316315174102783
+  },
+  {
+    "step": 505,
+    "loss": 1.7197245359420776,
+    "diagonal": 0.3532334864139557,
+    "finite": 1.3664910793304443
+  },
+  {
+    "step": 506,
+    "loss": 1.6654328107833862,
+    "diagonal": 0.47853848338127136,
+    "finite": 1.1868942975997925
+  },
+  {
+    "step": 507,
+    "loss": 2.0914998054504395,
+    "diagonal": 0.4792928993701935,
+    "finite": 1.6122069358825684
+  },
+  {
+    "step": 508,
+    "loss": 1.9830081462860107,
+    "diagonal": 0.5417270064353943,
+    "finite": 1.4412810802459717
+  },
+  {
+    "step": 509,
+    "loss": 1.8408247232437134,
+    "diagonal": 0.5111719369888306,
+    "finite": 1.3296527862548828
+  },
+  {
+    "step": 510,
+    "loss": 2.3334951400756836,
+    "diagonal": 0.5109838843345642,
+    "finite": 1.8225113153457642
+  },
+  {
+    "step": 511,
+    "loss": 1.4802908897399902,
+    "diagonal": 0.35036829113960266,
+    "finite": 1.12992262840271
+  },
+  {
+    "step": 512,
+    "loss": 1.9640733003616333,
+    "diagonal": 0.5375789403915405,
+    "finite": 1.4264943599700928
+  },
+  {
+    "step": 513,
+    "loss": 2.002926826477051,
+    "diagonal": 0.5033503770828247,
+    "finite": 1.4995765686035156
+  },
+  {
+    "step": 514,
+    "loss": 1.6059424877166748,
+    "diagonal": 0.5151256322860718,
+    "finite": 1.090816855430603
+  },
+  {
+    "step": 515,
+    "loss": 2.1360855102539062,
+    "diagonal": 0.5726323127746582,
+    "finite": 1.5634530782699585
+  },
+  {
+    "step": 516,
+    "loss": 1.8411643505096436,
+    "diagonal": 0.48363199830055237,
+    "finite": 1.3575323820114136
+  },
+  {
+    "step": 517,
+    "loss": 1.1843171119689941,
+    "diagonal": 0.3580440878868103,
+    "finite": 0.8262730836868286
+  },
+  {
+    "step": 518,
+    "loss": 1.6571882963180542,
+    "diagonal": 0.5446803569793701,
+    "finite": 1.112507939338684
+  },
+  {
+    "step": 519,
+    "loss": 2.1478798389434814,
+    "diagonal": 0.38635414838790894,
+    "finite": 1.7615257501602173
+  },
+  {
+    "step": 520,
+    "loss": 1.6332876682281494,
+    "diagonal": 0.4430199861526489,
+    "finite": 1.1902676820755005
+  },
+  {
+    "step": 521,
+    "loss": 1.7312839031219482,
+    "diagonal": 0.4909228980541229,
+    "finite": 1.240360975265503
+  },
+  {
+    "step": 522,
+    "loss": 1.8066954612731934,
+    "diagonal": 0.5232896208763123,
+    "finite": 1.2834057807922363
+  },
+  {
+    "step": 523,
+    "loss": 1.4595272541046143,
+    "diagonal": 0.42365384101867676,
+    "finite": 1.0358734130859375
+  },
+  {
+    "step": 524,
+    "loss": 2.171624183654785,
+    "diagonal": 0.5207180976867676,
+    "finite": 1.6509060859680176
+  },
+  {
+    "step": 525,
+    "loss": 2.0433433055877686,
+    "diagonal": 0.6222127079963684,
+    "finite": 1.421130657196045
+  },
+  {
+    "step": 526,
+    "loss": 1.8037785291671753,
+    "diagonal": 0.49359437823295593,
+    "finite": 1.310184121131897
+  },
+  {
+    "step": 527,
+    "loss": 1.9260430335998535,
+    "diagonal": 0.5413027405738831,
+    "finite": 1.3847403526306152
+  },
+  {
+    "step": 528,
+    "loss": 1.5653128623962402,
+    "diagonal": 0.4744942784309387,
+    "finite": 1.0908185243606567
+  },
+  {
+    "step": 529,
+    "loss": 1.9311579465866089,
+    "diagonal": 0.6962624788284302,
+    "finite": 1.2348954677581787
+  },
+  {
+    "step": 530,
+    "loss": 1.5253926515579224,
+    "diagonal": 0.4597223103046417,
+    "finite": 1.065670371055603
+  },
+  {
+    "step": 531,
+    "loss": 1.6888867616653442,
+    "diagonal": 0.3933241367340088,
+    "finite": 1.2955626249313354
+  },
+  {
+    "step": 532,
+    "loss": 1.5324307680130005,
+    "diagonal": 0.42561423778533936,
+    "finite": 1.1068165302276611
+  },
+  {
+    "step": 533,
+    "loss": 1.496266484260559,
+    "diagonal": 0.4016772210597992,
+    "finite": 1.0945892333984375
+  },
+  {
+    "step": 534,
+    "loss": 1.7097058296203613,
+    "diagonal": 0.40650835633277893,
+    "finite": 1.3031975030899048
+  },
+  {
+    "step": 535,
+    "loss": 2.2827324867248535,
+    "diagonal": 0.4890364408493042,
+    "finite": 1.7936960458755493
+  },
+  {
+    "step": 536,
+    "loss": 1.772454023361206,
+    "diagonal": 0.34456032514572144,
+    "finite": 1.4278937578201294
+  },
+  {
+    "step": 537,
+    "loss": 1.8752565383911133,
+    "diagonal": 0.5321568846702576,
+    "finite": 1.3430997133255005
+  },
+  {
+    "step": 538,
+    "loss": 1.6895332336425781,
+    "diagonal": 0.5062534809112549,
+    "finite": 1.1832797527313232
+  },
+  {
+    "step": 539,
+    "loss": 1.4174838066101074,
+    "diagonal": 0.3643791973590851,
+    "finite": 1.0531046390533447
+  },
+  {
+    "step": 540,
+    "loss": 1.7826168537139893,
+    "diagonal": 0.523944616317749,
+    "finite": 1.2586722373962402
+  },
+  {
+    "step": 541,
+    "loss": 1.5170763731002808,
+    "diagonal": 0.4056107699871063,
+    "finite": 1.111465573310852
+  },
+  {
+    "step": 542,
+    "loss": 1.8601646423339844,
+    "diagonal": 0.42877888679504395,
+    "finite": 1.4313857555389404
+  },
+  {
+    "step": 543,
+    "loss": 1.9496066570281982,
+    "diagonal": 0.4802195429801941,
+    "finite": 1.4693870544433594
+  },
+  {
+    "step": 544,
+    "loss": 1.520914077758789,
+    "diagonal": 0.42819732427597046,
+    "finite": 1.0927168130874634
+  },
+  {
+    "step": 545,
+    "loss": 1.532199740409851,
+    "diagonal": 0.38886621594429016,
+    "finite": 1.1433335542678833
+  },
+  {
+    "step": 546,
+    "loss": 1.5905952453613281,
+    "diagonal": 0.5405017733573914,
+    "finite": 1.0500935316085815
+  },
+  {
+    "step": 547,
+    "loss": 1.8850905895233154,
+    "diagonal": 0.5385124087333679,
+    "finite": 1.3465781211853027
+  },
+  {
+    "step": 548,
+    "loss": 1.8866392374038696,
+    "diagonal": 0.5601154565811157,
+    "finite": 1.326523780822754
+  },
+  {
+    "step": 549,
+    "loss": 2.191401720046997,
+    "diagonal": 0.5221851468086243,
+    "finite": 1.669216513633728
+  },
+  {
+    "step": 550,
+    "loss": 1.4180878400802612,
+    "diagonal": 0.4316115081310272,
+    "finite": 0.9864763021469116
+  },
+  {
+    "step": 551,
+    "loss": 1.550055742263794,
+    "diagonal": 0.370664119720459,
+    "finite": 1.179391622543335
+  },
+  {
+    "step": 552,
+    "loss": 2.148470401763916,
+    "diagonal": 0.5412737131118774,
+    "finite": 1.6071966886520386
+  },
+  {
+    "step": 553,
+    "loss": 1.7665427923202515,
+    "diagonal": 0.42166128754615784,
+    "finite": 1.344881534576416
+  },
+  {
+    "step": 554,
+    "loss": 2.0385777950286865,
+    "diagonal": 0.4991193413734436,
+    "finite": 1.5394583940505981
+  },
+  {
+    "step": 555,
+    "loss": 1.5528037548065186,
+    "diagonal": 0.3404068350791931,
+    "finite": 1.2123968601226807
+  },
+  {
+    "step": 556,
+    "loss": 1.9944032430648804,
+    "diagonal": 0.6191976070404053,
+    "finite": 1.375205636024475
+  },
+  {
+    "step": 557,
+    "loss": 2.138216972351074,
+    "diagonal": 0.4705450236797333,
+    "finite": 1.667672038078308
+  },
+  {
+    "step": 558,
+    "loss": 1.199811577796936,
+    "diagonal": 0.30765458941459656,
+    "finite": 0.8921569585800171
+  },
+  {
+    "step": 559,
+    "loss": 1.2257012128829956,
+    "diagonal": 0.441444456577301,
+    "finite": 0.7842567563056946
+  },
+  {
+    "step": 560,
+    "loss": 1.6269588470458984,
+    "diagonal": 0.4355662167072296,
+    "finite": 1.1913926601409912
+  },
+  {
+    "step": 561,
+    "loss": 1.8645321130752563,
+    "diagonal": 0.41692766547203064,
+    "finite": 1.4476044178009033
+  },
+  {
+    "step": 562,
+    "loss": 2.1903746128082275,
+    "diagonal": 0.6290820240974426,
+    "finite": 1.5612926483154297
+  },
+  {
+    "step": 563,
+    "loss": 1.5102007389068604,
+    "diagonal": 0.4910908341407776,
+    "finite": 1.0191099643707275
+  },
+  {
+    "step": 564,
+    "loss": 1.5630724430084229,
+    "diagonal": 0.4299631118774414,
+    "finite": 1.1331093311309814
+  },
+  {
+    "step": 565,
+    "loss": 1.4727091789245605,
+    "diagonal": 0.341532438993454,
+    "finite": 1.1311767101287842
+  },
+  {
+    "step": 566,
+    "loss": 1.9029573202133179,
+    "diagonal": 0.563075065612793,
+    "finite": 1.339882254600525
+  },
+  {
+    "step": 567,
+    "loss": 1.4220322370529175,
+    "diagonal": 0.3307032287120819,
+    "finite": 1.0913289785385132
+  },
+  {
+    "step": 568,
+    "loss": 1.5595762729644775,
+    "diagonal": 0.3974485993385315,
+    "finite": 1.1621277332305908
+  },
+  {
+    "step": 569,
+    "loss": 1.3474063873291016,
+    "diagonal": 0.4908578097820282,
+    "finite": 0.8565486073493958
+  },
+  {
+    "step": 570,
+    "loss": 2.3691534996032715,
+    "diagonal": 0.5943419933319092,
+    "finite": 1.7748115062713623
+  },
+  {
+    "step": 571,
+    "loss": 1.889088749885559,
+    "diagonal": 0.4527420997619629,
+    "finite": 1.4363466501235962
+  },
+  {
+    "step": 572,
+    "loss": 1.6469624042510986,
+    "diagonal": 0.30561351776123047,
+    "finite": 1.3413488864898682
+  },
+  {
+    "step": 573,
+    "loss": 2.012511730194092,
+    "diagonal": 0.4922260642051697,
+    "finite": 1.520285725593567
+  },
+  {
+    "step": 574,
+    "loss": 1.3440207242965698,
+    "diagonal": 0.3040353059768677,
+    "finite": 1.0399854183197021
+  },
+  {
+    "step": 575,
+    "loss": 1.1262702941894531,
+    "diagonal": 0.3347848653793335,
+    "finite": 0.7914854288101196
+  },
+  {
+    "step": 576,
+    "loss": 1.889002799987793,
+    "diagonal": 0.36689135432243347,
+    "finite": 1.522111415863037
+  },
+  {
+    "step": 577,
+    "loss": 1.5697864294052124,
+    "diagonal": 0.41547250747680664,
+    "finite": 1.1543139219284058
+  },
+  {
+    "step": 578,
+    "loss": 2.060518264770508,
+    "diagonal": 0.525428831577301,
+    "finite": 1.5350894927978516
+  },
+  {
+    "step": 579,
+    "loss": 1.46622896194458,
+    "diagonal": 0.3836080729961395,
+    "finite": 1.0826208591461182
+  },
+  {
+    "step": 580,
+    "loss": 1.8009966611862183,
+    "diagonal": 0.5705769062042236,
+    "finite": 1.2304197549819946
+  },
+  {
+    "step": 581,
+    "loss": 2.1225175857543945,
+    "diagonal": 0.7353659868240356,
+    "finite": 1.3871514797210693
+  },
+  {
+    "step": 582,
+    "loss": 2.002776622772217,
+    "diagonal": 0.5179977416992188,
+    "finite": 1.4847787618637085
+  },
+  {
+    "step": 583,
+    "loss": 1.6510212421417236,
+    "diagonal": 0.3936043381690979,
+    "finite": 1.257416844367981
+  },
+  {
+    "step": 584,
+    "loss": 1.574159860610962,
+    "diagonal": 0.48227936029434204,
+    "finite": 1.091880440711975
+  },
+  {
+    "step": 585,
+    "loss": 2.275329828262329,
+    "diagonal": 0.6317830681800842,
+    "finite": 1.6435468196868896
+  },
+  {
+    "step": 586,
+    "loss": 1.4472500085830688,
+    "diagonal": 0.38209137320518494,
+    "finite": 1.0651586055755615
+  },
+  {
+    "step": 587,
+    "loss": 1.530320167541504,
+    "diagonal": 0.3887045085430145,
+    "finite": 1.141615629196167
+  },
+  {
+    "step": 588,
+    "loss": 1.1835882663726807,
+    "diagonal": 0.3493569493293762,
+    "finite": 0.8342313170433044
+  },
+  {
+    "step": 589,
+    "loss": 1.664259433746338,
+    "diagonal": 0.4762819707393646,
+    "finite": 1.1879774332046509
+  },
+  {
+    "step": 590,
+    "loss": 1.6079968214035034,
+    "diagonal": 0.31788527965545654,
+    "finite": 1.2901115417480469
+  },
+  {
+    "step": 591,
+    "loss": 1.3619098663330078,
+    "diagonal": 0.344832181930542,
+    "finite": 1.0170776844024658
+  },
+  {
+    "step": 592,
+    "loss": 1.8254740238189697,
+    "diagonal": 0.5094416737556458,
+    "finite": 1.3160322904586792
+  },
+  {
+    "step": 593,
+    "loss": 1.6436307430267334,
+    "diagonal": 0.4848597049713135,
+    "finite": 1.15877103805542
+  },
+  {
+    "step": 594,
+    "loss": 1.8014872074127197,
+    "diagonal": 0.4646347165107727,
+    "finite": 1.3368524312973022
+  },
+  {
+    "step": 595,
+    "loss": 1.8878445625305176,
+    "diagonal": 0.376095712184906,
+    "finite": 1.5117489099502563
+  },
+  {
+    "step": 596,
+    "loss": 1.4784822463989258,
+    "diagonal": 0.38884085416793823,
+    "finite": 1.0896413326263428
+  },
+  {
+    "step": 597,
+    "loss": 1.621187686920166,
+    "diagonal": 0.3136424422264099,
+    "finite": 1.3075451850891113
+  },
+  {
+    "step": 598,
+    "loss": 1.542351245880127,
+    "diagonal": 0.42507222294807434,
+    "finite": 1.117279052734375
+  },
+  {
+    "step": 599,
+    "loss": 1.2098650932312012,
+    "diagonal": 0.39523857831954956,
+    "finite": 0.8146264553070068
+  },
+  {
+    "step": 600,
+    "loss": 2.1809699535369873,
+    "diagonal": 0.4827263355255127,
+    "finite": 1.6982436180114746
+  },
+  {
+    "step": 601,
+    "loss": 1.772085189819336,
+    "diagonal": 0.5635716915130615,
+    "finite": 1.2085134983062744
+  },
+  {
+    "step": 602,
+    "loss": 1.3155632019042969,
+    "diagonal": 0.2817878723144531,
+    "finite": 1.0337753295898438
+  },
+  {
+    "step": 603,
+    "loss": 1.7438851594924927,
+    "diagonal": 0.49837955832481384,
+    "finite": 1.2455055713653564
+  },
+  {
+    "step": 604,
+    "loss": 1.7281638383865356,
+    "diagonal": 0.5149973630905151,
+    "finite": 1.2131664752960205
+  },
+  {
+    "step": 605,
+    "loss": 1.770493745803833,
+    "diagonal": 0.43118077516555786,
+    "finite": 1.33931303024292
+  },
+  {
+    "step": 606,
+    "loss": 2.0832931995391846,
+    "diagonal": 0.5323976278305054,
+    "finite": 1.5508955717086792
+  },
+  {
+    "step": 607,
+    "loss": 1.8829561471939087,
+    "diagonal": 0.5034376382827759,
+    "finite": 1.3795185089111328
+  },
+  {
+    "step": 608,
+    "loss": 1.7266950607299805,
+    "diagonal": 0.3451049029827118,
+    "finite": 1.3815901279449463
+  },
+  {
+    "step": 609,
+    "loss": 1.5258363485336304,
+    "diagonal": 0.47674331068992615,
+    "finite": 1.0490930080413818
+  },
+  {
+    "step": 610,
+    "loss": 1.650556206703186,
+    "diagonal": 0.4473656117916107,
+    "finite": 1.203190565109253
+  },
+  {
+    "step": 611,
+    "loss": 1.4282418489456177,
+    "diagonal": 0.42176005244255066,
+    "finite": 1.0064817667007446
+  },
+  {
+    "step": 612,
+    "loss": 1.6916913986206055,
+    "diagonal": 0.41801244020462036,
+    "finite": 1.2736790180206299
+  },
+  {
+    "step": 613,
+    "loss": 1.5038700103759766,
+    "diagonal": 0.5010347962379456,
+    "finite": 1.0028351545333862
+  },
+  {
+    "step": 614,
+    "loss": 1.303734302520752,
+    "diagonal": 0.3823401629924774,
+    "finite": 0.9213941097259521
+  },
+  {
+    "step": 615,
+    "loss": 2.0251426696777344,
+    "diagonal": 0.45752090215682983,
+    "finite": 1.5676217079162598
+  },
+  {
+    "step": 616,
+    "loss": 1.6155872344970703,
+    "diagonal": 0.47474831342697144,
+    "finite": 1.1408389806747437
+  },
+  {
+    "step": 617,
+    "loss": 1.1583632230758667,
+    "diagonal": 0.3235182464122772,
+    "finite": 0.8348449468612671
+  },
+  {
+    "step": 618,
+    "loss": 2.0656228065490723,
+    "diagonal": 0.36586153507232666,
+    "finite": 1.699761152267456
+  },
+  {
+    "step": 619,
+    "loss": 1.5434138774871826,
+    "diagonal": 0.3583226799964905,
+    "finite": 1.1850911378860474
+  },
+  {
+    "step": 620,
+    "loss": 1.9149284362792969,
+    "diagonal": 0.3810591995716095,
+    "finite": 1.5338692665100098
+  },
+  {
+    "step": 621,
+    "loss": 2.1625845432281494,
+    "diagonal": 0.5771726369857788,
+    "finite": 1.5854119062423706
+  },
+  {
+    "step": 622,
+    "loss": 1.31198251247406,
+    "diagonal": 0.4036028981208801,
+    "finite": 0.9083796143531799
+  },
+  {
+    "step": 623,
+    "loss": 1.951051115989685,
+    "diagonal": 0.47266843914985657,
+    "finite": 1.4783827066421509
+  },
+  {
+    "step": 624,
+    "loss": 1.3374273777008057,
+    "diagonal": 0.4059629738330841,
+    "finite": 0.9314643740653992
+  },
+  {
+    "step": 625,
+    "loss": 1.5395736694335938,
+    "diagonal": 0.49489396810531616,
+    "finite": 1.0446796417236328
+  },
+  {
+    "step": 626,
+    "loss": 1.7861323356628418,
+    "diagonal": 0.45345133543014526,
+    "finite": 1.3326809406280518
+  },
+  {
+    "step": 627,
+    "loss": 1.6473942995071411,
+    "diagonal": 0.4761442244052887,
+    "finite": 1.1712501049041748
+  },
+  {
+    "step": 628,
+    "loss": 1.6134940385818481,
+    "diagonal": 0.5223058462142944,
+    "finite": 1.0911881923675537
+  },
+  {
+    "step": 629,
+    "loss": 2.04021954536438,
+    "diagonal": 0.5338261127471924,
+    "finite": 1.5063934326171875
+  },
+  {
+    "step": 630,
+    "loss": 1.2933810949325562,
+    "diagonal": 0.3542100489139557,
+    "finite": 0.9391710758209229
+  },
+  {
+    "step": 631,
+    "loss": 1.3418525457382202,
+    "diagonal": 0.34246358275413513,
+    "finite": 0.9993889927864075
+  },
+  {
+    "step": 632,
+    "loss": 1.6862893104553223,
+    "diagonal": 0.6639068722724915,
+    "finite": 1.0223824977874756
+  },
+  {
+    "step": 633,
+    "loss": 1.7047470808029175,
+    "diagonal": 0.31742486357688904,
+    "finite": 1.387322187423706
+  },
+  {
+    "step": 634,
+    "loss": 1.5502161979675293,
+    "diagonal": 0.33003345131874084,
+    "finite": 1.2201827764511108
+  },
+  {
+    "step": 635,
+    "loss": 1.2979809045791626,
+    "diagonal": 0.3740447759628296,
+    "finite": 0.923936128616333
+  },
+  {
+    "step": 636,
+    "loss": 1.5295861959457397,
+    "diagonal": 0.43943214416503906,
+    "finite": 1.0901540517807007
+  },
+  {
+    "step": 637,
+    "loss": 1.9408031702041626,
+    "diagonal": 0.5438840389251709,
+    "finite": 1.3969191312789917
+  },
+  {
+    "step": 638,
+    "loss": 1.8600597381591797,
+    "diagonal": 0.5082144141197205,
+    "finite": 1.3518452644348145
+  },
+  {
+    "step": 639,
+    "loss": 1.4108355045318604,
+    "diagonal": 0.40751251578330994,
+    "finite": 1.003322958946228
+  },
+  {
+    "step": 640,
+    "loss": 1.6256972551345825,
+    "diagonal": 0.39260801672935486,
+    "finite": 1.2330892086029053
+  },
+  {
+    "step": 641,
+    "loss": 1.5211414098739624,
+    "diagonal": 0.48448848724365234,
+    "finite": 1.03665292263031
+  },
+  {
+    "step": 642,
+    "loss": 2.0944600105285645,
+    "diagonal": 0.5920727252960205,
+    "finite": 1.5023874044418335
+  },
+  {
+    "step": 643,
+    "loss": 1.5938761234283447,
+    "diagonal": 0.37876957654953003,
+    "finite": 1.21510648727417
+  },
+  {
+    "step": 644,
+    "loss": 1.4973019361495972,
+    "diagonal": 0.3733108341693878,
+    "finite": 1.1239911317825317
+  },
+  {
+    "step": 645,
+    "loss": 1.7142064571380615,
+    "diagonal": 0.42366477847099304,
+    "finite": 1.290541648864746
+  },
+  {
+    "step": 646,
+    "loss": 1.3879412412643433,
+    "diagonal": 0.3923192322254181,
+    "finite": 0.9956219792366028
+  },
+  {
+    "step": 647,
+    "loss": 1.6536197662353516,
+    "diagonal": 0.5061696767807007,
+    "finite": 1.1474500894546509
+  },
+  {
+    "step": 648,
+    "loss": 1.4853219985961914,
+    "diagonal": 0.4952804446220398,
+    "finite": 0.9900414943695068
+  },
+  {
+    "step": 649,
+    "loss": 1.2341879606246948,
+    "diagonal": 0.30437561869621277,
+    "finite": 0.9298123717308044
+  },
+  {
+    "step": 650,
+    "loss": 1.5148299932479858,
+    "diagonal": 0.36442145705223083,
+    "finite": 1.1504085063934326
+  },
+  {
+    "step": 651,
+    "loss": 1.691215991973877,
+    "diagonal": 0.4698106050491333,
+    "finite": 1.2214053869247437
+  },
+  {
+    "step": 652,
+    "loss": 1.969840407371521,
+    "diagonal": 0.605243444442749,
+    "finite": 1.364596962928772
+  },
+  {
+    "step": 653,
+    "loss": 1.9527342319488525,
+    "diagonal": 0.43259698152542114,
+    "finite": 1.5201373100280762
+  },
+  {
+    "step": 654,
+    "loss": 1.809276819229126,
+    "diagonal": 0.41866230964660645,
+    "finite": 1.3906145095825195
+  },
+  {
+    "step": 655,
+    "loss": 1.3852190971374512,
+    "diagonal": 0.33902907371520996,
+    "finite": 1.0461900234222412
+  },
+  {
+    "step": 656,
+    "loss": 2.1179728507995605,
+    "diagonal": 0.5356765985488892,
+    "finite": 1.5822962522506714
+  },
+  {
+    "step": 657,
+    "loss": 1.5480384826660156,
+    "diagonal": 0.4805266857147217,
+    "finite": 1.067511796951294
+  },
+  {
+    "step": 658,
+    "loss": 1.5802161693572998,
+    "diagonal": 0.4859147071838379,
+    "finite": 1.094301462173462
+  },
+  {
+    "step": 659,
+    "loss": 2.232870101928711,
+    "diagonal": 0.6025310754776001,
+    "finite": 1.6303391456604004
+  },
+  {
+    "step": 660,
+    "loss": 1.9586936235427856,
+    "diagonal": 0.42215609550476074,
+    "finite": 1.536537528038025
+  },
+  {
+    "step": 661,
+    "loss": 1.8649685382843018,
+    "diagonal": 0.5521054863929749,
+    "finite": 1.3128631114959717
+  },
+  {
+    "step": 662,
+    "loss": 2.367551803588867,
+    "diagonal": 0.5024880170822144,
+    "finite": 1.8650637865066528
+  },
+  {
+    "step": 663,
+    "loss": 1.8373925685882568,
+    "diagonal": 0.5071724653244019,
+    "finite": 1.330220103263855
+  },
+  {
+    "step": 664,
+    "loss": 1.96778404712677,
+    "diagonal": 0.48769092559814453,
+    "finite": 1.4800931215286255
+  },
+  {
+    "step": 665,
+    "loss": 1.7263022661209106,
+    "diagonal": 0.43125760555267334,
+    "finite": 1.2950446605682373
+  },
+  {
+    "step": 666,
+    "loss": 1.6914787292480469,
+    "diagonal": 0.40979501605033875,
+    "finite": 1.2816836833953857
+  },
+  {
+    "step": 667,
+    "loss": 1.4407991170883179,
+    "diagonal": 0.3436833322048187,
+    "finite": 1.0971157550811768
+  },
+  {
+    "step": 668,
+    "loss": 1.3949592113494873,
+    "diagonal": 0.4266735315322876,
+    "finite": 0.9682856202125549
+  },
+  {
+    "step": 669,
+    "loss": 1.6988236904144287,
+    "diagonal": 0.5127044320106506,
+    "finite": 1.1861191987991333
+  },
+  {
+    "step": 670,
+    "loss": 2.1427202224731445,
+    "diagonal": 0.5761820077896118,
+    "finite": 1.5665383338928223
+  },
+  {
+    "step": 671,
+    "loss": 1.3310316801071167,
+    "diagonal": 0.31868037581443787,
+    "finite": 1.0123512744903564
+  },
+  {
+    "step": 672,
+    "loss": 1.7053608894348145,
+    "diagonal": 0.4907192885875702,
+    "finite": 1.2146415710449219
+  },
+  {
+    "step": 673,
+    "loss": 1.4613425731658936,
+    "diagonal": 0.3872157335281372,
+    "finite": 1.0741268396377563
+  },
+  {
+    "step": 674,
+    "loss": 1.676626443862915,
+    "diagonal": 0.3908010423183441,
+    "finite": 1.2858253717422485
+  },
+  {
+    "step": 675,
+    "loss": 1.8715306520462036,
+    "diagonal": 0.3997262418270111,
+    "finite": 1.4718043804168701
+  },
+  {
+    "step": 676,
+    "loss": 1.4226330518722534,
+    "diagonal": 0.4241560399532318,
+    "finite": 0.998477041721344
+  },
+  {
+    "step": 677,
+    "loss": 1.514458417892456,
+    "diagonal": 0.3481808304786682,
+    "finite": 1.166277527809143
+  },
+  {
+    "step": 678,
+    "loss": 0.9752084016799927,
+    "diagonal": 0.3511737883090973,
+    "finite": 0.6240346431732178
+  },
+  {
+    "step": 679,
+    "loss": 1.5649688243865967,
+    "diagonal": 0.42985397577285767,
+    "finite": 1.1351149082183838
+  },
+  {
+    "step": 680,
+    "loss": 1.3184034824371338,
+    "diagonal": 0.27182456851005554,
+    "finite": 1.0465788841247559
+  },
+  {
+    "step": 681,
+    "loss": 1.996690273284912,
+    "diagonal": 0.5975130796432495,
+    "finite": 1.3991771936416626
+  },
+  {
+    "step": 682,
+    "loss": 0.9835169315338135,
+    "diagonal": 0.3099641501903534,
+    "finite": 0.6735528111457825
+  },
+  {
+    "step": 683,
+    "loss": 1.8533700704574585,
+    "diagonal": 0.46443936228752136,
+    "finite": 1.3889306783676147
+  },
+  {
+    "step": 684,
+    "loss": 1.6670801639556885,
+    "diagonal": 0.33364588022232056,
+    "finite": 1.3334343433380127
+  },
+  {
+    "step": 685,
+    "loss": 1.7645058631896973,
+    "diagonal": 0.3564035892486572,
+    "finite": 1.40810227394104
+  },
+  {
+    "step": 686,
+    "loss": 1.712026834487915,
+    "diagonal": 0.3765867352485657,
+    "finite": 1.3354400396347046
+  },
+  {
+    "step": 687,
+    "loss": 1.8417397737503052,
+    "diagonal": 0.5960837602615356,
+    "finite": 1.2456560134887695
+  },
+  {
+    "step": 688,
+    "loss": 1.4529986381530762,
+    "diagonal": 0.3369302451610565,
+    "finite": 1.1160683631896973
+  },
+  {
+    "step": 689,
+    "loss": 1.912286400794983,
+    "diagonal": 0.5044431686401367,
+    "finite": 1.4078432321548462
+  },
+  {
+    "step": 690,
+    "loss": 1.2959086894989014,
+    "diagonal": 0.39711999893188477,
+    "finite": 0.8987886309623718
+  },
+  {
+    "step": 691,
+    "loss": 1.8598411083221436,
+    "diagonal": 0.469603955745697,
+    "finite": 1.3902372121810913
+  },
+  {
+    "step": 692,
+    "loss": 1.8981902599334717,
+    "diagonal": 0.6690903306007385,
+    "finite": 1.229099988937378
+  },
+  {
+    "step": 693,
+    "loss": 1.8172180652618408,
+    "diagonal": 0.4587138295173645,
+    "finite": 1.358504295349121
+  },
+  {
+    "step": 694,
+    "loss": 1.3344601392745972,
+    "diagonal": 0.3697020709514618,
+    "finite": 0.964758038520813
+  },
+  {
+    "step": 695,
+    "loss": 1.9850151538848877,
+    "diagonal": 0.5166107416152954,
+    "finite": 1.4684044122695923
+  },
+  {
+    "step": 696,
+    "loss": 1.734117031097412,
+    "diagonal": 0.4598425626754761,
+    "finite": 1.274274468421936
+  },
+  {
+    "step": 697,
+    "loss": 1.760316014289856,
+    "diagonal": 0.4400741159915924,
+    "finite": 1.320241928100586
+  },
+  {
+    "step": 698,
+    "loss": 1.6220159530639648,
+    "diagonal": 0.5150212645530701,
+    "finite": 1.1069947481155396
+  },
+  {
+    "step": 699,
+    "loss": 1.6468461751937866,
+    "diagonal": 0.42251670360565186,
+    "finite": 1.2243294715881348
+  },
+  {
+    "step": 700,
+    "loss": 1.1189666986465454,
+    "diagonal": 0.33774465322494507,
+    "finite": 0.7812220454216003
+  },
+  {
+    "step": 701,
+    "loss": 2.097569704055786,
+    "diagonal": 0.5290209650993347,
+    "finite": 1.5685486793518066
+  },
+  {
+    "step": 702,
+    "loss": 1.6476531028747559,
+    "diagonal": 0.5076385140419006,
+    "finite": 1.1400146484375
+  },
+  {
+    "step": 703,
+    "loss": 1.6071926355361938,
+    "diagonal": 0.39630815386772156,
+    "finite": 1.21088445186615
+  },
+  {
+    "step": 704,
+    "loss": 1.6648750305175781,
+    "diagonal": 0.507807195186615,
+    "finite": 1.157067894935608
+  },
+  {
+    "step": 705,
+    "loss": 1.6191188097000122,
+    "diagonal": 0.41091856360435486,
+    "finite": 1.208200216293335
+  },
+  {
+    "step": 706,
+    "loss": 1.4739669561386108,
+    "diagonal": 0.42050981521606445,
+    "finite": 1.0534571409225464
+  },
+  {
+    "step": 707,
+    "loss": 1.9823753833770752,
+    "diagonal": 0.5881301760673523,
+    "finite": 1.3942452669143677
+  },
+  {
+    "step": 708,
+    "loss": 1.5559035539627075,
+    "diagonal": 0.4127614498138428,
+    "finite": 1.1431421041488647
+  },
+  {
+    "step": 709,
+    "loss": 1.5074217319488525,
+    "diagonal": 0.5713944435119629,
+    "finite": 0.9360273480415344
+  },
+  {
+    "step": 710,
+    "loss": 1.4648109674453735,
+    "diagonal": 0.42205163836479187,
+    "finite": 1.0427592992782593
+  },
+  {
+    "step": 711,
+    "loss": 1.2180078029632568,
+    "diagonal": 0.32730695605278015,
+    "finite": 0.8907008171081543
+  },
+  {
+    "step": 712,
+    "loss": 1.4044309854507446,
+    "diagonal": 0.3406170904636383,
+    "finite": 1.0638139247894287
+  },
+  {
+    "step": 713,
+    "loss": 1.2416564226150513,
+    "diagonal": 0.31370165944099426,
+    "finite": 0.9279547929763794
+  },
+  {
+    "step": 714,
+    "loss": 1.6342697143554688,
+    "diagonal": 0.4074363112449646,
+    "finite": 1.226833462715149
+  },
+  {
+    "step": 715,
+    "loss": 1.9665961265563965,
+    "diagonal": 0.40368735790252686,
+    "finite": 1.5629087686538696
+  },
+  {
+    "step": 716,
+    "loss": 1.0849952697753906,
+    "diagonal": 0.3136846125125885,
+    "finite": 0.7713106870651245
+  },
+  {
+    "step": 717,
+    "loss": 1.3465583324432373,
+    "diagonal": 0.3531354069709778,
+    "finite": 0.9934229850769043
+  },
+  {
+    "step": 718,
+    "loss": 1.4310591220855713,
+    "diagonal": 0.36211568117141724,
+    "finite": 1.0689433813095093
+  },
+  {
+    "step": 719,
+    "loss": 1.554702877998352,
+    "diagonal": 0.45459985733032227,
+    "finite": 1.1001030206680298
+  },
+  {
+    "step": 720,
+    "loss": 1.4079397916793823,
+    "diagonal": 0.3762870132923126,
+    "finite": 1.031652808189392
+  },
+  {
+    "step": 721,
+    "loss": 1.5813047885894775,
+    "diagonal": 0.39880985021591187,
+    "finite": 1.1824949979782104
+  },
+  {
+    "step": 722,
+    "loss": 1.4669368267059326,
+    "diagonal": 0.31219351291656494,
+    "finite": 1.1547433137893677
+  },
+  {
+    "step": 723,
+    "loss": 1.4582571983337402,
+    "diagonal": 0.394377201795578,
+    "finite": 1.0638799667358398
+  },
+  {
+    "step": 724,
+    "loss": 1.8358765840530396,
+    "diagonal": 0.45046260952949524,
+    "finite": 1.3854140043258667
+  },
+  {
+    "step": 725,
+    "loss": 1.6392295360565186,
+    "diagonal": 0.398751437664032,
+    "finite": 1.2404780387878418
+  },
+  {
+    "step": 726,
+    "loss": 1.623095154762268,
+    "diagonal": 0.456081748008728,
+    "finite": 1.16701340675354
+  },
+  {
+    "step": 727,
+    "loss": 1.9855992794036865,
+    "diagonal": 0.517960786819458,
+    "finite": 1.4676384925842285
+  },
+  {
+    "step": 728,
+    "loss": 1.3651124238967896,
+    "diagonal": 0.26609840989112854,
+    "finite": 1.0990140438079834
+  },
+  {
+    "step": 729,
+    "loss": 1.6323063373565674,
+    "diagonal": 0.40164923667907715,
+    "finite": 1.2306571006774902
+  },
+  {
+    "step": 730,
+    "loss": 1.5320284366607666,
+    "diagonal": 0.3417559266090393,
+    "finite": 1.190272569656372
+  },
+  {
+    "step": 731,
+    "loss": 1.3958749771118164,
+    "diagonal": 0.4013197124004364,
+    "finite": 0.9945552349090576
+  },
+  {
+    "step": 732,
+    "loss": 1.354135513305664,
+    "diagonal": 0.37367844581604004,
+    "finite": 0.980457067489624
+  },
+  {
+    "step": 733,
+    "loss": 1.6609814167022705,
+    "diagonal": 0.524421751499176,
+    "finite": 1.1365596055984497
+  },
+  {
+    "step": 734,
+    "loss": 1.6907641887664795,
+    "diagonal": 0.5436276197433472,
+    "finite": 1.1471365690231323
+  },
+  {
+    "step": 735,
+    "loss": 2.227574348449707,
+    "diagonal": 0.39204534888267517,
+    "finite": 1.8355289697647095
+  },
+  {
+    "step": 736,
+    "loss": 2.3987812995910645,
+    "diagonal": 0.5312756299972534,
+    "finite": 1.8675055503845215
+  },
+  {
+    "step": 737,
+    "loss": 1.6040112972259521,
+    "diagonal": 0.4745047688484192,
+    "finite": 1.1295065879821777
+  },
+  {
+    "step": 738,
+    "loss": 1.2490754127502441,
+    "diagonal": 0.3052659332752228,
+    "finite": 0.943809449672699
+  },
+  {
+    "step": 739,
+    "loss": 1.358499526977539,
+    "diagonal": 0.33691757917404175,
+    "finite": 1.021582007408142
+  },
+  {
+    "step": 740,
+    "loss": 1.638956069946289,
+    "diagonal": 0.446140319108963,
+    "finite": 1.1928157806396484
+  },
+  {
+    "step": 741,
+    "loss": 1.2627298831939697,
+    "diagonal": 0.3219209909439087,
+    "finite": 0.9408089518547058
+  },
+  {
+    "step": 742,
+    "loss": 1.5595006942749023,
+    "diagonal": 0.4280204772949219,
+    "finite": 1.1314802169799805
+  },
+  {
+    "step": 743,
+    "loss": 1.1544355154037476,
+    "diagonal": 0.3873383104801178,
+    "finite": 0.7670972347259521
+  },
+  {
+    "step": 744,
+    "loss": 1.7088736295700073,
+    "diagonal": 0.45069432258605957,
+    "finite": 1.2581793069839478
+  },
+  {
+    "step": 745,
+    "loss": 1.518283724784851,
+    "diagonal": 0.3128248453140259,
+    "finite": 1.2054588794708252
+  },
+  {
+    "step": 746,
+    "loss": 1.6744177341461182,
+    "diagonal": 0.42506852746009827,
+    "finite": 1.2493492364883423
+  },
+  {
+    "step": 747,
+    "loss": 1.3344358205795288,
+    "diagonal": 0.35813191533088684,
+    "finite": 0.9763039350509644
+  },
+  {
+    "step": 748,
+    "loss": 1.8810703754425049,
+    "diagonal": 0.4657416343688965,
+    "finite": 1.4153287410736084
+  },
+  {
+    "step": 749,
+    "loss": 1.6182425022125244,
+    "diagonal": 0.40472275018692017,
+    "finite": 1.213519811630249
+  },
+  {
+    "step": 750,
+    "loss": 1.765653371810913,
+    "diagonal": 0.5049895644187927,
+    "finite": 1.2606637477874756
+  },
+  {
+    "step": 751,
+    "loss": 1.7092198133468628,
+    "diagonal": 0.5160104036331177,
+    "finite": 1.1932094097137451
+  },
+  {
+    "step": 752,
+    "loss": 1.6276847124099731,
+    "diagonal": 0.37515291571617126,
+    "finite": 1.2525317668914795
+  },
+  {
+    "step": 753,
+    "loss": 1.6211304664611816,
+    "diagonal": 0.4939503073692322,
+    "finite": 1.1271802186965942
+  },
+  {
+    "step": 754,
+    "loss": 1.4934091567993164,
+    "diagonal": 0.3856150209903717,
+    "finite": 1.107794165611267
+  },
+  {
+    "step": 755,
+    "loss": 1.4866247177124023,
+    "diagonal": 0.3686140477657318,
+    "finite": 1.1180106401443481
+  },
+  {
+    "step": 756,
+    "loss": 1.6463944911956787,
+    "diagonal": 0.44617635011672974,
+    "finite": 1.2002182006835938
+  },
+  {
+    "step": 757,
+    "loss": 1.6121258735656738,
+    "diagonal": 0.35896655917167664,
+    "finite": 1.2531592845916748
+  },
+  {
+    "step": 758,
+    "loss": 1.5754278898239136,
+    "diagonal": 0.46075382828712463,
+    "finite": 1.1146740913391113
+  },
+  {
+    "step": 759,
+    "loss": 1.186664342880249,
+    "diagonal": 0.2900444269180298,
+    "finite": 0.8966198563575745
+  },
+  {
+    "step": 760,
+    "loss": 1.934382677078247,
+    "diagonal": 0.42410752177238464,
+    "finite": 1.51027512550354
+  },
+  {
+    "step": 761,
+    "loss": 1.0905146598815918,
+    "diagonal": 0.3262464702129364,
+    "finite": 0.764268159866333
+  },
+  {
+    "step": 762,
+    "loss": 1.8563728332519531,
+    "diagonal": 0.5341417193412781,
+    "finite": 1.3222310543060303
+  },
+  {
+    "step": 763,
+    "loss": 1.6498135328292847,
+    "diagonal": 0.49125054478645325,
+    "finite": 1.1585630178451538
+  },
+  {
+    "step": 764,
+    "loss": 1.566523551940918,
+    "diagonal": 0.3917856812477112,
+    "finite": 1.1747379302978516
+  },
+  {
+    "step": 765,
+    "loss": 1.813042163848877,
+    "diagonal": 0.438040554523468,
+    "finite": 1.3750016689300537
+  },
+  {
+    "step": 766,
+    "loss": 1.613208532333374,
+    "diagonal": 0.4286648631095886,
+    "finite": 1.1845437288284302
+  },
+  {
+    "step": 767,
+    "loss": 1.581972360610962,
+    "diagonal": 0.46800753474235535,
+    "finite": 1.1139647960662842
+  },
+  {
+    "step": 768,
+    "loss": 1.265564203262329,
+    "diagonal": 0.3463503122329712,
+    "finite": 0.9192138910293579
+  },
+  {
+    "step": 769,
+    "loss": 1.46563720703125,
+    "diagonal": 0.28121739625930786,
+    "finite": 1.1844197511672974
+  },
+  {
+    "step": 770,
+    "loss": 1.834076166152954,
+    "diagonal": 0.39196616411209106,
+    "finite": 1.4421100616455078
+  },
+  {
+    "step": 771,
+    "loss": 1.4493037462234497,
+    "diagonal": 0.3477477729320526,
+    "finite": 1.1015559434890747
+  },
+  {
+    "step": 772,
+    "loss": 2.1911163330078125,
+    "diagonal": 0.601372480392456,
+    "finite": 1.5897438526153564
+  },
+  {
+    "step": 773,
+    "loss": 1.0992648601531982,
+    "diagonal": 0.36154401302337646,
+    "finite": 0.7377209067344666
+  },
+  {
+    "step": 774,
+    "loss": 2.3837175369262695,
+    "diagonal": 0.3747517764568329,
+    "finite": 2.0089657306671143
+  },
+  {
+    "step": 775,
+    "loss": 1.4691667556762695,
+    "diagonal": 0.4065985083580017,
+    "finite": 1.0625683069229126
+  },
+  {
+    "step": 776,
+    "loss": 1.2875983715057373,
+    "diagonal": 0.44474703073501587,
+    "finite": 0.8428513407707214
+  },
+  {
+    "step": 777,
+    "loss": 1.197171926498413,
+    "diagonal": 0.2981463670730591,
+    "finite": 0.899025559425354
+  },
+  {
+    "step": 778,
+    "loss": 1.5593725442886353,
+    "diagonal": 0.4339858293533325,
+    "finite": 1.1253867149353027
+  },
+  {
+    "step": 779,
+    "loss": 1.4029507637023926,
+    "diagonal": 0.36165016889572144,
+    "finite": 1.0413005352020264
+  },
+  {
+    "step": 780,
+    "loss": 1.775909185409546,
+    "diagonal": 0.516046941280365,
+    "finite": 1.2598623037338257
+  },
+  {
+    "step": 781,
+    "loss": 1.4036189317703247,
+    "diagonal": 0.45768651366233826,
+    "finite": 0.9459323883056641
+  },
+  {
+    "step": 782,
+    "loss": 1.6431503295898438,
+    "diagonal": 0.4427960216999054,
+    "finite": 1.2003543376922607
+  },
+  {
+    "step": 783,
+    "loss": 1.1742098331451416,
+    "diagonal": 0.3459559679031372,
+    "finite": 0.8282538652420044
+  },
+  {
+    "step": 784,
+    "loss": 2.1198949813842773,
+    "diagonal": 0.5744081139564514,
+    "finite": 1.5454869270324707
+  },
+  {
+    "step": 785,
+    "loss": 1.8589718341827393,
+    "diagonal": 0.5199095606803894,
+    "finite": 1.339062213897705
+  },
+  {
+    "step": 786,
+    "loss": 1.8414257764816284,
+    "diagonal": 0.40634608268737793,
+    "finite": 1.4350796937942505
+  },
+  {
+    "step": 787,
+    "loss": 1.3593077659606934,
+    "diagonal": 0.39412176609039307,
+    "finite": 0.9651859402656555
+  },
+  {
+    "step": 788,
+    "loss": 1.114790439605713,
+    "diagonal": 0.44178760051727295,
+    "finite": 0.6730027794837952
+  },
+  {
+    "step": 789,
+    "loss": 1.1541051864624023,
+    "diagonal": 0.29712212085723877,
+    "finite": 0.8569830656051636
+  },
+  {
+    "step": 790,
+    "loss": 1.3608992099761963,
+    "diagonal": 0.30457407236099243,
+    "finite": 1.0563251972198486
+  },
+  {
+    "step": 791,
+    "loss": 1.276749610900879,
+    "diagonal": 0.4337094724178314,
+    "finite": 0.8430401682853699
+  },
+  {
+    "step": 792,
+    "loss": 1.4033737182617188,
+    "diagonal": 0.37413883209228516,
+    "finite": 1.0292348861694336
+  },
+  {
+    "step": 793,
+    "loss": 1.4394962787628174,
+    "diagonal": 0.37666305899620056,
+    "finite": 1.0628331899642944
+  },
+  {
+    "step": 794,
+    "loss": 1.7864820957183838,
+    "diagonal": 0.40576574206352234,
+    "finite": 1.380716323852539
+  },
+  {
+    "step": 795,
+    "loss": 1.4178473949432373,
+    "diagonal": 0.31986305117607117,
+    "finite": 1.0979843139648438
+  },
+  {
+    "step": 796,
+    "loss": 1.8946304321289062,
+    "diagonal": 0.5726131796836853,
+    "finite": 1.3220171928405762
+  },
+  {
+    "step": 797,
+    "loss": 1.2881969213485718,
+    "diagonal": 0.36594390869140625,
+    "finite": 0.9222530126571655
+  },
+  {
+    "step": 798,
+    "loss": 1.6406681537628174,
+    "diagonal": 0.5089187026023865,
+    "finite": 1.1317493915557861
+  },
+  {
+    "step": 799,
+    "loss": 1.1837364435195923,
+    "diagonal": 0.27146783471107483,
+    "finite": 0.9122686386108398
+  },
+  {
+    "step": 800,
+    "loss": 1.4946022033691406,
+    "diagonal": 0.4143486022949219,
+    "finite": 1.0802536010742188
+  },
+  {
+    "step": 801,
+    "loss": 1.554261326789856,
+    "diagonal": 0.41797009110450745,
+    "finite": 1.136291265487671
+  },
+  {
+    "step": 802,
+    "loss": 1.1719589233398438,
+    "diagonal": 0.2532898187637329,
+    "finite": 0.9186691641807556
+  },
+  {
+    "step": 803,
+    "loss": 1.178809404373169,
+    "diagonal": 0.32222607731819153,
+    "finite": 0.8565833568572998
+  },
+  {
+    "step": 804,
+    "loss": 1.5729647874832153,
+    "diagonal": 0.4521383047103882,
+    "finite": 1.1208264827728271
+  },
+  {
+    "step": 805,
+    "loss": 1.177632212638855,
+    "diagonal": 0.29818210005760193,
+    "finite": 0.8794500827789307
+  },
+  {
+    "step": 806,
+    "loss": 1.256718397140503,
+    "diagonal": 0.28629645705223083,
+    "finite": 0.9704219102859497
+  },
+  {
+    "step": 807,
+    "loss": 1.441267967224121,
+    "diagonal": 0.4056670665740967,
+    "finite": 1.0356009006500244
+  },
+  {
+    "step": 808,
+    "loss": 1.5865082740783691,
+    "diagonal": 0.5105752348899841,
+    "finite": 1.0759329795837402
+  },
+  {
+    "step": 809,
+    "loss": 1.272940993309021,
+    "diagonal": 0.35972705483436584,
+    "finite": 0.9132139682769775
+  },
+  {
+    "step": 810,
+    "loss": 1.3610749244689941,
+    "diagonal": 0.2814761996269226,
+    "finite": 1.0795986652374268
+  },
+  {
+    "step": 811,
+    "loss": 1.7369763851165771,
+    "diagonal": 0.38538429141044617,
+    "finite": 1.3515920639038086
+  },
+  {
+    "step": 812,
+    "loss": 1.6221299171447754,
+    "diagonal": 0.34739506244659424,
+    "finite": 1.2747348546981812
+  },
+  {
+    "step": 813,
+    "loss": 1.6035699844360352,
+    "diagonal": 0.48701542615890503,
+    "finite": 1.116554617881775
+  },
+  {
+    "step": 814,
+    "loss": 1.5735299587249756,
+    "diagonal": 0.23070448637008667,
+    "finite": 1.3428255319595337
+  },
+  {
+    "step": 815,
+    "loss": 1.4033656120300293,
+    "diagonal": 0.2474212497472763,
+    "finite": 1.1559443473815918
+  },
+  {
+    "step": 816,
+    "loss": 1.10988187789917,
+    "diagonal": 0.2614961564540863,
+    "finite": 0.848385751247406
+  },
+  {
+    "step": 817,
+    "loss": 1.6092758178710938,
+    "diagonal": 0.5285791158676147,
+    "finite": 1.080696702003479
+  },
+  {
+    "step": 818,
+    "loss": 1.6478830575942993,
+    "diagonal": 0.45453035831451416,
+    "finite": 1.1933526992797852
+  },
+  {
+    "step": 819,
+    "loss": 1.3635292053222656,
+    "diagonal": 0.3755122721195221,
+    "finite": 0.9880169630050659
+  },
+  {
+    "step": 820,
+    "loss": 1.4709546566009521,
+    "diagonal": 0.3551366627216339,
+    "finite": 1.1158180236816406
+  },
+  {
+    "step": 821,
+    "loss": 1.5937461853027344,
+    "diagonal": 0.29380151629447937,
+    "finite": 1.2999446392059326
+  },
+  {
+    "step": 822,
+    "loss": 1.3311090469360352,
+    "diagonal": 0.3324238955974579,
+    "finite": 0.9986851215362549
+  },
+  {
+    "step": 823,
+    "loss": 1.4267603158950806,
+    "diagonal": 0.3479750454425812,
+    "finite": 1.0787853002548218
+  },
+  {
+    "step": 824,
+    "loss": 1.589815616607666,
+    "diagonal": 0.3839047849178314,
+    "finite": 1.2059108018875122
+  },
+  {
+    "step": 825,
+    "loss": 1.1032650470733643,
+    "diagonal": 0.3417174816131592,
+    "finite": 0.7615475654602051
+  },
+  {
+    "step": 826,
+    "loss": 1.3759897947311401,
+    "diagonal": 0.3807052969932556,
+    "finite": 0.9952844977378845
+  },
+  {
+    "step": 827,
+    "loss": 1.7980139255523682,
+    "diagonal": 0.44765058159828186,
+    "finite": 1.3503633737564087
+  },
+  {
+    "step": 828,
+    "loss": 1.3555850982666016,
+    "diagonal": 0.3212955594062805,
+    "finite": 1.0342894792556763
+  },
+  {
+    "step": 829,
+    "loss": 1.1513983011245728,
+    "diagonal": 0.3059452176094055,
+    "finite": 0.8454530835151672
+  },
+  {
+    "step": 830,
+    "loss": 2.1938366889953613,
+    "diagonal": 0.6944330930709839,
+    "finite": 1.499403715133667
+  },
+  {
+    "step": 831,
+    "loss": 1.0441924333572388,
+    "diagonal": 0.2791454792022705,
+    "finite": 0.7650469541549683
+  },
+  {
+    "step": 832,
+    "loss": 1.5458370447158813,
+    "diagonal": 0.3858688771724701,
+    "finite": 1.1599681377410889
+  },
+  {
+    "step": 833,
+    "loss": 2.0505716800689697,
+    "diagonal": 0.3843841552734375,
+    "finite": 1.6661875247955322
+  },
+  {
+    "step": 834,
+    "loss": 1.6938481330871582,
+    "diagonal": 0.49121910333633423,
+    "finite": 1.2026290893554688
+  },
+  {
+    "step": 835,
+    "loss": 1.602741003036499,
+    "diagonal": 0.42288321256637573,
+    "finite": 1.179857850074768
+  },
+  {
+    "step": 836,
+    "loss": 1.2352080345153809,
+    "diagonal": 0.3092476427555084,
+    "finite": 0.9259604215621948
+  },
+  {
+    "step": 837,
+    "loss": 1.2053642272949219,
+    "diagonal": 0.33876901865005493,
+    "finite": 0.8665952086448669
+  },
+  {
+    "step": 838,
+    "loss": 1.6030786037445068,
+    "diagonal": 0.426837682723999,
+    "finite": 1.1762409210205078
+  },
+  {
+    "step": 839,
+    "loss": 1.2277345657348633,
+    "diagonal": 0.33392900228500366,
+    "finite": 0.8938055634498596
+  },
+  {
+    "step": 840,
+    "loss": 1.4872769117355347,
+    "diagonal": 0.3256004750728607,
+    "finite": 1.1616764068603516
+  },
+  {
+    "step": 841,
+    "loss": 1.3315788507461548,
+    "diagonal": 0.44031357765197754,
+    "finite": 0.8912652730941772
+  },
+  {
+    "step": 842,
+    "loss": 1.4674656391143799,
+    "diagonal": 0.44890090823173523,
+    "finite": 1.0185647010803223
+  },
+  {
+    "step": 843,
+    "loss": 1.53497314453125,
+    "diagonal": 0.35756298899650574,
+    "finite": 1.1774101257324219
+  },
+  {
+    "step": 844,
+    "loss": 1.5744277238845825,
+    "diagonal": 0.42531707882881165,
+    "finite": 1.1491106748580933
+  },
+  {
+    "step": 845,
+    "loss": 1.428781509399414,
+    "diagonal": 0.3698427975177765,
+    "finite": 1.05893874168396
+  },
+  {
+    "step": 846,
+    "loss": 1.3995015621185303,
+    "diagonal": 0.4300183653831482,
+    "finite": 0.9694832563400269
+  },
+  {
+    "step": 847,
+    "loss": 1.2358518838882446,
+    "diagonal": 0.4100756049156189,
+    "finite": 0.8257762789726257
+  },
+  {
+    "step": 848,
+    "loss": 1.3437144756317139,
+    "diagonal": 0.39414623379707336,
+    "finite": 0.9495682716369629
+  },
+  {
+    "step": 849,
+    "loss": 1.8506247997283936,
+    "diagonal": 0.43259674310684204,
+    "finite": 1.4180281162261963
+  },
+  {
+    "step": 850,
+    "loss": 1.7214245796203613,
+    "diagonal": 0.3191809356212616,
+    "finite": 1.4022436141967773
+  },
+  {
+    "step": 851,
+    "loss": 1.442561149597168,
+    "diagonal": 0.44036978483200073,
+    "finite": 1.0021913051605225
+  },
+  {
+    "step": 852,
+    "loss": 1.3926453590393066,
+    "diagonal": 0.3241942226886749,
+    "finite": 1.068451166152954
+  },
+  {
+    "step": 853,
+    "loss": 1.3481426239013672,
+    "diagonal": 0.34589067101478577,
+    "finite": 1.0022519826889038
+  },
+  {
+    "step": 854,
+    "loss": 1.684112310409546,
+    "diagonal": 0.3501729667186737,
+    "finite": 1.3339393138885498
+  },
+  {
+    "step": 855,
+    "loss": 1.3611525297164917,
+    "diagonal": 0.4197569787502289,
+    "finite": 0.9413955807685852
+  },
+  {
+    "step": 856,
+    "loss": 1.6094328165054321,
+    "diagonal": 0.4150811731815338,
+    "finite": 1.1943516731262207
+  },
+  {
+    "step": 857,
+    "loss": 1.6111547946929932,
+    "diagonal": 0.37503722310066223,
+    "finite": 1.2361176013946533
+  },
+  {
+    "step": 858,
+    "loss": 1.4231855869293213,
+    "diagonal": 0.31741800904273987,
+    "finite": 1.1057676076889038
+  },
+  {
+    "step": 859,
+    "loss": 1.3820127248764038,
+    "diagonal": 0.36200574040412903,
+    "finite": 1.0200070142745972
+  },
+  {
+    "step": 860,
+    "loss": 1.303696870803833,
+    "diagonal": 0.328188419342041,
+    "finite": 0.975508451461792
+  },
+  {
+    "step": 861,
+    "loss": 1.5514799356460571,
+    "diagonal": 0.3888031542301178,
+    "finite": 1.1626768112182617
+  },
+  {
+    "step": 862,
+    "loss": 1.7891435623168945,
+    "diagonal": 0.4647509455680847,
+    "finite": 1.3243926763534546
+  },
+  {
+    "step": 863,
+    "loss": 1.0889475345611572,
+    "diagonal": 0.30252140760421753,
+    "finite": 0.7864261269569397
+  },
+  {
+    "step": 864,
+    "loss": 1.407402515411377,
+    "diagonal": 0.3221580982208252,
+    "finite": 1.0852444171905518
+  },
+  {
+    "step": 865,
+    "loss": 1.4768246412277222,
+    "diagonal": 0.31785234808921814,
+    "finite": 1.1589722633361816
+  },
+  {
+    "step": 866,
+    "loss": 1.489329218864441,
+    "diagonal": 0.40315642952919006,
+    "finite": 1.0861728191375732
+  },
+  {
+    "step": 867,
+    "loss": 1.8972194194793701,
+    "diagonal": 0.35995447635650635,
+    "finite": 1.5372649431228638
+  },
+  {
+    "step": 868,
+    "loss": 1.3412704467773438,
+    "diagonal": 0.3061988353729248,
+    "finite": 1.035071611404419
+  },
+  {
+    "step": 869,
+    "loss": 1.4557541608810425,
+    "diagonal": 0.3842910826206207,
+    "finite": 1.0714631080627441
+  },
+  {
+    "step": 870,
+    "loss": 1.7371535301208496,
+    "diagonal": 0.4692133963108063,
+    "finite": 1.2679401636123657
+  },
+  {
+    "step": 871,
+    "loss": 1.344374179840088,
+    "diagonal": 0.48915502429008484,
+    "finite": 0.8552191257476807
+  },
+  {
+    "step": 872,
+    "loss": 1.6125577688217163,
+    "diagonal": 0.4438835084438324,
+    "finite": 1.1686742305755615
+  },
+  {
+    "step": 873,
+    "loss": 1.4251537322998047,
+    "diagonal": 0.355103075504303,
+    "finite": 1.070050597190857
+  },
+  {
+    "step": 874,
+    "loss": 1.3079087734222412,
+    "diagonal": 0.48094862699508667,
+    "finite": 0.8269601464271545
+  },
+  {
+    "step": 875,
+    "loss": 1.4282283782958984,
+    "diagonal": 0.46741124987602234,
+    "finite": 0.9608171582221985
+  },
+  {
+    "step": 876,
+    "loss": 1.798842430114746,
+    "diagonal": 0.5547294020652771,
+    "finite": 1.2441130876541138
+  },
+  {
+    "step": 877,
+    "loss": 1.54257333278656,
+    "diagonal": 0.3760620653629303,
+    "finite": 1.1665112972259521
+  },
+  {
+    "step": 878,
+    "loss": 1.1684577465057373,
+    "diagonal": 0.3422203063964844,
+    "finite": 0.8262374401092529
+  },
+  {
+    "step": 879,
+    "loss": 1.4427452087402344,
+    "diagonal": 0.4831092357635498,
+    "finite": 0.9596359729766846
+  },
+  {
+    "step": 880,
+    "loss": 1.7756997346878052,
+    "diagonal": 0.4207036793231964,
+    "finite": 1.3549960851669312
+  },
+  {
+    "step": 881,
+    "loss": 1.7383627891540527,
+    "diagonal": 0.4898633360862732,
+    "finite": 1.2484993934631348
+  },
+  {
+    "step": 882,
+    "loss": 1.1189780235290527,
+    "diagonal": 0.23727869987487793,
+    "finite": 0.8816993236541748
+  },
+  {
+    "step": 883,
+    "loss": 1.1405564546585083,
+    "diagonal": 0.2880951166152954,
+    "finite": 0.8524613380432129
+  },
+  {
+    "step": 884,
+    "loss": 1.3777107000350952,
+    "diagonal": 0.32264018058776855,
+    "finite": 1.0550705194473267
+  },
+  {
+    "step": 885,
+    "loss": 1.0010480880737305,
+    "diagonal": 0.31151285767555237,
+    "finite": 0.6895352005958557
+  },
+  {
+    "step": 886,
+    "loss": 1.2342430353164673,
+    "diagonal": 0.31514325737953186,
+    "finite": 0.9190998077392578
+  },
+  {
+    "step": 887,
+    "loss": 1.646100401878357,
+    "diagonal": 0.4512462913990021,
+    "finite": 1.1948541402816772
+  },
+  {
+    "step": 888,
+    "loss": 1.4815342426300049,
+    "diagonal": 0.39024168252944946,
+    "finite": 1.0912926197052002
+  },
+  {
+    "step": 889,
+    "loss": 1.2218401432037354,
+    "diagonal": 0.3439347743988037,
+    "finite": 0.8779053092002869
+  },
+  {
+    "step": 890,
+    "loss": 1.3707890510559082,
+    "diagonal": 0.4620440602302551,
+    "finite": 0.9087450504302979
+  },
+  {
+    "step": 891,
+    "loss": 1.1882919073104858,
+    "diagonal": 0.3446711599826813,
+    "finite": 0.843620777130127
+  },
+  {
+    "step": 892,
+    "loss": 1.3198833465576172,
+    "diagonal": 0.3378951847553253,
+    "finite": 0.9819881916046143
+  },
+  {
+    "step": 893,
+    "loss": 1.5540976524353027,
+    "diagonal": 0.3645472526550293,
+    "finite": 1.1895503997802734
+  },
+  {
+    "step": 894,
+    "loss": 1.5357834100723267,
+    "diagonal": 0.4583404064178467,
+    "finite": 1.07744300365448
+  },
+  {
+    "step": 895,
+    "loss": 1.7077502012252808,
+    "diagonal": 0.4250603914260864,
+    "finite": 1.2826898097991943
+  },
+  {
+    "step": 896,
+    "loss": 1.8980567455291748,
+    "diagonal": 0.40648943185806274,
+    "finite": 1.4915673732757568
+  },
+  {
+    "step": 897,
+    "loss": 1.4633262157440186,
+    "diagonal": 0.2416556030511856,
+    "finite": 1.2216706275939941
+  },
+  {
+    "step": 898,
+    "loss": 1.7736514806747437,
+    "diagonal": 0.43238508701324463,
+    "finite": 1.341266393661499
+  },
+  {
+    "step": 899,
+    "loss": 1.6782214641571045,
+    "diagonal": 0.43925362825393677,
+    "finite": 1.238967776298523
+  },
+  {
+    "step": 900,
+    "loss": 1.6121081113815308,
+    "diagonal": 0.3833460807800293,
+    "finite": 1.2287620306015015
+  },
+  {
+    "step": 901,
+    "loss": 1.7388252019882202,
+    "diagonal": 0.375813364982605,
+    "finite": 1.3630118370056152
+  },
+  {
+    "step": 902,
+    "loss": 1.144435167312622,
+    "diagonal": 0.33229151368141174,
+    "finite": 0.8121436238288879
+  },
+  {
+    "step": 903,
+    "loss": 1.2623553276062012,
+    "diagonal": 0.2773866355419159,
+    "finite": 0.9849687218666077
+  },
+  {
+    "step": 904,
+    "loss": 1.3034467697143555,
+    "diagonal": 0.340605765581131,
+    "finite": 0.9628410339355469
+  },
+  {
+    "step": 905,
+    "loss": 1.8046793937683105,
+    "diagonal": 0.4988846182823181,
+    "finite": 1.3057948350906372
+  },
+  {
+    "step": 906,
+    "loss": 1.2491708993911743,
+    "diagonal": 0.3298235237598419,
+    "finite": 0.9193474054336548
+  },
+  {
+    "step": 907,
+    "loss": 1.4992139339447021,
+    "diagonal": 0.3904101848602295,
+    "finite": 1.1088037490844727
+  },
+  {
+    "step": 908,
+    "loss": 1.4486130475997925,
+    "diagonal": 0.36284515261650085,
+    "finite": 1.0857678651809692
+  },
+  {
+    "step": 909,
+    "loss": 1.3858004808425903,
+    "diagonal": 0.2985329329967499,
+    "finite": 1.087267518043518
+  },
+  {
+    "step": 910,
+    "loss": 1.2301701307296753,
+    "diagonal": 0.3822459578514099,
+    "finite": 0.8479241728782654
+  },
+  {
+    "step": 911,
+    "loss": 1.2811946868896484,
+    "diagonal": 0.38453036546707153,
+    "finite": 0.8966642618179321
+  },
+  {
+    "step": 912,
+    "loss": 1.2195870876312256,
+    "diagonal": 0.29341524839401245,
+    "finite": 0.9261717796325684
+  },
+  {
+    "step": 913,
+    "loss": 1.2402207851409912,
+    "diagonal": 0.37260329723358154,
+    "finite": 0.8676174283027649
+  },
+  {
+    "step": 914,
+    "loss": 1.6235281229019165,
+    "diagonal": 0.4015156924724579,
+    "finite": 1.2220124006271362
+  },
+  {
+    "step": 915,
+    "loss": 1.234520673751831,
+    "diagonal": 0.2232988327741623,
+    "finite": 1.0112218856811523
+  },
+  {
+    "step": 916,
+    "loss": 1.415903091430664,
+    "diagonal": 0.3227841854095459,
+    "finite": 1.0931189060211182
+  },
+  {
+    "step": 917,
+    "loss": 1.2149361371994019,
+    "diagonal": 0.2953782379627228,
+    "finite": 0.9195579290390015
+  },
+  {
+    "step": 918,
+    "loss": 1.6282830238342285,
+    "diagonal": 0.3584279417991638,
+    "finite": 1.26985502243042
+  },
+  {
+    "step": 919,
+    "loss": 1.7543002367019653,
+    "diagonal": 0.38578835129737854,
+    "finite": 1.3685119152069092
+  },
+  {
+    "step": 920,
+    "loss": 1.6581459045410156,
+    "diagonal": 0.520227313041687,
+    "finite": 1.1379185914993286
+  },
+  {
+    "step": 921,
+    "loss": 0.9742188453674316,
+    "diagonal": 0.29769018292427063,
+    "finite": 0.6765286922454834
+  },
+  {
+    "step": 922,
+    "loss": 1.624659776687622,
+    "diagonal": 0.41061943769454956,
+    "finite": 1.2140402793884277
+  },
+  {
+    "step": 923,
+    "loss": 1.587705135345459,
+    "diagonal": 0.3404831290245056,
+    "finite": 1.2472219467163086
+  },
+  {
+    "step": 924,
+    "loss": 1.1486130952835083,
+    "diagonal": 0.32180553674697876,
+    "finite": 0.8268075585365295
+  },
+  {
+    "step": 925,
+    "loss": 1.6009502410888672,
+    "diagonal": 0.3488594591617584,
+    "finite": 1.2520908117294312
+  },
+  {
+    "step": 926,
+    "loss": 1.67742919921875,
+    "diagonal": 0.49953415989875793,
+    "finite": 1.1778950691223145
+  },
+  {
+    "step": 927,
+    "loss": 1.8136730194091797,
+    "diagonal": 0.43198803067207336,
+    "finite": 1.3816850185394287
+  },
+  {
+    "step": 928,
+    "loss": 1.5002319812774658,
+    "diagonal": 0.45236295461654663,
+    "finite": 1.047869086265564
+  },
+  {
+    "step": 929,
+    "loss": 1.4793533086776733,
+    "diagonal": 0.3029572069644928,
+    "finite": 1.176396131515503
+  },
+  {
+    "step": 930,
+    "loss": 1.3524223566055298,
+    "diagonal": 0.377620130777359,
+    "finite": 0.9748022556304932
+  },
+  {
+    "step": 931,
+    "loss": 1.837817668914795,
+    "diagonal": 0.4478406012058258,
+    "finite": 1.3899770975112915
+  },
+  {
+    "step": 932,
+    "loss": 1.5086233615875244,
+    "diagonal": 0.398632287979126,
+    "finite": 1.1099910736083984
+  },
+  {
+    "step": 933,
+    "loss": 1.1619234085083008,
+    "diagonal": 0.3936966061592102,
+    "finite": 0.7682267427444458
+  },
+  {
+    "step": 934,
+    "loss": 1.189136028289795,
+    "diagonal": 0.2986323833465576,
+    "finite": 0.8905036449432373
+  },
+  {
+    "step": 935,
+    "loss": 1.1467863321304321,
+    "diagonal": 0.31726428866386414,
+    "finite": 0.8295220732688904
+  },
+  {
+    "step": 936,
+    "loss": 1.936655879020691,
+    "diagonal": 0.3623674213886261,
+    "finite": 1.5742884874343872
+  },
+  {
+    "step": 937,
+    "loss": 1.3394484519958496,
+    "diagonal": 0.34504979848861694,
+    "finite": 0.9943985939025879
+  },
+  {
+    "step": 938,
+    "loss": 1.9809144735336304,
+    "diagonal": 0.3992941081523895,
+    "finite": 1.5816203355789185
+  },
+  {
+    "step": 939,
+    "loss": 1.4526050090789795,
+    "diagonal": 0.26675063371658325,
+    "finite": 1.1858543157577515
+  },
+  {
+    "step": 940,
+    "loss": 1.1732672452926636,
+    "diagonal": 0.2846287786960602,
+    "finite": 0.888638436794281
+  },
+  {
+    "step": 941,
+    "loss": 1.2081162929534912,
+    "diagonal": 0.35579943656921387,
+    "finite": 0.8523169159889221
+  },
+  {
+    "step": 942,
+    "loss": 1.3515360355377197,
+    "diagonal": 0.3251063823699951,
+    "finite": 1.0264296531677246
+  },
+  {
+    "step": 943,
+    "loss": 1.6320466995239258,
+    "diagonal": 0.3844520151615143,
+    "finite": 1.2475947141647339
+  },
+  {
+    "step": 944,
+    "loss": 1.4150879383087158,
+    "diagonal": 0.4434976279735565,
+    "finite": 0.9715903401374817
+  },
+  {
+    "step": 945,
+    "loss": 1.1197617053985596,
+    "diagonal": 0.36485156416893005,
+    "finite": 0.7549101710319519
+  },
+  {
+    "step": 946,
+    "loss": 0.9194658398628235,
+    "diagonal": 0.2850208878517151,
+    "finite": 0.6344449520111084
+  },
+  {
+    "step": 947,
+    "loss": 1.6635491847991943,
+    "diagonal": 0.36421817541122437,
+    "finite": 1.2993309497833252
+  },
+  {
+    "step": 948,
+    "loss": 1.4181313514709473,
+    "diagonal": 0.3618437647819519,
+    "finite": 1.0562875270843506
+  },
+  {
+    "step": 949,
+    "loss": 1.4724186658859253,
+    "diagonal": 0.46243011951446533,
+    "finite": 1.00998854637146
+  },
+  {
+    "step": 950,
+    "loss": 1.1053180694580078,
+    "diagonal": 0.2865874469280243,
+    "finite": 0.8187306523323059
+  },
+  {
+    "step": 951,
+    "loss": 1.3875895738601685,
+    "diagonal": 0.34118029475212097,
+    "finite": 1.046409249305725
+  },
+  {
+    "step": 952,
+    "loss": 1.4368112087249756,
+    "diagonal": 0.40000665187835693,
+    "finite": 1.0368045568466187
+  },
+  {
+    "step": 953,
+    "loss": 1.6879329681396484,
+    "diagonal": 0.4819079041481018,
+    "finite": 1.2060250043869019
+  },
+  {
+    "step": 954,
+    "loss": 0.9702051877975464,
+    "diagonal": 0.27124854922294617,
+    "finite": 0.6989566087722778
+  },
+  {
+    "step": 955,
+    "loss": 1.4995330572128296,
+    "diagonal": 0.49912866950035095,
+    "finite": 1.0004043579101562
+  },
+  {
+    "step": 956,
+    "loss": 1.6743452548980713,
+    "diagonal": 0.3634950816631317,
+    "finite": 1.3108501434326172
+  },
+  {
+    "step": 957,
+    "loss": 1.8013334274291992,
+    "diagonal": 0.34858590364456177,
+    "finite": 1.4527474641799927
+  },
+  {
+    "step": 958,
+    "loss": 1.3904310464859009,
+    "diagonal": 0.40658748149871826,
+    "finite": 0.9838435649871826
+  },
+  {
+    "step": 959,
+    "loss": 1.3234955072402954,
+    "diagonal": 0.37628111243247986,
+    "finite": 0.9472143650054932
+  },
+  {
+    "step": 960,
+    "loss": 1.2549858093261719,
+    "diagonal": 0.34735262393951416,
+    "finite": 0.9076332449913025
+  },
+  {
+    "step": 961,
+    "loss": 1.2284220457077026,
+    "diagonal": 0.41108438372612,
+    "finite": 0.817337691783905
+  },
+  {
+    "step": 962,
+    "loss": 1.6181209087371826,
+    "diagonal": 0.311345636844635,
+    "finite": 1.3067753314971924
+  },
+  {
+    "step": 963,
+    "loss": 1.1448554992675781,
+    "diagonal": 0.3516332805156708,
+    "finite": 0.793222188949585
+  },
+  {
+    "step": 964,
+    "loss": 1.2574468851089478,
+    "diagonal": 0.37947937846183777,
+    "finite": 0.8779674768447876
+  },
+  {
+    "step": 965,
+    "loss": 1.1590477228164673,
+    "diagonal": 0.271347314119339,
+    "finite": 0.8877003788948059
+  },
+  {
+    "step": 966,
+    "loss": 1.857658863067627,
+    "diagonal": 0.5273510813713074,
+    "finite": 1.3303078413009644
+  },
+  {
+    "step": 967,
+    "loss": 0.9681417346000671,
+    "diagonal": 0.3019596338272095,
+    "finite": 0.6661821007728577
+  },
+  {
+    "step": 968,
+    "loss": 1.2186436653137207,
+    "diagonal": 0.2829115688800812,
+    "finite": 0.9357321262359619
+  },
+  {
+    "step": 969,
+    "loss": 1.496840000152588,
+    "diagonal": 0.327385276556015,
+    "finite": 1.1694546937942505
+  },
+  {
+    "step": 970,
+    "loss": 1.5086489915847778,
+    "diagonal": 0.3767271041870117,
+    "finite": 1.1319218873977661
+  },
+  {
+    "step": 971,
+    "loss": 1.3942203521728516,
+    "diagonal": 0.45893704891204834,
+    "finite": 0.9352832436561584
+  },
+  {
+    "step": 972,
+    "loss": 1.3058273792266846,
+    "diagonal": 0.34727367758750916,
+    "finite": 0.958553671836853
+  },
+  {
+    "step": 973,
+    "loss": 1.1903022527694702,
+    "diagonal": 0.28773024678230286,
+    "finite": 0.9025720357894897
+  },
+  {
+    "step": 974,
+    "loss": 1.5962964296340942,
+    "diagonal": 0.30264437198638916,
+    "finite": 1.293652057647705
+  },
+  {
+    "step": 975,
+    "loss": 1.598763346672058,
+    "diagonal": 0.47213754057884216,
+    "finite": 1.1266257762908936
+  },
+  {
+    "step": 976,
+    "loss": 1.4643813371658325,
+    "diagonal": 0.3743724524974823,
+    "finite": 1.0900088548660278
+  },
+  {
+    "step": 977,
+    "loss": 1.1954429149627686,
+    "diagonal": 0.3226501941680908,
+    "finite": 0.872792661190033
+  },
+  {
+    "step": 978,
+    "loss": 1.2584221363067627,
+    "diagonal": 0.31832388043403625,
+    "finite": 0.9400982856750488
+  },
+  {
+    "step": 979,
+    "loss": 1.2210760116577148,
+    "diagonal": 0.36369073390960693,
+    "finite": 0.8573852181434631
+  },
+  {
+    "step": 980,
+    "loss": 1.3118281364440918,
+    "diagonal": 0.3697723150253296,
+    "finite": 0.9420557618141174
+  },
+  {
+    "step": 981,
+    "loss": 1.6678905487060547,
+    "diagonal": 0.43740135431289673,
+    "finite": 1.2304892539978027
+  },
+  {
+    "step": 982,
+    "loss": 1.3909099102020264,
+    "diagonal": 0.27547308802604675,
+    "finite": 1.1154367923736572
+  },
+  {
+    "step": 983,
+    "loss": 1.5501644611358643,
+    "diagonal": 0.45176997780799866,
+    "finite": 1.098394513130188
+  },
+  {
+    "step": 984,
+    "loss": 1.3926002979278564,
+    "diagonal": 0.28117069602012634,
+    "finite": 1.1114295721054077
+  },
+  {
+    "step": 985,
+    "loss": 1.6040451526641846,
+    "diagonal": 0.3627452552318573,
+    "finite": 1.2412998676300049
+  },
+  {
+    "step": 986,
+    "loss": 1.255530595779419,
+    "diagonal": 0.32652297616004944,
+    "finite": 0.9290076494216919
+  },
+  {
+    "step": 987,
+    "loss": 1.0855278968811035,
+    "diagonal": 0.3354233205318451,
+    "finite": 0.750104546546936
+  },
+  {
+    "step": 988,
+    "loss": 1.3340096473693848,
+    "diagonal": 0.4705304205417633,
+    "finite": 0.8634792566299438
+  },
+  {
+    "step": 989,
+    "loss": 1.6215810775756836,
+    "diagonal": 0.4549405574798584,
+    "finite": 1.1666405200958252
+  },
+  {
+    "step": 990,
+    "loss": 1.1533663272857666,
+    "diagonal": 0.26563823223114014,
+    "finite": 0.8877280354499817
+  },
+  {
+    "step": 991,
+    "loss": 1.402809739112854,
+    "diagonal": 0.3661508858203888,
+    "finite": 1.0366588830947876
+  },
+  {
+    "step": 992,
+    "loss": 1.3755995035171509,
+    "diagonal": 0.42841586470603943,
+    "finite": 0.9471836686134338
+  },
+  {
+    "step": 993,
+    "loss": 1.220290184020996,
+    "diagonal": 0.38753312826156616,
+    "finite": 0.8327570557594299
+  },
+  {
+    "step": 994,
+    "loss": 1.4667472839355469,
+    "diagonal": 0.35964900255203247,
+    "finite": 1.1070983409881592
+  },
+  {
+    "step": 995,
+    "loss": 1.2344889640808105,
+    "diagonal": 0.31085771322250366,
+    "finite": 0.9236312508583069
+  },
+  {
+    "step": 996,
+    "loss": 1.6110010147094727,
+    "diagonal": 0.3787779211997986,
+    "finite": 1.2322231531143188
+  },
+  {
+    "step": 997,
+    "loss": 1.3584022521972656,
+    "diagonal": 0.5259389281272888,
+    "finite": 0.832463264465332
+  },
+  {
+    "step": 998,
+    "loss": 1.2912874221801758,
+    "diagonal": 0.27163729071617126,
+    "finite": 1.0196501016616821
+  },
+  {
+    "step": 999,
+    "loss": 1.4906156063079834,
+    "diagonal": 0.326355904340744,
+    "finite": 1.164259672164917
+  }
+]
diff --git a/lecture_6/verified_examples/diamond/report.json b/lecture_6/verified_examples/diamond/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..cd89d9a872af21333d3c63d5e1f11c7a9b9c10ad
--- /dev/null
+++ b/lecture_6/verified_examples/diamond/report.json
@@ -0,0 +1,599 @@
+{
+  "method": "diamond",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 2.3003412008285524,
+  "train_loss_last_20_mean": 1.3909348011016847,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "posterior_mean_rmse": 0.2850089371204376,
+  "posterior_variance_rmse": 0.3143199384212494,
+  "posterior_reference_mean": [
+    [
+      0.0,
+      0.0
+    ],
+    [
+      1.5137563943862915,
+      -1.3221392631530762
+    ],
+    [
+      -1.3908926248550415,
+      1.3908926248550415
+    ]
+  ],
+  "posterior_estimated_mean": [
+    [
+      -0.18024545907974243,
+      0.003118574619293213
+    ],
+    [
+      1.267401933670044,
+      -0.7068037986755371
+    ],
+    [
+      -1.4463410377502441,
+      1.5026049613952637
+    ]
+  ],
+  "unconditional_mean_reward": -0.15971410274505615,
+  "guided_mean_reward": 0.7896980047225952,
+  "guided_distribution": {
+    "finite_samples": true,
+    "mean_distance_to_center": 0.3346782922744751,
+    "mode_fractions": [
+      0.0078125,
+      0.0546875,
+      0.4140625,
+      0.5234375
+    ],
+    "mode_entropy": 0.9007704854011536,
+    "mean_target_log_density": -2.417095422744751
+  },
+  "posterior_steps": 4,
+  "particles": 32,
+  "importance_posterior_mean": [
+    [
+      1.3134080171585083,
+      -1.0870338678359985
+    ]
+  ],
+  "importance_effective_sample_size": [
+    87.88063049316406
+  ],
+  "posterior_value_context_gradient": [
+    [
+      0.4864501953125,
+      -0.0005682770861312747
+    ]
+  ],
+  "finite_value_gradient": true,
+  "guided_samples": [
+    [
+      1.4239320755004883,
+      -1.6344605684280396
+    ],
+    [
+      0.820663571357727,
+      1.0675268173217773
+    ],
+    [
+      1.7312030792236328,
+      1.5020395517349243
+    ],
+    [
+      1.5957815647125244,
+      -1.3913654088974
+    ],
+    [
+      1.685328722000122,
+      0.8918857574462891
+    ],
+    [
+      1.4466534852981567,
+      -1.5382049083709717
+    ],
+    [
+      1.28541898727417,
+      1.5201828479766846
+    ],
+    [
+      1.5956170558929443,
+      -1.5975165367126465
+    ],
+    [
+      1.5021460056304932,
+      -1.6548771858215332
+    ],
+    [
+      1.4455817937850952,
+      -1.5822546482086182
+    ],
+    [
+      1.3742811679840088,
+      -1.3331466913223267
+    ],
+    [
+      1.558626413345337,
+      1.4719631671905518
+    ],
+    [
+      1.6104819774627686,
+      1.5149130821228027
+    ],
+    [
+      1.564037799835205,
+      1.3624500036239624
+    ],
+    [
+      1.7101938724517822,
+      1.5559873580932617
+    ],
+    [
+      1.6751896142959595,
+      1.6580215692520142
+    ],
+    [
+      -1.7197034358978271,
+      0.026843391358852386
+    ],
+    [
+      1.0969843864440918,
+      1.674540400505066
+    ],
+    [
+      1.6624257564544678,
+      1.5301289558410645
+    ],
+    [
+      1.2797470092773438,
+      -1.365260124206543
+    ],
+    [
+      1.3860975503921509,
+      -1.256325125694275
+    ],
+    [
+      1.5823458433151245,
+      1.508630394935608
+    ],
+    [
+      1.271988868713379,
+      1.4601194858551025
+    ],
+    [
+      1.5773061513900757,
+      1.581010103225708
+    ],
+    [
+      1.63923180103302,
+      1.669417381286621
+    ],
+    [
+      1.5790058374404907,
+      -1.515872836112976
+    ],
+    [
+      1.4417922496795654,
+      -1.606476068496704
+    ],
+    [
+      1.6033616065979004,
+      1.6289159059524536
+    ],
+    [
+      1.540778636932373,
+      -1.662284016609192
+    ],
+    [
+      1.657673716545105,
+      1.6238281726837158
+    ],
+    [
+      1.5836094617843628,
+      1.5250147581100464
+    ],
+    [
+      1.612625241279602,
+      1.6740142107009888
+    ],
+    [
+      1.558722734451294,
+      1.5650380849838257
+    ],
+    [
+      1.7189573049545288,
+      1.4983768463134766
+    ],
+    [
+      1.6352909803390503,
+      -0.5368939638137817
+    ],
+    [
+      1.5946626663208008,
+      -1.5700006484985352
+    ],
+    [
+      1.6804535388946533,
+      1.5770878791809082
+    ],
+    [
+      1.1107227802276611,
+      -1.5352864265441895
+    ],
+    [
+      0.9618779420852661,
+      0.42890387773513794
+    ],
+    [
+      1.6688005924224854,
+      1.4183695316314697
+    ],
+    [
+      0.33374738693237305,
+      1.6311402320861816
+    ],
+    [
+      1.4518001079559326,
+      -1.2198750972747803
+    ],
+    [
+      -1.570938229560852,
+      1.6972243785858154
+    ],
+    [
+      1.6366329193115234,
+      0.6020137071609497
+    ],
+    [
+      1.5907059907913208,
+      -1.4118523597717285
+    ],
+    [
+      1.584066390991211,
+      0.8333951234817505
+    ],
+    [
+      1.5089004039764404,
+      -1.5565423965454102
+    ],
+    [
+      1.6349295377731323,
+      -0.9656093120574951
+    ],
+    [
+      1.4116308689117432,
+      -1.6314043998718262
+    ],
+    [
+      1.621009349822998,
+      1.5597038269042969
+    ],
+    [
+      1.5814099311828613,
+      -1.576127052307129
+    ],
+    [
+      1.5869709253311157,
+      -1.2168264389038086
+    ],
+    [
+      1.6517789363861084,
+      1.4501709938049316
+    ],
+    [
+      1.4277565479278564,
+      -1.5907894372940063
+    ],
+    [
+      1.6260474920272827,
+      1.5572700500488281
+    ],
+    [
+      1.3784841299057007,
+      -1.5776095390319824
+    ],
+    [
+      1.470922827720642,
+      -1.5990386009216309
+    ],
+    [
+      1.7276525497436523,
+      1.593909502029419
+    ],
+    [
+      1.5925891399383545,
+      1.6953942775726318
+    ],
+    [
+      1.5208659172058105,
+      -1.68135666847229
+    ],
+    [
+      1.3634998798370361,
+      -1.5775954723358154
+    ],
+    [
+      1.559653401374817,
+      1.2139616012573242
+    ],
+    [
+      1.5559732913970947,
+      1.46262526512146
+    ],
+    [
+      1.5682392120361328,
+      -1.1553092002868652
+    ],
+    [
+      0.887642502784729,
+      1.362033486366272
+    ],
+    [
+      1.2660781145095825,
+      1.7303816080093384
+    ],
+    [
+      1.467516541481018,
+      -1.5766841173171997
+    ],
+    [
+      1.5923066139221191,
+      -0.3573330044746399
+    ],
+    [
+      1.5671226978302002,
+      -1.3844462633132935
+    ],
+    [
+      1.599191665649414,
+      -0.94915372133255
+    ],
+    [
+      1.5076408386230469,
+      -1.69224214553833
+    ],
+    [
+      1.5239841938018799,
+      -1.5647516250610352
+    ],
+    [
+      1.6479213237762451,
+      1.2603404521942139
+    ],
+    [
+      1.6376280784606934,
+      1.503674864768982
+    ],
+    [
+      1.6714105606079102,
+      1.5488758087158203
+    ],
+    [
+      1.7056398391723633,
+      1.1564916372299194
+    ],
+    [
+      1.4253191947937012,
+      -1.5797067880630493
+    ],
+    [
+      1.6376031637191772,
+      -0.5283700227737427
+    ],
+    [
+      1.4474414587020874,
+      -1.6252524852752686
+    ],
+    [
+      1.7219773530960083,
+      0.05634384602308273
+    ],
+    [
+      -1.2868106365203857,
+      1.2074310779571533
+    ],
+    [
+      1.6215928792953491,
+      0.7394291162490845
+    ],
+    [
+      1.5216256380081177,
+      -1.3723549842834473
+    ],
+    [
+      1.5020408630371094,
+      1.2047991752624512
+    ],
+    [
+      1.6512093544006348,
+      0.35993295907974243
+    ],
+    [
+      1.5676319599151611,
+      -1.4075860977172852
+    ],
+    [
+      1.2091255187988281,
+      -1.598218560218811
+    ],
+    [
+      1.5905271768569946,
+      1.4241456985473633
+    ],
+    [
+      0.6883946061134338,
+      -1.3580327033996582
+    ],
+    [
+      1.5623457431793213,
+      0.9174542427062988
+    ],
+    [
+      0.7126510143280029,
+      -1.5044726133346558
+    ],
+    [
+      1.632599115371704,
+      0.5776304006576538
+    ],
+    [
+      1.6365389823913574,
+      1.5975536108016968
+    ],
+    [
+      1.6353740692138672,
+      1.4782400131225586
+    ],
+    [
+      -0.47797730565071106,
+      1.2545307874679565
+    ],
+    [
+      1.4518392086029053,
+      1.5415329933166504
+    ],
+    [
+      -0.3051835298538208,
+      1.6217577457427979
+    ],
+    [
+      -1.470801830291748,
+      1.6318693161010742
+    ],
+    [
+      1.435347318649292,
+      -0.5923207402229309
+    ],
+    [
+      1.5744106769561768,
+      -1.6331225633621216
+    ],
+    [
+      1.7261918783187866,
+      1.4705957174301147
+    ],
+    [
+      1.713143229484558,
+      1.2771549224853516
+    ],
+    [
+      1.4401357173919678,
+      1.0519170761108398
+    ],
+    [
+      1.6753945350646973,
+      1.368759274482727
+    ],
+    [
+      1.4861717224121094,
+      -1.184930443763733
+    ],
+    [
+      -1.3854299783706665,
+      -0.5987356901168823
+    ],
+    [
+      1.3937517404556274,
+      -1.6570689678192139
+    ],
+    [
+      1.6311099529266357,
+      1.2929785251617432
+    ],
+    [
+      1.7386894226074219,
+      1.412785291671753
+    ],
+    [
+      1.1458282470703125,
+      -1.503387451171875
+    ],
+    [
+      1.4150561094284058,
+      -1.4919843673706055
+    ],
+    [
+      1.5051624774932861,
+      -1.3969852924346924
+    ],
+    [
+      1.5180878639221191,
+      1.1440277099609375
+    ],
+    [
+      1.713269591331482,
+      1.5411263704299927
+    ],
+    [
+      1.3882720470428467,
+      1.0344327688217163
+    ],
+    [
+      1.148745059967041,
+      -1.4446316957473755
+    ],
+    [
+      1.5353538990020752,
+      1.626893401145935
+    ],
+    [
+      1.3163927793502808,
+      1.1063724756240845
+    ],
+    [
+      1.5402779579162598,
+      -1.5767762660980225
+    ],
+    [
+      1.6111400127410889,
+      1.5509306192398071
+    ],
+    [
+      1.6216984987258911,
+      1.627528190612793
+    ],
+    [
+      1.3344992399215698,
+      1.412132978439331
+    ],
+    [
+      1.5723090171813965,
+      1.3013609647750854
+    ],
+    [
+      1.6810638904571533,
+      1.3902350664138794
+    ],
+    [
+      1.514134407043457,
+      -1.6317684650421143
+    ],
+    [
+      -1.5336469411849976,
+      1.6840159893035889
+    ],
+    [
+      1.59185791015625,
+      0.894669771194458
+    ],
+    [
+      1.5892161130905151,
+      -1.5390504598617554
+    ]
+  ],
+  "finite_samples": true,
+  "mean_distance_to_center": 0.7815748453140259,
+  "mode_fractions": [
+    0.3203125,
+    0.2578125,
+    0.2421875,
+    0.1796875
+  ],
+  "mode_entropy": 1.366005539894104,
+  "mean_target_log_density": -7.900170803070068,
+  "elapsed_seconds": 4.959251613996457
+}
diff --git a/lecture_6/verified_examples/diamond/samples.txt b/lecture_6/verified_examples/diamond/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..1344f8486321f2c261141d5c80fb53c59fb28470
--- /dev/null
+++ b/lecture_6/verified_examples/diamond/samples.txt
@@ -0,0 +1,128 @@
+2.2033727 0.6325513
+-0.8903766 1.6244500
+-1.6766276 -0.4585864
+-2.2461300 -1.2390873
+-1.2628196 -1.9242668
+-2.2590456 1.7955806
+0.9153712 -1.7121311
+1.3096523 1.7047572
+1.2906915 -0.0166691
+-2.1414392 0.3495800
+-1.6892126 1.8833569
+0.9135532 1.3316488
+1.2397335 -1.5793184
+-2.4854422 -1.9841025
+-1.7927005 -1.4081614
+1.3866845 -0.7863324
+-1.1198184 1.4997510
+0.1954405 -1.4264648
+2.2903943 -1.9700282
+0.4374963 1.4532427
+-1.7565328 1.6668122
+-2.4087927 1.2363312
+-1.8418632 -0.3747814
+2.0019927 -1.6110351
+-2.6945360 -1.7657286
+-1.7163197 -0.4834450
+-2.5747113 -1.5711784
+0.9970886 -1.9359630
+2.0767653 1.4658098
+-0.6152016 -1.7292753
+-2.5275700 2.2582786
+-1.7056273 1.5394452
+1.3451686 -0.8872967
+0.8448586 -2.0894330
+-2.2752769 1.8330257
+-2.1132131 -1.5949206
+-2.7126865 -1.6516997
+-1.8096722 1.8811029
+1.7242919 0.7547657
+-0.0610400 -2.3555803
+-0.7931958 1.0583158
+-1.8406117 -1.1689000
+-1.4002738 1.9257092
+1.8231674 -1.2499933
+-1.4923434 -1.8191472
+-0.8518189 -1.0713218
+1.9270587 1.8578575
+-0.5759602 1.8664755
+1.2937179 1.2209600
+-1.4037337 1.8309121
+1.9977745 1.3121042
+1.8229039 0.4249681
+-1.4807591 -1.5449467
+-1.0774120 1.4950180
+-1.7503604 1.7186314
+-1.5628747 1.1511111
+1.4780554 -2.1762440
+-1.7895374 -1.9551983
+-1.8282890 -1.1626920
+-1.2839496 1.8977945
+-1.7679672 -1.7395824
+0.7835757 0.8855022
+-0.0727170 1.2793560
+1.6659024 2.1776032
+1.2212975 0.7443893
+1.4732485 -1.3421586
+2.3052244 -1.8986130
+-2.5343475 -1.4960650
+-0.6673316 -1.6045691
+-2.1210644 -0.5328113
+-0.6661598 -2.3711560
+-2.6500635 1.5198469
+-2.3042188 1.9527699
+2.0063462 1.5950097
+1.0736644 -2.5261593
+-0.3347158 -0.5393587
+-1.0560312 -1.0293305
+1.1012568 -1.8374598
+-1.7583520 0.8076223
+2.0980399 2.0447621
+-2.5289767 -1.9262173
+0.4048653 -1.8271444
+-1.7431371 2.0305600
+0.4980651 0.3195100
+-0.8734227 -2.3680782
+-1.3366101 -2.0335529
+0.8809181 1.7925076
+1.4043865 -2.3073900
+-1.7541065 -1.3713696
+2.0315976 -1.9233991
+0.9834231 -2.4081168
+-1.9716340 1.2398343
+1.2128587 -1.1104431
+-1.8377315 -2.2952490
+-2.0793722 -2.3272495
+-2.1536846 1.3822112
+1.7694763 -2.3643353
+0.8525420 -2.1141791
+-1.8382494 1.7158949
+-0.8475112 -1.9646697
+-1.0450895 1.3713253
+1.1502476 -2.1545911
+-0.5782086 1.5095887
+-1.4182853 1.3732688
+-1.9491012 -0.4992637
+-0.7951055 -2.3992167
+1.4930542 0.3673539
+-1.3393034 -0.8784691
+-0.4792465 -0.3949687
+-2.3118858 2.0121517
+1.5233687 1.1780030
+1.8708405 -0.8106906
+0.0799912 -2.5369678
+-2.4103167 -1.5198364
+0.6299105 -0.3983719
+-1.5948110 -0.7055436
+1.8613501 1.3047647
+1.4387577 1.2694920
+1.3237998 -0.9563271
+-1.5269694 -1.6439033
+0.7059031 -1.4727142
+-0.9232190 1.4867975
+0.1658047 0.8582997
+1.7637582 1.1457423
+0.1129579 -1.9319487
+-1.1872740 1.5180728
+-2.1945820 -2.4108355
+1.0137113 -2.3156834
diff --git a/lecture_6/verified_examples/discrete-esd/config.json b/lecture_6/verified_examples/discrete-esd/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..8735acc176e0ea326b998dfef8e2ef93a89b937d
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-esd/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "discrete-esd",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/discrete-esd"
+}
diff --git a/lecture_6/verified_examples/discrete-esd/losses.json b/lecture_6/verified_examples/discrete-esd/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..a314c10724d483b2c5ede807b9863cefe8d1a193
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-esd/losses.json
@@ -0,0 +1,7002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.5544092655181885,
+    "diagonal_ce": 2.5544071197509766,
+    "finite": 0.0005127222975715995,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 1,
+    "loss": 2.542593479156494,
+    "diagonal_ce": 2.5425896644592285,
+    "finite": 0.00046670070150867105,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 2,
+    "loss": 2.5348613262176514,
+    "diagonal_ce": 2.5348522663116455,
+    "finite": 0.000752040243241936,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 3,
+    "loss": 2.5357799530029297,
+    "diagonal_ce": 2.5357604026794434,
+    "finite": 0.0012257094494998455,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 4,
+    "loss": 2.5233678817749023,
+    "diagonal_ce": 2.5233538150787354,
+    "finite": 0.000702433695551008,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 5,
+    "loss": 2.5137200355529785,
+    "diagonal_ce": 2.5137007236480713,
+    "finite": 0.0008072663331404328,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 6,
+    "loss": 2.504737615585327,
+    "diagonal_ce": 2.5047035217285156,
+    "finite": 0.001214182237163186,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 7,
+    "loss": 2.500166416168213,
+    "diagonal_ce": 2.5001327991485596,
+    "finite": 0.0010530190775170922,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 8,
+    "loss": 2.4877965450286865,
+    "diagonal_ce": 2.4877395629882812,
+    "finite": 0.0015832650242373347,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 9,
+    "loss": 2.485257863998413,
+    "diagonal_ce": 2.485175371170044,
+    "finite": 0.002063432475551963,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 10,
+    "loss": 2.470529556274414,
+    "diagonal_ce": 2.4704623222351074,
+    "finite": 0.0015297880163416266,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 11,
+    "loss": 2.4672110080718994,
+    "diagonal_ce": 2.4671380519866943,
+    "finite": 0.0015187630197033286,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 12,
+    "loss": 2.45737886428833,
+    "diagonal_ce": 2.457195997238159,
+    "finite": 0.00351504934951663,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 13,
+    "loss": 2.4415781497955322,
+    "diagonal_ce": 2.441439390182495,
+    "finite": 0.0024788351729512215,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 14,
+    "loss": 2.4346916675567627,
+    "diagonal_ce": 2.4345414638519287,
+    "finite": 0.002503530588001013,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 15,
+    "loss": 2.423327922821045,
+    "diagonal_ce": 2.4231104850769043,
+    "finite": 0.0033987639471888542,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 16,
+    "loss": 2.4119961261749268,
+    "diagonal_ce": 2.4117276668548584,
+    "finite": 0.00394772831350565,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 17,
+    "loss": 2.399178981781006,
+    "diagonal_ce": 2.3988380432128906,
+    "finite": 0.004735277034342289,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 18,
+    "loss": 2.3890302181243896,
+    "diagonal_ce": 2.3885648250579834,
+    "finite": 0.006122835446149111,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 19,
+    "loss": 2.3753833770751953,
+    "diagonal_ce": 2.3749325275421143,
+    "finite": 0.005636455491185188,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 20,
+    "loss": 2.3707082271575928,
+    "diagonal_ce": 2.3702378273010254,
+    "finite": 0.005600292235612869,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 21,
+    "loss": 2.356781005859375,
+    "diagonal_ce": 2.355983018875122,
+    "finite": 0.009068491868674755,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 22,
+    "loss": 2.3380019664764404,
+    "diagonal_ce": 2.3371853828430176,
+    "finite": 0.008876192383468151,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 23,
+    "loss": 2.3273510932922363,
+    "diagonal_ce": 2.3264834880828857,
+    "finite": 0.009037842974066734,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 24,
+    "loss": 2.3010315895080566,
+    "diagonal_ce": 2.2998673915863037,
+    "finite": 0.01164255104959011,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 25,
+    "loss": 2.294166088104248,
+    "diagonal_ce": 2.2928552627563477,
+    "finite": 0.012604566290974617,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 26,
+    "loss": 2.25638484954834,
+    "diagonal_ce": 2.2541050910949707,
+    "finite": 0.02110959216952324,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 27,
+    "loss": 2.2416374683380127,
+    "diagonal_ce": 2.2395224571228027,
+    "finite": 0.018883636221289635,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 28,
+    "loss": 2.2021002769470215,
+    "diagonal_ce": 2.1992125511169434,
+    "finite": 0.02489355392754078,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 29,
+    "loss": 2.2084388732910156,
+    "diagonal_ce": 2.205274820327759,
+    "finite": 0.02636760286986828,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 30,
+    "loss": 2.1468751430511475,
+    "diagonal_ce": 2.142819881439209,
+    "finite": 0.03270449489355087,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 31,
+    "loss": 2.149366855621338,
+    "diagonal_ce": 2.143622875213623,
+    "finite": 0.04487423598766327,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 32,
+    "loss": 2.110110282897949,
+    "diagonal_ce": 2.1046767234802246,
+    "finite": 0.04116303473711014,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 33,
+    "loss": 2.080761194229126,
+    "diagonal_ce": 2.0738883018493652,
+    "finite": 0.05053514987230301,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 34,
+    "loss": 2.053429126739502,
+    "diagonal_ce": 2.044041633605957,
+    "finite": 0.06705395132303238,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 35,
+    "loss": 2.044961929321289,
+    "diagonal_ce": 2.0346789360046387,
+    "finite": 0.07141049206256866,
+    "denominator_clamp_fraction": 0.009915865026414394
+  },
+  {
+    "step": 36,
+    "loss": 2.02300763130188,
+    "diagonal_ce": 2.0094475746154785,
+    "finite": 0.09162138402462006,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 37,
+    "loss": 1.983749508857727,
+    "diagonal_ce": 1.9690650701522827,
+    "finite": 0.09660790860652924,
+    "denominator_clamp_fraction": 0.006009615492075682
+  },
+  {
+    "step": 38,
+    "loss": 1.9142833948135376,
+    "diagonal_ce": 1.89472496509552,
+    "finite": 0.12537460029125214,
+    "denominator_clamp_fraction": 0.006911057513207197
+  },
+  {
+    "step": 39,
+    "loss": 1.9130312204360962,
+    "diagonal_ce": 1.892714262008667,
+    "finite": 0.1269809901714325,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 40,
+    "loss": 1.8925189971923828,
+    "diagonal_ce": 1.874365210533142,
+    "finite": 0.11069361865520477,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 41,
+    "loss": 1.8439644575119019,
+    "diagonal_ce": 1.8142083883285522,
+    "finite": 0.17711947858333588,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 42,
+    "loss": 1.8253484964370728,
+    "diagonal_ce": 1.7887866497039795,
+    "finite": 0.2125687599182129,
+    "denominator_clamp_fraction": 0.016225961968302727
+  },
+  {
+    "step": 43,
+    "loss": 1.8190641403198242,
+    "diagonal_ce": 1.7811403274536133,
+    "finite": 0.21547633409500122,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 44,
+    "loss": 1.7612673044204712,
+    "diagonal_ce": 1.7096267938613892,
+    "finite": 0.28689178824424744,
+    "denominator_clamp_fraction": 0.01953125
+  },
+  {
+    "step": 45,
+    "loss": 1.6859707832336426,
+    "diagonal_ce": 1.6290688514709473,
+    "finite": 0.30924975872039795,
+    "denominator_clamp_fraction": 0.010516826994717121
+  },
+  {
+    "step": 46,
+    "loss": 1.6737444400787354,
+    "diagonal_ce": 1.596618413925171,
+    "finite": 0.4102446436882019,
+    "denominator_clamp_fraction": 0.04326923191547394
+  },
+  {
+    "step": 47,
+    "loss": 1.6778278350830078,
+    "diagonal_ce": 1.6140708923339844,
+    "finite": 0.33206772804260254,
+    "denominator_clamp_fraction": 0.012920673005282879
+  },
+  {
+    "step": 48,
+    "loss": 1.6604549884796143,
+    "diagonal_ce": 1.570701003074646,
+    "finite": 0.4579286277294159,
+    "denominator_clamp_fraction": 0.041766826063394547
+  },
+  {
+    "step": 49,
+    "loss": 1.6493141651153564,
+    "diagonal_ce": 1.5453965663909912,
+    "finite": 0.5195876955986023,
+    "denominator_clamp_fraction": 0.07091346383094788
+  },
+  {
+    "step": 50,
+    "loss": 1.5735342502593994,
+    "diagonal_ce": 1.460038423538208,
+    "finite": 0.5563523173332214,
+    "denominator_clamp_fraction": 0.016526442021131516
+  },
+  {
+    "step": 51,
+    "loss": 1.5602344274520874,
+    "diagonal_ce": 1.4173247814178467,
+    "finite": 0.6870654225349426,
+    "denominator_clamp_fraction": 0.06941105425357819
+  },
+  {
+    "step": 52,
+    "loss": 1.5458887815475464,
+    "diagonal_ce": 1.41200852394104,
+    "finite": 0.6315106749534607,
+    "denominator_clamp_fraction": 0.028545673936605453
+  },
+  {
+    "step": 53,
+    "loss": 1.53066885471344,
+    "diagonal_ce": 1.394854187965393,
+    "finite": 0.6287716627120972,
+    "denominator_clamp_fraction": 0.016225961968302727
+  },
+  {
+    "step": 54,
+    "loss": 1.5519639253616333,
+    "diagonal_ce": 1.368066668510437,
+    "finite": 0.8358964920043945,
+    "denominator_clamp_fraction": 0.06881009787321091
+  },
+  {
+    "step": 55,
+    "loss": 1.5411754846572876,
+    "diagonal_ce": 1.3574066162109375,
+    "finite": 0.8203968405723572,
+    "denominator_clamp_fraction": 0.05258413404226303
+  },
+  {
+    "step": 56,
+    "loss": 1.556820034980774,
+    "diagonal_ce": 1.3610281944274902,
+    "finite": 0.8587360382080078,
+    "denominator_clamp_fraction": 0.05498798191547394
+  },
+  {
+    "step": 57,
+    "loss": 1.5352786779403687,
+    "diagonal_ce": 1.3205803632736206,
+    "finite": 0.9254236817359924,
+    "denominator_clamp_fraction": 0.06460336595773697
+  },
+  {
+    "step": 58,
+    "loss": 1.5113444328308105,
+    "diagonal_ce": 1.2618646621704102,
+    "finite": 1.0571178197860718,
+    "denominator_clamp_fraction": 0.05799278989434242
+  },
+  {
+    "step": 59,
+    "loss": 1.546239972114563,
+    "diagonal_ce": 1.2698146104812622,
+    "finite": 1.151772379875183,
+    "denominator_clamp_fraction": 0.07542067021131516
+  },
+  {
+    "step": 60,
+    "loss": 1.5458717346191406,
+    "diagonal_ce": 1.2890794277191162,
+    "finite": 1.0524272918701172,
+    "denominator_clamp_fraction": 0.06730769574642181
+  },
+  {
+    "step": 61,
+    "loss": 1.5132770538330078,
+    "diagonal_ce": 1.2479137182235718,
+    "finite": 1.0700132846832275,
+    "denominator_clamp_fraction": 0.03305288404226303
+  },
+  {
+    "step": 62,
+    "loss": 1.5556089878082275,
+    "diagonal_ce": 1.3031952381134033,
+    "finite": 1.001641869544983,
+    "denominator_clamp_fraction": 0.044170673936605453
+  },
+  {
+    "step": 63,
+    "loss": 1.5297598838806152,
+    "diagonal_ce": 1.2369539737701416,
+    "finite": 1.143772840499878,
+    "denominator_clamp_fraction": 0.03966346010565758
+  },
+  {
+    "step": 64,
+    "loss": 1.552072525024414,
+    "diagonal_ce": 1.1933249235153198,
+    "finite": 1.3797985315322876,
+    "denominator_clamp_fraction": 0.08984375
+  },
+  {
+    "step": 65,
+    "loss": 1.5749601125717163,
+    "diagonal_ce": 1.257240653038025,
+    "finite": 1.2034828662872314,
+    "denominator_clamp_fraction": 0.07842548191547394
+  },
+  {
+    "step": 66,
+    "loss": 1.5640568733215332,
+    "diagonal_ce": 1.2097748517990112,
+    "finite": 1.3219480514526367,
+    "denominator_clamp_fraction": 0.10667067021131516
+  },
+  {
+    "step": 67,
+    "loss": 1.5423418283462524,
+    "diagonal_ce": 1.2197473049163818,
+    "finite": 1.186009168624878,
+    "denominator_clamp_fraction": 0.03695913404226303
+  },
+  {
+    "step": 68,
+    "loss": 1.5451840162277222,
+    "diagonal_ce": 1.1976670026779175,
+    "finite": 1.2591197490692139,
+    "denominator_clamp_fraction": 0.04897836595773697
+  },
+  {
+    "step": 69,
+    "loss": 1.5213371515274048,
+    "diagonal_ce": 1.1740275621414185,
+    "finite": 1.2403912544250488,
+    "denominator_clamp_fraction": 0.06310096383094788
+  },
+  {
+    "step": 70,
+    "loss": 1.5273168087005615,
+    "diagonal_ce": 1.1969891786575317,
+    "finite": 1.1631252765655518,
+    "denominator_clamp_fraction": 0.0390625
+  },
+  {
+    "step": 71,
+    "loss": 1.5287420749664307,
+    "diagonal_ce": 1.210385799407959,
+    "finite": 1.1054036617279053,
+    "denominator_clamp_fraction": 0.044170673936605453
+  },
+  {
+    "step": 72,
+    "loss": 1.6044999361038208,
+    "diagonal_ce": 1.2113802433013916,
+    "finite": 1.3463002443313599,
+    "denominator_clamp_fraction": 0.11808894574642181
+  },
+  {
+    "step": 73,
+    "loss": 1.5164368152618408,
+    "diagonal_ce": 1.2026747465133667,
+    "finite": 1.060006856918335,
+    "denominator_clamp_fraction": 0.05528846010565758
+  },
+  {
+    "step": 74,
+    "loss": 1.5077234506607056,
+    "diagonal_ce": 1.17703115940094,
+    "finite": 1.1023075580596924,
+    "denominator_clamp_fraction": 0.04056490212678909
+  },
+  {
+    "step": 75,
+    "loss": 1.5072263479232788,
+    "diagonal_ce": 1.1694315671920776,
+    "finite": 1.1111669540405273,
+    "denominator_clamp_fraction": 0.05528846010565758
+  },
+  {
+    "step": 76,
+    "loss": 1.5229607820510864,
+    "diagonal_ce": 1.2168647050857544,
+    "finite": 0.9938183426856995,
+    "denominator_clamp_fraction": 0.06580528616905212
+  },
+  {
+    "step": 77,
+    "loss": 1.5444470643997192,
+    "diagonal_ce": 1.1663166284561157,
+    "finite": 1.2119566202163696,
+    "denominator_clamp_fraction": 0.07842548191547394
+  },
+  {
+    "step": 78,
+    "loss": 1.5050792694091797,
+    "diagonal_ce": 1.2234070301055908,
+    "finite": 0.8913678526878357,
+    "denominator_clamp_fraction": 0.026742788031697273
+  },
+  {
+    "step": 79,
+    "loss": 1.527559518814087,
+    "diagonal_ce": 1.2351534366607666,
+    "finite": 0.9137688279151917,
+    "denominator_clamp_fraction": 0.05438701808452606
+  },
+  {
+    "step": 80,
+    "loss": 1.4839574098587036,
+    "diagonal_ce": 1.2147928476333618,
+    "finite": 0.8307546973228455,
+    "denominator_clamp_fraction": 0.022836538031697273
+  },
+  {
+    "step": 81,
+    "loss": 1.4837626218795776,
+    "diagonal_ce": 1.219550609588623,
+    "finite": 0.8055244088172913,
+    "denominator_clamp_fraction": 0.03335336595773697
+  },
+  {
+    "step": 82,
+    "loss": 1.4983711242675781,
+    "diagonal_ce": 1.2343026399612427,
+    "finite": 0.7953872084617615,
+    "denominator_clamp_fraction": 0.04867788404226303
+  },
+  {
+    "step": 83,
+    "loss": 1.4746464490890503,
+    "diagonal_ce": 1.223633050918579,
+    "finite": 0.7470638155937195,
+    "denominator_clamp_fraction": 0.01592548005282879
+  },
+  {
+    "step": 84,
+    "loss": 1.4743348360061646,
+    "diagonal_ce": 1.2309675216674805,
+    "finite": 0.715786337852478,
+    "denominator_clamp_fraction": 0.015024038031697273
+  },
+  {
+    "step": 85,
+    "loss": 1.467836618423462,
+    "diagonal_ce": 1.2057723999023438,
+    "finite": 0.7618143558502197,
+    "denominator_clamp_fraction": 0.044170673936605453
+  },
+  {
+    "step": 86,
+    "loss": 1.4439818859100342,
+    "diagonal_ce": 1.2280224561691284,
+    "finite": 0.6205729246139526,
+    "denominator_clamp_fraction": 0.01171875
+  },
+  {
+    "step": 87,
+    "loss": 1.4555480480194092,
+    "diagonal_ce": 1.2017697095870972,
+    "finite": 0.7209612131118774,
+    "denominator_clamp_fraction": 0.022836538031697273
+  },
+  {
+    "step": 88,
+    "loss": 1.4631857872009277,
+    "diagonal_ce": 1.218724250793457,
+    "finite": 0.686689555644989,
+    "denominator_clamp_fraction": 0.04236778989434242
+  },
+  {
+    "step": 89,
+    "loss": 1.4644432067871094,
+    "diagonal_ce": 1.2496709823608398,
+    "finite": 0.5965895056724548,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 90,
+    "loss": 1.487895131111145,
+    "diagonal_ce": 1.2795921564102173,
+    "finite": 0.572260856628418,
+    "denominator_clamp_fraction": 0.006310096010565758
+  },
+  {
+    "step": 91,
+    "loss": 1.4742071628570557,
+    "diagonal_ce": 1.2295433282852173,
+    "finite": 0.6648474931716919,
+    "denominator_clamp_fraction": 0.02944711595773697
+  },
+  {
+    "step": 92,
+    "loss": 1.4421417713165283,
+    "diagonal_ce": 1.2178765535354614,
+    "finite": 0.6028634309768677,
+    "denominator_clamp_fraction": 0.015024038031697273
+  },
+  {
+    "step": 93,
+    "loss": 1.485595941543579,
+    "diagonal_ce": 1.2509270906448364,
+    "finite": 0.6241192817687988,
+    "denominator_clamp_fraction": 0.03756009787321091
+  },
+  {
+    "step": 94,
+    "loss": 1.478010654449463,
+    "diagonal_ce": 1.2340086698532104,
+    "finite": 0.6421104669570923,
+    "denominator_clamp_fraction": 0.03515625
+  },
+  {
+    "step": 95,
+    "loss": 1.424001932144165,
+    "diagonal_ce": 1.2250211238861084,
+    "finite": 0.5181792974472046,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 96,
+    "loss": 1.4149043560028076,
+    "diagonal_ce": 1.207555890083313,
+    "finite": 0.5344030857086182,
+    "denominator_clamp_fraction": 0.0072115384973585606
+  },
+  {
+    "step": 97,
+    "loss": 1.4387253522872925,
+    "diagonal_ce": 1.2283307313919067,
+    "finite": 0.536720871925354,
+    "denominator_clamp_fraction": 0.016526442021131516
+  },
+  {
+    "step": 98,
+    "loss": 1.4585580825805664,
+    "diagonal_ce": 1.225968360900879,
+    "finite": 0.5873478055000305,
+    "denominator_clamp_fraction": 0.02313701994717121
+  },
+  {
+    "step": 99,
+    "loss": 1.4591069221496582,
+    "diagonal_ce": 1.239532470703125,
+    "finite": 0.5489360690116882,
+    "denominator_clamp_fraction": 0.029747596010565758
+  },
+  {
+    "step": 100,
+    "loss": 1.4451384544372559,
+    "diagonal_ce": 1.2206299304962158,
+    "finite": 0.5557142496109009,
+    "denominator_clamp_fraction": 0.025841346010565758
+  },
+  {
+    "step": 101,
+    "loss": 1.4792824983596802,
+    "diagonal_ce": 1.2506355047225952,
+    "finite": 0.5604093074798584,
+    "denominator_clamp_fraction": 0.027944711968302727
+  },
+  {
+    "step": 102,
+    "loss": 1.4349610805511475,
+    "diagonal_ce": 1.2119770050048828,
+    "finite": 0.5412234663963318,
+    "denominator_clamp_fraction": 0.020132211968302727
+  },
+  {
+    "step": 103,
+    "loss": 1.470641851425171,
+    "diagonal_ce": 1.2221426963806152,
+    "finite": 0.5973538756370544,
+    "denominator_clamp_fraction": 0.0390625
+  },
+  {
+    "step": 104,
+    "loss": 1.4447050094604492,
+    "diagonal_ce": 1.2220017910003662,
+    "finite": 0.5302456617355347,
+    "denominator_clamp_fraction": 0.022536057978868484
+  },
+  {
+    "step": 105,
+    "loss": 1.4287192821502686,
+    "diagonal_ce": 1.1856565475463867,
+    "finite": 0.5732613205909729,
+    "denominator_clamp_fraction": 0.030649038031697273
+  },
+  {
+    "step": 106,
+    "loss": 1.4355034828186035,
+    "diagonal_ce": 1.2250168323516846,
+    "finite": 0.491791307926178,
+    "denominator_clamp_fraction": 0.018329326063394547
+  },
+  {
+    "step": 107,
+    "loss": 1.4145972728729248,
+    "diagonal_ce": 1.1857668161392212,
+    "finite": 0.5297001600265503,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 108,
+    "loss": 1.4024077653884888,
+    "diagonal_ce": 1.1691311597824097,
+    "finite": 0.5350379943847656,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 109,
+    "loss": 1.4146583080291748,
+    "diagonal_ce": 1.1826879978179932,
+    "finite": 0.5272051692008972,
+    "denominator_clamp_fraction": 0.008413461968302727
+  },
+  {
+    "step": 110,
+    "loss": 1.386949062347412,
+    "diagonal_ce": 1.155810832977295,
+    "finite": 0.5205816030502319,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 111,
+    "loss": 1.407984733581543,
+    "diagonal_ce": 1.1687496900558472,
+    "finite": 0.534006655216217,
+    "denominator_clamp_fraction": 0.02944711595773697
+  },
+  {
+    "step": 112,
+    "loss": 1.4143399000167847,
+    "diagonal_ce": 1.1932259798049927,
+    "finite": 0.48919016122817993,
+    "denominator_clamp_fraction": 0.022235576063394547
+  },
+  {
+    "step": 113,
+    "loss": 1.4079920053482056,
+    "diagonal_ce": 1.158014178276062,
+    "finite": 0.5481969714164734,
+    "denominator_clamp_fraction": 0.024038461968302727
+  },
+  {
+    "step": 114,
+    "loss": 1.3951462507247925,
+    "diagonal_ce": 1.1568758487701416,
+    "finite": 0.5179790258407593,
+    "denominator_clamp_fraction": 0.018930288031697273
+  },
+  {
+    "step": 115,
+    "loss": 1.4182662963867188,
+    "diagonal_ce": 1.1874054670333862,
+    "finite": 0.4975448548793793,
+    "denominator_clamp_fraction": 0.02764423005282879
+  },
+  {
+    "step": 116,
+    "loss": 1.445169448852539,
+    "diagonal_ce": 1.1854499578475952,
+    "finite": 0.5549561977386475,
+    "denominator_clamp_fraction": 0.04116586595773697
+  },
+  {
+    "step": 117,
+    "loss": 1.3775062561035156,
+    "diagonal_ce": 1.1659048795700073,
+    "finite": 0.44830790162086487,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 118,
+    "loss": 1.4076030254364014,
+    "diagonal_ce": 1.1791188716888428,
+    "finite": 0.48000863194465637,
+    "denominator_clamp_fraction": 0.036358173936605453
+  },
+  {
+    "step": 119,
+    "loss": 1.3441565036773682,
+    "diagonal_ce": 1.1239229440689087,
+    "finite": 0.4588199853897095,
+    "denominator_clamp_fraction": 0.01171875
+  },
+  {
+    "step": 120,
+    "loss": 1.3402397632598877,
+    "diagonal_ce": 1.1424190998077393,
+    "finite": 0.40872037410736084,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 121,
+    "loss": 1.3661786317825317,
+    "diagonal_ce": 1.1363239288330078,
+    "finite": 0.4710136651992798,
+    "denominator_clamp_fraction": 0.02163461595773697
+  },
+  {
+    "step": 122,
+    "loss": 1.3742796182632446,
+    "diagonal_ce": 1.1410213708877563,
+    "finite": 0.47410205006599426,
+    "denominator_clamp_fraction": 0.02704326994717121
+  },
+  {
+    "step": 123,
+    "loss": 1.347014307975769,
+    "diagonal_ce": 1.1317241191864014,
+    "finite": 0.43405288457870483,
+    "denominator_clamp_fraction": 0.006009615492075682
+  },
+  {
+    "step": 124,
+    "loss": 1.3615320920944214,
+    "diagonal_ce": 1.1181535720825195,
+    "finite": 0.4867571294307709,
+    "denominator_clamp_fraction": 0.022235576063394547
+  },
+  {
+    "step": 125,
+    "loss": 1.4112434387207031,
+    "diagonal_ce": 1.1809126138687134,
+    "finite": 0.45700567960739136,
+    "denominator_clamp_fraction": 0.03876201808452606
+  },
+  {
+    "step": 126,
+    "loss": 1.4288243055343628,
+    "diagonal_ce": 1.1834110021591187,
+    "finite": 0.48309701681137085,
+    "denominator_clamp_fraction": 0.028846153989434242
+  },
+  {
+    "step": 127,
+    "loss": 1.372391939163208,
+    "diagonal_ce": 1.1311700344085693,
+    "finite": 0.4711363911628723,
+    "denominator_clamp_fraction": 0.03515625
+  },
+  {
+    "step": 128,
+    "loss": 1.364633560180664,
+    "diagonal_ce": 1.1310067176818848,
+    "finite": 0.45276519656181335,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 129,
+    "loss": 1.3363876342773438,
+    "diagonal_ce": 1.1052837371826172,
+    "finite": 0.44443070888519287,
+    "denominator_clamp_fraction": 0.03485576808452606
+  },
+  {
+    "step": 130,
+    "loss": 1.3286069631576538,
+    "diagonal_ce": 1.1208950281143188,
+    "finite": 0.39639678597450256,
+    "denominator_clamp_fraction": 0.007512019015848637
+  },
+  {
+    "step": 131,
+    "loss": 1.331923007965088,
+    "diagonal_ce": 1.1140979528427124,
+    "finite": 0.4125474691390991,
+    "denominator_clamp_fraction": 0.033954326063394547
+  },
+  {
+    "step": 132,
+    "loss": 1.3340997695922852,
+    "diagonal_ce": 1.116047739982605,
+    "finite": 0.4098722040653229,
+    "denominator_clamp_fraction": 0.024038461968302727
+  },
+  {
+    "step": 133,
+    "loss": 1.3219106197357178,
+    "diagonal_ce": 1.1002066135406494,
+    "finite": 0.41362690925598145,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 134,
+    "loss": 1.3073943853378296,
+    "diagonal_ce": 1.0639228820800781,
+    "finite": 0.45087307691574097,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 135,
+    "loss": 1.3124964237213135,
+    "diagonal_ce": 1.0962071418762207,
+    "finite": 0.3975904583930969,
+    "denominator_clamp_fraction": 0.0078125
+  },
+  {
+    "step": 136,
+    "loss": 1.3080722093582153,
+    "diagonal_ce": 1.098215103149414,
+    "finite": 0.38295096158981323,
+    "denominator_clamp_fraction": 0.0072115384973585606
+  },
+  {
+    "step": 137,
+    "loss": 1.349845051765442,
+    "diagonal_ce": 1.1014344692230225,
+    "finite": 0.4500192701816559,
+    "denominator_clamp_fraction": 0.014423076994717121
+  },
+  {
+    "step": 138,
+    "loss": 1.3093342781066895,
+    "diagonal_ce": 1.066529393196106,
+    "finite": 0.4366993308067322,
+    "denominator_clamp_fraction": 0.02313701994717121
+  },
+  {
+    "step": 139,
+    "loss": 1.264420986175537,
+    "diagonal_ce": 1.0345476865768433,
+    "finite": 0.4104880094528198,
+    "denominator_clamp_fraction": 0.026742788031697273
+  },
+  {
+    "step": 140,
+    "loss": 1.3178497552871704,
+    "diagonal_ce": 1.0683554410934448,
+    "finite": 0.4423658847808838,
+    "denominator_clamp_fraction": 0.05288461595773697
+  },
+  {
+    "step": 141,
+    "loss": 1.30189049243927,
+    "diagonal_ce": 1.0789941549301147,
+    "finite": 0.392423152923584,
+    "denominator_clamp_fraction": 0.010216346010565758
+  },
+  {
+    "step": 142,
+    "loss": 1.3077824115753174,
+    "diagonal_ce": 1.0618900060653687,
+    "finite": 0.42988184094429016,
+    "denominator_clamp_fraction": 0.05679086595773697
+  },
+  {
+    "step": 143,
+    "loss": 1.2543699741363525,
+    "diagonal_ce": 1.024393081665039,
+    "finite": 0.3992654085159302,
+    "denominator_clamp_fraction": 0.020132211968302727
+  },
+  {
+    "step": 144,
+    "loss": 1.3084684610366821,
+    "diagonal_ce": 1.0288721323013306,
+    "finite": 0.4820626974105835,
+    "denominator_clamp_fraction": 0.03846153989434242
+  },
+  {
+    "step": 145,
+    "loss": 1.2860164642333984,
+    "diagonal_ce": 1.0691295862197876,
+    "finite": 0.3713817000389099,
+    "denominator_clamp_fraction": 0.015024038031697273
+  },
+  {
+    "step": 146,
+    "loss": 1.3085744380950928,
+    "diagonal_ce": 1.0287528038024902,
+    "finite": 0.4758870303630829,
+    "denominator_clamp_fraction": 0.03365384787321091
+  },
+  {
+    "step": 147,
+    "loss": 1.2692615985870361,
+    "diagonal_ce": 1.0189727544784546,
+    "finite": 0.4227851629257202,
+    "denominator_clamp_fraction": 0.048076923936605453
+  },
+  {
+    "step": 148,
+    "loss": 1.2803118228912354,
+    "diagonal_ce": 1.037668228149414,
+    "finite": 0.40712010860443115,
+    "denominator_clamp_fraction": 0.05408653989434242
+  },
+  {
+    "step": 149,
+    "loss": 1.274780035018921,
+    "diagonal_ce": 1.006913423538208,
+    "finite": 0.44644445180892944,
+    "denominator_clamp_fraction": 0.05318509787321091
+  },
+  {
+    "step": 150,
+    "loss": 1.2953990697860718,
+    "diagonal_ce": 1.0145028829574585,
+    "finite": 0.46505993604660034,
+    "denominator_clamp_fraction": 0.06820913404226303
+  },
+  {
+    "step": 151,
+    "loss": 1.3038145303726196,
+    "diagonal_ce": 1.0474262237548828,
+    "finite": 0.421691358089447,
+    "denominator_clamp_fraction": 0.04236778989434242
+  },
+  {
+    "step": 152,
+    "loss": 1.2653566598892212,
+    "diagonal_ce": 1.001824140548706,
+    "finite": 0.43060874938964844,
+    "denominator_clamp_fraction": 0.03094951994717121
+  },
+  {
+    "step": 153,
+    "loss": 1.3092323541641235,
+    "diagonal_ce": 1.0495423078536987,
+    "finite": 0.4215746819972992,
+    "denominator_clamp_fraction": 0.05318509787321091
+  },
+  {
+    "step": 154,
+    "loss": 1.3018935918807983,
+    "diagonal_ce": 0.9934238195419312,
+    "finite": 0.49753183126449585,
+    "denominator_clamp_fraction": 0.07091346383094788
+  },
+  {
+    "step": 155,
+    "loss": 1.277451992034912,
+    "diagonal_ce": 1.0098731517791748,
+    "finite": 0.42881229519844055,
+    "denominator_clamp_fraction": 0.07902644574642181
+  },
+  {
+    "step": 156,
+    "loss": 1.1863412857055664,
+    "diagonal_ce": 0.9535406827926636,
+    "finite": 0.37070155143737793,
+    "denominator_clamp_fraction": 0.028545673936605453
+  },
+  {
+    "step": 157,
+    "loss": 1.3086227178573608,
+    "diagonal_ce": 1.0011141300201416,
+    "finite": 0.4865642189979553,
+    "denominator_clamp_fraction": 0.057391826063394547
+  },
+  {
+    "step": 158,
+    "loss": 1.31368887424469,
+    "diagonal_ce": 1.0182534456253052,
+    "finite": 0.4645210802555084,
+    "denominator_clamp_fraction": 0.06490384787321091
+  },
+  {
+    "step": 159,
+    "loss": 1.294236660003662,
+    "diagonal_ce": 0.9831764101982117,
+    "finite": 0.48603174090385437,
+    "denominator_clamp_fraction": 0.06730769574642181
+  },
+  {
+    "step": 160,
+    "loss": 1.2640382051467896,
+    "diagonal_ce": 1.0082406997680664,
+    "finite": 0.3972010612487793,
+    "denominator_clamp_fraction": 0.02704326994717121
+  },
+  {
+    "step": 161,
+    "loss": 1.238823652267456,
+    "diagonal_ce": 0.9728721380233765,
+    "finite": 0.4104190468788147,
+    "denominator_clamp_fraction": 0.04747596010565758
+  },
+  {
+    "step": 162,
+    "loss": 1.1673626899719238,
+    "diagonal_ce": 0.9380627274513245,
+    "finite": 0.3516870141029358,
+    "denominator_clamp_fraction": 0.016225961968302727
+  },
+  {
+    "step": 163,
+    "loss": 1.1697192192077637,
+    "diagonal_ce": 0.9293211698532104,
+    "finite": 0.3664604425430298,
+    "denominator_clamp_fraction": 0.010516826994717121
+  },
+  {
+    "step": 164,
+    "loss": 1.2130402326583862,
+    "diagonal_ce": 0.970579981803894,
+    "finite": 0.3673640787601471,
+    "denominator_clamp_fraction": 0.01953125
+  },
+  {
+    "step": 165,
+    "loss": 1.2058303356170654,
+    "diagonal_ce": 0.9566020965576172,
+    "finite": 0.37534382939338684,
+    "denominator_clamp_fraction": 0.04927884787321091
+  },
+  {
+    "step": 166,
+    "loss": 1.3279119729995728,
+    "diagonal_ce": 1.029969334602356,
+    "finite": 0.4460218846797943,
+    "denominator_clamp_fraction": 0.10366586595773697
+  },
+  {
+    "step": 167,
+    "loss": 1.2167332172393799,
+    "diagonal_ce": 0.9131528735160828,
+    "finite": 0.45175647735595703,
+    "denominator_clamp_fraction": 0.06370192021131516
+  },
+  {
+    "step": 168,
+    "loss": 1.228748083114624,
+    "diagonal_ce": 0.9796557426452637,
+    "finite": 0.36847981810569763,
+    "denominator_clamp_fraction": 0.041766826063394547
+  },
+  {
+    "step": 169,
+    "loss": 1.1955162286758423,
+    "diagonal_ce": 0.9567657113075256,
+    "finite": 0.3511037230491638,
+    "denominator_clamp_fraction": 0.03846153989434242
+  },
+  {
+    "step": 170,
+    "loss": 1.251978874206543,
+    "diagonal_ce": 1.0034089088439941,
+    "finite": 0.36340636014938354,
+    "denominator_clamp_fraction": 0.0625
+  },
+  {
+    "step": 171,
+    "loss": 1.235721468925476,
+    "diagonal_ce": 0.9723709225654602,
+    "finite": 0.3827769160270691,
+    "denominator_clamp_fraction": 0.03305288404226303
+  },
+  {
+    "step": 172,
+    "loss": 1.1866134405136108,
+    "diagonal_ce": 0.8986948728561401,
+    "finite": 0.41606730222702026,
+    "denominator_clamp_fraction": 0.03575721010565758
+  },
+  {
+    "step": 173,
+    "loss": 1.2702467441558838,
+    "diagonal_ce": 0.9384145140647888,
+    "finite": 0.47677046060562134,
+    "denominator_clamp_fraction": 0.07211538404226303
+  },
+  {
+    "step": 174,
+    "loss": 1.242130994796753,
+    "diagonal_ce": 0.9555574059486389,
+    "finite": 0.4093908667564392,
+    "denominator_clamp_fraction": 0.03725961595773697
+  },
+  {
+    "step": 175,
+    "loss": 1.2056293487548828,
+    "diagonal_ce": 0.9069521427154541,
+    "finite": 0.42425739765167236,
+    "denominator_clamp_fraction": 0.046875
+  },
+  {
+    "step": 176,
+    "loss": 1.2783119678497314,
+    "diagonal_ce": 0.9477338790893555,
+    "finite": 0.4669182598590851,
+    "denominator_clamp_fraction": 0.05318509787321091
+  },
+  {
+    "step": 177,
+    "loss": 1.2381696701049805,
+    "diagonal_ce": 0.9694440960884094,
+    "finite": 0.37742361426353455,
+    "denominator_clamp_fraction": 0.03155048191547394
+  },
+  {
+    "step": 178,
+    "loss": 1.1699985265731812,
+    "diagonal_ce": 0.8822042346000671,
+    "finite": 0.4019473195075989,
+    "denominator_clamp_fraction": 0.04447115212678909
+  },
+  {
+    "step": 179,
+    "loss": 1.1939561367034912,
+    "diagonal_ce": 0.8662289381027222,
+    "finite": 0.4551766514778137,
+    "denominator_clamp_fraction": 0.03756009787321091
+  },
+  {
+    "step": 180,
+    "loss": 1.2322896718978882,
+    "diagonal_ce": 0.8900303244590759,
+    "finite": 0.4727339744567871,
+    "denominator_clamp_fraction": 0.07782451808452606
+  },
+  {
+    "step": 181,
+    "loss": 1.155167579650879,
+    "diagonal_ce": 0.7675440311431885,
+    "finite": 0.5324498414993286,
+    "denominator_clamp_fraction": 0.08894230425357819
+  },
+  {
+    "step": 182,
+    "loss": 1.1970393657684326,
+    "diagonal_ce": 0.8737236261367798,
+    "finite": 0.44168820977211,
+    "denominator_clamp_fraction": 0.06400240212678909
+  },
+  {
+    "step": 183,
+    "loss": 1.169802188873291,
+    "diagonal_ce": 0.8407553434371948,
+    "finite": 0.4470745623111725,
+    "denominator_clamp_fraction": 0.06370192021131516
+  },
+  {
+    "step": 184,
+    "loss": 1.3164103031158447,
+    "diagonal_ce": 0.9411597847938538,
+    "finite": 0.5070952773094177,
+    "denominator_clamp_fraction": 0.07902644574642181
+  },
+  {
+    "step": 185,
+    "loss": 1.2717429399490356,
+    "diagonal_ce": 0.950248122215271,
+    "finite": 0.43211668729782104,
+    "denominator_clamp_fraction": 0.06069711595773697
+  },
+  {
+    "step": 186,
+    "loss": 1.1864196062088013,
+    "diagonal_ce": 0.8659959435462952,
+    "finite": 0.4283738136291504,
+    "denominator_clamp_fraction": 0.032151442021131516
+  },
+  {
+    "step": 187,
+    "loss": 1.275001883506775,
+    "diagonal_ce": 0.8994288444519043,
+    "finite": 0.4994322657585144,
+    "denominator_clamp_fraction": 0.06340144574642181
+  },
+  {
+    "step": 188,
+    "loss": 1.1642563343048096,
+    "diagonal_ce": 0.8179066777229309,
+    "finite": 0.4581344723701477,
+    "denominator_clamp_fraction": 0.08653846383094788
+  },
+  {
+    "step": 189,
+    "loss": 1.2713261842727661,
+    "diagonal_ce": 0.9717431664466858,
+    "finite": 0.3941882252693176,
+    "denominator_clamp_fraction": 0.07602163404226303
+  },
+  {
+    "step": 190,
+    "loss": 1.0887700319290161,
+    "diagonal_ce": 0.8447862267494202,
+    "finite": 0.3193504810333252,
+    "denominator_clamp_fraction": 0.038161057978868484
+  },
+  {
+    "step": 191,
+    "loss": 1.216088056564331,
+    "diagonal_ce": 0.9262397289276123,
+    "finite": 0.37740659713745117,
+    "denominator_clamp_fraction": 0.049879807978868484
+  },
+  {
+    "step": 192,
+    "loss": 1.202295184135437,
+    "diagonal_ce": 0.8981756567955017,
+    "finite": 0.39393723011016846,
+    "denominator_clamp_fraction": 0.05138221010565758
+  },
+  {
+    "step": 193,
+    "loss": 1.07974112033844,
+    "diagonal_ce": 0.8216698169708252,
+    "finite": 0.33256611227989197,
+    "denominator_clamp_fraction": 0.04867788404226303
+  },
+  {
+    "step": 194,
+    "loss": 1.173394799232483,
+    "diagonal_ce": 0.8633549213409424,
+    "finite": 0.3974870443344116,
+    "denominator_clamp_fraction": 0.04477163404226303
+  },
+  {
+    "step": 195,
+    "loss": 1.1971338987350464,
+    "diagonal_ce": 0.9129535555839539,
+    "finite": 0.3624749481678009,
+    "denominator_clamp_fraction": 0.020432692021131516
+  },
+  {
+    "step": 196,
+    "loss": 1.2009785175323486,
+    "diagonal_ce": 0.9108332991600037,
+    "finite": 0.3682045638561249,
+    "denominator_clamp_fraction": 0.051682692021131516
+  },
+  {
+    "step": 197,
+    "loss": 1.2699273824691772,
+    "diagonal_ce": 0.9530483484268188,
+    "finite": 0.4000997841358185,
+    "denominator_clamp_fraction": 0.03665865212678909
+  },
+  {
+    "step": 198,
+    "loss": 1.2355040311813354,
+    "diagonal_ce": 0.9737846851348877,
+    "finite": 0.32879310846328735,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 199,
+    "loss": 1.1721274852752686,
+    "diagonal_ce": 0.8655404448509216,
+    "finite": 0.38323378562927246,
+    "denominator_clamp_fraction": 0.03575721010565758
+  },
+  {
+    "step": 200,
+    "loss": 1.1229945421218872,
+    "diagonal_ce": 0.8138439655303955,
+    "finite": 0.38451558351516724,
+    "denominator_clamp_fraction": 0.04236778989434242
+  },
+  {
+    "step": 201,
+    "loss": 1.2117663621902466,
+    "diagonal_ce": 0.8901721835136414,
+    "finite": 0.398012638092041,
+    "denominator_clamp_fraction": 0.03846153989434242
+  },
+  {
+    "step": 202,
+    "loss": 1.2700488567352295,
+    "diagonal_ce": 0.9217969179153442,
+    "finite": 0.42888179421424866,
+    "denominator_clamp_fraction": 0.04537259787321091
+  },
+  {
+    "step": 203,
+    "loss": 1.1488035917282104,
+    "diagonal_ce": 0.8279579281806946,
+    "finite": 0.3931932747364044,
+    "denominator_clamp_fraction": 0.07061298191547394
+  },
+  {
+    "step": 204,
+    "loss": 1.1720771789550781,
+    "diagonal_ce": 0.9039276838302612,
+    "finite": 0.3270116448402405,
+    "denominator_clamp_fraction": 0.02944711595773697
+  },
+  {
+    "step": 205,
+    "loss": 1.1934362649917603,
+    "diagonal_ce": 0.8515331149101257,
+    "finite": 0.41493096947669983,
+    "denominator_clamp_fraction": 0.05829326808452606
+  },
+  {
+    "step": 206,
+    "loss": 1.1781691312789917,
+    "diagonal_ce": 0.8973613977432251,
+    "finite": 0.33913975954055786,
+    "denominator_clamp_fraction": 0.016826923936605453
+  },
+  {
+    "step": 207,
+    "loss": 1.265268087387085,
+    "diagonal_ce": 0.9109552502632141,
+    "finite": 0.42585670948028564,
+    "denominator_clamp_fraction": 0.03485576808452606
+  },
+  {
+    "step": 208,
+    "loss": 1.154492974281311,
+    "diagonal_ce": 0.8521625995635986,
+    "finite": 0.36163920164108276,
+    "denominator_clamp_fraction": 0.03665865212678909
+  },
+  {
+    "step": 209,
+    "loss": 1.2436641454696655,
+    "diagonal_ce": 0.9272742867469788,
+    "finite": 0.37665462493896484,
+    "denominator_clamp_fraction": 0.048076923936605453
+  },
+  {
+    "step": 210,
+    "loss": 1.1776784658432007,
+    "diagonal_ce": 0.8583086729049683,
+    "finite": 0.3784002661705017,
+    "denominator_clamp_fraction": 0.04537259787321091
+  },
+  {
+    "step": 211,
+    "loss": 1.1358492374420166,
+    "diagonal_ce": 0.8772095441818237,
+    "finite": 0.30499958992004395,
+    "denominator_clamp_fraction": 0.03575721010565758
+  },
+  {
+    "step": 212,
+    "loss": 1.184191107749939,
+    "diagonal_ce": 0.9137859344482422,
+    "finite": 0.317376971244812,
+    "denominator_clamp_fraction": 0.03545673191547394
+  },
+  {
+    "step": 213,
+    "loss": 1.1372853517532349,
+    "diagonal_ce": 0.8232256770133972,
+    "finite": 0.3668921887874603,
+    "denominator_clamp_fraction": 0.06370192021131516
+  },
+  {
+    "step": 214,
+    "loss": 1.1633751392364502,
+    "diagonal_ce": 0.8450233936309814,
+    "finite": 0.3701764941215515,
+    "denominator_clamp_fraction": 0.04356971010565758
+  },
+  {
+    "step": 215,
+    "loss": 1.1544039249420166,
+    "diagonal_ce": 0.869429886341095,
+    "finite": 0.3298311233520508,
+    "denominator_clamp_fraction": 0.021935096010565758
+  },
+  {
+    "step": 216,
+    "loss": 1.1660670042037964,
+    "diagonal_ce": 0.9055905938148499,
+    "finite": 0.3000880181789398,
+    "denominator_clamp_fraction": 0.01171875
+  },
+  {
+    "step": 217,
+    "loss": 1.1303279399871826,
+    "diagonal_ce": 0.8582834601402283,
+    "finite": 0.3119776248931885,
+    "denominator_clamp_fraction": 0.02554086595773697
+  },
+  {
+    "step": 218,
+    "loss": 1.203490972518921,
+    "diagonal_ce": 0.9552985429763794,
+    "finite": 0.28332462906837463,
+    "denominator_clamp_fraction": 0.020733173936605453
+  },
+  {
+    "step": 219,
+    "loss": 1.0720525979995728,
+    "diagonal_ce": 0.8523165583610535,
+    "finite": 0.24970000982284546,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 220,
+    "loss": 1.1311733722686768,
+    "diagonal_ce": 0.8648810386657715,
+    "finite": 0.3012356162071228,
+    "denominator_clamp_fraction": 0.028245192021131516
+  },
+  {
+    "step": 221,
+    "loss": 1.1785273551940918,
+    "diagonal_ce": 0.9057169556617737,
+    "finite": 0.3072189688682556,
+    "denominator_clamp_fraction": 0.01772836595773697
+  },
+  {
+    "step": 222,
+    "loss": 1.117069959640503,
+    "diagonal_ce": 0.8860748410224915,
+    "finite": 0.2589631974697113,
+    "denominator_clamp_fraction": 0.016826923936605453
+  },
+  {
+    "step": 223,
+    "loss": 1.1577284336090088,
+    "diagonal_ce": 0.8894208073616028,
+    "finite": 0.299450546503067,
+    "denominator_clamp_fraction": 0.03335336595773697
+  },
+  {
+    "step": 224,
+    "loss": 1.19344961643219,
+    "diagonal_ce": 0.9231942892074585,
+    "finite": 0.3002837300300598,
+    "denominator_clamp_fraction": 0.04627403989434242
+  },
+  {
+    "step": 225,
+    "loss": 1.2476272583007812,
+    "diagonal_ce": 0.9652546644210815,
+    "finite": 0.31235912442207336,
+    "denominator_clamp_fraction": 0.04717548191547394
+  },
+  {
+    "step": 226,
+    "loss": 1.081538438796997,
+    "diagonal_ce": 0.780928909778595,
+    "finite": 0.3310678005218506,
+    "denominator_clamp_fraction": 0.055889423936605453
+  },
+  {
+    "step": 227,
+    "loss": 1.1709036827087402,
+    "diagonal_ce": 0.8795804977416992,
+    "finite": 0.31943339109420776,
+    "denominator_clamp_fraction": 0.04116586595773697
+  },
+  {
+    "step": 228,
+    "loss": 1.3143000602722168,
+    "diagonal_ce": 1.0344572067260742,
+    "finite": 0.3055052161216736,
+    "denominator_clamp_fraction": 0.03365384787321091
+  },
+  {
+    "step": 229,
+    "loss": 1.1213196516036987,
+    "diagonal_ce": 0.8423874378204346,
+    "finite": 0.30318719148635864,
+    "denominator_clamp_fraction": 0.024338942021131516
+  },
+  {
+    "step": 230,
+    "loss": 1.0933034420013428,
+    "diagonal_ce": 0.8041630983352661,
+    "finite": 0.3129223883152008,
+    "denominator_clamp_fraction": 0.026742788031697273
+  },
+  {
+    "step": 231,
+    "loss": 1.2554837465286255,
+    "diagonal_ce": 0.9382464289665222,
+    "finite": 0.341850608587265,
+    "denominator_clamp_fraction": 0.045673076063394547
+  },
+  {
+    "step": 232,
+    "loss": 1.1152862310409546,
+    "diagonal_ce": 0.8144110441207886,
+    "finite": 0.32282742857933044,
+    "denominator_clamp_fraction": 0.05138221010565758
+  },
+  {
+    "step": 233,
+    "loss": 1.2012219429016113,
+    "diagonal_ce": 0.9547860622406006,
+    "finite": 0.26328620314598083,
+    "denominator_clamp_fraction": 0.041766826063394547
+  },
+  {
+    "step": 234,
+    "loss": 1.0249906778335571,
+    "diagonal_ce": 0.7818117737770081,
+    "finite": 0.258700966835022,
+    "denominator_clamp_fraction": 0.036358173936605453
+  },
+  {
+    "step": 235,
+    "loss": 1.1557753086090088,
+    "diagonal_ce": 0.8604004979133606,
+    "finite": 0.3128969669342041,
+    "denominator_clamp_fraction": 0.02704326994717121
+  },
+  {
+    "step": 236,
+    "loss": 1.1294535398483276,
+    "diagonal_ce": 0.8781566023826599,
+    "finite": 0.26508113741874695,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 237,
+    "loss": 1.1720843315124512,
+    "diagonal_ce": 0.8820433020591736,
+    "finite": 0.3046649396419525,
+    "denominator_clamp_fraction": 0.021033653989434242
+  },
+  {
+    "step": 238,
+    "loss": 1.0530877113342285,
+    "diagonal_ce": 0.859582781791687,
+    "finite": 0.20241102576255798,
+    "denominator_clamp_fraction": 0.03365384787321091
+  },
+  {
+    "step": 239,
+    "loss": 1.1241859197616577,
+    "diagonal_ce": 0.8506712913513184,
+    "finite": 0.2849110960960388,
+    "denominator_clamp_fraction": 0.028245192021131516
+  },
+  {
+    "step": 240,
+    "loss": 1.1408212184906006,
+    "diagonal_ce": 0.8929047584533691,
+    "finite": 0.2571747303009033,
+    "denominator_clamp_fraction": 0.009314903989434242
+  },
+  {
+    "step": 241,
+    "loss": 1.0887577533721924,
+    "diagonal_ce": 0.8330541849136353,
+    "finite": 0.26415663957595825,
+    "denominator_clamp_fraction": 0.05078125
+  },
+  {
+    "step": 242,
+    "loss": 1.0482635498046875,
+    "diagonal_ce": 0.8391871452331543,
+    "finite": 0.21509920060634613,
+    "denominator_clamp_fraction": 0.027944711968302727
+  },
+  {
+    "step": 243,
+    "loss": 1.108771562576294,
+    "diagonal_ce": 0.8650199174880981,
+    "finite": 0.2497454732656479,
+    "denominator_clamp_fraction": 0.010216346010565758
+  },
+  {
+    "step": 244,
+    "loss": 1.1181955337524414,
+    "diagonal_ce": 0.850470781326294,
+    "finite": 0.2731885015964508,
+    "denominator_clamp_fraction": 0.013221153989434242
+  },
+  {
+    "step": 245,
+    "loss": 1.1325119733810425,
+    "diagonal_ce": 0.8238463997840881,
+    "finite": 0.3136845529079437,
+    "denominator_clamp_fraction": 0.04447115212678909
+  },
+  {
+    "step": 246,
+    "loss": 1.0893995761871338,
+    "diagonal_ce": 0.8043839931488037,
+    "finite": 0.2884773313999176,
+    "denominator_clamp_fraction": 0.026141826063394547
+  },
+  {
+    "step": 247,
+    "loss": 1.0552176237106323,
+    "diagonal_ce": 0.805986225605011,
+    "finite": 0.2512413561344147,
+    "denominator_clamp_fraction": 0.04747596010565758
+  },
+  {
+    "step": 248,
+    "loss": 1.0803812742233276,
+    "diagonal_ce": 0.8555839657783508,
+    "finite": 0.22570013999938965,
+    "denominator_clamp_fraction": 0.007512019015848637
+  },
+  {
+    "step": 249,
+    "loss": 1.025777816772461,
+    "diagonal_ce": 0.7812384366989136,
+    "finite": 0.2445393204689026,
+    "denominator_clamp_fraction": 0.015024038031697273
+  },
+  {
+    "step": 250,
+    "loss": 1.1378068923950195,
+    "diagonal_ce": 0.9174699187278748,
+    "finite": 0.22033697366714478,
+    "denominator_clamp_fraction": 0.007512019015848637
+  },
+  {
+    "step": 251,
+    "loss": 1.0873229503631592,
+    "diagonal_ce": 0.8548334240913391,
+    "finite": 0.2324894666671753,
+    "denominator_clamp_fraction": 0.046875
+  },
+  {
+    "step": 252,
+    "loss": 1.0013779401779175,
+    "diagonal_ce": 0.7862412929534912,
+    "finite": 0.21513666212558746,
+    "denominator_clamp_fraction": 0.012620192021131516
+  },
+  {
+    "step": 253,
+    "loss": 0.9999586343765259,
+    "diagonal_ce": 0.7822645306587219,
+    "finite": 0.21769413352012634,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 254,
+    "loss": 1.1140543222427368,
+    "diagonal_ce": 0.9086360931396484,
+    "finite": 0.20541825890541077,
+    "denominator_clamp_fraction": 0.02133413404226303
+  },
+  {
+    "step": 255,
+    "loss": 1.0823543071746826,
+    "diagonal_ce": 0.8426945805549622,
+    "finite": 0.23965966701507568,
+    "denominator_clamp_fraction": 0.012620192021131516
+  },
+  {
+    "step": 256,
+    "loss": 1.0366239547729492,
+    "diagonal_ce": 0.8288944959640503,
+    "finite": 0.20772945880889893,
+    "denominator_clamp_fraction": 0.012620192021131516
+  },
+  {
+    "step": 257,
+    "loss": 1.097398042678833,
+    "diagonal_ce": 0.8870694041252136,
+    "finite": 0.2103285938501358,
+    "denominator_clamp_fraction": 0.01983173005282879
+  },
+  {
+    "step": 258,
+    "loss": 1.0079118013381958,
+    "diagonal_ce": 0.8545002341270447,
+    "finite": 0.15341156721115112,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 259,
+    "loss": 0.965855598449707,
+    "diagonal_ce": 0.8045757412910461,
+    "finite": 0.16127988696098328,
+    "denominator_clamp_fraction": 0.011418269015848637
+  },
+  {
+    "step": 260,
+    "loss": 1.029425859451294,
+    "diagonal_ce": 0.8791738152503967,
+    "finite": 0.150252103805542,
+    "denominator_clamp_fraction": 0.012920673005282879
+  },
+  {
+    "step": 261,
+    "loss": 1.0532662868499756,
+    "diagonal_ce": 0.867719292640686,
+    "finite": 0.18554693460464478,
+    "denominator_clamp_fraction": 0.036057692021131516
+  },
+  {
+    "step": 262,
+    "loss": 1.0853328704833984,
+    "diagonal_ce": 0.8358209133148193,
+    "finite": 0.24951191246509552,
+    "denominator_clamp_fraction": 0.015024038031697273
+  },
+  {
+    "step": 263,
+    "loss": 1.0474786758422852,
+    "diagonal_ce": 0.8358466029167175,
+    "finite": 0.21163208782672882,
+    "denominator_clamp_fraction": 0.018028846010565758
+  },
+  {
+    "step": 264,
+    "loss": 0.9435634613037109,
+    "diagonal_ce": 0.74637371301651,
+    "finite": 0.19718974828720093,
+    "denominator_clamp_fraction": 0.020432692021131516
+  },
+  {
+    "step": 265,
+    "loss": 1.190509557723999,
+    "diagonal_ce": 0.8496140837669373,
+    "finite": 0.34089547395706177,
+    "denominator_clamp_fraction": 0.06550480425357819
+  },
+  {
+    "step": 266,
+    "loss": 1.0951638221740723,
+    "diagonal_ce": 0.9034547209739685,
+    "finite": 0.19170914590358734,
+    "denominator_clamp_fraction": 0.010817307978868484
+  },
+  {
+    "step": 267,
+    "loss": 1.0804044008255005,
+    "diagonal_ce": 0.8701045513153076,
+    "finite": 0.2102998048067093,
+    "denominator_clamp_fraction": 0.018629807978868484
+  },
+  {
+    "step": 268,
+    "loss": 1.1445924043655396,
+    "diagonal_ce": 0.9224938154220581,
+    "finite": 0.22209857404232025,
+    "denominator_clamp_fraction": 0.020733173936605453
+  },
+  {
+    "step": 269,
+    "loss": 1.0624397993087769,
+    "diagonal_ce": 0.8047175407409668,
+    "finite": 0.25772225856781006,
+    "denominator_clamp_fraction": 0.02133413404226303
+  },
+  {
+    "step": 270,
+    "loss": 1.0402467250823975,
+    "diagonal_ce": 0.8030301332473755,
+    "finite": 0.23721662163734436,
+    "denominator_clamp_fraction": 0.03125
+  },
+  {
+    "step": 271,
+    "loss": 0.9980648159980774,
+    "diagonal_ce": 0.7756162881851196,
+    "finite": 0.22244852781295776,
+    "denominator_clamp_fraction": 0.022836538031697273
+  },
+  {
+    "step": 272,
+    "loss": 1.029768943786621,
+    "diagonal_ce": 0.7891771197319031,
+    "finite": 0.24059180915355682,
+    "denominator_clamp_fraction": 0.018028846010565758
+  },
+  {
+    "step": 273,
+    "loss": 1.1872963905334473,
+    "diagonal_ce": 0.9045450687408447,
+    "finite": 0.2827513515949249,
+    "denominator_clamp_fraction": 0.05889423191547394
+  },
+  {
+    "step": 274,
+    "loss": 0.9818659424781799,
+    "diagonal_ce": 0.800340473651886,
+    "finite": 0.18152545392513275,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 275,
+    "loss": 1.0303765535354614,
+    "diagonal_ce": 0.82819002866745,
+    "finite": 0.2021864801645279,
+    "denominator_clamp_fraction": 0.02524038404226303
+  },
+  {
+    "step": 276,
+    "loss": 1.0168085098266602,
+    "diagonal_ce": 0.8109232783317566,
+    "finite": 0.20588520169258118,
+    "denominator_clamp_fraction": 0.02373798005282879
+  },
+  {
+    "step": 277,
+    "loss": 1.0197033882141113,
+    "diagonal_ce": 0.8285409808158875,
+    "finite": 0.19116243720054626,
+    "denominator_clamp_fraction": 0.01592548005282879
+  },
+  {
+    "step": 278,
+    "loss": 1.0639820098876953,
+    "diagonal_ce": 0.8858499526977539,
+    "finite": 0.17813211679458618,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 279,
+    "loss": 1.0009504556655884,
+    "diagonal_ce": 0.8311325907707214,
+    "finite": 0.16981787979602814,
+    "denominator_clamp_fraction": 0.016526442021131516
+  },
+  {
+    "step": 280,
+    "loss": 0.9204802513122559,
+    "diagonal_ce": 0.7826662063598633,
+    "finite": 0.1378140151500702,
+    "denominator_clamp_fraction": 0.014423076994717121
+  },
+  {
+    "step": 281,
+    "loss": 1.0304793119430542,
+    "diagonal_ce": 0.8869527578353882,
+    "finite": 0.1435265839099884,
+    "denominator_clamp_fraction": 0.004807692486792803
+  },
+  {
+    "step": 282,
+    "loss": 1.0550315380096436,
+    "diagonal_ce": 0.8110957145690918,
+    "finite": 0.24393583834171295,
+    "denominator_clamp_fraction": 0.008713942021131516
+  },
+  {
+    "step": 283,
+    "loss": 0.9193068146705627,
+    "diagonal_ce": 0.7936265468597412,
+    "finite": 0.12568028271198273,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 284,
+    "loss": 0.9326395988464355,
+    "diagonal_ce": 0.781387984752655,
+    "finite": 0.1512516289949417,
+    "denominator_clamp_fraction": 0.004206730984151363
+  },
+  {
+    "step": 285,
+    "loss": 1.00630521774292,
+    "diagonal_ce": 0.8066325187683105,
+    "finite": 0.19967272877693176,
+    "denominator_clamp_fraction": 0.0078125
+  },
+  {
+    "step": 286,
+    "loss": 0.9738861322402954,
+    "diagonal_ce": 0.7857500910758972,
+    "finite": 0.1881360113620758,
+    "denominator_clamp_fraction": 0.007512019015848637
+  },
+  {
+    "step": 287,
+    "loss": 0.9971314668655396,
+    "diagonal_ce": 0.8352097272872925,
+    "finite": 0.16192176938056946,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 288,
+    "loss": 0.9623767733573914,
+    "diagonal_ce": 0.7540064454078674,
+    "finite": 0.20837032794952393,
+    "denominator_clamp_fraction": 0.011117788031697273
+  },
+  {
+    "step": 289,
+    "loss": 0.9664992690086365,
+    "diagonal_ce": 0.8061618804931641,
+    "finite": 0.1603373885154724,
+    "denominator_clamp_fraction": 0.004807692486792803
+  },
+  {
+    "step": 290,
+    "loss": 0.9224376678466797,
+    "diagonal_ce": 0.7628251314163208,
+    "finite": 0.15961255133152008,
+    "denominator_clamp_fraction": 0.006009615492075682
+  },
+  {
+    "step": 291,
+    "loss": 1.0331062078475952,
+    "diagonal_ce": 0.8102642893791199,
+    "finite": 0.22284196317195892,
+    "denominator_clamp_fraction": 0.025841346010565758
+  },
+  {
+    "step": 292,
+    "loss": 1.1242194175720215,
+    "diagonal_ce": 0.905741274356842,
+    "finite": 0.21847809851169586,
+    "denominator_clamp_fraction": 0.012920673005282879
+  },
+  {
+    "step": 293,
+    "loss": 0.9036567211151123,
+    "diagonal_ce": 0.7575697898864746,
+    "finite": 0.14608696103096008,
+    "denominator_clamp_fraction": 0.004206730984151363
+  },
+  {
+    "step": 294,
+    "loss": 1.045436978340149,
+    "diagonal_ce": 0.8082999587059021,
+    "finite": 0.23713698983192444,
+    "denominator_clamp_fraction": 0.012620192021131516
+  },
+  {
+    "step": 295,
+    "loss": 1.0087957382202148,
+    "diagonal_ce": 0.8183404207229614,
+    "finite": 0.19045527279376984,
+    "denominator_clamp_fraction": 0.013521634973585606
+  },
+  {
+    "step": 296,
+    "loss": 0.8710148334503174,
+    "diagonal_ce": 0.7291166186332703,
+    "finite": 0.14189821481704712,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 297,
+    "loss": 0.9468148350715637,
+    "diagonal_ce": 0.7859537601470947,
+    "finite": 0.1608610600233078,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 298,
+    "loss": 0.9519306421279907,
+    "diagonal_ce": 0.7359804511070251,
+    "finite": 0.2159501612186432,
+    "denominator_clamp_fraction": 0.026742788031697273
+  },
+  {
+    "step": 299,
+    "loss": 0.8769804239273071,
+    "diagonal_ce": 0.6826347708702087,
+    "finite": 0.19434568285942078,
+    "denominator_clamp_fraction": 0.032151442021131516
+  },
+  {
+    "step": 300,
+    "loss": 0.8121885657310486,
+    "diagonal_ce": 0.6706187129020691,
+    "finite": 0.14156986773014069,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 301,
+    "loss": 1.067241907119751,
+    "diagonal_ce": 0.8614600300788879,
+    "finite": 0.20578187704086304,
+    "denominator_clamp_fraction": 0.009014423005282879
+  },
+  {
+    "step": 302,
+    "loss": 0.9742194414138794,
+    "diagonal_ce": 0.7991976141929626,
+    "finite": 0.17502182722091675,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 303,
+    "loss": 1.0166852474212646,
+    "diagonal_ce": 0.8139845728874207,
+    "finite": 0.20270070433616638,
+    "denominator_clamp_fraction": 0.02704326994717121
+  },
+  {
+    "step": 304,
+    "loss": 1.0569974184036255,
+    "diagonal_ce": 0.8668408393859863,
+    "finite": 0.19015662372112274,
+    "denominator_clamp_fraction": 0.02944711595773697
+  },
+  {
+    "step": 305,
+    "loss": 1.0063551664352417,
+    "diagonal_ce": 0.8126822710037231,
+    "finite": 0.19367292523384094,
+    "denominator_clamp_fraction": 0.018629807978868484
+  },
+  {
+    "step": 306,
+    "loss": 0.9992581605911255,
+    "diagonal_ce": 0.8235835433006287,
+    "finite": 0.17567461729049683,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 307,
+    "loss": 0.9088255167007446,
+    "diagonal_ce": 0.7393924593925476,
+    "finite": 0.16943304240703583,
+    "denominator_clamp_fraction": 0.010817307978868484
+  },
+  {
+    "step": 308,
+    "loss": 1.0312212705612183,
+    "diagonal_ce": 0.8106576204299927,
+    "finite": 0.2205636203289032,
+    "denominator_clamp_fraction": 0.05438701808452606
+  },
+  {
+    "step": 309,
+    "loss": 0.979387104511261,
+    "diagonal_ce": 0.7794371247291565,
+    "finite": 0.1999499797821045,
+    "denominator_clamp_fraction": 0.024639423936605453
+  },
+  {
+    "step": 310,
+    "loss": 0.9434739351272583,
+    "diagonal_ce": 0.7710075378417969,
+    "finite": 0.17246641218662262,
+    "denominator_clamp_fraction": 0.015625
+  },
+  {
+    "step": 311,
+    "loss": 0.9491705894470215,
+    "diagonal_ce": 0.8002126812934875,
+    "finite": 0.14895790815353394,
+    "denominator_clamp_fraction": 0.018028846010565758
+  },
+  {
+    "step": 312,
+    "loss": 0.907563328742981,
+    "diagonal_ce": 0.7598844170570374,
+    "finite": 0.14767888188362122,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 313,
+    "loss": 0.9601645469665527,
+    "diagonal_ce": 0.7840811014175415,
+    "finite": 0.17608347535133362,
+    "denominator_clamp_fraction": 0.007512019015848637
+  },
+  {
+    "step": 314,
+    "loss": 0.9759513139724731,
+    "diagonal_ce": 0.8179442286491394,
+    "finite": 0.15800710022449493,
+    "denominator_clamp_fraction": 0.01772836595773697
+  },
+  {
+    "step": 315,
+    "loss": 0.936497688293457,
+    "diagonal_ce": 0.8017941117286682,
+    "finite": 0.13470359146595,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 316,
+    "loss": 0.9085500240325928,
+    "diagonal_ce": 0.7526620626449585,
+    "finite": 0.15588796138763428,
+    "denominator_clamp_fraction": 0.012920673005282879
+  },
+  {
+    "step": 317,
+    "loss": 0.9085578918457031,
+    "diagonal_ce": 0.7090007662773132,
+    "finite": 0.1995571404695511,
+    "denominator_clamp_fraction": 0.02133413404226303
+  },
+  {
+    "step": 318,
+    "loss": 0.921694815158844,
+    "diagonal_ce": 0.790758490562439,
+    "finite": 0.13093632459640503,
+    "denominator_clamp_fraction": 0.01983173005282879
+  },
+  {
+    "step": 319,
+    "loss": 1.0395444631576538,
+    "diagonal_ce": 0.8244588375091553,
+    "finite": 0.21508565545082092,
+    "denominator_clamp_fraction": 0.018629807978868484
+  },
+  {
+    "step": 320,
+    "loss": 1.013393521308899,
+    "diagonal_ce": 0.8340705633163452,
+    "finite": 0.1793229579925537,
+    "denominator_clamp_fraction": 0.01953125
+  },
+  {
+    "step": 321,
+    "loss": 0.8868662118911743,
+    "diagonal_ce": 0.774193525314331,
+    "finite": 0.11267271637916565,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 322,
+    "loss": 0.8656482696533203,
+    "diagonal_ce": 0.7027704119682312,
+    "finite": 0.1628778576850891,
+    "denominator_clamp_fraction": 0.016526442021131516
+  },
+  {
+    "step": 323,
+    "loss": 0.9036027193069458,
+    "diagonal_ce": 0.7421338558197021,
+    "finite": 0.16146883368492126,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 324,
+    "loss": 0.8658149838447571,
+    "diagonal_ce": 0.7145309448242188,
+    "finite": 0.15128402411937714,
+    "denominator_clamp_fraction": 0.016526442021131516
+  },
+  {
+    "step": 325,
+    "loss": 0.8632665872573853,
+    "diagonal_ce": 0.6925891637802124,
+    "finite": 0.17067742347717285,
+    "denominator_clamp_fraction": 0.02704326994717121
+  },
+  {
+    "step": 326,
+    "loss": 0.9897550344467163,
+    "diagonal_ce": 0.8132572770118713,
+    "finite": 0.17649777233600616,
+    "denominator_clamp_fraction": 0.015625
+  },
+  {
+    "step": 327,
+    "loss": 0.8946228623390198,
+    "diagonal_ce": 0.7736531496047974,
+    "finite": 0.1209697276353836,
+    "denominator_clamp_fraction": 0.009615384973585606
+  },
+  {
+    "step": 328,
+    "loss": 0.8698233366012573,
+    "diagonal_ce": 0.7125995755195618,
+    "finite": 0.15722374618053436,
+    "denominator_clamp_fraction": 0.020132211968302727
+  },
+  {
+    "step": 329,
+    "loss": 0.9905686974525452,
+    "diagonal_ce": 0.8509564399719238,
+    "finite": 0.13961224257946014,
+    "denominator_clamp_fraction": 0.015625
+  },
+  {
+    "step": 330,
+    "loss": 0.8480798006057739,
+    "diagonal_ce": 0.7215418219566345,
+    "finite": 0.1265379786491394,
+    "denominator_clamp_fraction": 0.011117788031697273
+  },
+  {
+    "step": 331,
+    "loss": 0.90309739112854,
+    "diagonal_ce": 0.7291585206985474,
+    "finite": 0.17393887042999268,
+    "denominator_clamp_fraction": 0.011418269015848637
+  },
+  {
+    "step": 332,
+    "loss": 0.9483770728111267,
+    "diagonal_ce": 0.771842896938324,
+    "finite": 0.17653417587280273,
+    "denominator_clamp_fraction": 0.013221153989434242
+  },
+  {
+    "step": 333,
+    "loss": 0.9178661108016968,
+    "diagonal_ce": 0.7644481062889099,
+    "finite": 0.15341801941394806,
+    "denominator_clamp_fraction": 0.021935096010565758
+  },
+  {
+    "step": 334,
+    "loss": 0.9734283685684204,
+    "diagonal_ce": 0.8308588862419128,
+    "finite": 0.14256946742534637,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 335,
+    "loss": 0.8026559352874756,
+    "diagonal_ce": 0.6824411749839783,
+    "finite": 0.1202147901058197,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 336,
+    "loss": 0.837315022945404,
+    "diagonal_ce": 0.6930984258651733,
+    "finite": 0.1442165970802307,
+    "denominator_clamp_fraction": 0.006610576994717121
+  },
+  {
+    "step": 337,
+    "loss": 0.8890665769577026,
+    "diagonal_ce": 0.7825696468353271,
+    "finite": 0.10649695247411728,
+    "denominator_clamp_fraction": 0.009615384973585606
+  },
+  {
+    "step": 338,
+    "loss": 0.8696854710578918,
+    "diagonal_ce": 0.7414144277572632,
+    "finite": 0.12827104330062866,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 339,
+    "loss": 0.8485907316207886,
+    "diagonal_ce": 0.7263184785842896,
+    "finite": 0.12227224558591843,
+    "denominator_clamp_fraction": 0.004807692486792803
+  },
+  {
+    "step": 340,
+    "loss": 0.8734008073806763,
+    "diagonal_ce": 0.7597525715827942,
+    "finite": 0.11364826560020447,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 341,
+    "loss": 1.0350521802902222,
+    "diagonal_ce": 0.7876381278038025,
+    "finite": 0.24741406738758087,
+    "denominator_clamp_fraction": 0.02914663404226303
+  },
+  {
+    "step": 342,
+    "loss": 0.8080256581306458,
+    "diagonal_ce": 0.6920021772384644,
+    "finite": 0.1160234659910202,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 343,
+    "loss": 0.9015318751335144,
+    "diagonal_ce": 0.7594735026359558,
+    "finite": 0.1420583575963974,
+    "denominator_clamp_fraction": 0.016225961968302727
+  },
+  {
+    "step": 344,
+    "loss": 0.8862390518188477,
+    "diagonal_ce": 0.7418227791786194,
+    "finite": 0.14441630244255066,
+    "denominator_clamp_fraction": 0.004807692486792803
+  },
+  {
+    "step": 345,
+    "loss": 0.8578318357467651,
+    "diagonal_ce": 0.7439132332801819,
+    "finite": 0.11391857266426086,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 346,
+    "loss": 0.8380669951438904,
+    "diagonal_ce": 0.689073383808136,
+    "finite": 0.1489936262369156,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 347,
+    "loss": 0.768757164478302,
+    "diagonal_ce": 0.6582411527633667,
+    "finite": 0.11051599681377411,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 348,
+    "loss": 0.8900839686393738,
+    "diagonal_ce": 0.7234557271003723,
+    "finite": 0.16662825644016266,
+    "denominator_clamp_fraction": 0.028846153989434242
+  },
+  {
+    "step": 349,
+    "loss": 0.8567103147506714,
+    "diagonal_ce": 0.6917231678962708,
+    "finite": 0.16498713195323944,
+    "denominator_clamp_fraction": 0.014423076994717121
+  },
+  {
+    "step": 350,
+    "loss": 0.8790296912193298,
+    "diagonal_ce": 0.719841480255127,
+    "finite": 0.15918821096420288,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 351,
+    "loss": 0.8958718776702881,
+    "diagonal_ce": 0.7466890811920166,
+    "finite": 0.14918279647827148,
+    "denominator_clamp_fraction": 0.015324519015848637
+  },
+  {
+    "step": 352,
+    "loss": 0.8734756708145142,
+    "diagonal_ce": 0.6959161162376404,
+    "finite": 0.17755955457687378,
+    "denominator_clamp_fraction": 0.027944711968302727
+  },
+  {
+    "step": 353,
+    "loss": 0.9486797451972961,
+    "diagonal_ce": 0.7786486148834229,
+    "finite": 0.17003114521503448,
+    "denominator_clamp_fraction": 0.01983173005282879
+  },
+  {
+    "step": 354,
+    "loss": 0.8649532198905945,
+    "diagonal_ce": 0.7460291385650635,
+    "finite": 0.1189241036772728,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 355,
+    "loss": 0.9766353368759155,
+    "diagonal_ce": 0.7775313854217529,
+    "finite": 0.1991039216518402,
+    "denominator_clamp_fraction": 0.020432692021131516
+  },
+  {
+    "step": 356,
+    "loss": 0.9605147242546082,
+    "diagonal_ce": 0.7702479958534241,
+    "finite": 0.19026672840118408,
+    "denominator_clamp_fraction": 0.010817307978868484
+  },
+  {
+    "step": 357,
+    "loss": 0.8852698802947998,
+    "diagonal_ce": 0.7599904537200928,
+    "finite": 0.12527945637702942,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 358,
+    "loss": 0.8911797404289246,
+    "diagonal_ce": 0.7035689353942871,
+    "finite": 0.18761079013347626,
+    "denominator_clamp_fraction": 0.02524038404226303
+  },
+  {
+    "step": 359,
+    "loss": 0.9591994881629944,
+    "diagonal_ce": 0.8182711005210876,
+    "finite": 0.14092840254306793,
+    "denominator_clamp_fraction": 0.016225961968302727
+  },
+  {
+    "step": 360,
+    "loss": 0.8605107069015503,
+    "diagonal_ce": 0.7126308679580688,
+    "finite": 0.14787986874580383,
+    "denominator_clamp_fraction": 0.006310096010565758
+  },
+  {
+    "step": 361,
+    "loss": 0.8369404077529907,
+    "diagonal_ce": 0.6970337629318237,
+    "finite": 0.1399066150188446,
+    "denominator_clamp_fraction": 0.010216346010565758
+  },
+  {
+    "step": 362,
+    "loss": 0.8534629344940186,
+    "diagonal_ce": 0.7452495694160461,
+    "finite": 0.1082133948802948,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 363,
+    "loss": 0.8264479637145996,
+    "diagonal_ce": 0.7177884578704834,
+    "finite": 0.10865949839353561,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 364,
+    "loss": 0.859808087348938,
+    "diagonal_ce": 0.6910895705223083,
+    "finite": 0.16871851682662964,
+    "denominator_clamp_fraction": 0.009014423005282879
+  },
+  {
+    "step": 365,
+    "loss": 0.8470917344093323,
+    "diagonal_ce": 0.7384377121925354,
+    "finite": 0.10865402221679688,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 366,
+    "loss": 0.9502674341201782,
+    "diagonal_ce": 0.8229416608810425,
+    "finite": 0.12732578814029694,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 367,
+    "loss": 0.8386829495429993,
+    "diagonal_ce": 0.7390438318252563,
+    "finite": 0.09963911026716232,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 368,
+    "loss": 0.8619136214256287,
+    "diagonal_ce": 0.7394254207611084,
+    "finite": 0.12248819321393967,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 369,
+    "loss": 0.9543797969818115,
+    "diagonal_ce": 0.7904970049858093,
+    "finite": 0.1638828068971634,
+    "denominator_clamp_fraction": 0.012319711968302727
+  },
+  {
+    "step": 370,
+    "loss": 0.8548635244369507,
+    "diagonal_ce": 0.746677577495575,
+    "finite": 0.10818594694137573,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 371,
+    "loss": 0.8331575393676758,
+    "diagonal_ce": 0.7366428971290588,
+    "finite": 0.09651461243629456,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 372,
+    "loss": 0.8180379867553711,
+    "diagonal_ce": 0.7286452651023865,
+    "finite": 0.08939273655414581,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 373,
+    "loss": 0.8254498839378357,
+    "diagonal_ce": 0.7205041646957397,
+    "finite": 0.10494573414325714,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 374,
+    "loss": 0.8292786478996277,
+    "diagonal_ce": 0.7258670926094055,
+    "finite": 0.10341155529022217,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 375,
+    "loss": 0.7675457000732422,
+    "diagonal_ce": 0.6336647868156433,
+    "finite": 0.13388094305992126,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 376,
+    "loss": 0.7341837882995605,
+    "diagonal_ce": 0.6612577438354492,
+    "finite": 0.07292602211236954,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 377,
+    "loss": 0.7949816584587097,
+    "diagonal_ce": 0.685688316822052,
+    "finite": 0.1092933639883995,
+    "denominator_clamp_fraction": 0.015625
+  },
+  {
+    "step": 378,
+    "loss": 0.9012349843978882,
+    "diagonal_ce": 0.8099856376647949,
+    "finite": 0.09124936163425446,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 379,
+    "loss": 0.8675934076309204,
+    "diagonal_ce": 0.7479267716407776,
+    "finite": 0.11966665089130402,
+    "denominator_clamp_fraction": 0.004807692486792803
+  },
+  {
+    "step": 380,
+    "loss": 0.7564648985862732,
+    "diagonal_ce": 0.6479794383049011,
+    "finite": 0.10848544538021088,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 381,
+    "loss": 0.8602343201637268,
+    "diagonal_ce": 0.7569487690925598,
+    "finite": 0.1032855361700058,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 382,
+    "loss": 0.72148597240448,
+    "diagonal_ce": 0.6243095993995667,
+    "finite": 0.09717637300491333,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 383,
+    "loss": 0.857286810874939,
+    "diagonal_ce": 0.7760664820671082,
+    "finite": 0.081220343708992,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 384,
+    "loss": 0.7763317227363586,
+    "diagonal_ce": 0.6431466937065125,
+    "finite": 0.1331850290298462,
+    "denominator_clamp_fraction": 0.006610576994717121
+  },
+  {
+    "step": 385,
+    "loss": 0.8690757155418396,
+    "diagonal_ce": 0.7496986985206604,
+    "finite": 0.1193770319223404,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 386,
+    "loss": 0.8540512323379517,
+    "diagonal_ce": 0.7443025708198547,
+    "finite": 0.10974866896867752,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 387,
+    "loss": 0.7926042079925537,
+    "diagonal_ce": 0.67421555519104,
+    "finite": 0.11838866025209427,
+    "denominator_clamp_fraction": 0.024038461968302727
+  },
+  {
+    "step": 388,
+    "loss": 0.7360994815826416,
+    "diagonal_ce": 0.6330089569091797,
+    "finite": 0.1030905544757843,
+    "denominator_clamp_fraction": 0.014122596010565758
+  },
+  {
+    "step": 389,
+    "loss": 0.9430867433547974,
+    "diagonal_ce": 0.7974732518196106,
+    "finite": 0.14561346173286438,
+    "denominator_clamp_fraction": 0.01171875
+  },
+  {
+    "step": 390,
+    "loss": 0.7554781436920166,
+    "diagonal_ce": 0.6469297409057617,
+    "finite": 0.1085483729839325,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 391,
+    "loss": 0.8018112778663635,
+    "diagonal_ce": 0.6782419085502625,
+    "finite": 0.12356936931610107,
+    "denominator_clamp_fraction": 0.006009615492075682
+  },
+  {
+    "step": 392,
+    "loss": 0.7926660776138306,
+    "diagonal_ce": 0.6951463222503662,
+    "finite": 0.09751974046230316,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 393,
+    "loss": 0.8098788857460022,
+    "diagonal_ce": 0.6623562574386597,
+    "finite": 0.14752262830734253,
+    "denominator_clamp_fraction": 0.010216346010565758
+  },
+  {
+    "step": 394,
+    "loss": 0.8016148209571838,
+    "diagonal_ce": 0.6832683682441711,
+    "finite": 0.1183464527130127,
+    "denominator_clamp_fraction": 0.006009615492075682
+  },
+  {
+    "step": 395,
+    "loss": 0.775367259979248,
+    "diagonal_ce": 0.6965746283531189,
+    "finite": 0.07879265397787094,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 396,
+    "loss": 0.8315038681030273,
+    "diagonal_ce": 0.6945897936820984,
+    "finite": 0.13691408932209015,
+    "denominator_clamp_fraction": 0.0078125
+  },
+  {
+    "step": 397,
+    "loss": 0.7998858690261841,
+    "diagonal_ce": 0.6664964556694031,
+    "finite": 0.1333894431591034,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 398,
+    "loss": 0.8504466414451599,
+    "diagonal_ce": 0.7711098790168762,
+    "finite": 0.07933678478002548,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 399,
+    "loss": 0.8096129298210144,
+    "diagonal_ce": 0.66689532995224,
+    "finite": 0.14271758496761322,
+    "denominator_clamp_fraction": 0.006310096010565758
+  },
+  {
+    "step": 400,
+    "loss": 0.7854093909263611,
+    "diagonal_ce": 0.677611768245697,
+    "finite": 0.10779763758182526,
+    "denominator_clamp_fraction": 0.006310096010565758
+  },
+  {
+    "step": 401,
+    "loss": 0.8654024004936218,
+    "diagonal_ce": 0.7447072863578796,
+    "finite": 0.12069511413574219,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 402,
+    "loss": 0.8268534541130066,
+    "diagonal_ce": 0.7257314920425415,
+    "finite": 0.1011219471693039,
+    "denominator_clamp_fraction": 0.004206730984151363
+  },
+  {
+    "step": 403,
+    "loss": 0.7894430756568909,
+    "diagonal_ce": 0.6799660921096802,
+    "finite": 0.10947699844837189,
+    "denominator_clamp_fraction": 0.015024038031697273
+  },
+  {
+    "step": 404,
+    "loss": 0.7689629793167114,
+    "diagonal_ce": 0.6728541254997253,
+    "finite": 0.09610885381698608,
+    "denominator_clamp_fraction": 0.0033052884973585606
+  },
+  {
+    "step": 405,
+    "loss": 0.7453575730323792,
+    "diagonal_ce": 0.6843417286872864,
+    "finite": 0.06101584434509277,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 406,
+    "loss": 0.8218478560447693,
+    "diagonal_ce": 0.727548360824585,
+    "finite": 0.09429951012134552,
+    "denominator_clamp_fraction": 0.008112980984151363
+  },
+  {
+    "step": 407,
+    "loss": 0.771151065826416,
+    "diagonal_ce": 0.6813889145851135,
+    "finite": 0.0897621214389801,
+    "denominator_clamp_fraction": 0.013221153989434242
+  },
+  {
+    "step": 408,
+    "loss": 0.6807917356491089,
+    "diagonal_ce": 0.6201254725456238,
+    "finite": 0.060666270554065704,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 409,
+    "loss": 0.7542665004730225,
+    "diagonal_ce": 0.6582514643669128,
+    "finite": 0.09601505100727081,
+    "denominator_clamp_fraction": 0.012920673005282879
+  },
+  {
+    "step": 410,
+    "loss": 0.7654865384101868,
+    "diagonal_ce": 0.6594813466072083,
+    "finite": 0.10600520670413971,
+    "denominator_clamp_fraction": 0.01742788404226303
+  },
+  {
+    "step": 411,
+    "loss": 0.7902191877365112,
+    "diagonal_ce": 0.6695460677146912,
+    "finite": 0.12067313492298126,
+    "denominator_clamp_fraction": 0.018329326063394547
+  },
+  {
+    "step": 412,
+    "loss": 0.8213135004043579,
+    "diagonal_ce": 0.722316324710846,
+    "finite": 0.09899715334177017,
+    "denominator_clamp_fraction": 0.014723557978868484
+  },
+  {
+    "step": 413,
+    "loss": 0.7909278273582458,
+    "diagonal_ce": 0.7087680697441101,
+    "finite": 0.08215977251529694,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 414,
+    "loss": 0.7609808444976807,
+    "diagonal_ce": 0.6748900413513184,
+    "finite": 0.08609079569578171,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 415,
+    "loss": 0.742397129535675,
+    "diagonal_ce": 0.6447526216506958,
+    "finite": 0.09764448553323746,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 416,
+    "loss": 0.7684663534164429,
+    "diagonal_ce": 0.6533262133598328,
+    "finite": 0.11514011770486832,
+    "denominator_clamp_fraction": 0.013221153989434242
+  },
+  {
+    "step": 417,
+    "loss": 0.8169517517089844,
+    "diagonal_ce": 0.7131669521331787,
+    "finite": 0.10378480702638626,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 418,
+    "loss": 0.7497815489768982,
+    "diagonal_ce": 0.6477432250976562,
+    "finite": 0.10203834623098373,
+    "denominator_clamp_fraction": 0.013822115026414394
+  },
+  {
+    "step": 419,
+    "loss": 0.7452567219734192,
+    "diagonal_ce": 0.6698527336120605,
+    "finite": 0.07540398836135864,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 420,
+    "loss": 0.744883120059967,
+    "diagonal_ce": 0.6452750563621521,
+    "finite": 0.09960806369781494,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 421,
+    "loss": 0.7231299877166748,
+    "diagonal_ce": 0.6228384375572205,
+    "finite": 0.10029152035713196,
+    "denominator_clamp_fraction": 0.0033052884973585606
+  },
+  {
+    "step": 422,
+    "loss": 0.7708094716072083,
+    "diagonal_ce": 0.6511678099632263,
+    "finite": 0.11964166164398193,
+    "denominator_clamp_fraction": 0.006610576994717121
+  },
+  {
+    "step": 423,
+    "loss": 0.7523102164268494,
+    "diagonal_ce": 0.6840099096298218,
+    "finite": 0.06830031424760818,
+    "denominator_clamp_fraction": 0.004206730984151363
+  },
+  {
+    "step": 424,
+    "loss": 0.6924446821212769,
+    "diagonal_ce": 0.6096358299255371,
+    "finite": 0.08280885964632034,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 425,
+    "loss": 0.8821415901184082,
+    "diagonal_ce": 0.7356441020965576,
+    "finite": 0.1464974582195282,
+    "denominator_clamp_fraction": 0.015024038031697273
+  },
+  {
+    "step": 426,
+    "loss": 0.6777635812759399,
+    "diagonal_ce": 0.6164408326148987,
+    "finite": 0.061322733759880066,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 427,
+    "loss": 0.8098215460777283,
+    "diagonal_ce": 0.6764386892318726,
+    "finite": 0.1333828717470169,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 428,
+    "loss": 0.7682116627693176,
+    "diagonal_ce": 0.6826348304748535,
+    "finite": 0.0855768471956253,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 429,
+    "loss": 0.7308171391487122,
+    "diagonal_ce": 0.616677463054657,
+    "finite": 0.11413969844579697,
+    "denominator_clamp_fraction": 0.016826923936605453
+  },
+  {
+    "step": 430,
+    "loss": 0.7362374067306519,
+    "diagonal_ce": 0.6201378703117371,
+    "finite": 0.11609955132007599,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 431,
+    "loss": 0.6714731454849243,
+    "diagonal_ce": 0.562705397605896,
+    "finite": 0.10876771807670593,
+    "denominator_clamp_fraction": 0.006009615492075682
+  },
+  {
+    "step": 432,
+    "loss": 0.706032395362854,
+    "diagonal_ce": 0.614981472492218,
+    "finite": 0.09105092287063599,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 433,
+    "loss": 0.7925037145614624,
+    "diagonal_ce": 0.6846085786819458,
+    "finite": 0.10789510607719421,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 434,
+    "loss": 0.718950629234314,
+    "diagonal_ce": 0.6326678991317749,
+    "finite": 0.08628273755311966,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 435,
+    "loss": 0.8213364481925964,
+    "diagonal_ce": 0.7424493432044983,
+    "finite": 0.07888711243867874,
+    "denominator_clamp_fraction": 0.013521634973585606
+  },
+  {
+    "step": 436,
+    "loss": 0.7382200956344604,
+    "diagonal_ce": 0.6152403354644775,
+    "finite": 0.1229797899723053,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 437,
+    "loss": 0.7403167486190796,
+    "diagonal_ce": 0.6403619647026062,
+    "finite": 0.099954754114151,
+    "denominator_clamp_fraction": 0.004206730984151363
+  },
+  {
+    "step": 438,
+    "loss": 0.7886344790458679,
+    "diagonal_ce": 0.6990610361099243,
+    "finite": 0.08957342803478241,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 439,
+    "loss": 0.703467845916748,
+    "diagonal_ce": 0.601282000541687,
+    "finite": 0.10218581557273865,
+    "denominator_clamp_fraction": 0.008413461968302727
+  },
+  {
+    "step": 440,
+    "loss": 0.7458884716033936,
+    "diagonal_ce": 0.6445140242576599,
+    "finite": 0.10137446224689484,
+    "denominator_clamp_fraction": 0.01742788404226303
+  },
+  {
+    "step": 441,
+    "loss": 0.7118334770202637,
+    "diagonal_ce": 0.6518281102180481,
+    "finite": 0.06000535935163498,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 442,
+    "loss": 0.8073335289955139,
+    "diagonal_ce": 0.6775802373886108,
+    "finite": 0.12975327670574188,
+    "denominator_clamp_fraction": 0.028846153989434242
+  },
+  {
+    "step": 443,
+    "loss": 0.7116774916648865,
+    "diagonal_ce": 0.6493959426879883,
+    "finite": 0.062281567603349686,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 444,
+    "loss": 0.6984348297119141,
+    "diagonal_ce": 0.6356647610664368,
+    "finite": 0.0627700537443161,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 445,
+    "loss": 0.801825761795044,
+    "diagonal_ce": 0.6858410835266113,
+    "finite": 0.11598467081785202,
+    "denominator_clamp_fraction": 0.007512019015848637
+  },
+  {
+    "step": 446,
+    "loss": 0.7448022365570068,
+    "diagonal_ce": 0.6553106307983398,
+    "finite": 0.08949162065982819,
+    "denominator_clamp_fraction": 0.0033052884973585606
+  },
+  {
+    "step": 447,
+    "loss": 0.7239787578582764,
+    "diagonal_ce": 0.6413830518722534,
+    "finite": 0.08259573578834534,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 448,
+    "loss": 0.7067590951919556,
+    "diagonal_ce": 0.6296775937080383,
+    "finite": 0.07708151638507843,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 449,
+    "loss": 0.5895014405250549,
+    "diagonal_ce": 0.5368571877479553,
+    "finite": 0.052644237875938416,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 450,
+    "loss": 0.716982364654541,
+    "diagonal_ce": 0.6316834688186646,
+    "finite": 0.08529887348413467,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 451,
+    "loss": 0.7208208441734314,
+    "diagonal_ce": 0.6686012744903564,
+    "finite": 0.05221956968307495,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 452,
+    "loss": 0.7740995287895203,
+    "diagonal_ce": 0.6843477487564087,
+    "finite": 0.08975179493427277,
+    "denominator_clamp_fraction": 0.01592548005282879
+  },
+  {
+    "step": 453,
+    "loss": 0.730528712272644,
+    "diagonal_ce": 0.6526821851730347,
+    "finite": 0.07784650474786758,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 454,
+    "loss": 0.7909731864929199,
+    "diagonal_ce": 0.7223467230796814,
+    "finite": 0.06862645596265793,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 455,
+    "loss": 0.6552515029907227,
+    "diagonal_ce": 0.5992807149887085,
+    "finite": 0.05597075819969177,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 456,
+    "loss": 0.7376663684844971,
+    "diagonal_ce": 0.6737252473831177,
+    "finite": 0.0639411136507988,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 457,
+    "loss": 0.7243179678916931,
+    "diagonal_ce": 0.6525801420211792,
+    "finite": 0.07173781096935272,
+    "denominator_clamp_fraction": 0.008413461968302727
+  },
+  {
+    "step": 458,
+    "loss": 0.6337286233901978,
+    "diagonal_ce": 0.5663496851921082,
+    "finite": 0.06737890839576721,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 459,
+    "loss": 0.716147780418396,
+    "diagonal_ce": 0.6061172485351562,
+    "finite": 0.11003051698207855,
+    "denominator_clamp_fraction": 0.005408653989434242
+  },
+  {
+    "step": 460,
+    "loss": 0.7619728446006775,
+    "diagonal_ce": 0.6706982851028442,
+    "finite": 0.09127453714609146,
+    "denominator_clamp_fraction": 0.0033052884973585606
+  },
+  {
+    "step": 461,
+    "loss": 0.7577263712882996,
+    "diagonal_ce": 0.6666926741600037,
+    "finite": 0.0910336822271347,
+    "denominator_clamp_fraction": 0.02704326994717121
+  },
+  {
+    "step": 462,
+    "loss": 0.6409522891044617,
+    "diagonal_ce": 0.5867875814437866,
+    "finite": 0.05416470021009445,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 463,
+    "loss": 0.7953826785087585,
+    "diagonal_ce": 0.6658827066421509,
+    "finite": 0.12949995696544647,
+    "denominator_clamp_fraction": 0.006310096010565758
+  },
+  {
+    "step": 464,
+    "loss": 0.6405065655708313,
+    "diagonal_ce": 0.5876266956329346,
+    "finite": 0.05287986248731613,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 465,
+    "loss": 0.8171943426132202,
+    "diagonal_ce": 0.7428649067878723,
+    "finite": 0.0743294358253479,
+    "denominator_clamp_fraction": 0.012319711968302727
+  },
+  {
+    "step": 466,
+    "loss": 0.6318665742874146,
+    "diagonal_ce": 0.5522763729095459,
+    "finite": 0.07959017902612686,
+    "denominator_clamp_fraction": 0.006310096010565758
+  },
+  {
+    "step": 467,
+    "loss": 0.787805438041687,
+    "diagonal_ce": 0.6923354268074036,
+    "finite": 0.09546998143196106,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 468,
+    "loss": 0.7687100768089294,
+    "diagonal_ce": 0.68684321641922,
+    "finite": 0.08186687529087067,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 469,
+    "loss": 0.7312949299812317,
+    "diagonal_ce": 0.6645974516868591,
+    "finite": 0.06669747829437256,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 470,
+    "loss": 0.626204252243042,
+    "diagonal_ce": 0.5499348044395447,
+    "finite": 0.07626946270465851,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 471,
+    "loss": 0.6378390789031982,
+    "diagonal_ce": 0.571357250213623,
+    "finite": 0.06648184359073639,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 472,
+    "loss": 0.7568502426147461,
+    "diagonal_ce": 0.6679994463920593,
+    "finite": 0.08885077387094498,
+    "denominator_clamp_fraction": 0.015324519015848637
+  },
+  {
+    "step": 473,
+    "loss": 0.6880300045013428,
+    "diagonal_ce": 0.5981971621513367,
+    "finite": 0.0898328647017479,
+    "denominator_clamp_fraction": 0.005709134507924318
+  },
+  {
+    "step": 474,
+    "loss": 0.5674099922180176,
+    "diagonal_ce": 0.5054931044578552,
+    "finite": 0.06191689521074295,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 475,
+    "loss": 0.6020162105560303,
+    "diagonal_ce": 0.5394262671470642,
+    "finite": 0.06258996576070786,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 476,
+    "loss": 0.7124978303909302,
+    "diagonal_ce": 0.6540822982788086,
+    "finite": 0.05841551348567009,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 477,
+    "loss": 0.8363984823226929,
+    "diagonal_ce": 0.7536540627479553,
+    "finite": 0.08274443447589874,
+    "denominator_clamp_fraction": 0.011117788031697273
+  },
+  {
+    "step": 478,
+    "loss": 0.6920225024223328,
+    "diagonal_ce": 0.6174696087837219,
+    "finite": 0.07455287128686905,
+    "denominator_clamp_fraction": 0.013521634973585606
+  },
+  {
+    "step": 479,
+    "loss": 0.7180197834968567,
+    "diagonal_ce": 0.6167593002319336,
+    "finite": 0.1012604758143425,
+    "denominator_clamp_fraction": 0.004206730984151363
+  },
+  {
+    "step": 480,
+    "loss": 0.6303182244300842,
+    "diagonal_ce": 0.5670607686042786,
+    "finite": 0.06325744092464447,
+    "denominator_clamp_fraction": 0.011418269015848637
+  },
+  {
+    "step": 481,
+    "loss": 0.6465815901756287,
+    "diagonal_ce": 0.5745073556900024,
+    "finite": 0.07207421958446503,
+    "denominator_clamp_fraction": 0.011418269015848637
+  },
+  {
+    "step": 482,
+    "loss": 0.6986662149429321,
+    "diagonal_ce": 0.6502180695533752,
+    "finite": 0.048448171466588974,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 483,
+    "loss": 0.5438734889030457,
+    "diagonal_ce": 0.5025736093521118,
+    "finite": 0.04129989445209503,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 484,
+    "loss": 0.7669207453727722,
+    "diagonal_ce": 0.6998494267463684,
+    "finite": 0.0670713409781456,
+    "denominator_clamp_fraction": 0.008413461968302727
+  },
+  {
+    "step": 485,
+    "loss": 0.6471929550170898,
+    "diagonal_ce": 0.5614634156227112,
+    "finite": 0.08572951704263687,
+    "denominator_clamp_fraction": 0.012019230984151363
+  },
+  {
+    "step": 486,
+    "loss": 0.6996145844459534,
+    "diagonal_ce": 0.6421306133270264,
+    "finite": 0.057483963668346405,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 487,
+    "loss": 0.5576689839363098,
+    "diagonal_ce": 0.5160412192344666,
+    "finite": 0.041627757251262665,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 488,
+    "loss": 0.7374939918518066,
+    "diagonal_ce": 0.6628351211547852,
+    "finite": 0.07465890049934387,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 489,
+    "loss": 0.7267981767654419,
+    "diagonal_ce": 0.6649264097213745,
+    "finite": 0.06187174469232559,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 490,
+    "loss": 0.6735790967941284,
+    "diagonal_ce": 0.5798150300979614,
+    "finite": 0.09376408159732819,
+    "denominator_clamp_fraction": 0.015625
+  },
+  {
+    "step": 491,
+    "loss": 0.6244878768920898,
+    "diagonal_ce": 0.5917580723762512,
+    "finite": 0.032729826867580414,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 492,
+    "loss": 0.6504906415939331,
+    "diagonal_ce": 0.5777916312217712,
+    "finite": 0.07269899547100067,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 493,
+    "loss": 0.6426087617874146,
+    "diagonal_ce": 0.595639705657959,
+    "finite": 0.046969085931777954,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 494,
+    "loss": 0.7629352807998657,
+    "diagonal_ce": 0.6676998138427734,
+    "finite": 0.09523545205593109,
+    "denominator_clamp_fraction": 0.01772836595773697
+  },
+  {
+    "step": 495,
+    "loss": 0.8230400085449219,
+    "diagonal_ce": 0.7268791794776917,
+    "finite": 0.09616085141897202,
+    "denominator_clamp_fraction": 0.018329326063394547
+  },
+  {
+    "step": 496,
+    "loss": 0.7507899403572083,
+    "diagonal_ce": 0.6861810684204102,
+    "finite": 0.0646088495850563,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 497,
+    "loss": 0.653329610824585,
+    "diagonal_ce": 0.6028943061828613,
+    "finite": 0.05043528974056244,
+    "denominator_clamp_fraction": 0.004206730984151363
+  },
+  {
+    "step": 498,
+    "loss": 0.6509811282157898,
+    "diagonal_ce": 0.6057372093200684,
+    "finite": 0.04524390771985054,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 499,
+    "loss": 0.6460714340209961,
+    "diagonal_ce": 0.6013754606246948,
+    "finite": 0.04469595476984978,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 500,
+    "loss": 0.6721780896186829,
+    "diagonal_ce": 0.5964077711105347,
+    "finite": 0.07577032595872879,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 501,
+    "loss": 0.7514182329177856,
+    "diagonal_ce": 0.6855183243751526,
+    "finite": 0.06589993834495544,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 502,
+    "loss": 0.6126246452331543,
+    "diagonal_ce": 0.5611078143119812,
+    "finite": 0.05151686072349548,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 503,
+    "loss": 0.6111059188842773,
+    "diagonal_ce": 0.5785229802131653,
+    "finite": 0.03258296474814415,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 504,
+    "loss": 0.5921530723571777,
+    "diagonal_ce": 0.5442901849746704,
+    "finite": 0.04786290228366852,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 505,
+    "loss": 0.6203198432922363,
+    "diagonal_ce": 0.5292845964431763,
+    "finite": 0.09103524684906006,
+    "denominator_clamp_fraction": 0.004807692486792803
+  },
+  {
+    "step": 506,
+    "loss": 0.6887680888175964,
+    "diagonal_ce": 0.6286129355430603,
+    "finite": 0.06015516817569733,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 507,
+    "loss": 0.6584504842758179,
+    "diagonal_ce": 0.6123529076576233,
+    "finite": 0.04609755426645279,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 508,
+    "loss": 0.8000038266181946,
+    "diagonal_ce": 0.7512221336364746,
+    "finite": 0.048781704157590866,
+    "denominator_clamp_fraction": 0.012319711968302727
+  },
+  {
+    "step": 509,
+    "loss": 0.6103681325912476,
+    "diagonal_ce": 0.5725628733634949,
+    "finite": 0.03780526667833328,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 510,
+    "loss": 0.6315293908119202,
+    "diagonal_ce": 0.5709472894668579,
+    "finite": 0.060582101345062256,
+    "denominator_clamp_fraction": 0.0033052884973585606
+  },
+  {
+    "step": 511,
+    "loss": 0.6500647068023682,
+    "diagonal_ce": 0.5951536893844604,
+    "finite": 0.05491102486848831,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 512,
+    "loss": 0.6539923548698425,
+    "diagonal_ce": 0.5819610357284546,
+    "finite": 0.07203133404254913,
+    "denominator_clamp_fraction": 0.008413461968302727
+  },
+  {
+    "step": 513,
+    "loss": 0.7077308297157288,
+    "diagonal_ce": 0.6449501514434814,
+    "finite": 0.06278067082166672,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 514,
+    "loss": 0.628811776638031,
+    "diagonal_ce": 0.5827932357788086,
+    "finite": 0.0460185632109642,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 515,
+    "loss": 0.648812472820282,
+    "diagonal_ce": 0.5815790295600891,
+    "finite": 0.06723345816135406,
+    "denominator_clamp_fraction": 0.0072115384973585606
+  },
+  {
+    "step": 516,
+    "loss": 0.6775001883506775,
+    "diagonal_ce": 0.6273738145828247,
+    "finite": 0.05012635886669159,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 517,
+    "loss": 0.5993533134460449,
+    "diagonal_ce": 0.5350977778434753,
+    "finite": 0.06425556540489197,
+    "denominator_clamp_fraction": 0.0078125
+  },
+  {
+    "step": 518,
+    "loss": 0.8008409142494202,
+    "diagonal_ce": 0.7077948451042175,
+    "finite": 0.09304605424404144,
+    "denominator_clamp_fraction": 0.00390625
+  },
+  {
+    "step": 519,
+    "loss": 0.5977768301963806,
+    "diagonal_ce": 0.5554398894309998,
+    "finite": 0.042336929589509964,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 520,
+    "loss": 0.7774783372879028,
+    "diagonal_ce": 0.7324330806732178,
+    "finite": 0.04504527151584625,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 521,
+    "loss": 0.7352972626686096,
+    "diagonal_ce": 0.6998006105422974,
+    "finite": 0.03549667447805405,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 522,
+    "loss": 0.5523637533187866,
+    "diagonal_ce": 0.5022304654121399,
+    "finite": 0.05013331025838852,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 523,
+    "loss": 0.6712018847465515,
+    "diagonal_ce": 0.6109110713005066,
+    "finite": 0.06029083952307701,
+    "denominator_clamp_fraction": 0.014423076994717121
+  },
+  {
+    "step": 524,
+    "loss": 0.7394240498542786,
+    "diagonal_ce": 0.6754465103149414,
+    "finite": 0.06397753953933716,
+    "denominator_clamp_fraction": 0.022836538031697273
+  },
+  {
+    "step": 525,
+    "loss": 0.5791739821434021,
+    "diagonal_ce": 0.551048219203949,
+    "finite": 0.028125759214162827,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 526,
+    "loss": 0.6841721534729004,
+    "diagonal_ce": 0.6181396842002869,
+    "finite": 0.06603248417377472,
+    "denominator_clamp_fraction": 0.016826923936605453
+  },
+  {
+    "step": 527,
+    "loss": 0.5868328213691711,
+    "diagonal_ce": 0.5451881289482117,
+    "finite": 0.04164471849799156,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 528,
+    "loss": 0.5621753931045532,
+    "diagonal_ce": 0.533174455165863,
+    "finite": 0.02900093048810959,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 529,
+    "loss": 0.5524446368217468,
+    "diagonal_ce": 0.5214176774024963,
+    "finite": 0.031026966869831085,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 530,
+    "loss": 0.7556821703910828,
+    "diagonal_ce": 0.7166492342948914,
+    "finite": 0.0390329584479332,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 531,
+    "loss": 0.6829645037651062,
+    "diagonal_ce": 0.6386851668357849,
+    "finite": 0.044279344379901886,
+    "denominator_clamp_fraction": 0.005108173005282879
+  },
+  {
+    "step": 532,
+    "loss": 0.6391577124595642,
+    "diagonal_ce": 0.6002726554870605,
+    "finite": 0.03888505697250366,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 533,
+    "loss": 0.7002159357070923,
+    "diagonal_ce": 0.6612170934677124,
+    "finite": 0.038998864591121674,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 534,
+    "loss": 0.6377582550048828,
+    "diagonal_ce": 0.5804111361503601,
+    "finite": 0.057347122579813004,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 535,
+    "loss": 0.7883289456367493,
+    "diagonal_ce": 0.7382974028587341,
+    "finite": 0.05003156512975693,
+    "denominator_clamp_fraction": 0.01171875
+  },
+  {
+    "step": 536,
+    "loss": 0.5405956506729126,
+    "diagonal_ce": 0.490800142288208,
+    "finite": 0.04979551583528519,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 537,
+    "loss": 0.6395557522773743,
+    "diagonal_ce": 0.6114963889122009,
+    "finite": 0.02805935963988304,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 538,
+    "loss": 0.6354121565818787,
+    "diagonal_ce": 0.6157186031341553,
+    "finite": 0.01969357207417488,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 539,
+    "loss": 0.7193261384963989,
+    "diagonal_ce": 0.6759997606277466,
+    "finite": 0.04332638531923294,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 540,
+    "loss": 0.6524300575256348,
+    "diagonal_ce": 0.6192355155944824,
+    "finite": 0.033194564282894135,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 541,
+    "loss": 0.6022663116455078,
+    "diagonal_ce": 0.5777280330657959,
+    "finite": 0.024538304656744003,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 542,
+    "loss": 0.8282478451728821,
+    "diagonal_ce": 0.7662099599838257,
+    "finite": 0.0620378702878952,
+    "denominator_clamp_fraction": 0.01171875
+  },
+  {
+    "step": 543,
+    "loss": 0.6301369071006775,
+    "diagonal_ce": 0.5839224457740784,
+    "finite": 0.04621448367834091,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 544,
+    "loss": 0.73349529504776,
+    "diagonal_ce": 0.6914767622947693,
+    "finite": 0.04201850667595863,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 545,
+    "loss": 0.6052560806274414,
+    "diagonal_ce": 0.5479452013969421,
+    "finite": 0.05731087177991867,
+    "denominator_clamp_fraction": 0.010216346010565758
+  },
+  {
+    "step": 546,
+    "loss": 0.5644820332527161,
+    "diagonal_ce": 0.5339996814727783,
+    "finite": 0.030482372269034386,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 547,
+    "loss": 0.7032116651535034,
+    "diagonal_ce": 0.6594411730766296,
+    "finite": 0.043770503252744675,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 548,
+    "loss": 0.5759158134460449,
+    "diagonal_ce": 0.5506227016448975,
+    "finite": 0.025293124839663506,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 549,
+    "loss": 0.5635728240013123,
+    "diagonal_ce": 0.5300162434577942,
+    "finite": 0.03355658799409866,
+    "denominator_clamp_fraction": 0.013221153989434242
+  },
+  {
+    "step": 550,
+    "loss": 0.6074241995811462,
+    "diagonal_ce": 0.5782250165939331,
+    "finite": 0.029199158772826195,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 551,
+    "loss": 0.6576682329177856,
+    "diagonal_ce": 0.624885082244873,
+    "finite": 0.03278317302465439,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 552,
+    "loss": 0.6457187533378601,
+    "diagonal_ce": 0.6109436750411987,
+    "finite": 0.03477505221962929,
+    "denominator_clamp_fraction": 0.013521634973585606
+  },
+  {
+    "step": 553,
+    "loss": 0.7286515831947327,
+    "diagonal_ce": 0.6707671284675598,
+    "finite": 0.05788446590304375,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 554,
+    "loss": 0.6993088722229004,
+    "diagonal_ce": 0.6692848801612854,
+    "finite": 0.030024012550711632,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 555,
+    "loss": 0.758497953414917,
+    "diagonal_ce": 0.7136675119400024,
+    "finite": 0.04483043774962425,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 556,
+    "loss": 0.5605158805847168,
+    "diagonal_ce": 0.5267695188522339,
+    "finite": 0.033746346831321716,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 557,
+    "loss": 0.6181505918502808,
+    "diagonal_ce": 0.5691646337509155,
+    "finite": 0.048985980451107025,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 558,
+    "loss": 0.5866934657096863,
+    "diagonal_ce": 0.5484833717346191,
+    "finite": 0.03821007162332535,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 559,
+    "loss": 0.6139578223228455,
+    "diagonal_ce": 0.5623492002487183,
+    "finite": 0.051608629524707794,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 560,
+    "loss": 0.6423730254173279,
+    "diagonal_ce": 0.5983689427375793,
+    "finite": 0.04400407522916794,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 561,
+    "loss": 0.6524251699447632,
+    "diagonal_ce": 0.6294083595275879,
+    "finite": 0.023016780614852905,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 562,
+    "loss": 0.5668851733207703,
+    "diagonal_ce": 0.5310987830162048,
+    "finite": 0.03578636795282364,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 563,
+    "loss": 0.6347087025642395,
+    "diagonal_ce": 0.6043699979782104,
+    "finite": 0.030338723212480545,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 564,
+    "loss": 0.6466543078422546,
+    "diagonal_ce": 0.6078702807426453,
+    "finite": 0.03878401964902878,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 565,
+    "loss": 0.6949759721755981,
+    "diagonal_ce": 0.6566447615623474,
+    "finite": 0.038331203162670135,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 566,
+    "loss": 0.6878714561462402,
+    "diagonal_ce": 0.64640873670578,
+    "finite": 0.04146270826458931,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 567,
+    "loss": 0.598480761051178,
+    "diagonal_ce": 0.5723655223846436,
+    "finite": 0.026115212589502335,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 568,
+    "loss": 0.8120890855789185,
+    "diagonal_ce": 0.7486295700073242,
+    "finite": 0.06345948576927185,
+    "denominator_clamp_fraction": 0.02524038404226303
+  },
+  {
+    "step": 569,
+    "loss": 0.5811008214950562,
+    "diagonal_ce": 0.5559898614883423,
+    "finite": 0.025110948830842972,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 570,
+    "loss": 0.48291462659835815,
+    "diagonal_ce": 0.46046847105026245,
+    "finite": 0.022446149960160255,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 571,
+    "loss": 0.5029021501541138,
+    "diagonal_ce": 0.4738744795322418,
+    "finite": 0.029027700424194336,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 572,
+    "loss": 0.5717477798461914,
+    "diagonal_ce": 0.508590042591095,
+    "finite": 0.06315772980451584,
+    "denominator_clamp_fraction": 0.014423076994717121
+  },
+  {
+    "step": 573,
+    "loss": 0.5905759930610657,
+    "diagonal_ce": 0.5601435899734497,
+    "finite": 0.030432380735874176,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 574,
+    "loss": 0.6666861176490784,
+    "diagonal_ce": 0.6367588043212891,
+    "finite": 0.02992730773985386,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 575,
+    "loss": 0.7652208209037781,
+    "diagonal_ce": 0.734966516494751,
+    "finite": 0.030254321172833443,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 576,
+    "loss": 0.6679584383964539,
+    "diagonal_ce": 0.6414391398429871,
+    "finite": 0.026519324630498886,
+    "denominator_clamp_fraction": 0.013221153989434242
+  },
+  {
+    "step": 577,
+    "loss": 0.6420336365699768,
+    "diagonal_ce": 0.6152055263519287,
+    "finite": 0.026828138157725334,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 578,
+    "loss": 0.5882583856582642,
+    "diagonal_ce": 0.5634134411811829,
+    "finite": 0.024844937026500702,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 579,
+    "loss": 0.6850799918174744,
+    "diagonal_ce": 0.6698124408721924,
+    "finite": 0.015267539769411087,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 580,
+    "loss": 0.6818789839744568,
+    "diagonal_ce": 0.6559768319129944,
+    "finite": 0.025902140885591507,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 581,
+    "loss": 0.6273800134658813,
+    "diagonal_ce": 0.5874008536338806,
+    "finite": 0.039979156106710434,
+    "denominator_clamp_fraction": 0.013822115026414394
+  },
+  {
+    "step": 582,
+    "loss": 0.7688145041465759,
+    "diagonal_ce": 0.7298523783683777,
+    "finite": 0.03896210342645645,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 583,
+    "loss": 0.6153131127357483,
+    "diagonal_ce": 0.5797214508056641,
+    "finite": 0.03559163957834244,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 584,
+    "loss": 0.6288698315620422,
+    "diagonal_ce": 0.5970128178596497,
+    "finite": 0.03185701370239258,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 585,
+    "loss": 0.6236522197723389,
+    "diagonal_ce": 0.5846468210220337,
+    "finite": 0.03900539502501488,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 586,
+    "loss": 0.5641753673553467,
+    "diagonal_ce": 0.5333986282348633,
+    "finite": 0.030776746571063995,
+    "denominator_clamp_fraction": 0.009314903989434242
+  },
+  {
+    "step": 587,
+    "loss": 0.5898221731185913,
+    "diagonal_ce": 0.5585214495658875,
+    "finite": 0.031300753355026245,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 588,
+    "loss": 0.534493625164032,
+    "diagonal_ce": 0.5096758604049683,
+    "finite": 0.024817761033773422,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 589,
+    "loss": 0.6361296772956848,
+    "diagonal_ce": 0.6124158501625061,
+    "finite": 0.02371382527053356,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 590,
+    "loss": 0.5410502552986145,
+    "diagonal_ce": 0.49519020318984985,
+    "finite": 0.04586002975702286,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 591,
+    "loss": 0.8909215331077576,
+    "diagonal_ce": 0.8699710965156555,
+    "finite": 0.02095046080648899,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 592,
+    "loss": 0.7255608439445496,
+    "diagonal_ce": 0.7044380307197571,
+    "finite": 0.021122833713889122,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 593,
+    "loss": 0.6839202642440796,
+    "diagonal_ce": 0.6423584222793579,
+    "finite": 0.04156186059117317,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 594,
+    "loss": 0.5300167798995972,
+    "diagonal_ce": 0.5074121356010437,
+    "finite": 0.022604644298553467,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 595,
+    "loss": 0.652788519859314,
+    "diagonal_ce": 0.604809582233429,
+    "finite": 0.04797893762588501,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 596,
+    "loss": 0.6468201875686646,
+    "diagonal_ce": 0.624630331993103,
+    "finite": 0.022189851850271225,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 597,
+    "loss": 0.606908917427063,
+    "diagonal_ce": 0.5898786783218384,
+    "finite": 0.01703025959432125,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 598,
+    "loss": 0.64947110414505,
+    "diagonal_ce": 0.6311807036399841,
+    "finite": 0.018290376290678978,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 599,
+    "loss": 0.7016006708145142,
+    "diagonal_ce": 0.6683798432350159,
+    "finite": 0.03322082385420799,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 600,
+    "loss": 0.569300651550293,
+    "diagonal_ce": 0.5504499673843384,
+    "finite": 0.01885070838034153,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 601,
+    "loss": 0.6725338697433472,
+    "diagonal_ce": 0.6491329073905945,
+    "finite": 0.023400988429784775,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 602,
+    "loss": 0.6365100145339966,
+    "diagonal_ce": 0.615338146686554,
+    "finite": 0.02117185853421688,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 603,
+    "loss": 0.559922993183136,
+    "diagonal_ce": 0.5459113717079163,
+    "finite": 0.014011600986123085,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 604,
+    "loss": 0.5124303102493286,
+    "diagonal_ce": 0.49579524993896484,
+    "finite": 0.01663505844771862,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 605,
+    "loss": 0.6139528155326843,
+    "diagonal_ce": 0.5987591743469238,
+    "finite": 0.015193612314760685,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 606,
+    "loss": 0.6136671304702759,
+    "diagonal_ce": 0.5871127843856812,
+    "finite": 0.026554357260465622,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 607,
+    "loss": 0.7914802432060242,
+    "diagonal_ce": 0.7677999138832092,
+    "finite": 0.02368033491075039,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 608,
+    "loss": 0.4897727072238922,
+    "diagonal_ce": 0.4671231806278229,
+    "finite": 0.02264953777194023,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 609,
+    "loss": 0.518082320690155,
+    "diagonal_ce": 0.5011655688285828,
+    "finite": 0.016916753724217415,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 610,
+    "loss": 0.7620576024055481,
+    "diagonal_ce": 0.7169044017791748,
+    "finite": 0.0451531782746315,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 611,
+    "loss": 0.5886778831481934,
+    "diagonal_ce": 0.5665091276168823,
+    "finite": 0.022168762981891632,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 612,
+    "loss": 0.571897029876709,
+    "diagonal_ce": 0.5353987216949463,
+    "finite": 0.03649827837944031,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 613,
+    "loss": 0.6244643926620483,
+    "diagonal_ce": 0.605955183506012,
+    "finite": 0.018509214743971825,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 614,
+    "loss": 0.6132481694221497,
+    "diagonal_ce": 0.5848124027252197,
+    "finite": 0.028435776010155678,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 615,
+    "loss": 0.5548699498176575,
+    "diagonal_ce": 0.5229019522666931,
+    "finite": 0.03196798264980316,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 616,
+    "loss": 0.5111632347106934,
+    "diagonal_ce": 0.4913090169429779,
+    "finite": 0.019854238256812096,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 617,
+    "loss": 0.631752073764801,
+    "diagonal_ce": 0.5939133763313293,
+    "finite": 0.03783870488405228,
+    "denominator_clamp_fraction": 0.009014423005282879
+  },
+  {
+    "step": 618,
+    "loss": 0.6572873592376709,
+    "diagonal_ce": 0.6164146661758423,
+    "finite": 0.04087270423769951,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 619,
+    "loss": 0.7859554290771484,
+    "diagonal_ce": 0.7464746832847595,
+    "finite": 0.039480723440647125,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 620,
+    "loss": 0.6688222885131836,
+    "diagonal_ce": 0.6515399217605591,
+    "finite": 0.01728234812617302,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 621,
+    "loss": 0.6968264579772949,
+    "diagonal_ce": 0.6702991127967834,
+    "finite": 0.026527361944317818,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 622,
+    "loss": 0.5501371026039124,
+    "diagonal_ce": 0.5217288732528687,
+    "finite": 0.028408249840140343,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 623,
+    "loss": 0.5614785552024841,
+    "diagonal_ce": 0.5344376564025879,
+    "finite": 0.027040917426347733,
+    "denominator_clamp_fraction": 0.013822115026414394
+  },
+  {
+    "step": 624,
+    "loss": 0.5524387359619141,
+    "diagonal_ce": 0.5266733169555664,
+    "finite": 0.025765417143702507,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 625,
+    "loss": 0.5884682536125183,
+    "diagonal_ce": 0.5661171674728394,
+    "finite": 0.022351104766130447,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 626,
+    "loss": 0.6238255500793457,
+    "diagonal_ce": 0.6055948734283447,
+    "finite": 0.018230684101581573,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 627,
+    "loss": 0.8037136197090149,
+    "diagonal_ce": 0.7877389788627625,
+    "finite": 0.0159746166318655,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 628,
+    "loss": 0.6266953945159912,
+    "diagonal_ce": 0.6067666411399841,
+    "finite": 0.01992872543632984,
+    "denominator_clamp_fraction": 0.004807692486792803
+  },
+  {
+    "step": 629,
+    "loss": 0.5434039831161499,
+    "diagonal_ce": 0.5287994742393494,
+    "finite": 0.014604524709284306,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 630,
+    "loss": 0.6219958066940308,
+    "diagonal_ce": 0.6074148416519165,
+    "finite": 0.014580946415662766,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 631,
+    "loss": 0.4209376275539398,
+    "diagonal_ce": 0.40308842062950134,
+    "finite": 0.017849205061793327,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 632,
+    "loss": 0.7265495657920837,
+    "diagonal_ce": 0.7085854411125183,
+    "finite": 0.01796410232782364,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 633,
+    "loss": 0.523493230342865,
+    "diagonal_ce": 0.503201425075531,
+    "finite": 0.020291777327656746,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 634,
+    "loss": 0.6336172819137573,
+    "diagonal_ce": 0.6163710355758667,
+    "finite": 0.01724623702466488,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 635,
+    "loss": 0.585576593875885,
+    "diagonal_ce": 0.5599547028541565,
+    "finite": 0.025621898472309113,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 636,
+    "loss": 0.7029398679733276,
+    "diagonal_ce": 0.683106541633606,
+    "finite": 0.019833296537399292,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 637,
+    "loss": 0.4796978533267975,
+    "diagonal_ce": 0.46326377987861633,
+    "finite": 0.016434065997600555,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 638,
+    "loss": 0.628753662109375,
+    "diagonal_ce": 0.6017031669616699,
+    "finite": 0.027050470933318138,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 639,
+    "loss": 0.46506762504577637,
+    "diagonal_ce": 0.44712117314338684,
+    "finite": 0.01794644445180893,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 640,
+    "loss": 0.5531535148620605,
+    "diagonal_ce": 0.534328281879425,
+    "finite": 0.018825219944119453,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 641,
+    "loss": 0.5781145691871643,
+    "diagonal_ce": 0.5516809225082397,
+    "finite": 0.026433655992150307,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 642,
+    "loss": 0.7016960978507996,
+    "diagonal_ce": 0.6657561659812927,
+    "finite": 0.03593993932008743,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 643,
+    "loss": 0.8085994720458984,
+    "diagonal_ce": 0.7707870006561279,
+    "finite": 0.0378124862909317,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 644,
+    "loss": 0.7041879296302795,
+    "diagonal_ce": 0.673494815826416,
+    "finite": 0.030693132430315018,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 645,
+    "loss": 0.5448811650276184,
+    "diagonal_ce": 0.5220677852630615,
+    "finite": 0.02281336858868599,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 646,
+    "loss": 0.5947080254554749,
+    "diagonal_ce": 0.5717060565948486,
+    "finite": 0.023001987487077713,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 647,
+    "loss": 0.6116319298744202,
+    "diagonal_ce": 0.5998156070709229,
+    "finite": 0.011816325597465038,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 648,
+    "loss": 0.5231515765190125,
+    "diagonal_ce": 0.5096585154533386,
+    "finite": 0.013493077829480171,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 649,
+    "loss": 0.550110399723053,
+    "diagonal_ce": 0.5201035737991333,
+    "finite": 0.03000681661069393,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 650,
+    "loss": 0.6362959146499634,
+    "diagonal_ce": 0.595518171787262,
+    "finite": 0.04077775776386261,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 651,
+    "loss": 0.6297622323036194,
+    "diagonal_ce": 0.6100878715515137,
+    "finite": 0.019674338400363922,
+    "denominator_clamp_fraction": 0.01171875
+  },
+  {
+    "step": 652,
+    "loss": 0.4749670922756195,
+    "diagonal_ce": 0.4571259021759033,
+    "finite": 0.01784118451178074,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 653,
+    "loss": 0.6576653122901917,
+    "diagonal_ce": 0.6370546221733093,
+    "finite": 0.020610667765140533,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 654,
+    "loss": 0.6037845015525818,
+    "diagonal_ce": 0.5852200984954834,
+    "finite": 0.01856439746916294,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 655,
+    "loss": 0.48668259382247925,
+    "diagonal_ce": 0.4705144464969635,
+    "finite": 0.0161681417375803,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 656,
+    "loss": 0.5398156642913818,
+    "diagonal_ce": 0.5254199504852295,
+    "finite": 0.014395738020539284,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 657,
+    "loss": 0.7932624816894531,
+    "diagonal_ce": 0.7715797424316406,
+    "finite": 0.02168271131813526,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 658,
+    "loss": 0.6316976547241211,
+    "diagonal_ce": 0.6122101545333862,
+    "finite": 0.019487520679831505,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 659,
+    "loss": 0.6908372640609741,
+    "diagonal_ce": 0.6761360168457031,
+    "finite": 0.014701230451464653,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 660,
+    "loss": 0.7234720587730408,
+    "diagonal_ce": 0.6963033080101013,
+    "finite": 0.027168769389390945,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 661,
+    "loss": 0.7051950693130493,
+    "diagonal_ce": 0.6717647314071655,
+    "finite": 0.03343034163117409,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 662,
+    "loss": 0.5349066853523254,
+    "diagonal_ce": 0.5168418288230896,
+    "finite": 0.01806485652923584,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 663,
+    "loss": 0.594739556312561,
+    "diagonal_ce": 0.5775893926620483,
+    "finite": 0.01715018041431904,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 664,
+    "loss": 0.721627414226532,
+    "diagonal_ce": 0.7025688886642456,
+    "finite": 0.019058553501963615,
+    "denominator_clamp_fraction": 0.013221153989434242
+  },
+  {
+    "step": 665,
+    "loss": 0.6538407206535339,
+    "diagonal_ce": 0.6318552494049072,
+    "finite": 0.021985448896884918,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 666,
+    "loss": 0.5675170421600342,
+    "diagonal_ce": 0.5422315001487732,
+    "finite": 0.025285545736551285,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 667,
+    "loss": 0.517606258392334,
+    "diagonal_ce": 0.5008368492126465,
+    "finite": 0.0167694054543972,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 668,
+    "loss": 0.450812429189682,
+    "diagonal_ce": 0.42884427309036255,
+    "finite": 0.02196815051138401,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 669,
+    "loss": 0.6072243452072144,
+    "diagonal_ce": 0.5878911018371582,
+    "finite": 0.01933326944708824,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 670,
+    "loss": 0.6543583273887634,
+    "diagonal_ce": 0.6291658878326416,
+    "finite": 0.02519242838025093,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 671,
+    "loss": 0.5262578725814819,
+    "diagonal_ce": 0.5167936086654663,
+    "finite": 0.00946424063295126,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 672,
+    "loss": 0.7622703313827515,
+    "diagonal_ce": 0.7363885641098022,
+    "finite": 0.02588173933327198,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 673,
+    "loss": 0.5332261323928833,
+    "diagonal_ce": 0.5102723836898804,
+    "finite": 0.022953756153583527,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 674,
+    "loss": 0.5005317330360413,
+    "diagonal_ce": 0.48630884289741516,
+    "finite": 0.0142228864133358,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 675,
+    "loss": 0.7119035124778748,
+    "diagonal_ce": 0.6831539273262024,
+    "finite": 0.02874959632754326,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 676,
+    "loss": 0.5725940465927124,
+    "diagonal_ce": 0.5544993877410889,
+    "finite": 0.018094632774591446,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 677,
+    "loss": 0.6776838302612305,
+    "diagonal_ce": 0.6622468829154968,
+    "finite": 0.015436917543411255,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 678,
+    "loss": 0.8002863526344299,
+    "diagonal_ce": 0.7763654589653015,
+    "finite": 0.023920893669128418,
+    "denominator_clamp_fraction": 0.012920673005282879
+  },
+  {
+    "step": 679,
+    "loss": 0.5463272929191589,
+    "diagonal_ce": 0.5292142629623413,
+    "finite": 0.017113052308559418,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 680,
+    "loss": 0.5915060043334961,
+    "diagonal_ce": 0.5698791146278381,
+    "finite": 0.021626871079206467,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 681,
+    "loss": 0.5979880094528198,
+    "diagonal_ce": 0.5840135216712952,
+    "finite": 0.01397450640797615,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 682,
+    "loss": 0.7530782222747803,
+    "diagonal_ce": 0.7333582639694214,
+    "finite": 0.019719963893294334,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 683,
+    "loss": 0.6265149712562561,
+    "diagonal_ce": 0.6088597178459167,
+    "finite": 0.017655281350016594,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 684,
+    "loss": 0.5948821902275085,
+    "diagonal_ce": 0.5749816298484802,
+    "finite": 0.019900573417544365,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 685,
+    "loss": 0.6739218235015869,
+    "diagonal_ce": 0.6561771035194397,
+    "finite": 0.01774471439421177,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 686,
+    "loss": 0.5985771417617798,
+    "diagonal_ce": 0.5843060612678528,
+    "finite": 0.0142710842192173,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 687,
+    "loss": 0.6509132981300354,
+    "diagonal_ce": 0.6318254470825195,
+    "finite": 0.01908787526190281,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 688,
+    "loss": 0.5296746492385864,
+    "diagonal_ce": 0.5150822997093201,
+    "finite": 0.014592346735298634,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 689,
+    "loss": 0.7289260625839233,
+    "diagonal_ce": 0.7051620483398438,
+    "finite": 0.023764006793498993,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 690,
+    "loss": 0.7431545853614807,
+    "diagonal_ce": 0.719286322593689,
+    "finite": 0.023868268355727196,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 691,
+    "loss": 0.7273208498954773,
+    "diagonal_ce": 0.706246018409729,
+    "finite": 0.021074814721941948,
+    "denominator_clamp_fraction": 0.012620192021131516
+  },
+  {
+    "step": 692,
+    "loss": 0.6549354791641235,
+    "diagonal_ce": 0.6349258422851562,
+    "finite": 0.020009629428386688,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 693,
+    "loss": 0.6138961911201477,
+    "diagonal_ce": 0.5944956541061401,
+    "finite": 0.01940053701400757,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 694,
+    "loss": 0.5130346417427063,
+    "diagonal_ce": 0.4954659342765808,
+    "finite": 0.01756872609257698,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 695,
+    "loss": 0.6297938823699951,
+    "diagonal_ce": 0.6169600486755371,
+    "finite": 0.012833818793296814,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 696,
+    "loss": 0.5664411187171936,
+    "diagonal_ce": 0.5365538597106934,
+    "finite": 0.029887234792113304,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 697,
+    "loss": 0.5079291462898254,
+    "diagonal_ce": 0.49445468187332153,
+    "finite": 0.013474471867084503,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 698,
+    "loss": 0.6136149764060974,
+    "diagonal_ce": 0.5827473998069763,
+    "finite": 0.03086758591234684,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 699,
+    "loss": 0.48145562410354614,
+    "diagonal_ce": 0.4660722613334656,
+    "finite": 0.015383372083306313,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 700,
+    "loss": 0.6137878894805908,
+    "diagonal_ce": 0.5965041518211365,
+    "finite": 0.017283761873841286,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 701,
+    "loss": 0.7181318402290344,
+    "diagonal_ce": 0.6862393021583557,
+    "finite": 0.031892526894807816,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 702,
+    "loss": 0.5273754596710205,
+    "diagonal_ce": 0.5165966749191284,
+    "finite": 0.010778800584375858,
+    "denominator_clamp_fraction": 0.0045072115026414394
+  },
+  {
+    "step": 703,
+    "loss": 0.5327385663986206,
+    "diagonal_ce": 0.5197975039482117,
+    "finite": 0.012941074557602406,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 704,
+    "loss": 0.6311885118484497,
+    "diagonal_ce": 0.6200499534606934,
+    "finite": 0.011138536036014557,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 705,
+    "loss": 0.7163003087043762,
+    "diagonal_ce": 0.7010319828987122,
+    "finite": 0.015268334187567234,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 706,
+    "loss": 0.6006308794021606,
+    "diagonal_ce": 0.5885624885559082,
+    "finite": 0.012068393640220165,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 707,
+    "loss": 0.6492714881896973,
+    "diagonal_ce": 0.6360341906547546,
+    "finite": 0.013237284496426582,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 708,
+    "loss": 0.5568116307258606,
+    "diagonal_ce": 0.5345996618270874,
+    "finite": 0.022211953997612,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 709,
+    "loss": 0.577998697757721,
+    "diagonal_ce": 0.5588740110397339,
+    "finite": 0.01912468858063221,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 710,
+    "loss": 0.6063473224639893,
+    "diagonal_ce": 0.5903922915458679,
+    "finite": 0.015955055132508278,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 711,
+    "loss": 0.5181697607040405,
+    "diagonal_ce": 0.50531405210495,
+    "finite": 0.012855679728090763,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 712,
+    "loss": 0.6531994938850403,
+    "diagonal_ce": 0.63418048620224,
+    "finite": 0.01901903562247753,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 713,
+    "loss": 0.5564747452735901,
+    "diagonal_ce": 0.5408052206039429,
+    "finite": 0.015669522807002068,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 714,
+    "loss": 0.43795379996299744,
+    "diagonal_ce": 0.42734494805336,
+    "finite": 0.010608838871121407,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 715,
+    "loss": 0.6155761480331421,
+    "diagonal_ce": 0.6022924780845642,
+    "finite": 0.013283699750900269,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 716,
+    "loss": 0.6686320304870605,
+    "diagonal_ce": 0.6413470506668091,
+    "finite": 0.02728499472141266,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 717,
+    "loss": 0.6223532557487488,
+    "diagonal_ce": 0.6014357209205627,
+    "finite": 0.020917529240250587,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 718,
+    "loss": 0.6268577575683594,
+    "diagonal_ce": 0.6084888577461243,
+    "finite": 0.018368910998106003,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 719,
+    "loss": 0.6084786653518677,
+    "diagonal_ce": 0.5932488441467285,
+    "finite": 0.0152298454195261,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 720,
+    "loss": 0.5408285856246948,
+    "diagonal_ce": 0.5200960040092468,
+    "finite": 0.02073260396718979,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 721,
+    "loss": 0.5264005661010742,
+    "diagonal_ce": 0.511029839515686,
+    "finite": 0.01537072379142046,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 722,
+    "loss": 0.5182824730873108,
+    "diagonal_ce": 0.5030423998832703,
+    "finite": 0.015240060165524483,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 723,
+    "loss": 0.5226160883903503,
+    "diagonal_ce": 0.4976325035095215,
+    "finite": 0.024983568117022514,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 724,
+    "loss": 0.6037580370903015,
+    "diagonal_ce": 0.5843091607093811,
+    "finite": 0.01944889687001705,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 725,
+    "loss": 0.675449550151825,
+    "diagonal_ce": 0.6582466959953308,
+    "finite": 0.01720283553004265,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 726,
+    "loss": 0.5868222117424011,
+    "diagonal_ce": 0.5731779336929321,
+    "finite": 0.013644292950630188,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 727,
+    "loss": 0.40330827236175537,
+    "diagonal_ce": 0.39206424355506897,
+    "finite": 0.011244015768170357,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 728,
+    "loss": 0.5897001028060913,
+    "diagonal_ce": 0.5710429549217224,
+    "finite": 0.01865716092288494,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 729,
+    "loss": 0.6159816384315491,
+    "diagonal_ce": 0.5961692333221436,
+    "finite": 0.019812382757663727,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 730,
+    "loss": 0.6257187128067017,
+    "diagonal_ce": 0.590807318687439,
+    "finite": 0.0349113792181015,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 731,
+    "loss": 0.5553706288337708,
+    "diagonal_ce": 0.5411418080329895,
+    "finite": 0.01422880869358778,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 732,
+    "loss": 0.5868955254554749,
+    "diagonal_ce": 0.5646546483039856,
+    "finite": 0.022240856662392616,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 733,
+    "loss": 0.49886810779571533,
+    "diagonal_ce": 0.48453572392463684,
+    "finite": 0.01433238759636879,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 734,
+    "loss": 0.6626257300376892,
+    "diagonal_ce": 0.649331271648407,
+    "finite": 0.013294462114572525,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 735,
+    "loss": 0.6024221181869507,
+    "diagonal_ce": 0.5901560187339783,
+    "finite": 0.012266108766198158,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 736,
+    "loss": 0.7496429681777954,
+    "diagonal_ce": 0.7373208999633789,
+    "finite": 0.01232206728309393,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 737,
+    "loss": 0.42810800671577454,
+    "diagonal_ce": 0.40484657883644104,
+    "finite": 0.023261424154043198,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 738,
+    "loss": 0.4837401509284973,
+    "diagonal_ce": 0.46553999185562134,
+    "finite": 0.01820014789700508,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 739,
+    "loss": 0.39904990792274475,
+    "diagonal_ce": 0.38327062129974365,
+    "finite": 0.0157792791724205,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 740,
+    "loss": 0.5033429861068726,
+    "diagonal_ce": 0.49335503578186035,
+    "finite": 0.009987923316657543,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 741,
+    "loss": 0.6927712559700012,
+    "diagonal_ce": 0.678854763507843,
+    "finite": 0.01391650177538395,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 742,
+    "loss": 0.5864633917808533,
+    "diagonal_ce": 0.5731558203697205,
+    "finite": 0.013307593762874603,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 743,
+    "loss": 0.5936177968978882,
+    "diagonal_ce": 0.5786426663398743,
+    "finite": 0.014975136145949364,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 744,
+    "loss": 0.6854786276817322,
+    "diagonal_ce": 0.6563876867294312,
+    "finite": 0.02909095771610737,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 745,
+    "loss": 0.4749138653278351,
+    "diagonal_ce": 0.4565931260585785,
+    "finite": 0.01832074113190174,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 746,
+    "loss": 0.7365022897720337,
+    "diagonal_ce": 0.72499680519104,
+    "finite": 0.011505463160574436,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 747,
+    "loss": 0.4759870171546936,
+    "diagonal_ce": 0.4597945213317871,
+    "finite": 0.0161924846470356,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 748,
+    "loss": 0.4530189037322998,
+    "diagonal_ce": 0.44365283846855164,
+    "finite": 0.009366078302264214,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 749,
+    "loss": 0.6186345219612122,
+    "diagonal_ce": 0.596966028213501,
+    "finite": 0.021668508648872375,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 750,
+    "loss": 0.6077239513397217,
+    "diagonal_ce": 0.5914188027381897,
+    "finite": 0.01630517840385437,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 751,
+    "loss": 0.6309541463851929,
+    "diagonal_ce": 0.6185433864593506,
+    "finite": 0.012410755269229412,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 752,
+    "loss": 0.628833532333374,
+    "diagonal_ce": 0.6100528836250305,
+    "finite": 0.018780656158924103,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 753,
+    "loss": 0.5356537699699402,
+    "diagonal_ce": 0.5179426074028015,
+    "finite": 0.017711160704493523,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 754,
+    "loss": 0.6407750248908997,
+    "diagonal_ce": 0.6147233247756958,
+    "finite": 0.026051700115203857,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 755,
+    "loss": 0.5545623302459717,
+    "diagonal_ce": 0.5438447594642639,
+    "finite": 0.010717568919062614,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 756,
+    "loss": 0.5484920144081116,
+    "diagonal_ce": 0.532532811164856,
+    "finite": 0.01595921628177166,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 757,
+    "loss": 0.562006950378418,
+    "diagonal_ce": 0.5526527166366577,
+    "finite": 0.009354235604405403,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 758,
+    "loss": 0.6121340990066528,
+    "diagonal_ce": 0.5986426472663879,
+    "finite": 0.013491479679942131,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 759,
+    "loss": 0.6339191198348999,
+    "diagonal_ce": 0.6128743290901184,
+    "finite": 0.021044792607426643,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 760,
+    "loss": 0.669256865978241,
+    "diagonal_ce": 0.6495206356048584,
+    "finite": 0.019736237823963165,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 761,
+    "loss": 0.689540445804596,
+    "diagonal_ce": 0.673290491104126,
+    "finite": 0.01624993048608303,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 762,
+    "loss": 0.572607696056366,
+    "diagonal_ce": 0.5565187335014343,
+    "finite": 0.016088942065835,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 763,
+    "loss": 0.6060802936553955,
+    "diagonal_ce": 0.5923280715942383,
+    "finite": 0.013752240687608719,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 764,
+    "loss": 0.5416013598442078,
+    "diagonal_ce": 0.5271113514900208,
+    "finite": 0.014490002766251564,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 765,
+    "loss": 0.5231943130493164,
+    "diagonal_ce": 0.5073214769363403,
+    "finite": 0.015872851014137268,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 766,
+    "loss": 0.5540797114372253,
+    "diagonal_ce": 0.5359303951263428,
+    "finite": 0.01814931072294712,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 767,
+    "loss": 0.6829676032066345,
+    "diagonal_ce": 0.6597594022750854,
+    "finite": 0.02320820465683937,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 768,
+    "loss": 0.5484914779663086,
+    "diagonal_ce": 0.5241214036941528,
+    "finite": 0.024370070546865463,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 769,
+    "loss": 0.6009080410003662,
+    "diagonal_ce": 0.5661206841468811,
+    "finite": 0.034787360578775406,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 770,
+    "loss": 0.5897852182388306,
+    "diagonal_ce": 0.5743873119354248,
+    "finite": 0.015397902578115463,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 771,
+    "loss": 0.5839186906814575,
+    "diagonal_ce": 0.557427704334259,
+    "finite": 0.026490960270166397,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 772,
+    "loss": 0.5141736268997192,
+    "diagonal_ce": 0.5000377893447876,
+    "finite": 0.014135857112705708,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 773,
+    "loss": 0.529209315776825,
+    "diagonal_ce": 0.5069406628608704,
+    "finite": 0.02226867526769638,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 774,
+    "loss": 0.513446569442749,
+    "diagonal_ce": 0.49966442584991455,
+    "finite": 0.013782121241092682,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 775,
+    "loss": 0.5692726969718933,
+    "diagonal_ce": 0.5594030022621155,
+    "finite": 0.009869702160358429,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 776,
+    "loss": 0.5743892192840576,
+    "diagonal_ce": 0.5545099377632141,
+    "finite": 0.0198792964220047,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 777,
+    "loss": 0.5381245017051697,
+    "diagonal_ce": 0.5251607894897461,
+    "finite": 0.012963727116584778,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 778,
+    "loss": 0.5383324027061462,
+    "diagonal_ce": 0.528495192527771,
+    "finite": 0.009837216697633266,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 779,
+    "loss": 0.48363229632377625,
+    "diagonal_ce": 0.4708130359649658,
+    "finite": 0.01281924732029438,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 780,
+    "loss": 0.4823688268661499,
+    "diagonal_ce": 0.46250399947166443,
+    "finite": 0.019864840433001518,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 781,
+    "loss": 0.5006603002548218,
+    "diagonal_ce": 0.4911996126174927,
+    "finite": 0.009460663422942162,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 782,
+    "loss": 0.5723392367362976,
+    "diagonal_ce": 0.5609276294708252,
+    "finite": 0.011411597952246666,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 783,
+    "loss": 0.487102746963501,
+    "diagonal_ce": 0.4715445339679718,
+    "finite": 0.015558227896690369,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 784,
+    "loss": 0.5067514777183533,
+    "diagonal_ce": 0.4966736137866974,
+    "finite": 0.01007788721472025,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 785,
+    "loss": 0.5149211883544922,
+    "diagonal_ce": 0.49715864658355713,
+    "finite": 0.01776256412267685,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 786,
+    "loss": 0.5089924931526184,
+    "diagonal_ce": 0.49322497844696045,
+    "finite": 0.01576751098036766,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 787,
+    "loss": 0.6734720468521118,
+    "diagonal_ce": 0.6573780179023743,
+    "finite": 0.016094040125608444,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 788,
+    "loss": 0.6284270286560059,
+    "diagonal_ce": 0.6112145185470581,
+    "finite": 0.017212482169270515,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 789,
+    "loss": 0.5083980560302734,
+    "diagonal_ce": 0.49512189626693726,
+    "finite": 0.013276132754981518,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 790,
+    "loss": 0.5764935612678528,
+    "diagonal_ce": 0.5632795095443726,
+    "finite": 0.013214055448770523,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 791,
+    "loss": 0.6446970701217651,
+    "diagonal_ce": 0.6326332688331604,
+    "finite": 0.012063814327120781,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 792,
+    "loss": 0.5058706402778625,
+    "diagonal_ce": 0.4983273446559906,
+    "finite": 0.007543306332081556,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 793,
+    "loss": 0.4816247224807739,
+    "diagonal_ce": 0.4735278785228729,
+    "finite": 0.008096855133771896,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 794,
+    "loss": 0.7098290920257568,
+    "diagonal_ce": 0.69267338514328,
+    "finite": 0.01715570129454136,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 795,
+    "loss": 0.688001811504364,
+    "diagonal_ce": 0.6744686961174011,
+    "finite": 0.01353313960134983,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 796,
+    "loss": 0.5306289792060852,
+    "diagonal_ce": 0.519428551197052,
+    "finite": 0.011200444772839546,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 797,
+    "loss": 0.4785991907119751,
+    "diagonal_ce": 0.4672900438308716,
+    "finite": 0.011309154331684113,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 798,
+    "loss": 0.45640239119529724,
+    "diagonal_ce": 0.4441656172275543,
+    "finite": 0.01223678421229124,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 799,
+    "loss": 0.5437244176864624,
+    "diagonal_ce": 0.5237823128700256,
+    "finite": 0.01994212530553341,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 800,
+    "loss": 0.5486654043197632,
+    "diagonal_ce": 0.5297513604164124,
+    "finite": 0.018914051353931427,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 801,
+    "loss": 0.7206960320472717,
+    "diagonal_ce": 0.6952354311943054,
+    "finite": 0.025460591539740562,
+    "denominator_clamp_fraction": 0.009615384973585606
+  },
+  {
+    "step": 802,
+    "loss": 0.602383553981781,
+    "diagonal_ce": 0.5771592855453491,
+    "finite": 0.02522425353527069,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 803,
+    "loss": 0.6681185364723206,
+    "diagonal_ce": 0.6522265076637268,
+    "finite": 0.015892043709754944,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 804,
+    "loss": 0.40946680307388306,
+    "diagonal_ce": 0.3911820352077484,
+    "finite": 0.018284764140844345,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 805,
+    "loss": 0.5810178518295288,
+    "diagonal_ce": 0.5652363300323486,
+    "finite": 0.015781491994857788,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 806,
+    "loss": 0.5113784670829773,
+    "diagonal_ce": 0.49899792671203613,
+    "finite": 0.012380549684166908,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 807,
+    "loss": 0.501133143901825,
+    "diagonal_ce": 0.48334866762161255,
+    "finite": 0.017784466966986656,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 808,
+    "loss": 0.643611490726471,
+    "diagonal_ce": 0.6273416876792908,
+    "finite": 0.016269823536276817,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 809,
+    "loss": 0.6822221279144287,
+    "diagonal_ce": 0.6585033535957336,
+    "finite": 0.023718779906630516,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 810,
+    "loss": 0.45160144567489624,
+    "diagonal_ce": 0.42920544743537903,
+    "finite": 0.022395987063646317,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 811,
+    "loss": 0.6238494515419006,
+    "diagonal_ce": 0.6148497462272644,
+    "finite": 0.008999706245958805,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 812,
+    "loss": 0.5093680620193481,
+    "diagonal_ce": 0.4942375421524048,
+    "finite": 0.01513051800429821,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 813,
+    "loss": 0.4928099811077118,
+    "diagonal_ce": 0.4692593216896057,
+    "finite": 0.023550648242235184,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 814,
+    "loss": 0.6350634694099426,
+    "diagonal_ce": 0.6244508028030396,
+    "finite": 0.010612647980451584,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 815,
+    "loss": 0.8795283436775208,
+    "diagonal_ce": 0.8549177050590515,
+    "finite": 0.02461061254143715,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 816,
+    "loss": 0.7337229251861572,
+    "diagonal_ce": 0.7177563309669495,
+    "finite": 0.01596659980714321,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 817,
+    "loss": 0.4701704978942871,
+    "diagonal_ce": 0.4606275260448456,
+    "finite": 0.009542969986796379,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 818,
+    "loss": 0.48994216322898865,
+    "diagonal_ce": 0.4697917401790619,
+    "finite": 0.020150434225797653,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 819,
+    "loss": 0.5219963192939758,
+    "diagonal_ce": 0.4999995231628418,
+    "finite": 0.021996818482875824,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 820,
+    "loss": 0.524752676486969,
+    "diagonal_ce": 0.5024738907814026,
+    "finite": 0.022278765216469765,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 821,
+    "loss": 0.44897952675819397,
+    "diagonal_ce": 0.4389593005180359,
+    "finite": 0.010020218789577484,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 822,
+    "loss": 0.582037627696991,
+    "diagonal_ce": 0.5569404363632202,
+    "finite": 0.025097165256738663,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 823,
+    "loss": 0.5225581526756287,
+    "diagonal_ce": 0.49033451080322266,
+    "finite": 0.0322236567735672,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 824,
+    "loss": 0.5006670951843262,
+    "diagonal_ce": 0.4707234501838684,
+    "finite": 0.029943641275167465,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 825,
+    "loss": 0.5272935628890991,
+    "diagonal_ce": 0.5095541477203369,
+    "finite": 0.017739389091730118,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 826,
+    "loss": 0.6134257316589355,
+    "diagonal_ce": 0.6014693975448608,
+    "finite": 0.011956337839365005,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 827,
+    "loss": 0.5929689407348633,
+    "diagonal_ce": 0.5811554193496704,
+    "finite": 0.011813515797257423,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 828,
+    "loss": 0.3818301558494568,
+    "diagonal_ce": 0.37028607726097107,
+    "finite": 0.011544075794517994,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 829,
+    "loss": 0.5514151453971863,
+    "diagonal_ce": 0.5317804217338562,
+    "finite": 0.01963472180068493,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 830,
+    "loss": 0.6436810493469238,
+    "diagonal_ce": 0.6290481090545654,
+    "finite": 0.014632967300713062,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 831,
+    "loss": 0.5409604907035828,
+    "diagonal_ce": 0.5213450193405151,
+    "finite": 0.019615454599261284,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 832,
+    "loss": 0.8103760480880737,
+    "diagonal_ce": 0.7918921709060669,
+    "finite": 0.018483906984329224,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 833,
+    "loss": 0.6419922113418579,
+    "diagonal_ce": 0.6245571374893188,
+    "finite": 0.017435086891055107,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 834,
+    "loss": 0.7467128038406372,
+    "diagonal_ce": 0.7228217720985413,
+    "finite": 0.023891061544418335,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 835,
+    "loss": 0.6449132561683655,
+    "diagonal_ce": 0.6238080263137817,
+    "finite": 0.02110520750284195,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 836,
+    "loss": 0.5690863132476807,
+    "diagonal_ce": 0.5425642132759094,
+    "finite": 0.02652212232351303,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 837,
+    "loss": 0.5010640025138855,
+    "diagonal_ce": 0.4653845429420471,
+    "finite": 0.03567945212125778,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 838,
+    "loss": 0.5543786287307739,
+    "diagonal_ce": 0.5333372354507446,
+    "finite": 0.021041391417384148,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 839,
+    "loss": 0.6207300424575806,
+    "diagonal_ce": 0.6030519604682922,
+    "finite": 0.01767810806632042,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 840,
+    "loss": 0.8156002759933472,
+    "diagonal_ce": 0.8023778200149536,
+    "finite": 0.013222449459135532,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 841,
+    "loss": 0.48631152510643005,
+    "diagonal_ce": 0.4653514325618744,
+    "finite": 0.02096007950603962,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 842,
+    "loss": 0.5731793642044067,
+    "diagonal_ce": 0.5585774779319763,
+    "finite": 0.014601909555494785,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 843,
+    "loss": 0.7311967015266418,
+    "diagonal_ce": 0.7121527194976807,
+    "finite": 0.01904400810599327,
+    "denominator_clamp_fraction": 0.012620192021131516
+  },
+  {
+    "step": 844,
+    "loss": 0.49962836503982544,
+    "diagonal_ce": 0.48804497718811035,
+    "finite": 0.01158338412642479,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 845,
+    "loss": 0.5560299754142761,
+    "diagonal_ce": 0.5432302355766296,
+    "finite": 0.01279971282929182,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 846,
+    "loss": 0.4836072027683258,
+    "diagonal_ce": 0.46392861008644104,
+    "finite": 0.019678601995110512,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 847,
+    "loss": 0.5818763971328735,
+    "diagonal_ce": 0.5592716932296753,
+    "finite": 0.022604674100875854,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 848,
+    "loss": 0.5291388034820557,
+    "diagonal_ce": 0.5087099671363831,
+    "finite": 0.020428836345672607,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 849,
+    "loss": 0.6607095003128052,
+    "diagonal_ce": 0.6400813460350037,
+    "finite": 0.020628152415156364,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 850,
+    "loss": 0.44103941321372986,
+    "diagonal_ce": 0.41669222712516785,
+    "finite": 0.024347182363271713,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 851,
+    "loss": 0.6028369665145874,
+    "diagonal_ce": 0.5705167055130005,
+    "finite": 0.03232027590274811,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 852,
+    "loss": 0.5604470372200012,
+    "diagonal_ce": 0.545754611492157,
+    "finite": 0.014692451804876328,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 853,
+    "loss": 0.46564871072769165,
+    "diagonal_ce": 0.45523908734321594,
+    "finite": 0.010409610345959663,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 854,
+    "loss": 0.6995688080787659,
+    "diagonal_ce": 0.6744518876075745,
+    "finite": 0.0251169390976429,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 855,
+    "loss": 0.650472104549408,
+    "diagonal_ce": 0.6339892745018005,
+    "finite": 0.016482841223478317,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 856,
+    "loss": 0.444025456905365,
+    "diagonal_ce": 0.43510594964027405,
+    "finite": 0.008919493295252323,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 857,
+    "loss": 0.4643429219722748,
+    "diagonal_ce": 0.44738835096359253,
+    "finite": 0.016954582184553146,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 858,
+    "loss": 0.4593389928340912,
+    "diagonal_ce": 0.4423595070838928,
+    "finite": 0.01697949692606926,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 859,
+    "loss": 0.5077901482582092,
+    "diagonal_ce": 0.4938320517539978,
+    "finite": 0.013958108611404896,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 860,
+    "loss": 0.5958495736122131,
+    "diagonal_ce": 0.5714259147644043,
+    "finite": 0.024423660710453987,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 861,
+    "loss": 0.6480916738510132,
+    "diagonal_ce": 0.6221884489059448,
+    "finite": 0.02590319886803627,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 862,
+    "loss": 0.6281359195709229,
+    "diagonal_ce": 0.6076319813728333,
+    "finite": 0.02050391025841236,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 863,
+    "loss": 0.7614450454711914,
+    "diagonal_ce": 0.7509779334068298,
+    "finite": 0.01046711578965187,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 864,
+    "loss": 0.5962967872619629,
+    "diagonal_ce": 0.5649383664131165,
+    "finite": 0.031358443200588226,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 865,
+    "loss": 0.6118267774581909,
+    "diagonal_ce": 0.5830374956130981,
+    "finite": 0.028789274394512177,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 866,
+    "loss": 0.5626156330108643,
+    "diagonal_ce": 0.5441803932189941,
+    "finite": 0.01843525655567646,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 867,
+    "loss": 0.5118398070335388,
+    "diagonal_ce": 0.49168187379837036,
+    "finite": 0.02015794813632965,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 868,
+    "loss": 0.49764686822891235,
+    "diagonal_ce": 0.48130449652671814,
+    "finite": 0.016342362388968468,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 869,
+    "loss": 0.6858304142951965,
+    "diagonal_ce": 0.6592267155647278,
+    "finite": 0.026603693142533302,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 870,
+    "loss": 0.5336241126060486,
+    "diagonal_ce": 0.5203287601470947,
+    "finite": 0.013295361772179604,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 871,
+    "loss": 0.6456870436668396,
+    "diagonal_ce": 0.6276601552963257,
+    "finite": 0.01802690327167511,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 872,
+    "loss": 0.5444455742835999,
+    "diagonal_ce": 0.5176974534988403,
+    "finite": 0.026748109608888626,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 873,
+    "loss": 0.5056474804878235,
+    "diagonal_ce": 0.4862501323223114,
+    "finite": 0.01939733326435089,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 874,
+    "loss": 0.6643450260162354,
+    "diagonal_ce": 0.6475584506988525,
+    "finite": 0.01678656041622162,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 875,
+    "loss": 0.5589088201522827,
+    "diagonal_ce": 0.5347499847412109,
+    "finite": 0.02415885590016842,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 876,
+    "loss": 0.6295764446258545,
+    "diagonal_ce": 0.6149351596832275,
+    "finite": 0.014641279354691505,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 877,
+    "loss": 0.5715024471282959,
+    "diagonal_ce": 0.5495897531509399,
+    "finite": 0.021912680938839912,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 878,
+    "loss": 0.554183840751648,
+    "diagonal_ce": 0.5272164940834045,
+    "finite": 0.02696734294295311,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 879,
+    "loss": 0.45032840967178345,
+    "diagonal_ce": 0.41994595527648926,
+    "finite": 0.030382443219423294,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 880,
+    "loss": 0.5344918370246887,
+    "diagonal_ce": 0.5151023268699646,
+    "finite": 0.019389521330595016,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 881,
+    "loss": 0.7323041558265686,
+    "diagonal_ce": 0.6947628855705261,
+    "finite": 0.03754127770662308,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 882,
+    "loss": 0.5196437239646912,
+    "diagonal_ce": 0.5073122978210449,
+    "finite": 0.01233145222067833,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 883,
+    "loss": 0.4547305107116699,
+    "diagonal_ce": 0.4349305331707001,
+    "finite": 0.0197999719530344,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 884,
+    "loss": 0.4511018395423889,
+    "diagonal_ce": 0.4290560781955719,
+    "finite": 0.02204575575888157,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 885,
+    "loss": 0.40761783719062805,
+    "diagonal_ce": 0.3949839472770691,
+    "finite": 0.012633882462978363,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 886,
+    "loss": 0.7450606822967529,
+    "diagonal_ce": 0.7158386707305908,
+    "finite": 0.0292220376431942,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 887,
+    "loss": 0.45695939660072327,
+    "diagonal_ce": 0.43758198618888855,
+    "finite": 0.01937740296125412,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 888,
+    "loss": 0.4102703034877777,
+    "diagonal_ce": 0.3772238790988922,
+    "finite": 0.03304643556475639,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 889,
+    "loss": 0.5402452945709229,
+    "diagonal_ce": 0.5203805565834045,
+    "finite": 0.0198647640645504,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 890,
+    "loss": 0.4657187759876251,
+    "diagonal_ce": 0.44375696778297424,
+    "finite": 0.02196180447936058,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 891,
+    "loss": 0.5003225803375244,
+    "diagonal_ce": 0.4700784385204315,
+    "finite": 0.030244166031479836,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 892,
+    "loss": 0.5705115795135498,
+    "diagonal_ce": 0.5400265455245972,
+    "finite": 0.03048502840101719,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 893,
+    "loss": 0.485396146774292,
+    "diagonal_ce": 0.47002488374710083,
+    "finite": 0.015371275134384632,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 894,
+    "loss": 0.5726713538169861,
+    "diagonal_ce": 0.5468692779541016,
+    "finite": 0.02580205351114273,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 895,
+    "loss": 0.5853931307792664,
+    "diagonal_ce": 0.5669130682945251,
+    "finite": 0.01848004385828972,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 896,
+    "loss": 0.41981691122055054,
+    "diagonal_ce": 0.40366119146347046,
+    "finite": 0.01615571789443493,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 897,
+    "loss": 0.4831574261188507,
+    "diagonal_ce": 0.46520179510116577,
+    "finite": 0.01795562170445919,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 898,
+    "loss": 0.44368699193000793,
+    "diagonal_ce": 0.42141857743263245,
+    "finite": 0.02226841263473034,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 899,
+    "loss": 0.5734885334968567,
+    "diagonal_ce": 0.5516678094863892,
+    "finite": 0.021820727735757828,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 900,
+    "loss": 0.5325654745101929,
+    "diagonal_ce": 0.5116254091262817,
+    "finite": 0.02094004675745964,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 901,
+    "loss": 0.6036251783370972,
+    "diagonal_ce": 0.5784999132156372,
+    "finite": 0.02512524463236332,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 902,
+    "loss": 0.618726372718811,
+    "diagonal_ce": 0.5885629057884216,
+    "finite": 0.030163487419486046,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 903,
+    "loss": 0.5931383967399597,
+    "diagonal_ce": 0.5727478265762329,
+    "finite": 0.0203905887901783,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 904,
+    "loss": 0.6805710196495056,
+    "diagonal_ce": 0.6662841439247131,
+    "finite": 0.014286903664469719,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 905,
+    "loss": 0.8202154040336609,
+    "diagonal_ce": 0.7992514371871948,
+    "finite": 0.02096395380795002,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 906,
+    "loss": 0.5873478055000305,
+    "diagonal_ce": 0.5712869763374329,
+    "finite": 0.01606081798672676,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 907,
+    "loss": 0.37785768508911133,
+    "diagonal_ce": 0.3570358157157898,
+    "finite": 0.02082187682390213,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 908,
+    "loss": 0.431032657623291,
+    "diagonal_ce": 0.4179682731628418,
+    "finite": 0.01306439284235239,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 909,
+    "loss": 0.7075389623641968,
+    "diagonal_ce": 0.6851628422737122,
+    "finite": 0.02237614430487156,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 910,
+    "loss": 0.4640948474407196,
+    "diagonal_ce": 0.44820475578308105,
+    "finite": 0.0158900935202837,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 911,
+    "loss": 0.6250128746032715,
+    "diagonal_ce": 0.5943713784217834,
+    "finite": 0.030641483142971992,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 912,
+    "loss": 0.6958544254302979,
+    "diagonal_ce": 0.6535726189613342,
+    "finite": 0.04228179529309273,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 913,
+    "loss": 0.6510277390480042,
+    "diagonal_ce": 0.6307699680328369,
+    "finite": 0.02025776170194149,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 914,
+    "loss": 0.5013381838798523,
+    "diagonal_ce": 0.47570300102233887,
+    "finite": 0.02563520334661007,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 915,
+    "loss": 0.7849375009536743,
+    "diagonal_ce": 0.7465534210205078,
+    "finite": 0.0383840873837471,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 916,
+    "loss": 0.5437095761299133,
+    "diagonal_ce": 0.506415843963623,
+    "finite": 0.037293754518032074,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 917,
+    "loss": 0.3832581341266632,
+    "diagonal_ce": 0.36790287494659424,
+    "finite": 0.015355246141552925,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 918,
+    "loss": 0.5271069407463074,
+    "diagonal_ce": 0.5049093961715698,
+    "finite": 0.022197561338543892,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 919,
+    "loss": 0.5030472874641418,
+    "diagonal_ce": 0.48513492941856384,
+    "finite": 0.017912358045578003,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 920,
+    "loss": 0.49985024333000183,
+    "diagonal_ce": 0.4793272614479065,
+    "finite": 0.020522968843579292,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 921,
+    "loss": 0.5322801470756531,
+    "diagonal_ce": 0.510388195514679,
+    "finite": 0.02189197577536106,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 922,
+    "loss": 0.607306182384491,
+    "diagonal_ce": 0.5917044281959534,
+    "finite": 0.015601727180182934,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 923,
+    "loss": 0.5742857456207275,
+    "diagonal_ce": 0.5601059198379517,
+    "finite": 0.014179798774421215,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 924,
+    "loss": 0.771300196647644,
+    "diagonal_ce": 0.731120765209198,
+    "finite": 0.04017942026257515,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 925,
+    "loss": 0.683904230594635,
+    "diagonal_ce": 0.6640129685401917,
+    "finite": 0.01989123784005642,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 926,
+    "loss": 0.4187425673007965,
+    "diagonal_ce": 0.3920857012271881,
+    "finite": 0.026656854897737503,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 927,
+    "loss": 0.6102643013000488,
+    "diagonal_ce": 0.5664534568786621,
+    "finite": 0.043810829520225525,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 928,
+    "loss": 0.6756588816642761,
+    "diagonal_ce": 0.6506849527359009,
+    "finite": 0.024973943829536438,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 929,
+    "loss": 0.5712452530860901,
+    "diagonal_ce": 0.544911801815033,
+    "finite": 0.026333436369895935,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 930,
+    "loss": 0.6242753863334656,
+    "diagonal_ce": 0.6022234559059143,
+    "finite": 0.022051921114325523,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 931,
+    "loss": 0.6498751640319824,
+    "diagonal_ce": 0.6188488602638245,
+    "finite": 0.03102627396583557,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 932,
+    "loss": 0.5805134177207947,
+    "diagonal_ce": 0.5677736401557922,
+    "finite": 0.012739748694002628,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 933,
+    "loss": 0.6030794978141785,
+    "diagonal_ce": 0.5757375359535217,
+    "finite": 0.027341989800333977,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 934,
+    "loss": 0.5481701493263245,
+    "diagonal_ce": 0.5362383127212524,
+    "finite": 0.011931860819458961,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 935,
+    "loss": 0.49525755643844604,
+    "diagonal_ce": 0.4793650507926941,
+    "finite": 0.015892501920461655,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 936,
+    "loss": 0.518965482711792,
+    "diagonal_ce": 0.503728985786438,
+    "finite": 0.015236488543450832,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 937,
+    "loss": 0.5197223424911499,
+    "diagonal_ce": 0.5086443424224854,
+    "finite": 0.01107802614569664,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 938,
+    "loss": 0.47528085112571716,
+    "diagonal_ce": 0.4536189138889313,
+    "finite": 0.021661944687366486,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 939,
+    "loss": 0.5751881003379822,
+    "diagonal_ce": 0.5560173392295837,
+    "finite": 0.01917073503136635,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 940,
+    "loss": 0.6752945184707642,
+    "diagonal_ce": 0.6472834944725037,
+    "finite": 0.02801104448735714,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 941,
+    "loss": 0.7113932371139526,
+    "diagonal_ce": 0.6941270232200623,
+    "finite": 0.01726621575653553,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 942,
+    "loss": 0.6027950048446655,
+    "diagonal_ce": 0.5799164175987244,
+    "finite": 0.022878557443618774,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 943,
+    "loss": 0.6226018071174622,
+    "diagonal_ce": 0.5882090330123901,
+    "finite": 0.034392766654491425,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 944,
+    "loss": 0.5356345176696777,
+    "diagonal_ce": 0.516076385974884,
+    "finite": 0.019558148458600044,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 945,
+    "loss": 0.6910940408706665,
+    "diagonal_ce": 0.665909469127655,
+    "finite": 0.025184599682688713,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 946,
+    "loss": 0.48610126972198486,
+    "diagonal_ce": 0.4690795838832855,
+    "finite": 0.017021680250763893,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 947,
+    "loss": 0.47220438718795776,
+    "diagonal_ce": 0.4481837749481201,
+    "finite": 0.024020617827773094,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 948,
+    "loss": 0.6611101627349854,
+    "diagonal_ce": 0.6365684270858765,
+    "finite": 0.02454173006117344,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 949,
+    "loss": 0.3474770784378052,
+    "diagonal_ce": 0.32069316506385803,
+    "finite": 0.026783915236592293,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 950,
+    "loss": 0.6471576690673828,
+    "diagonal_ce": 0.6227415800094604,
+    "finite": 0.024416066706180573,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 951,
+    "loss": 0.6613496541976929,
+    "diagonal_ce": 0.6429504156112671,
+    "finite": 0.018399247899651527,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 952,
+    "loss": 0.4505833089351654,
+    "diagonal_ce": 0.42598408460617065,
+    "finite": 0.02459922805428505,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 953,
+    "loss": 0.6013648509979248,
+    "diagonal_ce": 0.5781534910202026,
+    "finite": 0.023211343213915825,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 954,
+    "loss": 0.6797902584075928,
+    "diagonal_ce": 0.65212482213974,
+    "finite": 0.027665413916110992,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 955,
+    "loss": 0.5178916454315186,
+    "diagonal_ce": 0.4983413517475128,
+    "finite": 0.019550267606973648,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 956,
+    "loss": 0.5710849165916443,
+    "diagonal_ce": 0.5491987466812134,
+    "finite": 0.021886147558689117,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 957,
+    "loss": 0.48128369450569153,
+    "diagonal_ce": 0.46129947900772095,
+    "finite": 0.019984222948551178,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 958,
+    "loss": 0.6149168610572815,
+    "diagonal_ce": 0.5976653695106506,
+    "finite": 0.017251502722501755,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 959,
+    "loss": 0.6310409903526306,
+    "diagonal_ce": 0.6141537427902222,
+    "finite": 0.01688724011182785,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 960,
+    "loss": 0.6732026934623718,
+    "diagonal_ce": 0.6398649215698242,
+    "finite": 0.0333377830684185,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 961,
+    "loss": 0.6948805451393127,
+    "diagonal_ce": 0.6771823763847351,
+    "finite": 0.017698148265480995,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 962,
+    "loss": 0.47064515948295593,
+    "diagonal_ce": 0.44960492849349976,
+    "finite": 0.021040242165327072,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 963,
+    "loss": 0.6006948947906494,
+    "diagonal_ce": 0.5749710202217102,
+    "finite": 0.025723896920681,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 964,
+    "loss": 0.5827991366386414,
+    "diagonal_ce": 0.5437201857566833,
+    "finite": 0.03907894715666771,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 965,
+    "loss": 0.5025697350502014,
+    "diagonal_ce": 0.48045384883880615,
+    "finite": 0.022115880623459816,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 966,
+    "loss": 0.6127169728279114,
+    "diagonal_ce": 0.591763436794281,
+    "finite": 0.02095351740717888,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 967,
+    "loss": 0.5258904099464417,
+    "diagonal_ce": 0.4966822862625122,
+    "finite": 0.02920813485980034,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 968,
+    "loss": 0.4837932586669922,
+    "diagonal_ce": 0.4627567231655121,
+    "finite": 0.021036531776189804,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 969,
+    "loss": 0.5422194600105286,
+    "diagonal_ce": 0.5140296220779419,
+    "finite": 0.028189847245812416,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 970,
+    "loss": 0.4502159059047699,
+    "diagonal_ce": 0.43150782585144043,
+    "finite": 0.018708081915974617,
+    "denominator_clamp_fraction": 0.0036057692486792803
+  },
+  {
+    "step": 971,
+    "loss": 0.6789350509643555,
+    "diagonal_ce": 0.6348596215248108,
+    "finite": 0.044075433164834976,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 972,
+    "loss": 0.6780048608779907,
+    "diagonal_ce": 0.6374091506004333,
+    "finite": 0.040595728904008865,
+    "denominator_clamp_fraction": 0.003004807746037841
+  },
+  {
+    "step": 973,
+    "loss": 0.6332203149795532,
+    "diagonal_ce": 0.6097506284713745,
+    "finite": 0.02346966601908207,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 974,
+    "loss": 0.6097824573516846,
+    "diagonal_ce": 0.5838267207145691,
+    "finite": 0.025955740362405777,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 975,
+    "loss": 0.6320362091064453,
+    "diagonal_ce": 0.5891642570495605,
+    "finite": 0.04287195950746536,
+    "denominator_clamp_fraction": 0.0033052884973585606
+  },
+  {
+    "step": 976,
+    "loss": 0.8230292797088623,
+    "diagonal_ce": 0.7757126092910767,
+    "finite": 0.047316644340753555,
+    "denominator_clamp_fraction": 0.0024038462433964014
+  },
+  {
+    "step": 977,
+    "loss": 0.494777113199234,
+    "diagonal_ce": 0.48264068365097046,
+    "finite": 0.012136416509747505,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 978,
+    "loss": 0.628568708896637,
+    "diagonal_ce": 0.6091159582138062,
+    "finite": 0.019452769309282303,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 979,
+    "loss": 0.6846625804901123,
+    "diagonal_ce": 0.6568242311477661,
+    "finite": 0.027838367968797684,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 980,
+    "loss": 0.3105844557285309,
+    "diagonal_ce": 0.2870241403579712,
+    "finite": 0.023560307919979095,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 981,
+    "loss": 0.4735328257083893,
+    "diagonal_ce": 0.4500899910926819,
+    "finite": 0.023442823439836502,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 982,
+    "loss": 0.4417276978492737,
+    "diagonal_ce": 0.3998929560184479,
+    "finite": 0.04183473438024521,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 983,
+    "loss": 0.7347345352172852,
+    "diagonal_ce": 0.6930587887763977,
+    "finite": 0.04167577624320984,
+    "denominator_clamp_fraction": 0.002704326994717121
+  },
+  {
+    "step": 984,
+    "loss": 0.4801180958747864,
+    "diagonal_ce": 0.46859368681907654,
+    "finite": 0.011524408124387264,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 985,
+    "loss": 0.5558499097824097,
+    "diagonal_ce": 0.5285478830337524,
+    "finite": 0.027302000671625137,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 986,
+    "loss": 0.46247556805610657,
+    "diagonal_ce": 0.4223218262195587,
+    "finite": 0.04015375301241875,
+    "denominator_clamp_fraction": 0.0015024038730189204
+  },
+  {
+    "step": 987,
+    "loss": 0.6719669103622437,
+    "diagonal_ce": 0.644607424736023,
+    "finite": 0.027359502390027046,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 988,
+    "loss": 0.6148054599761963,
+    "diagonal_ce": 0.589257538318634,
+    "finite": 0.025547947734594345,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  },
+  {
+    "step": 989,
+    "loss": 0.48576292395591736,
+    "diagonal_ce": 0.4638049304485321,
+    "finite": 0.021957993507385254,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 990,
+    "loss": 0.47747811675071716,
+    "diagonal_ce": 0.45061734318733215,
+    "finite": 0.026860781013965607,
+    "denominator_clamp_fraction": 0.0012019231216982007
+  },
+  {
+    "step": 991,
+    "loss": 0.64714515209198,
+    "diagonal_ce": 0.6220496892929077,
+    "finite": 0.025095481425523758,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 992,
+    "loss": 0.48300206661224365,
+    "diagonal_ce": 0.4555726647377014,
+    "finite": 0.027429403737187386,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 993,
+    "loss": 0.7973770499229431,
+    "diagonal_ce": 0.7753204107284546,
+    "finite": 0.022056635469198227,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 994,
+    "loss": 0.6123725175857544,
+    "diagonal_ce": 0.5820583701133728,
+    "finite": 0.030314119532704353,
+    "denominator_clamp_fraction": 0.0018028846243396401
+  },
+  {
+    "step": 995,
+    "loss": 0.5834636092185974,
+    "diagonal_ce": 0.5598469376564026,
+    "finite": 0.023616693913936615,
+    "denominator_clamp_fraction": 0.0003004807804245502
+  },
+  {
+    "step": 996,
+    "loss": 0.5515056252479553,
+    "diagonal_ce": 0.521996021270752,
+    "finite": 0.02950960583984852,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 997,
+    "loss": 0.44611048698425293,
+    "diagonal_ce": 0.4188399910926819,
+    "finite": 0.027270494028925896,
+    "denominator_clamp_fraction": 0.0009014423121698201
+  },
+  {
+    "step": 998,
+    "loss": 0.6524769067764282,
+    "diagonal_ce": 0.6286444664001465,
+    "finite": 0.023832449689507484,
+    "denominator_clamp_fraction": 0.0006009615608491004
+  },
+  {
+    "step": 999,
+    "loss": 0.5620855093002319,
+    "diagonal_ce": 0.5271346569061279,
+    "finite": 0.0349508598446846,
+    "denominator_clamp_fraction": 0.0021033654920756817
+  }
+]
diff --git a/lecture_6/verified_examples/discrete-esd/report.json b/lecture_6/verified_examples/discrete-esd/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..621147403d1e9d536ec0a204553d65308a418ec4
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-esd/report.json
@@ -0,0 +1,19 @@
+{
+  "method": "discrete-esd",
+  "data_kind": "synthetic-text",
+  "train_loss_first_20_mean": 2.4726498126983643,
+  "train_loss_last_20_mean": 0.5522287711501122,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "heldout_diagonal_ce_at_half_time": 0.4571278393268585,
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "unique_fraction": 0.03125,
+  "token_entropy": 2.413414239883423,
+  "mean_length": 4.0,
+  "empty_fraction": 0.0,
+  "training_support_fraction": 1.0,
+  "elapsed_seconds": 4.619678268994903
+}
diff --git a/lecture_6/verified_examples/discrete-esd/samples.txt b/lecture_6/verified_examples/discrete-esd/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..2074e254174c5f009332e8409fe783ee1969e485
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-esd/samples.txt
@@ -0,0 +1,128 @@
+gold star moves down
+blue square moves right
+gold star moves down
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+gold star moves down
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+green triangle moves up
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+blue square moves right
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+red circle moves left
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+red circle moves left
+red circle moves left
+red circle moves left
+gold star moves down
+green triangle moves up
+blue square moves right
+gold star moves down
+green triangle moves up
+red circle moves left
+gold star moves down
+red circle moves left
+green triangle moves up
+red circle moves left
+red circle moves left
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+red circle moves left
+green triangle moves up
+gold star moves down
+gold star moves down
diff --git a/lecture_6/verified_examples/discrete-lsd/config.json b/lecture_6/verified_examples/discrete-lsd/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..7d5e4f4625f5c93e5034e76af4807861b5e45309
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-lsd/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "discrete-lsd",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/discrete-lsd"
+}
diff --git a/lecture_6/verified_examples/discrete-lsd/losses.json b/lecture_6/verified_examples/discrete-lsd/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..9997d8d0687baab0aeca8116f8ef60754d44d104
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-lsd/losses.json
@@ -0,0 +1,7002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.5544073581695557,
+    "diagonal_ce": 2.5544071197509766,
+    "finite": 7.414323044940829e-05,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 1,
+    "loss": 2.542590379714966,
+    "diagonal_ce": 2.5425896644592285,
+    "finite": 8.07336182333529e-05,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 2,
+    "loss": 2.534853219985962,
+    "diagonal_ce": 2.5348520278930664,
+    "finite": 0.00010454317089170218,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 3,
+    "loss": 2.5357630252838135,
+    "diagonal_ce": 2.5357601642608643,
+    "finite": 0.00017265643691644073,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 4,
+    "loss": 2.5233585834503174,
+    "diagonal_ce": 2.5233542919158936,
+    "finite": 0.0002104247105307877,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 5,
+    "loss": 2.513707399368286,
+    "diagonal_ce": 2.513700485229492,
+    "finite": 0.00028352090157568455,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 6,
+    "loss": 2.504714250564575,
+    "diagonal_ce": 2.5047028064727783,
+    "finite": 0.00040512997657060623,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 7,
+    "loss": 2.500147819519043,
+    "diagonal_ce": 2.5001327991485596,
+    "finite": 0.0004671127535402775,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 8,
+    "loss": 2.487760305404663,
+    "diagonal_ce": 2.487739086151123,
+    "finite": 0.0005867509753443301,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 9,
+    "loss": 2.485203266143799,
+    "diagonal_ce": 2.485175132751465,
+    "finite": 0.0007008006796240807,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 10,
+    "loss": 2.4705004692077637,
+    "diagonal_ce": 2.470461845397949,
+    "finite": 0.0008781706565059721,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 11,
+    "loss": 2.4671878814697266,
+    "diagonal_ce": 2.4671378135681152,
+    "finite": 0.0010441243648529053,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 12,
+    "loss": 2.457261085510254,
+    "diagonal_ce": 2.457195281982422,
+    "finite": 0.0012667679693549871,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 13,
+    "loss": 2.441525936126709,
+    "diagonal_ce": 2.4414384365081787,
+    "finite": 0.0015625354135408998,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 14,
+    "loss": 2.4346516132354736,
+    "diagonal_ce": 2.434540033340454,
+    "finite": 0.0018590583931654692,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 15,
+    "loss": 2.4232497215270996,
+    "diagonal_ce": 2.4231085777282715,
+    "finite": 0.002205805853009224,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 16,
+    "loss": 2.4119036197662354,
+    "diagonal_ce": 2.411724328994751,
+    "finite": 0.002635890617966652,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 17,
+    "loss": 2.3990659713745117,
+    "diagonal_ce": 2.398834228515625,
+    "finite": 0.003218155587092042,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 18,
+    "loss": 2.3888442516326904,
+    "diagonal_ce": 2.3885602951049805,
+    "finite": 0.0037356822285801172,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 19,
+    "loss": 2.3752763271331787,
+    "diagonal_ce": 2.374926805496216,
+    "finite": 0.004370275419205427,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 20,
+    "loss": 2.3706445693969727,
+    "diagonal_ce": 2.3702311515808105,
+    "finite": 0.004920412320643663,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 21,
+    "loss": 2.356461763381958,
+    "diagonal_ce": 2.3559770584106445,
+    "finite": 0.005508096423000097,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 22,
+    "loss": 2.3378121852874756,
+    "diagonal_ce": 2.3371741771698,
+    "finite": 0.006933967582881451,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 23,
+    "loss": 2.327186346054077,
+    "diagonal_ce": 2.326476573944092,
+    "finite": 0.007393903564661741,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 24,
+    "loss": 2.3008010387420654,
+    "diagonal_ce": 2.2998578548431396,
+    "finite": 0.00943172350525856,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 25,
+    "loss": 2.2938759326934814,
+    "diagonal_ce": 2.292843818664551,
+    "finite": 0.009924178943037987,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 26,
+    "loss": 2.2555806636810303,
+    "diagonal_ce": 2.2540903091430664,
+    "finite": 0.013799409382045269,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 27,
+    "loss": 2.2412474155426025,
+    "diagonal_ce": 2.239502191543579,
+    "finite": 0.015582602471113205,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 28,
+    "loss": 2.201404094696045,
+    "diagonal_ce": 2.1991841793060303,
+    "finite": 0.019136663526296616,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 29,
+    "loss": 2.2075886726379395,
+    "diagonal_ce": 2.205249786376953,
+    "finite": 0.019490256905555725,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 30,
+    "loss": 2.1460494995117188,
+    "diagonal_ce": 2.1427743434906006,
+    "finite": 0.026413053274154663,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 31,
+    "loss": 2.1472530364990234,
+    "diagonal_ce": 2.143584966659546,
+    "finite": 0.028656423091888428,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 32,
+    "loss": 2.1092309951782227,
+    "diagonal_ce": 2.1046128273010254,
+    "finite": 0.03498631715774536,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 33,
+    "loss": 2.079475164413452,
+    "diagonal_ce": 2.0738017559051514,
+    "finite": 0.04171571135520935,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 34,
+    "loss": 2.050854206085205,
+    "diagonal_ce": 2.0439507961273193,
+    "finite": 0.04931054264307022,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 35,
+    "loss": 2.04229736328125,
+    "diagonal_ce": 2.034581184387207,
+    "finite": 0.053584542125463486,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 36,
+    "loss": 2.0184478759765625,
+    "diagonal_ce": 2.009314775466919,
+    "finite": 0.06170943006873131,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 37,
+    "loss": 1.9800347089767456,
+    "diagonal_ce": 1.9689583778381348,
+    "finite": 0.07287049293518066,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 38,
+    "loss": 1.9088584184646606,
+    "diagonal_ce": 1.894476294517517,
+    "finite": 0.09219284355640411,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 39,
+    "loss": 1.9082903861999512,
+    "diagonal_ce": 1.8925031423568726,
+    "finite": 0.09867030382156372,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 40,
+    "loss": 1.8908137083053589,
+    "diagonal_ce": 1.8741017580032349,
+    "finite": 0.10190221667289734,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 41,
+    "loss": 1.8361495733261108,
+    "diagonal_ce": 1.8138107061386108,
+    "finite": 0.1329692006111145,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 42,
+    "loss": 1.8141032457351685,
+    "diagonal_ce": 1.7884637117385864,
+    "finite": 0.14906710386276245,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 43,
+    "loss": 1.809645175933838,
+    "diagonal_ce": 1.7808970212936401,
+    "finite": 0.16334152221679688,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 44,
+    "loss": 1.7460062503814697,
+    "diagonal_ce": 1.7092082500457764,
+    "finite": 0.2044331282377243,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 45,
+    "loss": 1.6741695404052734,
+    "diagonal_ce": 1.6283830404281616,
+    "finite": 0.24883952736854553,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 46,
+    "loss": 1.6496927738189697,
+    "diagonal_ce": 1.5958921909332275,
+    "finite": 0.28617358207702637,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 47,
+    "loss": 1.6681514978408813,
+    "diagonal_ce": 1.6134817600250244,
+    "finite": 0.28473809361457825,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 48,
+    "loss": 1.6370837688446045,
+    "diagonal_ce": 1.5697615146636963,
+    "finite": 0.34348082542419434,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 49,
+    "loss": 1.621133804321289,
+    "diagonal_ce": 1.5447715520858765,
+    "finite": 0.381811261177063,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 50,
+    "loss": 1.5492377281188965,
+    "diagonal_ce": 1.4588170051574707,
+    "finite": 0.443238765001297,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 51,
+    "loss": 1.5260953903198242,
+    "diagonal_ce": 1.415706992149353,
+    "finite": 0.5307136178016663,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 52,
+    "loss": 1.5233832597732544,
+    "diagonal_ce": 1.4098963737487793,
+    "finite": 0.5353152751922607,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 53,
+    "loss": 1.5142360925674438,
+    "diagonal_ce": 1.3931643962860107,
+    "finite": 0.5605169534683228,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 54,
+    "loss": 1.510205626487732,
+    "diagonal_ce": 1.3665897846221924,
+    "finite": 0.6527993679046631,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 55,
+    "loss": 1.506030559539795,
+    "diagonal_ce": 1.3553072214126587,
+    "finite": 0.6728718876838684,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 56,
+    "loss": 1.5199179649353027,
+    "diagonal_ce": 1.3589552640914917,
+    "finite": 0.7059767842292786,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 57,
+    "loss": 1.5041568279266357,
+    "diagonal_ce": 1.3186928033828735,
+    "finite": 0.7994137406349182,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 58,
+    "loss": 1.4713553190231323,
+    "diagonal_ce": 1.2587890625,
+    "finite": 0.9007043838500977,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 59,
+    "loss": 1.4942489862442017,
+    "diagonal_ce": 1.2667356729507446,
+    "finite": 0.9479721188545227,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 60,
+    "loss": 1.5015597343444824,
+    "diagonal_ce": 1.2859760522842407,
+    "finite": 0.8835394382476807,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 61,
+    "loss": 1.4813268184661865,
+    "diagonal_ce": 1.2446305751800537,
+    "finite": 0.9544202089309692,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 62,
+    "loss": 1.5213172435760498,
+    "diagonal_ce": 1.3009815216064453,
+    "finite": 0.8743479251861572,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 63,
+    "loss": 1.501665472984314,
+    "diagonal_ce": 1.2339529991149902,
+    "finite": 1.045751929283142,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 64,
+    "loss": 1.4914122819900513,
+    "diagonal_ce": 1.188820481300354,
+    "finite": 1.163814663887024,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 65,
+    "loss": 1.5240520238876343,
+    "diagonal_ce": 1.2532099485397339,
+    "finite": 1.0259168148040771,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 66,
+    "loss": 1.5044760704040527,
+    "diagonal_ce": 1.2052290439605713,
+    "finite": 1.1165934801101685,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 67,
+    "loss": 1.506641149520874,
+    "diagonal_ce": 1.215122103691101,
+    "finite": 1.071761131286621,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 68,
+    "loss": 1.5061619281768799,
+    "diagonal_ce": 1.1926589012145996,
+    "finite": 1.1358803510665894,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 69,
+    "loss": 1.4768824577331543,
+    "diagonal_ce": 1.1677550077438354,
+    "finite": 1.104026436805725,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 70,
+    "loss": 1.4912769794464111,
+    "diagonal_ce": 1.1903713941574097,
+    "finite": 1.059526801109314,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 71,
+    "loss": 1.4984673261642456,
+    "diagonal_ce": 1.2050094604492188,
+    "finite": 1.0189508199691772,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 72,
+    "loss": 1.5360058546066284,
+    "diagonal_ce": 1.2079018354415894,
+    "finite": 1.1236438751220703,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 73,
+    "loss": 1.4840693473815918,
+    "diagonal_ce": 1.1956663131713867,
+    "finite": 0.9743346571922302,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 74,
+    "loss": 1.4756853580474854,
+    "diagonal_ce": 1.1694111824035645,
+    "finite": 1.020914077758789,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 75,
+    "loss": 1.4622828960418701,
+    "diagonal_ce": 1.1605494022369385,
+    "finite": 0.9925443530082703,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 76,
+    "loss": 1.4866771697998047,
+    "diagonal_ce": 1.208681344985962,
+    "finite": 0.9025837182998657,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 77,
+    "loss": 1.4823710918426514,
+    "diagonal_ce": 1.1553744077682495,
+    "finite": 1.0480661392211914,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 78,
+    "loss": 1.4823827743530273,
+    "diagonal_ce": 1.2132163047790527,
+    "finite": 0.8517924547195435,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 79,
+    "loss": 1.4909390211105347,
+    "diagonal_ce": 1.2256388664245605,
+    "finite": 0.8290629982948303,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 80,
+    "loss": 1.4576464891433716,
+    "diagonal_ce": 1.203162670135498,
+    "finite": 0.7854439616203308,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 81,
+    "loss": 1.4603753089904785,
+    "diagonal_ce": 1.2082645893096924,
+    "finite": 0.76863032579422,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 82,
+    "loss": 1.4656362533569336,
+    "diagonal_ce": 1.222625494003296,
+    "finite": 0.7319602966308594,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 83,
+    "loss": 1.454124093055725,
+    "diagonal_ce": 1.211713433265686,
+    "finite": 0.7214601635932922,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 84,
+    "loss": 1.4511971473693848,
+    "diagonal_ce": 1.2173538208007812,
+    "finite": 0.6877743005752563,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 85,
+    "loss": 1.4274036884307861,
+    "diagonal_ce": 1.1926912069320679,
+    "finite": 0.6823037266731262,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 86,
+    "loss": 1.4310897588729858,
+    "diagonal_ce": 1.216354489326477,
+    "finite": 0.6170554757118225,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 87,
+    "loss": 1.4234950542449951,
+    "diagonal_ce": 1.1889472007751465,
+    "finite": 0.666329026222229,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 88,
+    "loss": 1.423721194267273,
+    "diagonal_ce": 1.2044543027877808,
+    "finite": 0.6159182190895081,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 89,
+    "loss": 1.4428784847259521,
+    "diagonal_ce": 1.2390999794006348,
+    "finite": 0.5660514831542969,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 90,
+    "loss": 1.4676531553268433,
+    "diagonal_ce": 1.2722163200378418,
+    "finite": 0.5369142889976501,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 91,
+    "loss": 1.4275743961334229,
+    "diagonal_ce": 1.2196717262268066,
+    "finite": 0.5649529695510864,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 92,
+    "loss": 1.4119744300842285,
+    "diagonal_ce": 1.2093298435211182,
+    "finite": 0.5447433590888977,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 93,
+    "loss": 1.4453119039535522,
+    "diagonal_ce": 1.2443583011627197,
+    "finite": 0.5344511270523071,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 94,
+    "loss": 1.4292923212051392,
+    "diagonal_ce": 1.2218601703643799,
+    "finite": 0.5458741784095764,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 95,
+    "loss": 1.405745506286621,
+    "diagonal_ce": 1.2151949405670166,
+    "finite": 0.49622538685798645,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 96,
+    "loss": 1.3912153244018555,
+    "diagonal_ce": 1.1960148811340332,
+    "finite": 0.503093957901001,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 97,
+    "loss": 1.4164844751358032,
+    "diagonal_ce": 1.2190427780151367,
+    "finite": 0.5036777853965759,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 98,
+    "loss": 1.4192882776260376,
+    "diagonal_ce": 1.2175840139389038,
+    "finite": 0.5093542337417603,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 99,
+    "loss": 1.4280937910079956,
+    "diagonal_ce": 1.2339712381362915,
+    "finite": 0.4853063225746155,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 100,
+    "loss": 1.4102346897125244,
+    "diagonal_ce": 1.2127872705459595,
+    "finite": 0.48873135447502136,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 101,
+    "loss": 1.4406869411468506,
+    "diagonal_ce": 1.2475794553756714,
+    "finite": 0.4733026921749115,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 102,
+    "loss": 1.4032676219940186,
+    "diagonal_ce": 1.203666090965271,
+    "finite": 0.4844696521759033,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 103,
+    "loss": 1.4196221828460693,
+    "diagonal_ce": 1.2136342525482178,
+    "finite": 0.49516332149505615,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 104,
+    "loss": 1.4096262454986572,
+    "diagonal_ce": 1.2135337591171265,
+    "finite": 0.4668867588043213,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 105,
+    "loss": 1.3777823448181152,
+    "diagonal_ce": 1.175516128540039,
+    "finite": 0.4770428240299225,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 106,
+    "loss": 1.413235068321228,
+    "diagonal_ce": 1.219329833984375,
+    "finite": 0.4530496597290039,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 107,
+    "loss": 1.3822838068008423,
+    "diagonal_ce": 1.1784299612045288,
+    "finite": 0.47188395261764526,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 108,
+    "loss": 1.36844801902771,
+    "diagonal_ce": 1.159440279006958,
+    "finite": 0.47937557101249695,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 109,
+    "loss": 1.375396490097046,
+    "diagonal_ce": 1.1754512786865234,
+    "finite": 0.4544209837913513,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 110,
+    "loss": 1.3503261804580688,
+    "diagonal_ce": 1.145424246788025,
+    "finite": 0.4614908695220947,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 111,
+    "loss": 1.3622503280639648,
+    "diagonal_ce": 1.1611857414245605,
+    "finite": 0.44880473613739014,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 112,
+    "loss": 1.3810925483703613,
+    "diagonal_ce": 1.1843247413635254,
+    "finite": 0.43532705307006836,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 113,
+    "loss": 1.3561339378356934,
+    "diagonal_ce": 1.1453709602355957,
+    "finite": 0.4621993899345398,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 114,
+    "loss": 1.3505654335021973,
+    "diagonal_ce": 1.1465340852737427,
+    "finite": 0.44354626536369324,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 115,
+    "loss": 1.374405026435852,
+    "diagonal_ce": 1.176248550415039,
+    "finite": 0.4270613193511963,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 116,
+    "loss": 1.3801467418670654,
+    "diagonal_ce": 1.1739357709884644,
+    "finite": 0.44062182307243347,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 117,
+    "loss": 1.3511710166931152,
+    "diagonal_ce": 1.1526806354522705,
+    "finite": 0.4205305278301239,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 118,
+    "loss": 1.3631055355072021,
+    "diagonal_ce": 1.165698766708374,
+    "finite": 0.41472020745277405,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 119,
+    "loss": 1.3161838054656982,
+    "diagonal_ce": 1.109066128730774,
+    "finite": 0.4314951002597809,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 120,
+    "loss": 1.320153832435608,
+    "diagonal_ce": 1.1252647638320923,
+    "finite": 0.4026634097099304,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 121,
+    "loss": 1.3150303363800049,
+    "diagonal_ce": 1.1210427284240723,
+    "finite": 0.3975157141685486,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 122,
+    "loss": 1.3228713274002075,
+    "diagonal_ce": 1.1251579523086548,
+    "finite": 0.40185636281967163,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 123,
+    "loss": 1.3099758625030518,
+    "diagonal_ce": 1.1188546419143677,
+    "finite": 0.38532501459121704,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 124,
+    "loss": 1.305080533027649,
+    "diagonal_ce": 1.1031420230865479,
+    "finite": 0.40387704968452454,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 125,
+    "loss": 1.3582473993301392,
+    "diagonal_ce": 1.1682766675949097,
+    "finite": 0.3769260048866272,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 126,
+    "loss": 1.3629484176635742,
+    "diagonal_ce": 1.1688814163208008,
+    "finite": 0.3820216655731201,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 127,
+    "loss": 1.3099397420883179,
+    "diagonal_ce": 1.1177911758422852,
+    "finite": 0.3752902150154114,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 128,
+    "loss": 1.307471752166748,
+    "diagonal_ce": 1.115719199180603,
+    "finite": 0.371613472700119,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 129,
+    "loss": 1.2801485061645508,
+    "diagonal_ce": 1.089267611503601,
+    "finite": 0.36707866191864014,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 130,
+    "loss": 1.2880898714065552,
+    "diagonal_ce": 1.106244683265686,
+    "finite": 0.3470327854156494,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 131,
+    "loss": 1.283347249031067,
+    "diagonal_ce": 1.0973032712936401,
+    "finite": 0.3523560166358948,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 132,
+    "loss": 1.2913957834243774,
+    "diagonal_ce": 1.0978049039840698,
+    "finite": 0.3638925850391388,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 133,
+    "loss": 1.2704137563705444,
+    "diagonal_ce": 1.080816388130188,
+    "finite": 0.353726327419281,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 134,
+    "loss": 1.237006425857544,
+    "diagonal_ce": 1.0448888540267944,
+    "finite": 0.355773389339447,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 135,
+    "loss": 1.2602933645248413,
+    "diagonal_ce": 1.0782662630081177,
+    "finite": 0.33460867404937744,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 136,
+    "loss": 1.260636806488037,
+    "diagonal_ce": 1.0813539028167725,
+    "finite": 0.32715854048728943,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 137,
+    "loss": 1.2740349769592285,
+    "diagonal_ce": 1.0831432342529297,
+    "finite": 0.34581831097602844,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 138,
+    "loss": 1.2344551086425781,
+    "diagonal_ce": 1.0473995208740234,
+    "finite": 0.33643093705177307,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 139,
+    "loss": 1.1973837614059448,
+    "diagonal_ce": 1.0140396356582642,
+    "finite": 0.32740020751953125,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 140,
+    "loss": 1.2296497821807861,
+    "diagonal_ce": 1.0482141971588135,
+    "finite": 0.3216942250728607,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 141,
+    "loss": 1.2313644886016846,
+    "diagonal_ce": 1.0589216947555542,
+    "finite": 0.3035964369773865,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 142,
+    "loss": 1.2215917110443115,
+    "diagonal_ce": 1.0400422811508179,
+    "finite": 0.31739410758018494,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 143,
+    "loss": 1.1827154159545898,
+    "diagonal_ce": 1.0011835098266602,
+    "finite": 0.3151596188545227,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 144,
+    "loss": 1.198267936706543,
+    "diagonal_ce": 1.006665587425232,
+    "finite": 0.33034899830818176,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 145,
+    "loss": 1.227134346961975,
+    "diagonal_ce": 1.0486665964126587,
+    "finite": 0.3055955171585083,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 146,
+    "loss": 1.203201413154602,
+    "diagonal_ce": 1.0065029859542847,
+    "finite": 0.33452120423316956,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 147,
+    "loss": 1.1800310611724854,
+    "diagonal_ce": 0.9956310391426086,
+    "finite": 0.3114866316318512,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 148,
+    "loss": 1.1982600688934326,
+    "diagonal_ce": 1.0143458843231201,
+    "finite": 0.30858075618743896,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 149,
+    "loss": 1.1650162935256958,
+    "diagonal_ce": 0.9813677668571472,
+    "finite": 0.3060808777809143,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 150,
+    "loss": 1.1840180158615112,
+    "diagonal_ce": 0.9905954003334045,
+    "finite": 0.32023608684539795,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 151,
+    "loss": 1.2070398330688477,
+    "diagonal_ce": 1.0186975002288818,
+    "finite": 0.3097735643386841,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 152,
+    "loss": 1.154881238937378,
+    "diagonal_ce": 0.9741564989089966,
+    "finite": 0.29530179500579834,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 153,
+    "loss": 1.2135943174362183,
+    "diagonal_ce": 1.0247520208358765,
+    "finite": 0.3065620958805084,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 154,
+    "loss": 1.1679778099060059,
+    "diagonal_ce": 0.9636747241020203,
+    "finite": 0.329521119594574,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 155,
+    "loss": 1.1712626218795776,
+    "diagonal_ce": 0.9820570349693298,
+    "finite": 0.30321404337882996,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 156,
+    "loss": 1.0954443216323853,
+    "diagonal_ce": 0.9192827343940735,
+    "finite": 0.28051209449768066,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 157,
+    "loss": 1.1647018194198608,
+    "diagonal_ce": 0.9706659317016602,
+    "finite": 0.30701881647109985,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 158,
+    "loss": 1.17966890335083,
+    "diagonal_ce": 0.9873932600021362,
+    "finite": 0.3023202419281006,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 159,
+    "loss": 1.147477626800537,
+    "diagonal_ce": 0.9490615725517273,
+    "finite": 0.3100251257419586,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 160,
+    "loss": 1.151647925376892,
+    "diagonal_ce": 0.9768970012664795,
+    "finite": 0.2713523805141449,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 161,
+    "loss": 1.1144903898239136,
+    "diagonal_ce": 0.9326202273368835,
+    "finite": 0.28066378831863403,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 162,
+    "loss": 1.0716925859451294,
+    "diagonal_ce": 0.8984874486923218,
+    "finite": 0.26565200090408325,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 163,
+    "loss": 1.0665512084960938,
+    "diagonal_ce": 0.8851804733276367,
+    "finite": 0.2764797806739807,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 164,
+    "loss": 1.1064584255218506,
+    "diagonal_ce": 0.9311163425445557,
+    "finite": 0.26566991209983826,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 165,
+    "loss": 1.099156141281128,
+    "diagonal_ce": 0.9189281463623047,
+    "finite": 0.2714277505874634,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 166,
+    "loss": 1.1773133277893066,
+    "diagonal_ce": 0.9961541891098022,
+    "finite": 0.27119630575180054,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 167,
+    "loss": 1.0642966032028198,
+    "diagonal_ce": 0.8736442923545837,
+    "finite": 0.28370875120162964,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 168,
+    "loss": 1.125430941581726,
+    "diagonal_ce": 0.9458613991737366,
+    "finite": 0.26563534140586853,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 169,
+    "loss": 1.0885818004608154,
+    "diagonal_ce": 0.916221559047699,
+    "finite": 0.2534709572792053,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 170,
+    "loss": 1.148575782775879,
+    "diagonal_ce": 0.9695864319801331,
+    "finite": 0.26168039441108704,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 171,
+    "loss": 1.1173993349075317,
+    "diagonal_ce": 0.9364486336708069,
+    "finite": 0.2630096673965454,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 172,
+    "loss": 1.051477313041687,
+    "diagonal_ce": 0.8574039936065674,
+    "finite": 0.2804528474807739,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 173,
+    "loss": 1.1036258935928345,
+    "diagonal_ce": 0.9023423194885254,
+    "finite": 0.28920048475265503,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 174,
+    "loss": 1.1092286109924316,
+    "diagonal_ce": 0.9228226542472839,
+    "finite": 0.2662942707538605,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 175,
+    "loss": 1.0628244876861572,
+    "diagonal_ce": 0.8667789101600647,
+    "finite": 0.2784738540649414,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 176,
+    "loss": 1.1137030124664307,
+    "diagonal_ce": 0.9173123836517334,
+    "finite": 0.277387797832489,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 177,
+    "loss": 1.11945378780365,
+    "diagonal_ce": 0.937403678894043,
+    "finite": 0.2556883990764618,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 178,
+    "loss": 1.0316133499145508,
+    "diagonal_ce": 0.8412647843360901,
+    "finite": 0.2658499479293823,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 179,
+    "loss": 1.0222359895706177,
+    "diagonal_ce": 0.8246692419052124,
+    "finite": 0.27439820766448975,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 180,
+    "loss": 1.0825179815292358,
+    "diagonal_ce": 0.8582299947738647,
+    "finite": 0.3097899854183197,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 181,
+    "loss": 0.9559372663497925,
+    "diagonal_ce": 0.720490038394928,
+    "finite": 0.3234165608882904,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 182,
+    "loss": 1.0360023975372314,
+    "diagonal_ce": 0.8348591923713684,
+    "finite": 0.2747857868671417,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 183,
+    "loss": 0.9939725995063782,
+    "diagonal_ce": 0.7952297329902649,
+    "finite": 0.27003106474876404,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 184,
+    "loss": 1.1052651405334473,
+    "diagonal_ce": 0.9081714153289795,
+    "finite": 0.2663429379463196,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 185,
+    "loss": 1.1077724695205688,
+    "diagonal_ce": 0.9170810580253601,
+    "finite": 0.2563056945800781,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 186,
+    "loss": 1.009110689163208,
+    "diagonal_ce": 0.8209412693977356,
+    "finite": 0.2515633702278137,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 187,
+    "loss": 1.0684200525283813,
+    "diagonal_ce": 0.8611101508140564,
+    "finite": 0.2756781280040741,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 188,
+    "loss": 1.0045498609542847,
+    "diagonal_ce": 0.7736257910728455,
+    "finite": 0.3054550886154175,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 189,
+    "loss": 1.112023115158081,
+    "diagonal_ce": 0.9383984208106995,
+    "finite": 0.22845357656478882,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 190,
+    "loss": 0.9680942296981812,
+    "diagonal_ce": 0.7948789596557617,
+    "finite": 0.22672151029109955,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 191,
+    "loss": 1.0594123601913452,
+    "diagonal_ce": 0.8858044147491455,
+    "finite": 0.22605207562446594,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 192,
+    "loss": 1.0256342887878418,
+    "diagonal_ce": 0.8534245491027832,
+    "finite": 0.22306965291500092,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 193,
+    "loss": 0.9461332559585571,
+    "diagonal_ce": 0.7662067413330078,
+    "finite": 0.2318640500307083,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 194,
+    "loss": 1.0126508474349976,
+    "diagonal_ce": 0.8185924887657166,
+    "finite": 0.24879276752471924,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 195,
+    "loss": 1.0483646392822266,
+    "diagonal_ce": 0.872622013092041,
+    "finite": 0.22416158020496368,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 196,
+    "loss": 1.0402823686599731,
+    "diagonal_ce": 0.8657649159431458,
+    "finite": 0.22146889567375183,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 197,
+    "loss": 1.082980751991272,
+    "diagonal_ce": 0.9156466722488403,
+    "finite": 0.2112804502248764,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 198,
+    "loss": 1.116255521774292,
+    "diagonal_ce": 0.9414489269256592,
+    "finite": 0.21960632503032684,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 199,
+    "loss": 0.9999392032623291,
+    "diagonal_ce": 0.8168604373931885,
+    "finite": 0.22884848713874817,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 200,
+    "loss": 0.9492279887199402,
+    "diagonal_ce": 0.7572470903396606,
+    "finite": 0.23878219723701477,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 201,
+    "loss": 1.0597584247589111,
+    "diagonal_ce": 0.8520484566688538,
+    "finite": 0.2570668160915375,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 202,
+    "loss": 1.069105863571167,
+    "diagonal_ce": 0.8850132822990417,
+    "finite": 0.22671496868133545,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 203,
+    "loss": 0.9823801517486572,
+    "diagonal_ce": 0.7828918695449829,
+    "finite": 0.24447090923786163,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 204,
+    "loss": 1.043257236480713,
+    "diagonal_ce": 0.866573691368103,
+    "finite": 0.21546776592731476,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 205,
+    "loss": 1.016093134880066,
+    "diagonal_ce": 0.8128845691680908,
+    "finite": 0.2466123253107071,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 206,
+    "loss": 1.052675485610962,
+    "diagonal_ce": 0.8635086417198181,
+    "finite": 0.22846242785453796,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 207,
+    "loss": 1.0367469787597656,
+    "diagonal_ce": 0.8717004656791687,
+    "finite": 0.1983732432126999,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 208,
+    "loss": 0.9909878373146057,
+    "diagonal_ce": 0.8139238953590393,
+    "finite": 0.21179896593093872,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 209,
+    "loss": 1.069687008857727,
+    "diagonal_ce": 0.8968825936317444,
+    "finite": 0.20571957528591156,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 210,
+    "loss": 0.9794411063194275,
+    "diagonal_ce": 0.8137716054916382,
+    "finite": 0.19629089534282684,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 211,
+    "loss": 0.9989926815032959,
+    "diagonal_ce": 0.8389416933059692,
+    "finite": 0.1887393742799759,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 212,
+    "loss": 1.0597108602523804,
+    "diagonal_ce": 0.8901976346969604,
+    "finite": 0.19895917177200317,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 213,
+    "loss": 0.9541576504707336,
+    "diagonal_ce": 0.774925947189331,
+    "finite": 0.2093828171491623,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 214,
+    "loss": 0.9859510660171509,
+    "diagonal_ce": 0.8041176795959473,
+    "finite": 0.21143412590026855,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 215,
+    "loss": 1.0064398050308228,
+    "diagonal_ce": 0.8284885287284851,
+    "finite": 0.2059621512889862,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 216,
+    "loss": 1.025248408317566,
+    "diagonal_ce": 0.8721561431884766,
+    "finite": 0.17637358605861664,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 217,
+    "loss": 0.9839286804199219,
+    "diagonal_ce": 0.8154324889183044,
+    "finite": 0.1932295858860016,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 218,
+    "loss": 1.0746688842773438,
+    "diagonal_ce": 0.9274213910102844,
+    "finite": 0.1680908054113388,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 219,
+    "loss": 0.964250385761261,
+    "diagonal_ce": 0.807823121547699,
+    "finite": 0.17775827646255493,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 220,
+    "loss": 1.005834698677063,
+    "diagonal_ce": 0.8263558149337769,
+    "finite": 0.20303046703338623,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 221,
+    "loss": 1.0076311826705933,
+    "diagonal_ce": 0.863499641418457,
+    "finite": 0.16231033205986023,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 222,
+    "loss": 0.9897627830505371,
+    "diagonal_ce": 0.8398457169532776,
+    "finite": 0.16806842386722565,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 223,
+    "loss": 1.0053164958953857,
+    "diagonal_ce": 0.8531140089035034,
+    "finite": 0.16986887156963348,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 224,
+    "loss": 1.047465443611145,
+    "diagonal_ce": 0.8930510878562927,
+    "finite": 0.17157147824764252,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 225,
+    "loss": 1.0972785949707031,
+    "diagonal_ce": 0.9454036951065063,
+    "finite": 0.16800327599048615,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 226,
+    "loss": 0.8934255838394165,
+    "diagonal_ce": 0.7206628918647766,
+    "finite": 0.19026726484298706,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 227,
+    "loss": 1.0022763013839722,
+    "diagonal_ce": 0.8409897685050964,
+    "finite": 0.17684930562973022,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 228,
+    "loss": 1.1531306505203247,
+    "diagonal_ce": 1.0177637338638306,
+    "finite": 0.14778050780296326,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 229,
+    "loss": 0.9398061633110046,
+    "diagonal_ce": 0.7890252470970154,
+    "finite": 0.16389229893684387,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 230,
+    "loss": 0.8993154764175415,
+    "diagonal_ce": 0.7444798946380615,
+    "finite": 0.16757094860076904,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 231,
+    "loss": 1.063441276550293,
+    "diagonal_ce": 0.9071200489997864,
+    "finite": 0.1684495508670807,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 232,
+    "loss": 0.9159336686134338,
+    "diagonal_ce": 0.7554603219032288,
+    "finite": 0.17218172550201416,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 233,
+    "loss": 1.067026138305664,
+    "diagonal_ce": 0.9243695139884949,
+    "finite": 0.15241087973117828,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 234,
+    "loss": 0.8780559301376343,
+    "diagonal_ce": 0.7167618274688721,
+    "finite": 0.1715894490480423,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 235,
+    "loss": 0.9463746547698975,
+    "diagonal_ce": 0.8045733571052551,
+    "finite": 0.15021324157714844,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 236,
+    "loss": 0.9752471446990967,
+    "diagonal_ce": 0.8339575529098511,
+    "finite": 0.1490396410226822,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 237,
+    "loss": 0.9902316927909851,
+    "diagonal_ce": 0.8338834047317505,
+    "finite": 0.16423140466213226,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 238,
+    "loss": 0.9327830076217651,
+    "diagonal_ce": 0.803223192691803,
+    "finite": 0.13552279770374298,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 239,
+    "loss": 0.9475317001342773,
+    "diagonal_ce": 0.7994370460510254,
+    "finite": 0.15426528453826904,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 240,
+    "loss": 1.0005332231521606,
+    "diagonal_ce": 0.8549025058746338,
+    "finite": 0.15106917917728424,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 241,
+    "loss": 0.9190895557403564,
+    "diagonal_ce": 0.7797180414199829,
+    "finite": 0.1439788043498993,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 242,
+    "loss": 0.9054849743843079,
+    "diagonal_ce": 0.7829030752182007,
+    "finite": 0.12611305713653564,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 243,
+    "loss": 0.9571634531021118,
+    "diagonal_ce": 0.8162239193916321,
+    "finite": 0.14440524578094482,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 244,
+    "loss": 0.9481264352798462,
+    "diagonal_ce": 0.8010894060134888,
+    "finite": 0.15003778040409088,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 245,
+    "loss": 0.9253410696983337,
+    "diagonal_ce": 0.7738791108131409,
+    "finite": 0.15392476320266724,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 246,
+    "loss": 0.8964287042617798,
+    "diagonal_ce": 0.7490313053131104,
+    "finite": 0.1491876244544983,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 247,
+    "loss": 0.8829659223556519,
+    "diagonal_ce": 0.7421426177024841,
+    "finite": 0.14195895195007324,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 248,
+    "loss": 0.9413860440254211,
+    "diagonal_ce": 0.8086232542991638,
+    "finite": 0.1332959681749344,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 249,
+    "loss": 0.8690797686576843,
+    "diagonal_ce": 0.7200689911842346,
+    "finite": 0.1490107923746109,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 250,
+    "loss": 1.0055820941925049,
+    "diagonal_ce": 0.8852713704109192,
+    "finite": 0.12031078338623047,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 251,
+    "loss": 0.9339940547943115,
+    "diagonal_ce": 0.8084137439727783,
+    "finite": 0.1255803108215332,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 252,
+    "loss": 0.8541144132614136,
+    "diagonal_ce": 0.7267217040061951,
+    "finite": 0.1273927092552185,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 253,
+    "loss": 0.8474516868591309,
+    "diagonal_ce": 0.7252922058105469,
+    "finite": 0.12215948104858398,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 254,
+    "loss": 1.0029703378677368,
+    "diagonal_ce": 0.8808069825172424,
+    "finite": 0.12216337025165558,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 255,
+    "loss": 0.9218531250953674,
+    "diagonal_ce": 0.8007652163505554,
+    "finite": 0.1210879236459732,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 256,
+    "loss": 0.8898220062255859,
+    "diagonal_ce": 0.7765535712242126,
+    "finite": 0.1132684201002121,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 257,
+    "loss": 0.9604684114456177,
+    "diagonal_ce": 0.8508222103118896,
+    "finite": 0.10964617878198624,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 258,
+    "loss": 0.9138397574424744,
+    "diagonal_ce": 0.8091956973075867,
+    "finite": 0.1046440526843071,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 259,
+    "loss": 0.8699180483818054,
+    "diagonal_ce": 0.7554290294647217,
+    "finite": 0.11448900401592255,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 260,
+    "loss": 0.9413666725158691,
+    "diagonal_ce": 0.8386090397834778,
+    "finite": 0.10275763273239136,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 261,
+    "loss": 0.9460834264755249,
+    "diagonal_ce": 0.830454409122467,
+    "finite": 0.11562898755073547,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 262,
+    "loss": 0.9200173616409302,
+    "diagonal_ce": 0.7979671955108643,
+    "finite": 0.1220501959323883,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 263,
+    "loss": 0.9303090572357178,
+    "diagonal_ce": 0.8009307384490967,
+    "finite": 0.1293783038854599,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 264,
+    "loss": 0.8102479577064514,
+    "diagonal_ce": 0.6881885528564453,
+    "finite": 0.1220594197511673,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 265,
+    "loss": 0.95188307762146,
+    "diagonal_ce": 0.8171658515930176,
+    "finite": 0.1347172111272812,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 266,
+    "loss": 0.9934684634208679,
+    "diagonal_ce": 0.878949761390686,
+    "finite": 0.11451868712902069,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 267,
+    "loss": 0.9565571546554565,
+    "diagonal_ce": 0.8390532732009888,
+    "finite": 0.11750386655330658,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 268,
+    "loss": 1.0234999656677246,
+    "diagonal_ce": 0.9049501419067383,
+    "finite": 0.11854983121156693,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 269,
+    "loss": 0.8780663013458252,
+    "diagonal_ce": 0.7572768926620483,
+    "finite": 0.12078939378261566,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 270,
+    "loss": 0.887148380279541,
+    "diagonal_ce": 0.7588626146316528,
+    "finite": 0.1282857358455658,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 271,
+    "loss": 0.8451805114746094,
+    "diagonal_ce": 0.7284995317459106,
+    "finite": 0.11668098717927933,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 272,
+    "loss": 0.8650834560394287,
+    "diagonal_ce": 0.7437506318092346,
+    "finite": 0.1213328018784523,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 273,
+    "loss": 1.0008764266967773,
+    "diagonal_ce": 0.8831881284713745,
+    "finite": 0.11768829822540283,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 274,
+    "loss": 0.8594944477081299,
+    "diagonal_ce": 0.7561701536178589,
+    "finite": 0.103324294090271,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 275,
+    "loss": 0.882731556892395,
+    "diagonal_ce": 0.7859642505645752,
+    "finite": 0.09676733613014221,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 276,
+    "loss": 0.8725935220718384,
+    "diagonal_ce": 0.7679142355918884,
+    "finite": 0.10467930138111115,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 277,
+    "loss": 0.8850838541984558,
+    "diagonal_ce": 0.7853102087974548,
+    "finite": 0.09977366775274277,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 278,
+    "loss": 0.9560685157775879,
+    "diagonal_ce": 0.8598822355270386,
+    "finite": 0.09618630260229111,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 279,
+    "loss": 0.8881536722183228,
+    "diagonal_ce": 0.7891485691070557,
+    "finite": 0.09900509566068649,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 280,
+    "loss": 0.813774049282074,
+    "diagonal_ce": 0.7293984293937683,
+    "finite": 0.08437562733888626,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 281,
+    "loss": 0.9516669511795044,
+    "diagonal_ce": 0.8667050004005432,
+    "finite": 0.08496195822954178,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 282,
+    "loss": 0.8685863018035889,
+    "diagonal_ce": 0.77079176902771,
+    "finite": 0.09779451042413712,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 283,
+    "loss": 0.8455403447151184,
+    "diagonal_ce": 0.7498735189437866,
+    "finite": 0.09566683322191238,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 284,
+    "loss": 0.8218908905982971,
+    "diagonal_ce": 0.7313474416732788,
+    "finite": 0.09054345637559891,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 285,
+    "loss": 0.8603167533874512,
+    "diagonal_ce": 0.7660958766937256,
+    "finite": 0.09422089904546738,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 286,
+    "loss": 0.8241929411888123,
+    "diagonal_ce": 0.7371505498886108,
+    "finite": 0.08704237639904022,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 287,
+    "loss": 0.8915013670921326,
+    "diagonal_ce": 0.8039937615394592,
+    "finite": 0.08750762045383453,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 288,
+    "loss": 0.8199359774589539,
+    "diagonal_ce": 0.7155244946479797,
+    "finite": 0.10441146790981293,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 289,
+    "loss": 0.8527997136116028,
+    "diagonal_ce": 0.765369713306427,
+    "finite": 0.08742998540401459,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 290,
+    "loss": 0.8115634918212891,
+    "diagonal_ce": 0.7173636555671692,
+    "finite": 0.09419982135295868,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 291,
+    "loss": 0.8810088634490967,
+    "diagonal_ce": 0.7797592878341675,
+    "finite": 0.10124959796667099,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 292,
+    "loss": 1.0015642642974854,
+    "diagonal_ce": 0.8999652862548828,
+    "finite": 0.10159892588853836,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 293,
+    "loss": 0.8133551478385925,
+    "diagonal_ce": 0.721450686454773,
+    "finite": 0.09190445393323898,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 294,
+    "loss": 0.8627196550369263,
+    "diagonal_ce": 0.7742679119110107,
+    "finite": 0.08845173567533493,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 295,
+    "loss": 0.8861047029495239,
+    "diagonal_ce": 0.7884236574172974,
+    "finite": 0.09768103808164597,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 296,
+    "loss": 0.7685565948486328,
+    "diagonal_ce": 0.6789160370826721,
+    "finite": 0.08964058011770248,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 297,
+    "loss": 0.8248617649078369,
+    "diagonal_ce": 0.7476165890693665,
+    "finite": 0.07724515348672867,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 298,
+    "loss": 0.7991270422935486,
+    "diagonal_ce": 0.6978825926780701,
+    "finite": 0.10124446451663971,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 299,
+    "loss": 0.7446162104606628,
+    "diagonal_ce": 0.6357988119125366,
+    "finite": 0.10881739854812622,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 300,
+    "loss": 0.7179926633834839,
+    "diagonal_ce": 0.6212986707687378,
+    "finite": 0.0966939628124237,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 301,
+    "loss": 0.944494903087616,
+    "diagonal_ce": 0.8537246584892273,
+    "finite": 0.09077025204896927,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 302,
+    "loss": 0.8517212271690369,
+    "diagonal_ce": 0.7678673267364502,
+    "finite": 0.08385388553142548,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 303,
+    "loss": 0.8921302556991577,
+    "diagonal_ce": 0.7967025637626648,
+    "finite": 0.09542766213417053,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 304,
+    "loss": 0.9314195513725281,
+    "diagonal_ce": 0.8515124917030334,
+    "finite": 0.07990705221891403,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 305,
+    "loss": 0.8571605682373047,
+    "diagonal_ce": 0.7803457379341125,
+    "finite": 0.07681481540203094,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 306,
+    "loss": 0.8748458623886108,
+    "diagonal_ce": 0.7958106994628906,
+    "finite": 0.07903514802455902,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 307,
+    "loss": 0.7689096331596375,
+    "diagonal_ce": 0.6877541542053223,
+    "finite": 0.08115547895431519,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 308,
+    "loss": 0.865324079990387,
+    "diagonal_ce": 0.7778936624526978,
+    "finite": 0.08743041753768921,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 309,
+    "loss": 0.840769350528717,
+    "diagonal_ce": 0.7545441389083862,
+    "finite": 0.08622518926858902,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 310,
+    "loss": 0.8264783620834351,
+    "diagonal_ce": 0.7399557828903198,
+    "finite": 0.08652259409427643,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 311,
+    "loss": 0.8307100534439087,
+    "diagonal_ce": 0.7575465440750122,
+    "finite": 0.07316352427005768,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 312,
+    "loss": 0.7934510707855225,
+    "diagonal_ce": 0.7179976105690002,
+    "finite": 0.07545346766710281,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 313,
+    "loss": 0.8225486278533936,
+    "diagonal_ce": 0.743028998374939,
+    "finite": 0.07951965928077698,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 314,
+    "loss": 0.8492944240570068,
+    "diagonal_ce": 0.7806862592697144,
+    "finite": 0.06860814988613129,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 315,
+    "loss": 0.8408191800117493,
+    "diagonal_ce": 0.7655597925186157,
+    "finite": 0.07525940239429474,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 316,
+    "loss": 0.7723700404167175,
+    "diagonal_ce": 0.6989073157310486,
+    "finite": 0.07346270233392715,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 317,
+    "loss": 0.7417513728141785,
+    "diagonal_ce": 0.6563820838928223,
+    "finite": 0.0853693038225174,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 318,
+    "loss": 0.8223352432250977,
+    "diagonal_ce": 0.7510672211647034,
+    "finite": 0.07126801460981369,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 319,
+    "loss": 0.8934231400489807,
+    "diagonal_ce": 0.8109697699546814,
+    "finite": 0.08245334774255753,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 320,
+    "loss": 0.8789741396903992,
+    "diagonal_ce": 0.8074312210083008,
+    "finite": 0.07154293358325958,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 321,
+    "loss": 0.8051720857620239,
+    "diagonal_ce": 0.736745297908783,
+    "finite": 0.06842675805091858,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 322,
+    "loss": 0.7194018959999084,
+    "diagonal_ce": 0.6453631520271301,
+    "finite": 0.07403875887393951,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 323,
+    "loss": 0.7820868492126465,
+    "diagonal_ce": 0.7048565745353699,
+    "finite": 0.07723026722669601,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 324,
+    "loss": 0.7521985769271851,
+    "diagonal_ce": 0.6735710501670837,
+    "finite": 0.07862752676010132,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 325,
+    "loss": 0.7177990674972534,
+    "diagonal_ce": 0.6421064734458923,
+    "finite": 0.0756925716996193,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 326,
+    "loss": 0.8685851693153381,
+    "diagonal_ce": 0.793938159942627,
+    "finite": 0.07464698702096939,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 327,
+    "loss": 0.8161792755126953,
+    "diagonal_ce": 0.7461480498313904,
+    "finite": 0.07003119587898254,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 328,
+    "loss": 0.7343193292617798,
+    "diagonal_ce": 0.6666708588600159,
+    "finite": 0.06764848530292511,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 329,
+    "loss": 0.8888405561447144,
+    "diagonal_ce": 0.830078661441803,
+    "finite": 0.05876191332936287,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 330,
+    "loss": 0.7515192031860352,
+    "diagonal_ce": 0.6823980808258057,
+    "finite": 0.0691211149096489,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 331,
+    "loss": 0.758956253528595,
+    "diagonal_ce": 0.6911499500274658,
+    "finite": 0.06780628859996796,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 332,
+    "loss": 0.814583957195282,
+    "diagonal_ce": 0.7437702417373657,
+    "finite": 0.07081370800733566,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 333,
+    "loss": 0.8009682297706604,
+    "diagonal_ce": 0.7306643724441528,
+    "finite": 0.07030383497476578,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 334,
+    "loss": 0.8769005537033081,
+    "diagonal_ce": 0.8151460886001587,
+    "finite": 0.0617544949054718,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 335,
+    "loss": 0.6962003707885742,
+    "diagonal_ce": 0.6296979784965515,
+    "finite": 0.06650238484144211,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 336,
+    "loss": 0.7059897780418396,
+    "diagonal_ce": 0.6405907273292542,
+    "finite": 0.06539905816316605,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 337,
+    "loss": 0.8058360815048218,
+    "diagonal_ce": 0.7485576868057251,
+    "finite": 0.05727840214967728,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 338,
+    "loss": 0.77463299036026,
+    "diagonal_ce": 0.7092487215995789,
+    "finite": 0.06538425385951996,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 339,
+    "loss": 0.7536060810089111,
+    "diagonal_ce": 0.6912453770637512,
+    "finite": 0.062360722571611404,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 340,
+    "loss": 0.7838948965072632,
+    "diagonal_ce": 0.7229479551315308,
+    "finite": 0.060946911573410034,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 341,
+    "loss": 0.8400519490242004,
+    "diagonal_ce": 0.771720826625824,
+    "finite": 0.06833112239837646,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 342,
+    "loss": 0.7157717943191528,
+    "diagonal_ce": 0.6491614580154419,
+    "finite": 0.06661035120487213,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 343,
+    "loss": 0.7882110476493835,
+    "diagonal_ce": 0.7270172238349915,
+    "finite": 0.06119384616613388,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 344,
+    "loss": 0.7700013518333435,
+    "diagonal_ce": 0.7079461216926575,
+    "finite": 0.06205521523952484,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 345,
+    "loss": 0.7771500945091248,
+    "diagonal_ce": 0.7149050831794739,
+    "finite": 0.062244996428489685,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 346,
+    "loss": 0.7093478441238403,
+    "diagonal_ce": 0.6446982026100159,
+    "finite": 0.06464961171150208,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 347,
+    "loss": 0.6720442771911621,
+    "diagonal_ce": 0.6113556623458862,
+    "finite": 0.06068858876824379,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 348,
+    "loss": 0.7489561438560486,
+    "diagonal_ce": 0.6839020848274231,
+    "finite": 0.0650540366768837,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 349,
+    "loss": 0.7230247259140015,
+    "diagonal_ce": 0.6550002098083496,
+    "finite": 0.06802451610565186,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 350,
+    "loss": 0.7382804751396179,
+    "diagonal_ce": 0.6795169711112976,
+    "finite": 0.05876351147890091,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 351,
+    "loss": 0.7683074474334717,
+    "diagonal_ce": 0.7083593606948853,
+    "finite": 0.05994810909032822,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 352,
+    "loss": 0.7216811180114746,
+    "diagonal_ce": 0.6558428406715393,
+    "finite": 0.0658382847905159,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 353,
+    "loss": 0.8316231369972229,
+    "diagonal_ce": 0.7674727439880371,
+    "finite": 0.064150370657444,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 354,
+    "loss": 0.7735188007354736,
+    "diagonal_ce": 0.7170727849006653,
+    "finite": 0.05644599720835686,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 355,
+    "loss": 0.808109700679779,
+    "diagonal_ce": 0.7502905130386353,
+    "finite": 0.0578191764652729,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 356,
+    "loss": 0.8003501296043396,
+    "diagonal_ce": 0.7399966716766357,
+    "finite": 0.06035343185067177,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 357,
+    "loss": 0.7872487306594849,
+    "diagonal_ce": 0.7297881841659546,
+    "finite": 0.057460568845272064,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 358,
+    "loss": 0.7325144410133362,
+    "diagonal_ce": 0.6690962910652161,
+    "finite": 0.06341814249753952,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 359,
+    "loss": 0.860661506652832,
+    "diagonal_ce": 0.8068966865539551,
+    "finite": 0.053764812648296356,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 360,
+    "loss": 0.7328557372093201,
+    "diagonal_ce": 0.676626980304718,
+    "finite": 0.05622875690460205,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 361,
+    "loss": 0.7230742573738098,
+    "diagonal_ce": 0.6631737947463989,
+    "finite": 0.059900447726249695,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 362,
+    "loss": 0.7569904327392578,
+    "diagonal_ce": 0.709674060344696,
+    "finite": 0.04731637239456177,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 363,
+    "loss": 0.7265082597732544,
+    "diagonal_ce": 0.6761029958724976,
+    "finite": 0.050405293703079224,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 364,
+    "loss": 0.7061264514923096,
+    "diagonal_ce": 0.6501456499099731,
+    "finite": 0.055980831384658813,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 365,
+    "loss": 0.7618527412414551,
+    "diagonal_ce": 0.7092422246932983,
+    "finite": 0.05261050909757614,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 366,
+    "loss": 0.8642386198043823,
+    "diagonal_ce": 0.8132855892181396,
+    "finite": 0.050953056663274765,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 367,
+    "loss": 0.7472683787345886,
+    "diagonal_ce": 0.70116126537323,
+    "finite": 0.046107131987810135,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 368,
+    "loss": 0.7535245418548584,
+    "diagonal_ce": 0.7049192786216736,
+    "finite": 0.04860525578260422,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 369,
+    "loss": 0.824826717376709,
+    "diagonal_ce": 0.774733304977417,
+    "finite": 0.050093431025743484,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 370,
+    "loss": 0.755693256855011,
+    "diagonal_ce": 0.7073954343795776,
+    "finite": 0.04829781502485275,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 371,
+    "loss": 0.7442342638969421,
+    "diagonal_ce": 0.6994197368621826,
+    "finite": 0.044814515858888626,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 372,
+    "loss": 0.7502530217170715,
+    "diagonal_ce": 0.7000199556350708,
+    "finite": 0.050233058631420135,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 373,
+    "loss": 0.7431419491767883,
+    "diagonal_ce": 0.6909149289131165,
+    "finite": 0.052226994186639786,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 374,
+    "loss": 0.7295202016830444,
+    "diagonal_ce": 0.6857764720916748,
+    "finite": 0.043743718415498734,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 375,
+    "loss": 0.6303626298904419,
+    "diagonal_ce": 0.5805236101150513,
+    "finite": 0.04983902722597122,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 376,
+    "loss": 0.6617233157157898,
+    "diagonal_ce": 0.6134001016616821,
+    "finite": 0.04832323268055916,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 377,
+    "loss": 0.707927405834198,
+    "diagonal_ce": 0.6550645232200623,
+    "finite": 0.05286290496587753,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 378,
+    "loss": 0.8479862213134766,
+    "diagonal_ce": 0.8012640476226807,
+    "finite": 0.046722158789634705,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 379,
+    "loss": 0.7677333354949951,
+    "diagonal_ce": 0.7222095131874084,
+    "finite": 0.04552379623055458,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 380,
+    "loss": 0.654848039150238,
+    "diagonal_ce": 0.6028797626495361,
+    "finite": 0.0519682839512825,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 381,
+    "loss": 0.7791681289672852,
+    "diagonal_ce": 0.7319308519363403,
+    "finite": 0.047237273305654526,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 382,
+    "loss": 0.6145023107528687,
+    "diagonal_ce": 0.5673844218254089,
+    "finite": 0.047117918729782104,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 383,
+    "loss": 0.800172746181488,
+    "diagonal_ce": 0.755908727645874,
+    "finite": 0.044264014810323715,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 384,
+    "loss": 0.6500666737556458,
+    "diagonal_ce": 0.6001490950584412,
+    "finite": 0.0499175563454628,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 385,
+    "loss": 0.7744835019111633,
+    "diagonal_ce": 0.7296178340911865,
+    "finite": 0.04486566781997681,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 386,
+    "loss": 0.7612977623939514,
+    "diagonal_ce": 0.7172999978065491,
+    "finite": 0.04399777576327324,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 387,
+    "loss": 0.6873184442520142,
+    "diagonal_ce": 0.6399831175804138,
+    "finite": 0.04733533784747124,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 388,
+    "loss": 0.6276646852493286,
+    "diagonal_ce": 0.5824785828590393,
+    "finite": 0.04518609121441841,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 389,
+    "loss": 0.8359301090240479,
+    "diagonal_ce": 0.7900696992874146,
+    "finite": 0.04586043208837509,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 390,
+    "loss": 0.6519963145256042,
+    "diagonal_ce": 0.6054638028144836,
+    "finite": 0.0465325266122818,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 391,
+    "loss": 0.6875976324081421,
+    "diagonal_ce": 0.6417620182037354,
+    "finite": 0.04583562910556793,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 392,
+    "loss": 0.6948622465133667,
+    "diagonal_ce": 0.6547784209251404,
+    "finite": 0.04008382186293602,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 393,
+    "loss": 0.6713463068008423,
+    "diagonal_ce": 0.6250336766242981,
+    "finite": 0.0463126003742218,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 394,
+    "loss": 0.6940029263496399,
+    "diagonal_ce": 0.6514111161231995,
+    "finite": 0.04259180277585983,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 395,
+    "loss": 0.7016136646270752,
+    "diagonal_ce": 0.6606593728065491,
+    "finite": 0.04095430672168732,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 396,
+    "loss": 0.7061418890953064,
+    "diagonal_ce": 0.6610605716705322,
+    "finite": 0.04508130997419357,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 397,
+    "loss": 0.676167905330658,
+    "diagonal_ce": 0.6316098570823669,
+    "finite": 0.044558070600032806,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 398,
+    "loss": 0.7933163046836853,
+    "diagonal_ce": 0.7555347681045532,
+    "finite": 0.03778151422739029,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 399,
+    "loss": 0.6825944185256958,
+    "diagonal_ce": 0.634157121181488,
+    "finite": 0.04843731224536896,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 400,
+    "loss": 0.6839274764060974,
+    "diagonal_ce": 0.6421167850494385,
+    "finite": 0.041810669004917145,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 401,
+    "loss": 0.7701592445373535,
+    "diagonal_ce": 0.7284684181213379,
+    "finite": 0.041690826416015625,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 402,
+    "loss": 0.7355458736419678,
+    "diagonal_ce": 0.6967223882675171,
+    "finite": 0.03882349282503128,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 403,
+    "loss": 0.6945071220397949,
+    "diagonal_ce": 0.653057336807251,
+    "finite": 0.04144979268312454,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 404,
+    "loss": 0.6871864795684814,
+    "diagonal_ce": 0.6473369598388672,
+    "finite": 0.03984948992729187,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 405,
+    "loss": 0.6743623614311218,
+    "diagonal_ce": 0.6397155523300171,
+    "finite": 0.03464679792523384,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 406,
+    "loss": 0.7425937652587891,
+    "diagonal_ce": 0.7040084004402161,
+    "finite": 0.03858534246683121,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 407,
+    "loss": 0.6838128566741943,
+    "diagonal_ce": 0.6441643834114075,
+    "finite": 0.03964845463633537,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 408,
+    "loss": 0.60124272108078,
+    "diagonal_ce": 0.5659829378128052,
+    "finite": 0.03525977581739426,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 409,
+    "loss": 0.6547039747238159,
+    "diagonal_ce": 0.619671106338501,
+    "finite": 0.03503284975886345,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 410,
+    "loss": 0.6578102111816406,
+    "diagonal_ce": 0.618893563747406,
+    "finite": 0.03891666978597641,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 411,
+    "loss": 0.6688941717147827,
+    "diagonal_ce": 0.6307005882263184,
+    "finite": 0.03819360211491585,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 412,
+    "loss": 0.7336212396621704,
+    "diagonal_ce": 0.6989380121231079,
+    "finite": 0.03468320146203041,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 413,
+    "loss": 0.7202556133270264,
+    "diagonal_ce": 0.684348464012146,
+    "finite": 0.03590713441371918,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 414,
+    "loss": 0.6904106140136719,
+    "diagonal_ce": 0.650610089302063,
+    "finite": 0.0398004949092865,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 415,
+    "loss": 0.6492401361465454,
+    "diagonal_ce": 0.6103774309158325,
+    "finite": 0.0388626828789711,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 416,
+    "loss": 0.6556081771850586,
+    "diagonal_ce": 0.6150643229484558,
+    "finite": 0.040543846786022186,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 417,
+    "loss": 0.7238236665725708,
+    "diagonal_ce": 0.6840763092041016,
+    "finite": 0.03974737972021103,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 418,
+    "loss": 0.6676759123802185,
+    "diagonal_ce": 0.6242771148681641,
+    "finite": 0.043398793786764145,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 419,
+    "loss": 0.6764143705368042,
+    "diagonal_ce": 0.6403405070304871,
+    "finite": 0.03607387840747833,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 420,
+    "loss": 0.6422423720359802,
+    "diagonal_ce": 0.6057068109512329,
+    "finite": 0.03653554990887642,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 421,
+    "loss": 0.6279417872428894,
+    "diagonal_ce": 0.5872968435287476,
+    "finite": 0.04064493626356125,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 422,
+    "loss": 0.6524912714958191,
+    "diagonal_ce": 0.6134576201438904,
+    "finite": 0.03903364762663841,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 423,
+    "loss": 0.6843507289886475,
+    "diagonal_ce": 0.6507158875465393,
+    "finite": 0.03363481163978577,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 424,
+    "loss": 0.597837507724762,
+    "diagonal_ce": 0.5627622604370117,
+    "finite": 0.03507523983716965,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 425,
+    "loss": 0.7639458179473877,
+    "diagonal_ce": 0.7243139147758484,
+    "finite": 0.039631880819797516,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 426,
+    "loss": 0.605995774269104,
+    "diagonal_ce": 0.5694626569747925,
+    "finite": 0.03653312847018242,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 427,
+    "loss": 0.6889557242393494,
+    "diagonal_ce": 0.6516923308372498,
+    "finite": 0.0372634157538414,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 428,
+    "loss": 0.6902561187744141,
+    "diagonal_ce": 0.6537544131278992,
+    "finite": 0.03650170564651489,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 429,
+    "loss": 0.6086870431900024,
+    "diagonal_ce": 0.5706732273101807,
+    "finite": 0.03801383078098297,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 430,
+    "loss": 0.6167628169059753,
+    "diagonal_ce": 0.5834284424781799,
+    "finite": 0.033334389328956604,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 431,
+    "loss": 0.5470474362373352,
+    "diagonal_ce": 0.512357771396637,
+    "finite": 0.034689657390117645,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 432,
+    "loss": 0.6115111112594604,
+    "diagonal_ce": 0.5778605341911316,
+    "finite": 0.033650562167167664,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 433,
+    "loss": 0.6934790015220642,
+    "diagonal_ce": 0.6579595804214478,
+    "finite": 0.035519443452358246,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 434,
+    "loss": 0.6298158764839172,
+    "diagonal_ce": 0.5963177680969238,
+    "finite": 0.033498115837574005,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 435,
+    "loss": 0.7697394490242004,
+    "diagonal_ce": 0.7343396544456482,
+    "finite": 0.035399772226810455,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 436,
+    "loss": 0.6152932047843933,
+    "diagonal_ce": 0.5788193345069885,
+    "finite": 0.03647386282682419,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 437,
+    "loss": 0.6347460746765137,
+    "diagonal_ce": 0.6005380153656006,
+    "finite": 0.034208059310913086,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 438,
+    "loss": 0.7142512798309326,
+    "diagonal_ce": 0.6810414791107178,
+    "finite": 0.03320979326963425,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 439,
+    "loss": 0.5930210947990417,
+    "diagonal_ce": 0.5591452717781067,
+    "finite": 0.03387582674622536,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 440,
+    "loss": 0.6444439888000488,
+    "diagonal_ce": 0.6108866930007935,
+    "finite": 0.03355729952454567,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 441,
+    "loss": 0.6568295955657959,
+    "diagonal_ce": 0.6258417963981628,
+    "finite": 0.030987776815891266,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 442,
+    "loss": 0.6825027465820312,
+    "diagonal_ce": 0.646605908870697,
+    "finite": 0.03589685633778572,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 443,
+    "loss": 0.6448249220848083,
+    "diagonal_ce": 0.6132047176361084,
+    "finite": 0.03162018582224846,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 444,
+    "loss": 0.6411618590354919,
+    "diagonal_ce": 0.6080642342567444,
+    "finite": 0.03309762850403786,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 445,
+    "loss": 0.698471188545227,
+    "diagonal_ce": 0.6646596789360046,
+    "finite": 0.0338115394115448,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 446,
+    "loss": 0.6698213219642639,
+    "diagonal_ce": 0.6352019309997559,
+    "finite": 0.03461937978863716,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 447,
+    "loss": 0.6441018581390381,
+    "diagonal_ce": 0.6116001605987549,
+    "finite": 0.0325017049908638,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 448,
+    "loss": 0.6252701878547668,
+    "diagonal_ce": 0.5941129922866821,
+    "finite": 0.031157221645116806,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 449,
+    "loss": 0.5192617177963257,
+    "diagonal_ce": 0.4887954294681549,
+    "finite": 0.030466295778751373,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 450,
+    "loss": 0.6314641237258911,
+    "diagonal_ce": 0.5999914407730103,
+    "finite": 0.03147267922759056,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 451,
+    "loss": 0.6609703302383423,
+    "diagonal_ce": 0.6321731209754944,
+    "finite": 0.02879718318581581,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 452,
+    "loss": 0.6934636831283569,
+    "diagonal_ce": 0.6635990738868713,
+    "finite": 0.029864631593227386,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 453,
+    "loss": 0.6531942486763,
+    "diagonal_ce": 0.6247183680534363,
+    "finite": 0.028475884348154068,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 454,
+    "loss": 0.7447242736816406,
+    "diagonal_ce": 0.7163733243942261,
+    "finite": 0.028350941836833954,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 455,
+    "loss": 0.5786945223808289,
+    "diagonal_ce": 0.5535286664962769,
+    "finite": 0.025165852159261703,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 456,
+    "loss": 0.6770111918449402,
+    "diagonal_ce": 0.6499187350273132,
+    "finite": 0.027092453092336655,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 457,
+    "loss": 0.6526545286178589,
+    "diagonal_ce": 0.6241241693496704,
+    "finite": 0.028530364856123924,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 458,
+    "loss": 0.5525838136672974,
+    "diagonal_ce": 0.5259220004081726,
+    "finite": 0.02666180208325386,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 459,
+    "loss": 0.6066097021102905,
+    "diagonal_ce": 0.5739644169807434,
+    "finite": 0.032645273953676224,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 460,
+    "loss": 0.6751711964607239,
+    "diagonal_ce": 0.6467127799987793,
+    "finite": 0.02845839038491249,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 461,
+    "loss": 0.6713707447052002,
+    "diagonal_ce": 0.643720269203186,
+    "finite": 0.02765050157904625,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 462,
+    "loss": 0.5701006054878235,
+    "diagonal_ce": 0.5432145595550537,
+    "finite": 0.026886053383350372,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 463,
+    "loss": 0.6848776936531067,
+    "diagonal_ce": 0.6560318470001221,
+    "finite": 0.028845863416790962,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 464,
+    "loss": 0.5744101405143738,
+    "diagonal_ce": 0.5470436215400696,
+    "finite": 0.027366546913981438,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 465,
+    "loss": 0.7628709077835083,
+    "diagonal_ce": 0.7386136054992676,
+    "finite": 0.024257292971014977,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 466,
+    "loss": 0.5416143536567688,
+    "diagonal_ce": 0.5100865960121155,
+    "finite": 0.03152776136994362,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 467,
+    "loss": 0.7005416750907898,
+    "diagonal_ce": 0.6724841594696045,
+    "finite": 0.028057489544153214,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 468,
+    "loss": 0.7085564136505127,
+    "diagonal_ce": 0.6795039772987366,
+    "finite": 0.029052412137389183,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 469,
+    "loss": 0.6703270673751831,
+    "diagonal_ce": 0.6439297199249268,
+    "finite": 0.02639731951057911,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 470,
+    "loss": 0.5363497734069824,
+    "diagonal_ce": 0.50794517993927,
+    "finite": 0.02840459905564785,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 471,
+    "loss": 0.5503550171852112,
+    "diagonal_ce": 0.5251665115356445,
+    "finite": 0.025188487023115158,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 472,
+    "loss": 0.6743677258491516,
+    "diagonal_ce": 0.6470215916633606,
+    "finite": 0.027346137911081314,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 473,
+    "loss": 0.5944116115570068,
+    "diagonal_ce": 0.5646321177482605,
+    "finite": 0.029779501259326935,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 474,
+    "loss": 0.4782329201698303,
+    "diagonal_ce": 0.45001670718193054,
+    "finite": 0.028216227889060974,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 475,
+    "loss": 0.5270548462867737,
+    "diagonal_ce": 0.4983994960784912,
+    "finite": 0.02865535207092762,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 476,
+    "loss": 0.6605451703071594,
+    "diagonal_ce": 0.6336292624473572,
+    "finite": 0.026915913447737694,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 477,
+    "loss": 0.7781417965888977,
+    "diagonal_ce": 0.7509332895278931,
+    "finite": 0.02720850519835949,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 478,
+    "loss": 0.6073985695838928,
+    "diagonal_ce": 0.5828835368156433,
+    "finite": 0.02451505698263645,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 479,
+    "loss": 0.6249350905418396,
+    "diagonal_ce": 0.5974640846252441,
+    "finite": 0.027470989152789116,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 480,
+    "loss": 0.559982419013977,
+    "diagonal_ce": 0.5334547758102417,
+    "finite": 0.026527630165219307,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 481,
+    "loss": 0.573820948600769,
+    "diagonal_ce": 0.545023500919342,
+    "finite": 0.028797471895813942,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 482,
+    "loss": 0.6466936469078064,
+    "diagonal_ce": 0.6213534474372864,
+    "finite": 0.025340192019939423,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 483,
+    "loss": 0.4946439266204834,
+    "diagonal_ce": 0.4662449359893799,
+    "finite": 0.02839897945523262,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 484,
+    "loss": 0.7124395966529846,
+    "diagonal_ce": 0.6881934404373169,
+    "finite": 0.024246130138635635,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 485,
+    "loss": 0.5625434517860413,
+    "diagonal_ce": 0.5322597622871399,
+    "finite": 0.03028370440006256,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 486,
+    "loss": 0.6392427086830139,
+    "diagonal_ce": 0.6140480637550354,
+    "finite": 0.02519465796649456,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 487,
+    "loss": 0.5051918625831604,
+    "diagonal_ce": 0.47725218534469604,
+    "finite": 0.027939682826399803,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 488,
+    "loss": 0.6618245244026184,
+    "diagonal_ce": 0.6371508240699768,
+    "finite": 0.02467370592057705,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 489,
+    "loss": 0.6776738166809082,
+    "diagonal_ce": 0.6529949307441711,
+    "finite": 0.024678897112607956,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 490,
+    "loss": 0.5686613917350769,
+    "diagonal_ce": 0.5453424453735352,
+    "finite": 0.023318972438573837,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 491,
+    "loss": 0.5763123035430908,
+    "diagonal_ce": 0.5536980628967285,
+    "finite": 0.022614257410168648,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 492,
+    "loss": 0.5739288330078125,
+    "diagonal_ce": 0.5477862358093262,
+    "finite": 0.026142612099647522,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 493,
+    "loss": 0.5894178152084351,
+    "diagonal_ce": 0.5659788846969604,
+    "finite": 0.02343890443444252,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 494,
+    "loss": 0.674031138420105,
+    "diagonal_ce": 0.6528664827346802,
+    "finite": 0.021164627745747566,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 495,
+    "loss": 0.7482611536979675,
+    "diagonal_ce": 0.7222744226455688,
+    "finite": 0.02598675712943077,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 496,
+    "loss": 0.7159263491630554,
+    "diagonal_ce": 0.6901769638061523,
+    "finite": 0.02574940025806427,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 497,
+    "loss": 0.6050274968147278,
+    "diagonal_ce": 0.5818672776222229,
+    "finite": 0.023160208016633987,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 498,
+    "loss": 0.6082615852355957,
+    "diagonal_ce": 0.5882173180580139,
+    "finite": 0.020044270902872086,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 499,
+    "loss": 0.5984987616539001,
+    "diagonal_ce": 0.5741889476776123,
+    "finite": 0.024309799075126648,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 500,
+    "loss": 0.6018598079681396,
+    "diagonal_ce": 0.579677402973175,
+    "finite": 0.02218242548406124,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 501,
+    "loss": 0.7008907198905945,
+    "diagonal_ce": 0.6799957156181335,
+    "finite": 0.020895015448331833,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 502,
+    "loss": 0.5524638891220093,
+    "diagonal_ce": 0.5315962433815002,
+    "finite": 0.020867666229605675,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 503,
+    "loss": 0.5606788396835327,
+    "diagonal_ce": 0.5413534641265869,
+    "finite": 0.019325392320752144,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 504,
+    "loss": 0.5211968421936035,
+    "diagonal_ce": 0.5021588206291199,
+    "finite": 0.019038047641515732,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 505,
+    "loss": 0.5197935104370117,
+    "diagonal_ce": 0.4999230206012726,
+    "finite": 0.019870491698384285,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 506,
+    "loss": 0.6365341544151306,
+    "diagonal_ce": 0.6167281866073608,
+    "finite": 0.019805945456027985,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 507,
+    "loss": 0.6132209300994873,
+    "diagonal_ce": 0.5936622619628906,
+    "finite": 0.019558671861886978,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 508,
+    "loss": 0.7767196297645569,
+    "diagonal_ce": 0.7574305534362793,
+    "finite": 0.01928909309208393,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 509,
+    "loss": 0.5573607087135315,
+    "diagonal_ce": 0.5388445854187012,
+    "finite": 0.018516143783926964,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 510,
+    "loss": 0.5579210519790649,
+    "diagonal_ce": 0.5397876501083374,
+    "finite": 0.01813342608511448,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 511,
+    "loss": 0.5766472816467285,
+    "diagonal_ce": 0.5585757493972778,
+    "finite": 0.018071506172418594,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 512,
+    "loss": 0.5726830959320068,
+    "diagonal_ce": 0.5525991916656494,
+    "finite": 0.02008388563990593,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 513,
+    "loss": 0.6520645022392273,
+    "diagonal_ce": 0.6328627467155457,
+    "finite": 0.01920172944664955,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 514,
+    "loss": 0.5798124074935913,
+    "diagonal_ce": 0.5625455379486084,
+    "finite": 0.017266863957047462,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 515,
+    "loss": 0.5779342651367188,
+    "diagonal_ce": 0.559119701385498,
+    "finite": 0.018814576789736748,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 516,
+    "loss": 0.6327803134918213,
+    "diagonal_ce": 0.6149325966835022,
+    "finite": 0.01784772425889969,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 517,
+    "loss": 0.5286946892738342,
+    "diagonal_ce": 0.5082566738128662,
+    "finite": 0.020437993109226227,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 518,
+    "loss": 0.7243720293045044,
+    "diagonal_ce": 0.7056682109832764,
+    "finite": 0.018703829497098923,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 519,
+    "loss": 0.5394834876060486,
+    "diagonal_ce": 0.5225902795791626,
+    "finite": 0.016893189400434494,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 520,
+    "loss": 0.7501127123832703,
+    "diagonal_ce": 0.732719361782074,
+    "finite": 0.017393365502357483,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 521,
+    "loss": 0.7085971832275391,
+    "diagonal_ce": 0.6919126510620117,
+    "finite": 0.016684506088495255,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 522,
+    "loss": 0.4951702356338501,
+    "diagonal_ce": 0.47704872488975525,
+    "finite": 0.01812150329351425,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 523,
+    "loss": 0.6050935983657837,
+    "diagonal_ce": 0.5865939259529114,
+    "finite": 0.018499691039323807,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 524,
+    "loss": 0.6970679759979248,
+    "diagonal_ce": 0.6805688142776489,
+    "finite": 0.01649915613234043,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 525,
+    "loss": 0.5513212084770203,
+    "diagonal_ce": 0.5335600972175598,
+    "finite": 0.01776108518242836,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 526,
+    "loss": 0.6222240328788757,
+    "diagonal_ce": 0.6059207320213318,
+    "finite": 0.0163032915443182,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 527,
+    "loss": 0.5290552973747253,
+    "diagonal_ce": 0.513405442237854,
+    "finite": 0.015649830922484398,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 528,
+    "loss": 0.527915894985199,
+    "diagonal_ce": 0.5121625661849976,
+    "finite": 0.015753313899040222,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 529,
+    "loss": 0.5060659646987915,
+    "diagonal_ce": 0.49028897285461426,
+    "finite": 0.015777019783854485,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 530,
+    "loss": 0.7318223714828491,
+    "diagonal_ce": 0.7187910079956055,
+    "finite": 0.013031378388404846,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 531,
+    "loss": 0.6367942094802856,
+    "diagonal_ce": 0.62239670753479,
+    "finite": 0.014397498220205307,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 532,
+    "loss": 0.6004944443702698,
+    "diagonal_ce": 0.5861696600914001,
+    "finite": 0.014324766583740711,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 533,
+    "loss": 0.6585888266563416,
+    "diagonal_ce": 0.6445782780647278,
+    "finite": 0.01401054672896862,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 534,
+    "loss": 0.573524534702301,
+    "diagonal_ce": 0.5585248470306396,
+    "finite": 0.014999662525951862,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 535,
+    "loss": 0.7526350021362305,
+    "diagonal_ce": 0.7366021871566772,
+    "finite": 0.01603280007839203,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 536,
+    "loss": 0.47080376744270325,
+    "diagonal_ce": 0.4562428295612335,
+    "finite": 0.014560934156179428,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 537,
+    "loss": 0.6090667247772217,
+    "diagonal_ce": 0.594142735004425,
+    "finite": 0.014923996292054653,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 538,
+    "loss": 0.6106581091880798,
+    "diagonal_ce": 0.5967293977737427,
+    "finite": 0.01392871793359518,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 539,
+    "loss": 0.676858127117157,
+    "diagonal_ce": 0.6624531745910645,
+    "finite": 0.01440494880080223,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 540,
+    "loss": 0.6268742680549622,
+    "diagonal_ce": 0.6106095314025879,
+    "finite": 0.016264744102954865,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 541,
+    "loss": 0.5645159482955933,
+    "diagonal_ce": 0.5505557656288147,
+    "finite": 0.013960168696939945,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 542,
+    "loss": 0.7882531881332397,
+    "diagonal_ce": 0.7736791968345642,
+    "finite": 0.014574019238352776,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 543,
+    "loss": 0.5776463150978088,
+    "diagonal_ce": 0.5640395283699036,
+    "finite": 0.013606803491711617,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 544,
+    "loss": 0.7019368410110474,
+    "diagonal_ce": 0.686687707901001,
+    "finite": 0.015249110758304596,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 545,
+    "loss": 0.5340763926506042,
+    "diagonal_ce": 0.5198198556900024,
+    "finite": 0.014256535097956657,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 546,
+    "loss": 0.5181438326835632,
+    "diagonal_ce": 0.5041096210479736,
+    "finite": 0.014034205116331577,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 547,
+    "loss": 0.6605829000473022,
+    "diagonal_ce": 0.646726131439209,
+    "finite": 0.013856766745448112,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 548,
+    "loss": 0.5435114502906799,
+    "diagonal_ce": 0.5300104022026062,
+    "finite": 0.013501066714525223,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 549,
+    "loss": 0.5168514251708984,
+    "diagonal_ce": 0.5025110244750977,
+    "finite": 0.014340408146381378,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 550,
+    "loss": 0.5799723863601685,
+    "diagonal_ce": 0.5648676753044128,
+    "finite": 0.015104704536497593,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 551,
+    "loss": 0.6311435103416443,
+    "diagonal_ce": 0.6151133179664612,
+    "finite": 0.016030216589570045,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 552,
+    "loss": 0.6150109767913818,
+    "diagonal_ce": 0.6002059578895569,
+    "finite": 0.014805031940340996,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 553,
+    "loss": 0.6829022765159607,
+    "diagonal_ce": 0.6685949563980103,
+    "finite": 0.014307331293821335,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 554,
+    "loss": 0.6690447926521301,
+    "diagonal_ce": 0.6553296446800232,
+    "finite": 0.013715134933590889,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 555,
+    "loss": 0.7354040145874023,
+    "diagonal_ce": 0.7204458713531494,
+    "finite": 0.014958171173930168,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 556,
+    "loss": 0.5175671577453613,
+    "diagonal_ce": 0.5034370422363281,
+    "finite": 0.014130138792097569,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 557,
+    "loss": 0.5633156895637512,
+    "diagonal_ce": 0.5503152012825012,
+    "finite": 0.013000472448766232,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 558,
+    "loss": 0.5345790386199951,
+    "diagonal_ce": 0.5223364233970642,
+    "finite": 0.012242598459124565,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 559,
+    "loss": 0.5616412162780762,
+    "diagonal_ce": 0.54725581407547,
+    "finite": 0.01438540406525135,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 560,
+    "loss": 0.598503589630127,
+    "diagonal_ce": 0.585936427116394,
+    "finite": 0.012567142955958843,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 561,
+    "loss": 0.638524055480957,
+    "diagonal_ce": 0.6256587505340576,
+    "finite": 0.012865313328802586,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 562,
+    "loss": 0.5327693223953247,
+    "diagonal_ce": 0.5183181762695312,
+    "finite": 0.014451169408857822,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 563,
+    "loss": 0.5966244339942932,
+    "diagonal_ce": 0.5834324359893799,
+    "finite": 0.013192002661526203,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 564,
+    "loss": 0.6070969104766846,
+    "diagonal_ce": 0.5962904691696167,
+    "finite": 0.01080643106251955,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 565,
+    "loss": 0.6735056042671204,
+    "diagonal_ce": 0.660788357257843,
+    "finite": 0.012717225588858128,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 566,
+    "loss": 0.6545330882072449,
+    "diagonal_ce": 0.6425924897193909,
+    "finite": 0.011940577998757362,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 567,
+    "loss": 0.5721631050109863,
+    "diagonal_ce": 0.5597977638244629,
+    "finite": 0.01236532349139452,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 568,
+    "loss": 0.7566614151000977,
+    "diagonal_ce": 0.7458537817001343,
+    "finite": 0.010807624086737633,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 569,
+    "loss": 0.5459063053131104,
+    "diagonal_ce": 0.5346810221672058,
+    "finite": 0.01122527290135622,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 570,
+    "loss": 0.4459802806377411,
+    "diagonal_ce": 0.4335804581642151,
+    "finite": 0.012399827130138874,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 571,
+    "loss": 0.4579251706600189,
+    "diagonal_ce": 0.4463948905467987,
+    "finite": 0.011530272662639618,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 572,
+    "loss": 0.5018711090087891,
+    "diagonal_ce": 0.48923712968826294,
+    "finite": 0.012634003534913063,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 573,
+    "loss": 0.5594511032104492,
+    "diagonal_ce": 0.5480518937110901,
+    "finite": 0.01139920111745596,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 574,
+    "loss": 0.6386539340019226,
+    "diagonal_ce": 0.627204954624176,
+    "finite": 0.01144900731742382,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 575,
+    "loss": 0.7483478784561157,
+    "diagonal_ce": 0.7375432252883911,
+    "finite": 0.010804682038724422,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 576,
+    "loss": 0.6471668481826782,
+    "diagonal_ce": 0.6370682716369629,
+    "finite": 0.010098593309521675,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 577,
+    "loss": 0.6167723536491394,
+    "diagonal_ce": 0.6046761870384216,
+    "finite": 0.012096147984266281,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 578,
+    "loss": 0.563551664352417,
+    "diagonal_ce": 0.5524041652679443,
+    "finite": 0.011147497221827507,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 579,
+    "loss": 0.6696039438247681,
+    "diagonal_ce": 0.6605997085571289,
+    "finite": 0.0090042594820261,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 580,
+    "loss": 0.6670722365379333,
+    "diagonal_ce": 0.6562135219573975,
+    "finite": 0.010858729481697083,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 581,
+    "loss": 0.582184374332428,
+    "diagonal_ce": 0.5708792209625244,
+    "finite": 0.011305181309580803,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 582,
+    "loss": 0.7435131072998047,
+    "diagonal_ce": 0.7318216562271118,
+    "finite": 0.011691436171531677,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 583,
+    "loss": 0.5767515897750854,
+    "diagonal_ce": 0.5662277936935425,
+    "finite": 0.010523822158575058,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 584,
+    "loss": 0.6008018255233765,
+    "diagonal_ce": 0.588950514793396,
+    "finite": 0.011851332150399685,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 585,
+    "loss": 0.5863428711891174,
+    "diagonal_ce": 0.5747398734092712,
+    "finite": 0.011603021994233131,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 586,
+    "loss": 0.5283535718917847,
+    "diagonal_ce": 0.5162670016288757,
+    "finite": 0.012086543254554272,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 587,
+    "loss": 0.5617507100105286,
+    "diagonal_ce": 0.5480512976646423,
+    "finite": 0.013699430041015148,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 588,
+    "loss": 0.5048167705535889,
+    "diagonal_ce": 0.49348488450050354,
+    "finite": 0.011331886053085327,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 589,
+    "loss": 0.6207965016365051,
+    "diagonal_ce": 0.6096097230911255,
+    "finite": 0.011186782270669937,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 590,
+    "loss": 0.4849300980567932,
+    "diagonal_ce": 0.4737657308578491,
+    "finite": 0.011164378374814987,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 591,
+    "loss": 0.8984530568122864,
+    "diagonal_ce": 0.8877646923065186,
+    "finite": 0.01068834774196148,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 592,
+    "loss": 0.7102774977684021,
+    "diagonal_ce": 0.7002007961273193,
+    "finite": 0.010076727718114853,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 593,
+    "loss": 0.6492293477058411,
+    "diagonal_ce": 0.6388502717018127,
+    "finite": 0.010379078797996044,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 594,
+    "loss": 0.4986514747142792,
+    "diagonal_ce": 0.48939698934555054,
+    "finite": 0.009254476986825466,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 595,
+    "loss": 0.6055177450180054,
+    "diagonal_ce": 0.5940898060798645,
+    "finite": 0.011427929624915123,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 596,
+    "loss": 0.6225715279579163,
+    "diagonal_ce": 0.612570583820343,
+    "finite": 0.010000944137573242,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 597,
+    "loss": 0.586924135684967,
+    "diagonal_ce": 0.5771869421005249,
+    "finite": 0.009737183339893818,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 598,
+    "loss": 0.6395585536956787,
+    "diagonal_ce": 0.6292519569396973,
+    "finite": 0.010306615382432938,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 599,
+    "loss": 0.6718650460243225,
+    "diagonal_ce": 0.6628748774528503,
+    "finite": 0.008990141563117504,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 600,
+    "loss": 0.5512247681617737,
+    "diagonal_ce": 0.5410904884338379,
+    "finite": 0.010134292766451836,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 601,
+    "loss": 0.6468669772148132,
+    "diagonal_ce": 0.6377440094947815,
+    "finite": 0.009122952818870544,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 602,
+    "loss": 0.6296743750572205,
+    "diagonal_ce": 0.6199943423271179,
+    "finite": 0.009680010378360748,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 603,
+    "loss": 0.537834107875824,
+    "diagonal_ce": 0.5284162759780884,
+    "finite": 0.009417831897735596,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 604,
+    "loss": 0.49066731333732605,
+    "diagonal_ce": 0.48070836067199707,
+    "finite": 0.009958954527974129,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 605,
+    "loss": 0.6003963947296143,
+    "diagonal_ce": 0.5917304754257202,
+    "finite": 0.008665895089507103,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 606,
+    "loss": 0.5916875004768372,
+    "diagonal_ce": 0.5820155143737793,
+    "finite": 0.00967196561396122,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 607,
+    "loss": 0.785651445388794,
+    "diagonal_ce": 0.776777982711792,
+    "finite": 0.008873457089066505,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 608,
+    "loss": 0.4558711349964142,
+    "diagonal_ce": 0.44712820649147034,
+    "finite": 0.00874292105436325,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 609,
+    "loss": 0.4873217046260834,
+    "diagonal_ce": 0.4777073562145233,
+    "finite": 0.009614335373044014,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 610,
+    "loss": 0.7309101223945618,
+    "diagonal_ce": 0.7210524082183838,
+    "finite": 0.009857693687081337,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 611,
+    "loss": 0.5660988688468933,
+    "diagonal_ce": 0.555881917476654,
+    "finite": 0.010216966271400452,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 612,
+    "loss": 0.5343184471130371,
+    "diagonal_ce": 0.5242375135421753,
+    "finite": 0.010080920532345772,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 613,
+    "loss": 0.605339765548706,
+    "diagonal_ce": 0.5961235165596008,
+    "finite": 0.009216255508363247,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 614,
+    "loss": 0.590851366519928,
+    "diagonal_ce": 0.5810023546218872,
+    "finite": 0.009849028661847115,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 615,
+    "loss": 0.5192759037017822,
+    "diagonal_ce": 0.509079098701477,
+    "finite": 0.010196824558079243,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 616,
+    "loss": 0.4838307201862335,
+    "diagonal_ce": 0.47518032789230347,
+    "finite": 0.008650391362607479,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 617,
+    "loss": 0.5998514294624329,
+    "diagonal_ce": 0.5903928875923157,
+    "finite": 0.009458563290536404,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 618,
+    "loss": 0.6226804852485657,
+    "diagonal_ce": 0.6120803952217102,
+    "finite": 0.010600091889500618,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 619,
+    "loss": 0.7553141117095947,
+    "diagonal_ce": 0.7452737092971802,
+    "finite": 0.01004038192331791,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 620,
+    "loss": 0.6627117395401001,
+    "diagonal_ce": 0.6539012789726257,
+    "finite": 0.008810460567474365,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 621,
+    "loss": 0.677218496799469,
+    "diagonal_ce": 0.6679871082305908,
+    "finite": 0.009231379255652428,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 622,
+    "loss": 0.5131298303604126,
+    "diagonal_ce": 0.504089891910553,
+    "finite": 0.009039941243827343,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 623,
+    "loss": 0.5343592762947083,
+    "diagonal_ce": 0.5245434045791626,
+    "finite": 0.009815874509513378,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 624,
+    "loss": 0.5239041447639465,
+    "diagonal_ce": 0.5139783620834351,
+    "finite": 0.009925791062414646,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 625,
+    "loss": 0.556225597858429,
+    "diagonal_ce": 0.548145055770874,
+    "finite": 0.008080541156232357,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 626,
+    "loss": 0.606436014175415,
+    "diagonal_ce": 0.5978854298591614,
+    "finite": 0.008550582453608513,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 627,
+    "loss": 0.8149150609970093,
+    "diagonal_ce": 0.8061119914054871,
+    "finite": 0.008803091943264008,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 628,
+    "loss": 0.6141947507858276,
+    "diagonal_ce": 0.6059550046920776,
+    "finite": 0.00823976006358862,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 629,
+    "loss": 0.5206602811813354,
+    "diagonal_ce": 0.5121123790740967,
+    "finite": 0.008547872304916382,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 630,
+    "loss": 0.6101374626159668,
+    "diagonal_ce": 0.6029079556465149,
+    "finite": 0.0072294785641133785,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 631,
+    "loss": 0.39149367809295654,
+    "diagonal_ce": 0.383247971534729,
+    "finite": 0.008245697245001793,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 632,
+    "loss": 0.7350402474403381,
+    "diagonal_ce": 0.7273446917533875,
+    "finite": 0.007695527747273445,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 633,
+    "loss": 0.5028181076049805,
+    "diagonal_ce": 0.4948224723339081,
+    "finite": 0.007995622232556343,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 634,
+    "loss": 0.6111866235733032,
+    "diagonal_ce": 0.6033226847648621,
+    "finite": 0.00786393228918314,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 635,
+    "loss": 0.5644696950912476,
+    "diagonal_ce": 0.556158185005188,
+    "finite": 0.008311523124575615,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 636,
+    "loss": 0.7013010382652283,
+    "diagonal_ce": 0.6918712258338928,
+    "finite": 0.00942983292043209,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 637,
+    "loss": 0.4612039029598236,
+    "diagonal_ce": 0.452532559633255,
+    "finite": 0.008671357296407223,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 638,
+    "loss": 0.6093447804450989,
+    "diagonal_ce": 0.6008826494216919,
+    "finite": 0.008462106809020042,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 639,
+    "loss": 0.44109588861465454,
+    "diagonal_ce": 0.43239259719848633,
+    "finite": 0.00870328489691019,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 640,
+    "loss": 0.5358665585517883,
+    "diagonal_ce": 0.5278182029724121,
+    "finite": 0.008048378862440586,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 641,
+    "loss": 0.5436427593231201,
+    "diagonal_ce": 0.5344996452331543,
+    "finite": 0.009143118746578693,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 642,
+    "loss": 0.6733269691467285,
+    "diagonal_ce": 0.6654145121574402,
+    "finite": 0.007912470027804375,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 643,
+    "loss": 0.7949280738830566,
+    "diagonal_ce": 0.7867088913917542,
+    "finite": 0.008219198323786259,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 644,
+    "loss": 0.6714023947715759,
+    "diagonal_ce": 0.6626521348953247,
+    "finite": 0.00875028781592846,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 645,
+    "loss": 0.5213226079940796,
+    "diagonal_ce": 0.5136758089065552,
+    "finite": 0.007646818179637194,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 646,
+    "loss": 0.579781711101532,
+    "diagonal_ce": 0.5714555382728577,
+    "finite": 0.008326193317770958,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 647,
+    "loss": 0.5978947281837463,
+    "diagonal_ce": 0.5917291641235352,
+    "finite": 0.0061655850149691105,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 648,
+    "loss": 0.5109679698944092,
+    "diagonal_ce": 0.5044748783111572,
+    "finite": 0.00649309903383255,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 649,
+    "loss": 0.5288452506065369,
+    "diagonal_ce": 0.5211489200592041,
+    "finite": 0.007696311920881271,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 650,
+    "loss": 0.5878691673278809,
+    "diagonal_ce": 0.579733669757843,
+    "finite": 0.008135473355650902,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 651,
+    "loss": 0.6111144423484802,
+    "diagonal_ce": 0.6029661297798157,
+    "finite": 0.008148283697664738,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 652,
+    "loss": 0.4487120807170868,
+    "diagonal_ce": 0.43970435857772827,
+    "finite": 0.009007716551423073,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 653,
+    "loss": 0.6331949830055237,
+    "diagonal_ce": 0.624643862247467,
+    "finite": 0.008551100268959999,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 654,
+    "loss": 0.5956894159317017,
+    "diagonal_ce": 0.5879713296890259,
+    "finite": 0.007718069478869438,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 655,
+    "loss": 0.4583145081996918,
+    "diagonal_ce": 0.45091313123703003,
+    "finite": 0.00740137230604887,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 656,
+    "loss": 0.5159623622894287,
+    "diagonal_ce": 0.507940411567688,
+    "finite": 0.008021936751902103,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 657,
+    "loss": 0.7928258180618286,
+    "diagonal_ce": 0.7859463095664978,
+    "finite": 0.006879524793475866,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 658,
+    "loss": 0.6157294511795044,
+    "diagonal_ce": 0.6074747443199158,
+    "finite": 0.008254720829427242,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 659,
+    "loss": 0.6901326179504395,
+    "diagonal_ce": 0.6825571656227112,
+    "finite": 0.007575437892228365,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 660,
+    "loss": 0.7289746403694153,
+    "diagonal_ce": 0.7215388417243958,
+    "finite": 0.00743579538539052,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 661,
+    "loss": 0.6753803491592407,
+    "diagonal_ce": 0.6664649844169617,
+    "finite": 0.00891535822302103,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 662,
+    "loss": 0.5176945924758911,
+    "diagonal_ce": 0.5101022124290466,
+    "finite": 0.007592353969812393,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 663,
+    "loss": 0.5755003690719604,
+    "diagonal_ce": 0.5681465268135071,
+    "finite": 0.007353830151259899,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 664,
+    "loss": 0.7143294811248779,
+    "diagonal_ce": 0.7066959738731384,
+    "finite": 0.007633533328771591,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 665,
+    "loss": 0.643746554851532,
+    "diagonal_ce": 0.6351837515830994,
+    "finite": 0.008562801405787468,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 666,
+    "loss": 0.5382785797119141,
+    "diagonal_ce": 0.529930830001831,
+    "finite": 0.008347720839083195,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 667,
+    "loss": 0.4940456748008728,
+    "diagonal_ce": 0.4870603382587433,
+    "finite": 0.006985323037952185,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 668,
+    "loss": 0.4279005527496338,
+    "diagonal_ce": 0.42158594727516174,
+    "finite": 0.006314592901617289,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 669,
+    "loss": 0.5933705568313599,
+    "diagonal_ce": 0.5858733654022217,
+    "finite": 0.007497186306864023,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 670,
+    "loss": 0.6366049647331238,
+    "diagonal_ce": 0.6295660734176636,
+    "finite": 0.007038918323814869,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 671,
+    "loss": 0.5111297369003296,
+    "diagonal_ce": 0.505505383014679,
+    "finite": 0.005624332930892706,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 672,
+    "loss": 0.7506306171417236,
+    "diagonal_ce": 0.7439679503440857,
+    "finite": 0.0066626728512346745,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 673,
+    "loss": 0.5125833749771118,
+    "diagonal_ce": 0.5063104033470154,
+    "finite": 0.00627299677580595,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 674,
+    "loss": 0.49144116044044495,
+    "diagonal_ce": 0.4842877984046936,
+    "finite": 0.007153376005589962,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 675,
+    "loss": 0.6944558024406433,
+    "diagonal_ce": 0.6864891648292542,
+    "finite": 0.007966640405356884,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 676,
+    "loss": 0.5594035387039185,
+    "diagonal_ce": 0.5512566566467285,
+    "finite": 0.00814690999686718,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 677,
+    "loss": 0.6736543774604797,
+    "diagonal_ce": 0.6662617921829224,
+    "finite": 0.007392571773380041,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 678,
+    "loss": 0.8058139681816101,
+    "diagonal_ce": 0.7982680797576904,
+    "finite": 0.007545914966613054,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 679,
+    "loss": 0.5400267839431763,
+    "diagonal_ce": 0.5320441126823425,
+    "finite": 0.00798267126083374,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 680,
+    "loss": 0.5727203488349915,
+    "diagonal_ce": 0.5648512840270996,
+    "finite": 0.007869082503020763,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 681,
+    "loss": 0.595813512802124,
+    "diagonal_ce": 0.5880692601203918,
+    "finite": 0.007744249887764454,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 682,
+    "loss": 0.7573827505111694,
+    "diagonal_ce": 0.7495984435081482,
+    "finite": 0.007784286513924599,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 683,
+    "loss": 0.612346351146698,
+    "diagonal_ce": 0.6051459312438965,
+    "finite": 0.007200443651527166,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 684,
+    "loss": 0.573434591293335,
+    "diagonal_ce": 0.5652711987495422,
+    "finite": 0.008163373917341232,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 685,
+    "loss": 0.6594268083572388,
+    "diagonal_ce": 0.6515123248100281,
+    "finite": 0.007914458401501179,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 686,
+    "loss": 0.5910385251045227,
+    "diagonal_ce": 0.5845412611961365,
+    "finite": 0.006497264374047518,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 687,
+    "loss": 0.639155387878418,
+    "diagonal_ce": 0.6328718066215515,
+    "finite": 0.006283598951995373,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 688,
+    "loss": 0.5139408111572266,
+    "diagonal_ce": 0.5079089999198914,
+    "finite": 0.006031784228980541,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 689,
+    "loss": 0.7041627168655396,
+    "diagonal_ce": 0.6988198757171631,
+    "finite": 0.005342837423086166,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 690,
+    "loss": 0.7353074550628662,
+    "diagonal_ce": 0.7281829714775085,
+    "finite": 0.0071245101280510426,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 691,
+    "loss": 0.7025004029273987,
+    "diagonal_ce": 0.6959900259971619,
+    "finite": 0.006510400213301182,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 692,
+    "loss": 0.627493143081665,
+    "diagonal_ce": 0.6214544177055359,
+    "finite": 0.00603872537612915,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 693,
+    "loss": 0.5960169434547424,
+    "diagonal_ce": 0.5906808972358704,
+    "finite": 0.00533606531098485,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 694,
+    "loss": 0.49401456117630005,
+    "diagonal_ce": 0.488330602645874,
+    "finite": 0.0056839436292648315,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 695,
+    "loss": 0.6306723952293396,
+    "diagonal_ce": 0.6240099668502808,
+    "finite": 0.006662424653768539,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 696,
+    "loss": 0.5326254367828369,
+    "diagonal_ce": 0.5255710482597351,
+    "finite": 0.007054400630295277,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 697,
+    "loss": 0.4954960346221924,
+    "diagonal_ce": 0.4887072741985321,
+    "finite": 0.006788752507418394,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 698,
+    "loss": 0.5809249877929688,
+    "diagonal_ce": 0.5741643309593201,
+    "finite": 0.0067606535740196705,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 699,
+    "loss": 0.4688231647014618,
+    "diagonal_ce": 0.4626196324825287,
+    "finite": 0.006203541066497564,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 700,
+    "loss": 0.59879469871521,
+    "diagonal_ce": 0.5941352248191833,
+    "finite": 0.004659448750317097,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 701,
+    "loss": 0.6935173869132996,
+    "diagonal_ce": 0.6859790086746216,
+    "finite": 0.007538384757936001,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 702,
+    "loss": 0.5242071151733398,
+    "diagonal_ce": 0.5191726684570312,
+    "finite": 0.005034463480114937,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 703,
+    "loss": 0.5198773145675659,
+    "diagonal_ce": 0.5146153569221497,
+    "finite": 0.005261946003884077,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 704,
+    "loss": 0.6280377507209778,
+    "diagonal_ce": 0.6226241588592529,
+    "finite": 0.005413577426224947,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 705,
+    "loss": 0.7076901793479919,
+    "diagonal_ce": 0.7012805938720703,
+    "finite": 0.0064095789566636086,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 706,
+    "loss": 0.58082515001297,
+    "diagonal_ce": 0.5754550695419312,
+    "finite": 0.005370075814425945,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 707,
+    "loss": 0.6482847332954407,
+    "diagonal_ce": 0.6426904797554016,
+    "finite": 0.005594266578555107,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 708,
+    "loss": 0.5462526082992554,
+    "diagonal_ce": 0.5401334166526794,
+    "finite": 0.006119169760495424,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 709,
+    "loss": 0.5578601956367493,
+    "diagonal_ce": 0.5517117977142334,
+    "finite": 0.00614842027425766,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 710,
+    "loss": 0.5941129326820374,
+    "diagonal_ce": 0.5880698561668396,
+    "finite": 0.006043069064617157,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 711,
+    "loss": 0.5012702941894531,
+    "diagonal_ce": 0.4955810606479645,
+    "finite": 0.005689256824553013,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 712,
+    "loss": 0.6353463530540466,
+    "diagonal_ce": 0.6297165155410767,
+    "finite": 0.005629836115986109,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 713,
+    "loss": 0.5407114028930664,
+    "diagonal_ce": 0.5342450141906738,
+    "finite": 0.006466382183134556,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 714,
+    "loss": 0.4269896149635315,
+    "diagonal_ce": 0.4210900068283081,
+    "finite": 0.005899622105062008,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 715,
+    "loss": 0.6055414080619812,
+    "diagonal_ce": 0.5987833142280579,
+    "finite": 0.006758102215826511,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 716,
+    "loss": 0.6489261984825134,
+    "diagonal_ce": 0.6414657831192017,
+    "finite": 0.007460413035005331,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 717,
+    "loss": 0.6034770607948303,
+    "diagonal_ce": 0.5967567563056946,
+    "finite": 0.00672032218426466,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 718,
+    "loss": 0.6145187616348267,
+    "diagonal_ce": 0.6084722280502319,
+    "finite": 0.006046507507562637,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 719,
+    "loss": 0.6042395830154419,
+    "diagonal_ce": 0.5980110168457031,
+    "finite": 0.006228553131222725,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 720,
+    "loss": 0.5209748148918152,
+    "diagonal_ce": 0.5153365135192871,
+    "finite": 0.005638290662318468,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 721,
+    "loss": 0.5177671313285828,
+    "diagonal_ce": 0.5126168131828308,
+    "finite": 0.005150323733687401,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 722,
+    "loss": 0.5031850337982178,
+    "diagonal_ce": 0.4958106279373169,
+    "finite": 0.007374422159045935,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 723,
+    "loss": 0.50382000207901,
+    "diagonal_ce": 0.4970121681690216,
+    "finite": 0.006807848811149597,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 724,
+    "loss": 0.5917925238609314,
+    "diagonal_ce": 0.5859212875366211,
+    "finite": 0.005871220957487822,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 725,
+    "loss": 0.6642739176750183,
+    "diagonal_ce": 0.6570364236831665,
+    "finite": 0.0072375028394162655,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 726,
+    "loss": 0.5758785605430603,
+    "diagonal_ce": 0.5702481865882874,
+    "finite": 0.005630383267998695,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 727,
+    "loss": 0.39212143421173096,
+    "diagonal_ce": 0.3861486613750458,
+    "finite": 0.005972779355943203,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 728,
+    "loss": 0.5828346014022827,
+    "diagonal_ce": 0.5764625072479248,
+    "finite": 0.006372079718858004,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 729,
+    "loss": 0.6042951941490173,
+    "diagonal_ce": 0.5981358289718628,
+    "finite": 0.0061593628488481045,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 730,
+    "loss": 0.5995025038719177,
+    "diagonal_ce": 0.5924692749977112,
+    "finite": 0.007033240050077438,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 731,
+    "loss": 0.5489842891693115,
+    "diagonal_ce": 0.5430288910865784,
+    "finite": 0.005955368280410767,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 732,
+    "loss": 0.5685091018676758,
+    "diagonal_ce": 0.5634715557098389,
+    "finite": 0.005037540104240179,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 733,
+    "loss": 0.47914251685142517,
+    "diagonal_ce": 0.47332656383514404,
+    "finite": 0.005815954878926277,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 734,
+    "loss": 0.653533399105072,
+    "diagonal_ce": 0.6480089426040649,
+    "finite": 0.00552446860820055,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 735,
+    "loss": 0.592214047908783,
+    "diagonal_ce": 0.5857126116752625,
+    "finite": 0.006501408293843269,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 736,
+    "loss": 0.7437296509742737,
+    "diagonal_ce": 0.738357663154602,
+    "finite": 0.005371990147978067,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 737,
+    "loss": 0.40659528970718384,
+    "diagonal_ce": 0.39899930357933044,
+    "finite": 0.007595983799546957,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 738,
+    "loss": 0.4651910662651062,
+    "diagonal_ce": 0.45819297432899475,
+    "finite": 0.00699809193611145,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 739,
+    "loss": 0.3871261179447174,
+    "diagonal_ce": 0.38016295433044434,
+    "finite": 0.00696317246183753,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 740,
+    "loss": 0.4938567578792572,
+    "diagonal_ce": 0.48773571848869324,
+    "finite": 0.006121025886386633,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 741,
+    "loss": 0.6874012351036072,
+    "diagonal_ce": 0.6807235479354858,
+    "finite": 0.00667768158018589,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 742,
+    "loss": 0.5790383219718933,
+    "diagonal_ce": 0.5720372796058655,
+    "finite": 0.007001029327511787,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 743,
+    "loss": 0.5823857188224792,
+    "diagonal_ce": 0.5744723677635193,
+    "finite": 0.007913348264992237,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 744,
+    "loss": 0.6669067144393921,
+    "diagonal_ce": 0.656377375125885,
+    "finite": 0.010529354214668274,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 745,
+    "loss": 0.4654569923877716,
+    "diagonal_ce": 0.45869675278663635,
+    "finite": 0.006760247517377138,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 746,
+    "loss": 0.7244997024536133,
+    "diagonal_ce": 0.7184880375862122,
+    "finite": 0.00601166021078825,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 747,
+    "loss": 0.46043506264686584,
+    "diagonal_ce": 0.4543153643608093,
+    "finite": 0.006119703408330679,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 748,
+    "loss": 0.4528111219406128,
+    "diagonal_ce": 0.4478117525577545,
+    "finite": 0.004999356344342232,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 749,
+    "loss": 0.6034864187240601,
+    "diagonal_ce": 0.5964399576187134,
+    "finite": 0.007046479266136885,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 750,
+    "loss": 0.5969497561454773,
+    "diagonal_ce": 0.5911222100257874,
+    "finite": 0.005827555898576975,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 751,
+    "loss": 0.6282649636268616,
+    "diagonal_ce": 0.6226179003715515,
+    "finite": 0.0056470539420843124,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 752,
+    "loss": 0.6155189275741577,
+    "diagonal_ce": 0.608855128288269,
+    "finite": 0.0066637806594371796,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 753,
+    "loss": 0.5230832695960999,
+    "diagonal_ce": 0.5174530148506165,
+    "finite": 0.0056302486918866634,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 754,
+    "loss": 0.6214657425880432,
+    "diagonal_ce": 0.6135199666023254,
+    "finite": 0.00794574711471796,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 755,
+    "loss": 0.5509589314460754,
+    "diagonal_ce": 0.5457984209060669,
+    "finite": 0.005160487722605467,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 756,
+    "loss": 0.5346243381500244,
+    "diagonal_ce": 0.5287739038467407,
+    "finite": 0.005850439891219139,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 757,
+    "loss": 0.5541980862617493,
+    "diagonal_ce": 0.5488003492355347,
+    "finite": 0.005397708620876074,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 758,
+    "loss": 0.6023750901222229,
+    "diagonal_ce": 0.5970009565353394,
+    "finite": 0.005374159198254347,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 759,
+    "loss": 0.6202178597450256,
+    "diagonal_ce": 0.6146104335784912,
+    "finite": 0.0056074378080666065,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 760,
+    "loss": 0.6581442356109619,
+    "diagonal_ce": 0.6522322297096252,
+    "finite": 0.005912011489272118,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 761,
+    "loss": 0.6771562695503235,
+    "diagonal_ce": 0.6721134185791016,
+    "finite": 0.005042857024818659,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 762,
+    "loss": 0.5520400404930115,
+    "diagonal_ce": 0.5459381341934204,
+    "finite": 0.006101878359913826,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 763,
+    "loss": 0.5993403792381287,
+    "diagonal_ce": 0.5917047262191772,
+    "finite": 0.00763567304238677,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 764,
+    "loss": 0.5349870920181274,
+    "diagonal_ce": 0.5283200740814209,
+    "finite": 0.0066670021042227745,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 765,
+    "loss": 0.5196247100830078,
+    "diagonal_ce": 0.5135496258735657,
+    "finite": 0.006075065117329359,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 766,
+    "loss": 0.5443314909934998,
+    "diagonal_ce": 0.5357762575149536,
+    "finite": 0.008555215783417225,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 767,
+    "loss": 0.6704074144363403,
+    "diagonal_ce": 0.6638140082359314,
+    "finite": 0.006593433674424887,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 768,
+    "loss": 0.5294128060340881,
+    "diagonal_ce": 0.5231624841690063,
+    "finite": 0.006250328384339809,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 769,
+    "loss": 0.5705233812332153,
+    "diagonal_ce": 0.5611991882324219,
+    "finite": 0.009324194863438606,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 770,
+    "loss": 0.5802000164985657,
+    "diagonal_ce": 0.5734050273895264,
+    "finite": 0.006794964428991079,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 771,
+    "loss": 0.5638351440429688,
+    "diagonal_ce": 0.556929349899292,
+    "finite": 0.006905789487063885,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 772,
+    "loss": 0.4980980455875397,
+    "diagonal_ce": 0.49151721596717834,
+    "finite": 0.006580821238458157,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 773,
+    "loss": 0.5070294737815857,
+    "diagonal_ce": 0.5018641948699951,
+    "finite": 0.00516530079767108,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 774,
+    "loss": 0.5018056035041809,
+    "diagonal_ce": 0.4959375858306885,
+    "finite": 0.0058680130168795586,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 775,
+    "loss": 0.5686250925064087,
+    "diagonal_ce": 0.5632296800613403,
+    "finite": 0.005395402200520039,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 776,
+    "loss": 0.5665005445480347,
+    "diagonal_ce": 0.559552788734436,
+    "finite": 0.006947750225663185,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 777,
+    "loss": 0.5235010981559753,
+    "diagonal_ce": 0.5187853574752808,
+    "finite": 0.004715760704129934,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 778,
+    "loss": 0.5351263284683228,
+    "diagonal_ce": 0.5297474265098572,
+    "finite": 0.00537892198190093,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 779,
+    "loss": 0.46582260727882385,
+    "diagonal_ce": 0.46142029762268066,
+    "finite": 0.004402295220643282,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 780,
+    "loss": 0.46495765447616577,
+    "diagonal_ce": 0.4584329426288605,
+    "finite": 0.006524713709950447,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 781,
+    "loss": 0.4873627722263336,
+    "diagonal_ce": 0.48225343227386475,
+    "finite": 0.005109329707920551,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 782,
+    "loss": 0.568583071231842,
+    "diagonal_ce": 0.5632913112640381,
+    "finite": 0.0052917711436748505,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 783,
+    "loss": 0.4877476990222931,
+    "diagonal_ce": 0.48149481415748596,
+    "finite": 0.00625289510935545,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 784,
+    "loss": 0.5013951659202576,
+    "diagonal_ce": 0.49692243337631226,
+    "finite": 0.0044727385975420475,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 785,
+    "loss": 0.512033224105835,
+    "diagonal_ce": 0.5057892799377441,
+    "finite": 0.006243942305445671,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 786,
+    "loss": 0.4942454695701599,
+    "diagonal_ce": 0.4870906174182892,
+    "finite": 0.007154849823564291,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 787,
+    "loss": 0.6734670400619507,
+    "diagonal_ce": 0.6673418283462524,
+    "finite": 0.006125199142843485,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 788,
+    "loss": 0.6318269371986389,
+    "diagonal_ce": 0.6264512538909912,
+    "finite": 0.005375697743147612,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 789,
+    "loss": 0.5028437972068787,
+    "diagonal_ce": 0.4976605474948883,
+    "finite": 0.005183238536119461,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 790,
+    "loss": 0.5684487819671631,
+    "diagonal_ce": 0.5635743737220764,
+    "finite": 0.004874427802860737,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 791,
+    "loss": 0.6304670572280884,
+    "diagonal_ce": 0.6251676082611084,
+    "finite": 0.005299433600157499,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 792,
+    "loss": 0.4995303750038147,
+    "diagonal_ce": 0.4954448938369751,
+    "finite": 0.0040854886174201965,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 793,
+    "loss": 0.47471264004707336,
+    "diagonal_ce": 0.470079630613327,
+    "finite": 0.004632994998246431,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 794,
+    "loss": 0.6906453371047974,
+    "diagonal_ce": 0.6836915612220764,
+    "finite": 0.006953774020075798,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 795,
+    "loss": 0.6655197739601135,
+    "diagonal_ce": 0.6592100262641907,
+    "finite": 0.006309773772954941,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 796,
+    "loss": 0.5233592391014099,
+    "diagonal_ce": 0.5174532532691956,
+    "finite": 0.005905990954488516,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 797,
+    "loss": 0.4656547009944916,
+    "diagonal_ce": 0.45985981822013855,
+    "finite": 0.00579487532377243,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 798,
+    "loss": 0.4461555480957031,
+    "diagonal_ce": 0.4388057291507721,
+    "finite": 0.007349804975092411,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 799,
+    "loss": 0.523564875125885,
+    "diagonal_ce": 0.5132700800895691,
+    "finite": 0.010294795967638493,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 800,
+    "loss": 0.5474784970283508,
+    "diagonal_ce": 0.5372216105461121,
+    "finite": 0.010256904177367687,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 801,
+    "loss": 0.7017863988876343,
+    "diagonal_ce": 0.6909029483795166,
+    "finite": 0.010883446782827377,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 802,
+    "loss": 0.5958714485168457,
+    "diagonal_ce": 0.5843381285667419,
+    "finite": 0.011533325538039207,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 803,
+    "loss": 0.6585777401924133,
+    "diagonal_ce": 0.6514270305633545,
+    "finite": 0.0071507347747683525,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 804,
+    "loss": 0.39493370056152344,
+    "diagonal_ce": 0.3876396715641022,
+    "finite": 0.007294026203453541,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 805,
+    "loss": 0.575885534286499,
+    "diagonal_ce": 0.5688033699989319,
+    "finite": 0.00708217266947031,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 806,
+    "loss": 0.5023419857025146,
+    "diagonal_ce": 0.49661028385162354,
+    "finite": 0.005731683224439621,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 807,
+    "loss": 0.48783475160598755,
+    "diagonal_ce": 0.481813907623291,
+    "finite": 0.006020829547196627,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 808,
+    "loss": 0.6357893943786621,
+    "diagonal_ce": 0.6307830810546875,
+    "finite": 0.005006309598684311,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 809,
+    "loss": 0.6655011177062988,
+    "diagonal_ce": 0.6598958373069763,
+    "finite": 0.00560530461370945,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 810,
+    "loss": 0.4394412636756897,
+    "diagonal_ce": 0.43243497610092163,
+    "finite": 0.0070062982849776745,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 811,
+    "loss": 0.6125896573066711,
+    "diagonal_ce": 0.6083641052246094,
+    "finite": 0.004225544165819883,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 812,
+    "loss": 0.49754810333251953,
+    "diagonal_ce": 0.4921131730079651,
+    "finite": 0.00543493777513504,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 813,
+    "loss": 0.4757639467716217,
+    "diagonal_ce": 0.4702734053134918,
+    "finite": 0.005490536335855722,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 814,
+    "loss": 0.636618435382843,
+    "diagonal_ce": 0.6321563720703125,
+    "finite": 0.004462063778191805,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 815,
+    "loss": 0.8618163466453552,
+    "diagonal_ce": 0.8539515137672424,
+    "finite": 0.007864835672080517,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 816,
+    "loss": 0.7235003113746643,
+    "diagonal_ce": 0.7170732021331787,
+    "finite": 0.006427127867937088,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 817,
+    "loss": 0.4608389139175415,
+    "diagonal_ce": 0.456059068441391,
+    "finite": 0.004779833368957043,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 818,
+    "loss": 0.47293755412101746,
+    "diagonal_ce": 0.46664559841156006,
+    "finite": 0.006291944067925215,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 819,
+    "loss": 0.49559667706489563,
+    "diagonal_ce": 0.4887877404689789,
+    "finite": 0.006808947771787643,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 820,
+    "loss": 0.509457528591156,
+    "diagonal_ce": 0.502822995185852,
+    "finite": 0.006634504999965429,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 821,
+    "loss": 0.4455493092536926,
+    "diagonal_ce": 0.4397084414958954,
+    "finite": 0.005840857978910208,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 822,
+    "loss": 0.5696754455566406,
+    "diagonal_ce": 0.5619443655014038,
+    "finite": 0.007731080986559391,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 823,
+    "loss": 0.49776190519332886,
+    "diagonal_ce": 0.49123474955558777,
+    "finite": 0.00652714679017663,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 824,
+    "loss": 0.48365068435668945,
+    "diagonal_ce": 0.47579115629196167,
+    "finite": 0.00785953737795353,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 825,
+    "loss": 0.5158015489578247,
+    "diagonal_ce": 0.5092089176177979,
+    "finite": 0.006592645309865475,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 826,
+    "loss": 0.5954440832138062,
+    "diagonal_ce": 0.5911053419113159,
+    "finite": 0.004338755272328854,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 827,
+    "loss": 0.5807132720947266,
+    "diagonal_ce": 0.5759730339050293,
+    "finite": 0.004740266595035791,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 828,
+    "loss": 0.3725481629371643,
+    "diagonal_ce": 0.3681032657623291,
+    "finite": 0.004444899503141642,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 829,
+    "loss": 0.5308090448379517,
+    "diagonal_ce": 0.5238667130470276,
+    "finite": 0.006942336447536945,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 830,
+    "loss": 0.6335241198539734,
+    "diagonal_ce": 0.628877580165863,
+    "finite": 0.0046465652994811535,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 831,
+    "loss": 0.5237299799919128,
+    "diagonal_ce": 0.5172346234321594,
+    "finite": 0.006495336070656776,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 832,
+    "loss": 0.8111534118652344,
+    "diagonal_ce": 0.8056508898735046,
+    "finite": 0.005502538755536079,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 833,
+    "loss": 0.6222092509269714,
+    "diagonal_ce": 0.616165041923523,
+    "finite": 0.006044226698577404,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 834,
+    "loss": 0.7149990797042847,
+    "diagonal_ce": 0.7080711126327515,
+    "finite": 0.006927996873855591,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 835,
+    "loss": 0.6276789903640747,
+    "diagonal_ce": 0.6208916306495667,
+    "finite": 0.006787364836782217,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 836,
+    "loss": 0.545329749584198,
+    "diagonal_ce": 0.5387950539588928,
+    "finite": 0.006534721702337265,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 837,
+    "loss": 0.46386072039604187,
+    "diagonal_ce": 0.4575711786746979,
+    "finite": 0.006289544049650431,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 838,
+    "loss": 0.5388756990432739,
+    "diagonal_ce": 0.5320637822151184,
+    "finite": 0.006811896339058876,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 839,
+    "loss": 0.6065017580986023,
+    "diagonal_ce": 0.5990663766860962,
+    "finite": 0.007435367908328772,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 840,
+    "loss": 0.7993283867835999,
+    "diagonal_ce": 0.7929359674453735,
+    "finite": 0.006392435636371374,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 841,
+    "loss": 0.47384950518608093,
+    "diagonal_ce": 0.4673815369606018,
+    "finite": 0.006467982195317745,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 842,
+    "loss": 0.5604268312454224,
+    "diagonal_ce": 0.5536066293716431,
+    "finite": 0.006820179987698793,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 843,
+    "loss": 0.7154809832572937,
+    "diagonal_ce": 0.7069144248962402,
+    "finite": 0.008566545322537422,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 844,
+    "loss": 0.49197155237197876,
+    "diagonal_ce": 0.4871358275413513,
+    "finite": 0.004835735075175762,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 845,
+    "loss": 0.550067126750946,
+    "diagonal_ce": 0.5437185764312744,
+    "finite": 0.0063485694117844105,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 846,
+    "loss": 0.46488291025161743,
+    "diagonal_ce": 0.4587379992008209,
+    "finite": 0.006144898943603039,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 847,
+    "loss": 0.5616777539253235,
+    "diagonal_ce": 0.553398847579956,
+    "finite": 0.008278927765786648,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 848,
+    "loss": 0.5094170570373535,
+    "diagonal_ce": 0.5021622180938721,
+    "finite": 0.007254858035594225,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 849,
+    "loss": 0.6369756460189819,
+    "diagonal_ce": 0.6293386816978455,
+    "finite": 0.007636993657797575,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 850,
+    "loss": 0.42707014083862305,
+    "diagonal_ce": 0.4200599491596222,
+    "finite": 0.00701019074767828,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 851,
+    "loss": 0.5732865333557129,
+    "diagonal_ce": 0.5652807354927063,
+    "finite": 0.008005786687135696,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 852,
+    "loss": 0.5480430126190186,
+    "diagonal_ce": 0.5420964956283569,
+    "finite": 0.005946533754467964,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 853,
+    "loss": 0.4526594877243042,
+    "diagonal_ce": 0.4458290636539459,
+    "finite": 0.006830437108874321,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 854,
+    "loss": 0.6816496253013611,
+    "diagonal_ce": 0.6724427342414856,
+    "finite": 0.009206913411617279,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 855,
+    "loss": 0.64021235704422,
+    "diagonal_ce": 0.6338539719581604,
+    "finite": 0.006358372513204813,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 856,
+    "loss": 0.4447290897369385,
+    "diagonal_ce": 0.44007664918899536,
+    "finite": 0.004652446135878563,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 857,
+    "loss": 0.4479391276836395,
+    "diagonal_ce": 0.4419925808906555,
+    "finite": 0.005946558900177479,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 858,
+    "loss": 0.4562253952026367,
+    "diagonal_ce": 0.44985878467559814,
+    "finite": 0.006366615649312735,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 859,
+    "loss": 0.503882884979248,
+    "diagonal_ce": 0.4964403510093689,
+    "finite": 0.007442510686814785,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 860,
+    "loss": 0.5780331492424011,
+    "diagonal_ce": 0.5702403783798218,
+    "finite": 0.007792773190885782,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 861,
+    "loss": 0.6321535110473633,
+    "diagonal_ce": 0.6244366765022278,
+    "finite": 0.007716820575296879,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 862,
+    "loss": 0.6126351356506348,
+    "diagonal_ce": 0.6063548922538757,
+    "finite": 0.0062802317552268505,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 863,
+    "loss": 0.7492361068725586,
+    "diagonal_ce": 0.7432650327682495,
+    "finite": 0.005971055012196302,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 864,
+    "loss": 0.5674687027931213,
+    "diagonal_ce": 0.5596107840538025,
+    "finite": 0.007857943885028362,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 865,
+    "loss": 0.5943393707275391,
+    "diagonal_ce": 0.5847892165184021,
+    "finite": 0.009550146758556366,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 866,
+    "loss": 0.5456478595733643,
+    "diagonal_ce": 0.538981020450592,
+    "finite": 0.006666810251772404,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 867,
+    "loss": 0.4895772337913513,
+    "diagonal_ce": 0.4831171929836273,
+    "finite": 0.006460033357143402,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 868,
+    "loss": 0.4848993122577667,
+    "diagonal_ce": 0.4775504767894745,
+    "finite": 0.007348830811679363,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 869,
+    "loss": 0.666684091091156,
+    "diagonal_ce": 0.6572362184524536,
+    "finite": 0.009447877295315266,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 870,
+    "loss": 0.5173861384391785,
+    "diagonal_ce": 0.5112637281417847,
+    "finite": 0.006122388876974583,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 871,
+    "loss": 0.6283849477767944,
+    "diagonal_ce": 0.6192231774330139,
+    "finite": 0.009161768481135368,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 872,
+    "loss": 0.5192814469337463,
+    "diagonal_ce": 0.5111588835716248,
+    "finite": 0.008122578263282776,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 873,
+    "loss": 0.49278202652931213,
+    "diagonal_ce": 0.4836049973964691,
+    "finite": 0.009177030064165592,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 874,
+    "loss": 0.6481224298477173,
+    "diagonal_ce": 0.6402440071105957,
+    "finite": 0.00787840411067009,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 875,
+    "loss": 0.5423305034637451,
+    "diagonal_ce": 0.5339985489845276,
+    "finite": 0.008331956341862679,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 876,
+    "loss": 0.6148635149002075,
+    "diagonal_ce": 0.6086366772651672,
+    "finite": 0.0062268199399113655,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 877,
+    "loss": 0.5449190735816956,
+    "diagonal_ce": 0.5355437994003296,
+    "finite": 0.009375299327075481,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 878,
+    "loss": 0.5414549112319946,
+    "diagonal_ce": 0.5318161249160767,
+    "finite": 0.009638803079724312,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 879,
+    "loss": 0.43005380034446716,
+    "diagonal_ce": 0.42037874460220337,
+    "finite": 0.009675051085650921,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 880,
+    "loss": 0.5194410085678101,
+    "diagonal_ce": 0.5104116797447205,
+    "finite": 0.009029349312186241,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 881,
+    "loss": 0.7028164267539978,
+    "diagonal_ce": 0.6905432939529419,
+    "finite": 0.012273117899894714,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 882,
+    "loss": 0.5112824440002441,
+    "diagonal_ce": 0.5037509799003601,
+    "finite": 0.007531445473432541,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 883,
+    "loss": 0.4558033049106598,
+    "diagonal_ce": 0.445104718208313,
+    "finite": 0.010698576457798481,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 884,
+    "loss": 0.44344431161880493,
+    "diagonal_ce": 0.42971447110176086,
+    "finite": 0.013729849830269814,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 885,
+    "loss": 0.4101882874965668,
+    "diagonal_ce": 0.4012671709060669,
+    "finite": 0.008921126835048199,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 886,
+    "loss": 0.722348690032959,
+    "diagonal_ce": 0.7084174156188965,
+    "finite": 0.01393127627670765,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 887,
+    "loss": 0.44963088631629944,
+    "diagonal_ce": 0.43865978717803955,
+    "finite": 0.010971092619001865,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 888,
+    "loss": 0.3979225754737854,
+    "diagonal_ce": 0.3813645839691162,
+    "finite": 0.016557984054088593,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 889,
+    "loss": 0.5162067413330078,
+    "diagonal_ce": 0.5056949257850647,
+    "finite": 0.010511809960007668,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 890,
+    "loss": 0.4587552547454834,
+    "diagonal_ce": 0.44770893454551697,
+    "finite": 0.011046325787901878,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 891,
+    "loss": 0.472834050655365,
+    "diagonal_ce": 0.4606274366378784,
+    "finite": 0.01220661774277687,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 892,
+    "loss": 0.5453384518623352,
+    "diagonal_ce": 0.53477543592453,
+    "finite": 0.010563033632934093,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 893,
+    "loss": 0.4825454652309418,
+    "diagonal_ce": 0.4737328886985779,
+    "finite": 0.008812571875751019,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 894,
+    "loss": 0.5608348846435547,
+    "diagonal_ce": 0.5526748299598694,
+    "finite": 0.008160080760717392,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 895,
+    "loss": 0.5726346373558044,
+    "diagonal_ce": 0.5634057521820068,
+    "finite": 0.009228857234120369,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 896,
+    "loss": 0.4127964377403259,
+    "diagonal_ce": 0.40683525800704956,
+    "finite": 0.005961167626082897,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 897,
+    "loss": 0.4805457293987274,
+    "diagonal_ce": 0.4724661409854889,
+    "finite": 0.008079600520431995,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 898,
+    "loss": 0.427171915769577,
+    "diagonal_ce": 0.4188382625579834,
+    "finite": 0.008333643898367882,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 899,
+    "loss": 0.5550060272216797,
+    "diagonal_ce": 0.5464355945587158,
+    "finite": 0.008570424281060696,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 900,
+    "loss": 0.5151471495628357,
+    "diagonal_ce": 0.5059902667999268,
+    "finite": 0.009156884625554085,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 901,
+    "loss": 0.586535632610321,
+    "diagonal_ce": 0.5790464878082275,
+    "finite": 0.00748913548886776,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 902,
+    "loss": 0.6002157330513,
+    "diagonal_ce": 0.5914089679718018,
+    "finite": 0.008806743659079075,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 903,
+    "loss": 0.5694604516029358,
+    "diagonal_ce": 0.5598147511482239,
+    "finite": 0.00964568741619587,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 904,
+    "loss": 0.6578077673912048,
+    "diagonal_ce": 0.6518113017082214,
+    "finite": 0.005996448919177055,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 905,
+    "loss": 0.8008654117584229,
+    "diagonal_ce": 0.7929348349571228,
+    "finite": 0.00793058518320322,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 906,
+    "loss": 0.5821862816810608,
+    "diagonal_ce": 0.574679970741272,
+    "finite": 0.0075063155964016914,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 907,
+    "loss": 0.3726291060447693,
+    "diagonal_ce": 0.364531934261322,
+    "finite": 0.008097170852124691,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 908,
+    "loss": 0.42724528908729553,
+    "diagonal_ce": 0.42201122641563416,
+    "finite": 0.005234059877693653,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 909,
+    "loss": 0.6855906248092651,
+    "diagonal_ce": 0.6772248148918152,
+    "finite": 0.008365794084966183,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 910,
+    "loss": 0.4549189507961273,
+    "diagonal_ce": 0.44604429602622986,
+    "finite": 0.008874648250639439,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 911,
+    "loss": 0.6134465336799622,
+    "diagonal_ce": 0.6013154983520508,
+    "finite": 0.012131060473620892,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 912,
+    "loss": 0.6558403372764587,
+    "diagonal_ce": 0.6446853280067444,
+    "finite": 0.011155038140714169,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 913,
+    "loss": 0.622712254524231,
+    "diagonal_ce": 0.6147189736366272,
+    "finite": 0.007993272505700588,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 914,
+    "loss": 0.48636379837989807,
+    "diagonal_ce": 0.4775903522968292,
+    "finite": 0.008773434907197952,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 915,
+    "loss": 0.7558749318122864,
+    "diagonal_ce": 0.7444888353347778,
+    "finite": 0.0113860834389925,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 916,
+    "loss": 0.5074302554130554,
+    "diagonal_ce": 0.49759289622306824,
+    "finite": 0.009837387129664421,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 917,
+    "loss": 0.37874293327331543,
+    "diagonal_ce": 0.37256699800491333,
+    "finite": 0.00617594737559557,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 918,
+    "loss": 0.5059505701065063,
+    "diagonal_ce": 0.4993909001350403,
+    "finite": 0.006559646688401699,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 919,
+    "loss": 0.49301376938819885,
+    "diagonal_ce": 0.4867834448814392,
+    "finite": 0.00623032171279192,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 920,
+    "loss": 0.4852101504802704,
+    "diagonal_ce": 0.4772184491157532,
+    "finite": 0.007991700433194637,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 921,
+    "loss": 0.5214487314224243,
+    "diagonal_ce": 0.5154344439506531,
+    "finite": 0.006014311220496893,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 922,
+    "loss": 0.5948119759559631,
+    "diagonal_ce": 0.5868982076644897,
+    "finite": 0.007913743145763874,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 923,
+    "loss": 0.5597038269042969,
+    "diagonal_ce": 0.5538655519485474,
+    "finite": 0.005838269367814064,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 924,
+    "loss": 0.7188944816589355,
+    "diagonal_ce": 0.7103230357170105,
+    "finite": 0.008571457117795944,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 925,
+    "loss": 0.6580535769462585,
+    "diagonal_ce": 0.6511411070823669,
+    "finite": 0.006912460550665855,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 926,
+    "loss": 0.40372389554977417,
+    "diagonal_ce": 0.394847571849823,
+    "finite": 0.008876334875822067,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 927,
+    "loss": 0.5816882252693176,
+    "diagonal_ce": 0.5685639977455139,
+    "finite": 0.01312421727925539,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 928,
+    "loss": 0.6531115770339966,
+    "diagonal_ce": 0.6437980532646179,
+    "finite": 0.009313513524830341,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 929,
+    "loss": 0.551659107208252,
+    "diagonal_ce": 0.5441124439239502,
+    "finite": 0.007546633947640657,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 930,
+    "loss": 0.6078030467033386,
+    "diagonal_ce": 0.5994877219200134,
+    "finite": 0.008315314538776875,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 931,
+    "loss": 0.6261146068572998,
+    "diagonal_ce": 0.6178109645843506,
+    "finite": 0.008303660899400711,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 932,
+    "loss": 0.5721932053565979,
+    "diagonal_ce": 0.565576434135437,
+    "finite": 0.006616751663386822,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 933,
+    "loss": 0.5810271501541138,
+    "diagonal_ce": 0.5725963115692139,
+    "finite": 0.00843086838722229,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 934,
+    "loss": 0.5262070298194885,
+    "diagonal_ce": 0.519981324672699,
+    "finite": 0.006225680932402611,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 935,
+    "loss": 0.4874900281429291,
+    "diagonal_ce": 0.48072490096092224,
+    "finite": 0.006765118800103664,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 936,
+    "loss": 0.5169948935508728,
+    "diagonal_ce": 0.5097775459289551,
+    "finite": 0.007217375561594963,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 937,
+    "loss": 0.5138378143310547,
+    "diagonal_ce": 0.5080317854881287,
+    "finite": 0.005806013010442257,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 938,
+    "loss": 0.45253387093544006,
+    "diagonal_ce": 0.4432564675807953,
+    "finite": 0.009277400560677052,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 939,
+    "loss": 0.5579321384429932,
+    "diagonal_ce": 0.5500686168670654,
+    "finite": 0.007863525301218033,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 940,
+    "loss": 0.6452203392982483,
+    "diagonal_ce": 0.63552325963974,
+    "finite": 0.009697088971734047,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 941,
+    "loss": 0.686764657497406,
+    "diagonal_ce": 0.6782090663909912,
+    "finite": 0.008555572479963303,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 942,
+    "loss": 0.5878320932388306,
+    "diagonal_ce": 0.577642560005188,
+    "finite": 0.010189520195126534,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 943,
+    "loss": 0.5952630043029785,
+    "diagonal_ce": 0.5838620662689209,
+    "finite": 0.01140096690505743,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 944,
+    "loss": 0.5083600878715515,
+    "diagonal_ce": 0.500794529914856,
+    "finite": 0.00756555050611496,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 945,
+    "loss": 0.6678808927536011,
+    "diagonal_ce": 0.6581935882568359,
+    "finite": 0.009687327779829502,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 946,
+    "loss": 0.4819662272930145,
+    "diagonal_ce": 0.4753194749355316,
+    "finite": 0.006646766792982817,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 947,
+    "loss": 0.4564162492752075,
+    "diagonal_ce": 0.44816675782203674,
+    "finite": 0.008249504491686821,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 948,
+    "loss": 0.6380008459091187,
+    "diagonal_ce": 0.6280667185783386,
+    "finite": 0.009934144094586372,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 949,
+    "loss": 0.3249991834163666,
+    "diagonal_ce": 0.31650668382644653,
+    "finite": 0.008492487482726574,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 950,
+    "loss": 0.6317607164382935,
+    "diagonal_ce": 0.6218127012252808,
+    "finite": 0.009947998449206352,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 951,
+    "loss": 0.6388425230979919,
+    "diagonal_ce": 0.6320170760154724,
+    "finite": 0.006825422868132591,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 952,
+    "loss": 0.43717604875564575,
+    "diagonal_ce": 0.42788955569267273,
+    "finite": 0.009286507964134216,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 953,
+    "loss": 0.5807943940162659,
+    "diagonal_ce": 0.5709277987480164,
+    "finite": 0.009866597130894661,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 954,
+    "loss": 0.651330292224884,
+    "diagonal_ce": 0.6409424543380737,
+    "finite": 0.010387854650616646,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 955,
+    "loss": 0.49994781613349915,
+    "diagonal_ce": 0.49194231629371643,
+    "finite": 0.008005501702427864,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 956,
+    "loss": 0.5508167743682861,
+    "diagonal_ce": 0.5424692034721375,
+    "finite": 0.008347544819116592,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 957,
+    "loss": 0.4631909430027008,
+    "diagonal_ce": 0.456468403339386,
+    "finite": 0.006722533144056797,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 958,
+    "loss": 0.6108623743057251,
+    "diagonal_ce": 0.603079080581665,
+    "finite": 0.0077832723036408424,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 959,
+    "loss": 0.6164854764938354,
+    "diagonal_ce": 0.608442485332489,
+    "finite": 0.008042985573410988,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 960,
+    "loss": 0.6432101130485535,
+    "diagonal_ce": 0.634824812412262,
+    "finite": 0.008385277353227139,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 961,
+    "loss": 0.6737319231033325,
+    "diagonal_ce": 0.6662247180938721,
+    "finite": 0.007507214322686195,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 962,
+    "loss": 0.4600570797920227,
+    "diagonal_ce": 0.45298755168914795,
+    "finite": 0.00706953089684248,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 963,
+    "loss": 0.5867164731025696,
+    "diagonal_ce": 0.577156662940979,
+    "finite": 0.009559828788042068,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 964,
+    "loss": 0.5529857873916626,
+    "diagonal_ce": 0.5418724417686462,
+    "finite": 0.011113361455500126,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 965,
+    "loss": 0.46707412600517273,
+    "diagonal_ce": 0.4597221612930298,
+    "finite": 0.007351957261562347,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 966,
+    "loss": 0.5991917848587036,
+    "diagonal_ce": 0.5908828377723694,
+    "finite": 0.008308937773108482,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 967,
+    "loss": 0.4978238046169281,
+    "diagonal_ce": 0.4872570335865021,
+    "finite": 0.010566783137619495,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 968,
+    "loss": 0.46766188740730286,
+    "diagonal_ce": 0.45918047428131104,
+    "finite": 0.008481406606733799,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 969,
+    "loss": 0.5293903946876526,
+    "diagonal_ce": 0.5184854865074158,
+    "finite": 0.010904902592301369,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 970,
+    "loss": 0.4403159022331238,
+    "diagonal_ce": 0.4307064712047577,
+    "finite": 0.009609443135559559,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 971,
+    "loss": 0.6331284046173096,
+    "diagonal_ce": 0.6197682619094849,
+    "finite": 0.013360151089727879,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 972,
+    "loss": 0.6432663202285767,
+    "diagonal_ce": 0.6311972141265869,
+    "finite": 0.012069091200828552,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 973,
+    "loss": 0.6107258200645447,
+    "diagonal_ce": 0.6008569002151489,
+    "finite": 0.009868904016911983,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 974,
+    "loss": 0.5777919292449951,
+    "diagonal_ce": 0.5665515661239624,
+    "finite": 0.01124035008251667,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 975,
+    "loss": 0.5953963994979858,
+    "diagonal_ce": 0.5823468565940857,
+    "finite": 0.01304952334612608,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 976,
+    "loss": 0.7790805101394653,
+    "diagonal_ce": 0.7660829424858093,
+    "finite": 0.01299756858497858,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 977,
+    "loss": 0.48473361134529114,
+    "diagonal_ce": 0.4788905084133148,
+    "finite": 0.005843089893460274,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 978,
+    "loss": 0.6039106845855713,
+    "diagonal_ce": 0.594408392906189,
+    "finite": 0.009502299129962921,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 979,
+    "loss": 0.6667865514755249,
+    "diagonal_ce": 0.6574640870094299,
+    "finite": 0.00932244025170803,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 980,
+    "loss": 0.30677086114883423,
+    "diagonal_ce": 0.2947276532649994,
+    "finite": 0.012043219991028309,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 981,
+    "loss": 0.450969934463501,
+    "diagonal_ce": 0.44023779034614563,
+    "finite": 0.01073214691132307,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 982,
+    "loss": 0.40752312541007996,
+    "diagonal_ce": 0.3968833088874817,
+    "finite": 0.010639823973178864,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 983,
+    "loss": 0.6810687184333801,
+    "diagonal_ce": 0.6677467226982117,
+    "finite": 0.013322015292942524,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 984,
+    "loss": 0.46712565422058105,
+    "diagonal_ce": 0.46088722348213196,
+    "finite": 0.006238439120352268,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 985,
+    "loss": 0.5268827676773071,
+    "diagonal_ce": 0.5167883038520813,
+    "finite": 0.010094487108290195,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 986,
+    "loss": 0.44378694891929626,
+    "diagonal_ce": 0.4321528971195221,
+    "finite": 0.011634046211838722,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 987,
+    "loss": 0.6359665393829346,
+    "diagonal_ce": 0.6263202428817749,
+    "finite": 0.00964630488306284,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 988,
+    "loss": 0.5839577317237854,
+    "diagonal_ce": 0.5737399458885193,
+    "finite": 0.01021780539304018,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 989,
+    "loss": 0.47099801898002625,
+    "diagonal_ce": 0.462946355342865,
+    "finite": 0.00805166456848383,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 990,
+    "loss": 0.45798832178115845,
+    "diagonal_ce": 0.45075491070747375,
+    "finite": 0.007233396638184786,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 991,
+    "loss": 0.6249522566795349,
+    "diagonal_ce": 0.614018440246582,
+    "finite": 0.010933801531791687,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 992,
+    "loss": 0.4624441862106323,
+    "diagonal_ce": 0.45524296164512634,
+    "finite": 0.0072012185119092464,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 993,
+    "loss": 0.7641139626502991,
+    "diagonal_ce": 0.7522022128105164,
+    "finite": 0.01191176101565361,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 994,
+    "loss": 0.5872702598571777,
+    "diagonal_ce": 0.5760332942008972,
+    "finite": 0.01123694609850645,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 995,
+    "loss": 0.5573554039001465,
+    "diagonal_ce": 0.5464478731155396,
+    "finite": 0.010907519608736038,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 996,
+    "loss": 0.538702666759491,
+    "diagonal_ce": 0.5257202386856079,
+    "finite": 0.01298242062330246,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 997,
+    "loss": 0.4299183189868927,
+    "diagonal_ce": 0.4176831543445587,
+    "finite": 0.012235155329108238,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 998,
+    "loss": 0.6370847225189209,
+    "diagonal_ce": 0.624146580696106,
+    "finite": 0.012938158586621284,
+    "denominator_clamp_fraction": 0.0
+  },
+  {
+    "step": 999,
+    "loss": 0.5221912860870361,
+    "diagonal_ce": 0.5091460347175598,
+    "finite": 0.013045252300798893,
+    "denominator_clamp_fraction": 0.0
+  }
+]
diff --git a/lecture_6/verified_examples/discrete-lsd/report.json b/lecture_6/verified_examples/discrete-lsd/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..cf81d58703b0829884e8df478801c5df616f1e7b
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-lsd/report.json
@@ -0,0 +1,19 @@
+{
+  "method": "discrete-lsd",
+  "data_kind": "synthetic-text",
+  "train_loss_first_20_mean": 2.4725986242294313,
+  "train_loss_last_20_mean": 0.5278535842895508,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "heldout_diagonal_ce_at_half_time": 0.4605702757835388,
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "unique_fraction": 0.0390625,
+  "token_entropy": 2.4118592739105225,
+  "mean_length": 4.0,
+  "empty_fraction": 0.0,
+  "training_support_fraction": 0.9921875,
+  "elapsed_seconds": 4.936540884998976
+}
diff --git a/lecture_6/verified_examples/discrete-lsd/samples.txt b/lecture_6/verified_examples/discrete-lsd/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..77fdfec551b628ba26f32e36459404909255f406
--- /dev/null
+++ b/lecture_6/verified_examples/discrete-lsd/samples.txt
@@ -0,0 +1,128 @@
+gold star moves down
+blue square moves right
+gold star moves down
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+gold star moves down
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+green triangle moves up
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+blue square moves right
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+blue circle moves right
+blue square moves right
+gold star moves down
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+red circle moves left
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+red circle moves left
+red circle moves left
+red circle moves left
+gold star moves down
+green triangle moves up
+blue square moves right
+gold star moves down
+green triangle moves up
+red circle moves left
+gold star moves down
+red circle moves left
+green triangle moves up
+red circle moves left
+red circle moves left
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+red circle moves left
+green triangle moves up
+gold star moves down
+gold star moves down
diff --git a/lecture_6/verified_examples/environment.json b/lecture_6/verified_examples/environment.json
new file mode 100644
index 0000000000000000000000000000000000000000..1a57db7279d7ebcd373e586ded7da67cd4baab9f
--- /dev/null
+++ b/lecture_6/verified_examples/environment.json
@@ -0,0 +1,17 @@
+{
+  "date": "2026-09-13",
+  "python": "3.12.14",
+  "primary_torch": "2.9.1+cpu",
+  "additional_torch": "2.14.0+cpu",
+  "device": "CPU",
+  "threads": 1,
+  "seed": 6270,
+  "training_steps_per_default_method": 1000,
+  "method_count": 16,
+  "mathematics_tests_passed": 23,
+  "checkpoint_reload_exact": true,
+  "optional_meta_finetune_steps": 300,
+  "ssfm_paper_learning_rate": 0.0001,
+  "ssfm_paper_steps": 2000,
+  "scope": "Teaching examples; no large-scale benchmark reproduction."
+}
diff --git a/lecture_6/verified_examples/expanding/config.json b/lecture_6/verified_examples/expanding/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..8f08bbeec4fdf032f8f7f78e3d297a6cf6de4af7
--- /dev/null
+++ b/lecture_6/verified_examples/expanding/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "expanding",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/expanding"
+}
diff --git a/lecture_6/verified_examples/expanding/losses.json b/lecture_6/verified_examples/expanding/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..20903fe40aed37516b98880ffc252ddad3aafb76
--- /dev/null
+++ b/lecture_6/verified_examples/expanding/losses.json
@@ -0,0 +1,7002 @@
+[
+  {
+    "step": 0,
+    "loss": 4.418208599090576,
+    "diagonal_ce": 2.703463315963745,
+    "finite": 2.0316654627094977e-05,
+    "insertion": 1.7147454023361206
+  },
+  {
+    "step": 1,
+    "loss": 4.256107330322266,
+    "diagonal_ce": 2.70145845413208,
+    "finite": 3.860110882669687e-05,
+    "insertion": 1.5546486377716064
+  },
+  {
+    "step": 2,
+    "loss": 4.375098705291748,
+    "diagonal_ce": 2.7032277584075928,
+    "finite": 6.686252891086042e-05,
+    "insertion": 1.6718703508377075
+  },
+  {
+    "step": 3,
+    "loss": 4.2118024826049805,
+    "diagonal_ce": 2.6990768909454346,
+    "finite": 0.00010243965516565368,
+    "insertion": 1.512723684310913
+  },
+  {
+    "step": 4,
+    "loss": 4.137642860412598,
+    "diagonal_ce": 2.70654034614563,
+    "finite": 0.00017642653256189078,
+    "insertion": 1.4310991764068604
+  },
+  {
+    "step": 5,
+    "loss": 4.127918243408203,
+    "diagonal_ce": 2.7048580646514893,
+    "finite": 0.00023392504954244941,
+    "insertion": 1.4230544567108154
+  },
+  {
+    "step": 6,
+    "loss": 4.418669700622559,
+    "diagonal_ce": 2.684077262878418,
+    "finite": 0.0003469941148068756,
+    "insertion": 1.734582543373108
+  },
+  {
+    "step": 7,
+    "loss": 4.323233604431152,
+    "diagonal_ce": 2.678666114807129,
+    "finite": 0.00043509757961146533,
+    "insertion": 1.644553780555725
+  },
+  {
+    "step": 8,
+    "loss": 4.18668270111084,
+    "diagonal_ce": 2.681349515914917,
+    "finite": 0.0006218850612640381,
+    "insertion": 1.5053110122680664
+  },
+  {
+    "step": 9,
+    "loss": 4.254272937774658,
+    "diagonal_ce": 2.6763625144958496,
+    "finite": 0.0008019880624487996,
+    "insertion": 1.5778783559799194
+  },
+  {
+    "step": 10,
+    "loss": 4.215969085693359,
+    "diagonal_ce": 2.661811590194702,
+    "finite": 0.0010479968041181564,
+    "insertion": 1.554111361503601
+  },
+  {
+    "step": 11,
+    "loss": 4.681575775146484,
+    "diagonal_ce": 2.6513431072235107,
+    "finite": 0.001104514580219984,
+    "insertion": 2.030179977416992
+  },
+  {
+    "step": 12,
+    "loss": 4.012063980102539,
+    "diagonal_ce": 2.6687581539154053,
+    "finite": 0.001490707159973681,
+    "insertion": 1.3432283401489258
+  },
+  {
+    "step": 13,
+    "loss": 4.2330522537231445,
+    "diagonal_ce": 2.6690826416015625,
+    "finite": 0.001872988766990602,
+    "insertion": 1.5638647079467773
+  },
+  {
+    "step": 14,
+    "loss": 4.370534420013428,
+    "diagonal_ce": 2.676198720932007,
+    "finite": 0.002300146734341979,
+    "insertion": 1.6941977739334106
+  },
+  {
+    "step": 15,
+    "loss": 4.363055229187012,
+    "diagonal_ce": 2.6500461101531982,
+    "finite": 0.0025215453933924437,
+    "insertion": 1.7128477096557617
+  },
+  {
+    "step": 16,
+    "loss": 4.295920372009277,
+    "diagonal_ce": 2.6500372886657715,
+    "finite": 0.0032640628051012754,
+    "insertion": 1.6456608772277832
+  },
+  {
+    "step": 17,
+    "loss": 4.095782279968262,
+    "diagonal_ce": 2.636272668838501,
+    "finite": 0.0036172454711049795,
+    "insertion": 1.4592492580413818
+  },
+  {
+    "step": 18,
+    "loss": 3.9872875213623047,
+    "diagonal_ce": 2.6662843227386475,
+    "finite": 0.004064017906785011,
+    "insertion": 1.3206945657730103
+  },
+  {
+    "step": 19,
+    "loss": 4.178189277648926,
+    "diagonal_ce": 2.6358642578125,
+    "finite": 0.005261581391096115,
+    "insertion": 1.541904091835022
+  },
+  {
+    "step": 20,
+    "loss": 4.032587051391602,
+    "diagonal_ce": 2.633556365966797,
+    "finite": 0.00580186303704977,
+    "insertion": 1.3985434770584106
+  },
+  {
+    "step": 21,
+    "loss": 4.106997013092041,
+    "diagonal_ce": 2.649312973022461,
+    "finite": 0.006470636930316687,
+    "insertion": 1.4571146965026855
+  },
+  {
+    "step": 22,
+    "loss": 4.460247993469238,
+    "diagonal_ce": 2.6072866916656494,
+    "finite": 0.007622211240231991,
+    "insertion": 1.8522602319717407
+  },
+  {
+    "step": 23,
+    "loss": 4.0089335441589355,
+    "diagonal_ce": 2.62469220161438,
+    "finite": 0.008988374844193459,
+    "insertion": 1.3833783864974976
+  },
+  {
+    "step": 24,
+    "loss": 3.978041648864746,
+    "diagonal_ce": 2.607442617416382,
+    "finite": 0.011762376874685287,
+    "insertion": 1.3694229125976562
+  },
+  {
+    "step": 25,
+    "loss": 4.183734893798828,
+    "diagonal_ce": 2.597017526626587,
+    "finite": 0.011408360674977303,
+    "insertion": 1.585531234741211
+  },
+  {
+    "step": 26,
+    "loss": 3.9626827239990234,
+    "diagonal_ce": 2.5932319164276123,
+    "finite": 0.014295605011284351,
+    "insertion": 1.367906928062439
+  },
+  {
+    "step": 27,
+    "loss": 4.172595024108887,
+    "diagonal_ce": 2.595028877258301,
+    "finite": 0.015800131484866142,
+    "insertion": 1.575796365737915
+  },
+  {
+    "step": 28,
+    "loss": 4.728540420532227,
+    "diagonal_ce": 2.5846595764160156,
+    "finite": 0.018297960981726646,
+    "insertion": 2.1417582035064697
+  },
+  {
+    "step": 29,
+    "loss": 4.112189292907715,
+    "diagonal_ce": 2.533951997756958,
+    "finite": 0.02101384848356247,
+    "insertion": 1.57571542263031
+  },
+  {
+    "step": 30,
+    "loss": 3.7410635948181152,
+    "diagonal_ce": 2.5127925872802734,
+    "finite": 0.030287811532616615,
+    "insertion": 1.2245155572891235
+  },
+  {
+    "step": 31,
+    "loss": 4.168045997619629,
+    "diagonal_ce": 2.623074531555176,
+    "finite": 0.028384055942296982,
+    "insertion": 1.5413384437561035
+  },
+  {
+    "step": 32,
+    "loss": 3.957141399383545,
+    "diagonal_ce": 2.5015931129455566,
+    "finite": 0.03487147390842438,
+    "insertion": 1.450945258140564
+  },
+  {
+    "step": 33,
+    "loss": 3.830172300338745,
+    "diagonal_ce": 2.458831310272217,
+    "finite": 0.04274271801114082,
+    "insertion": 1.365527868270874
+  },
+  {
+    "step": 34,
+    "loss": 3.984614849090576,
+    "diagonal_ce": 2.4918229579925537,
+    "finite": 0.04588279128074646,
+    "insertion": 1.4863685369491577
+  },
+  {
+    "step": 35,
+    "loss": 3.9120187759399414,
+    "diagonal_ce": 2.4444704055786133,
+    "finite": 0.05090292915701866,
+    "insertion": 1.4602183103561401
+  },
+  {
+    "step": 36,
+    "loss": 3.728023052215576,
+    "diagonal_ce": 2.4415407180786133,
+    "finite": 0.06364066898822784,
+    "insertion": 1.2770637273788452
+  },
+  {
+    "step": 37,
+    "loss": 3.7274250984191895,
+    "diagonal_ce": 2.476844310760498,
+    "finite": 0.06823433190584183,
+    "insertion": 1.2402092218399048
+  },
+  {
+    "step": 38,
+    "loss": 3.9234461784362793,
+    "diagonal_ce": 2.4361135959625244,
+    "finite": 0.07685550302267075,
+    "insertion": 1.4753432273864746
+  },
+  {
+    "step": 39,
+    "loss": 4.121678352355957,
+    "diagonal_ce": 2.436774730682373,
+    "finite": 0.08589252829551697,
+    "insertion": 1.6711605787277222
+  },
+  {
+    "step": 40,
+    "loss": 3.9105615615844727,
+    "diagonal_ce": 2.423196792602539,
+    "finite": 0.0971708670258522,
+    "insertion": 1.4714287519454956
+  },
+  {
+    "step": 41,
+    "loss": 3.7170376777648926,
+    "diagonal_ce": 2.357436180114746,
+    "finite": 0.13421641290187836,
+    "insertion": 1.3370529413223267
+  },
+  {
+    "step": 42,
+    "loss": 3.876804828643799,
+    "diagonal_ce": 2.3777947425842285,
+    "finite": 0.1337071657180786,
+    "insertion": 1.4760125875473022
+  },
+  {
+    "step": 43,
+    "loss": 3.8252322673797607,
+    "diagonal_ce": 2.4233622550964355,
+    "finite": 0.15667398273944855,
+    "insertion": 1.3742954730987549
+  },
+  {
+    "step": 44,
+    "loss": 3.706218957901001,
+    "diagonal_ce": 2.3414194583892822,
+    "finite": 0.17265044152736664,
+    "insertion": 1.3337223529815674
+  },
+  {
+    "step": 45,
+    "loss": 3.8358819484710693,
+    "diagonal_ce": 2.3564279079437256,
+    "finite": 0.17683203518390656,
+    "insertion": 1.4469170570373535
+  },
+  {
+    "step": 46,
+    "loss": 3.7239608764648438,
+    "diagonal_ce": 2.3060359954833984,
+    "finite": 0.2091890573501587,
+    "insertion": 1.3785971403121948
+  },
+  {
+    "step": 47,
+    "loss": 3.63980770111084,
+    "diagonal_ce": 2.3110508918762207,
+    "finite": 0.2207830399274826,
+    "insertion": 1.28636634349823
+  },
+  {
+    "step": 48,
+    "loss": 3.73225474357605,
+    "diagonal_ce": 2.431936740875244,
+    "finite": 0.23628199100494385,
+    "insertion": 1.2540066242218018
+  },
+  {
+    "step": 49,
+    "loss": 3.6221585273742676,
+    "diagonal_ce": 2.255747079849243,
+    "finite": 0.2991293668746948,
+    "insertion": 1.306585431098938
+  },
+  {
+    "step": 50,
+    "loss": 3.5766866207122803,
+    "diagonal_ce": 2.2681407928466797,
+    "finite": 0.2923794388771057,
+    "insertion": 1.2489004135131836
+  },
+  {
+    "step": 51,
+    "loss": 3.3827242851257324,
+    "diagonal_ce": 2.2145490646362305,
+    "finite": 0.3306327164173126,
+    "insertion": 1.0994036197662354
+  },
+  {
+    "step": 52,
+    "loss": 3.8566136360168457,
+    "diagonal_ce": 2.3617491722106934,
+    "finite": 0.28930339217185974,
+    "insertion": 1.4335323572158813
+  },
+  {
+    "step": 53,
+    "loss": 3.6825485229492188,
+    "diagonal_ce": 2.2413432598114014,
+    "finite": 0.32964518666267395,
+    "insertion": 1.3700019121170044
+  },
+  {
+    "step": 54,
+    "loss": 3.4370598793029785,
+    "diagonal_ce": 2.239400863647461,
+    "finite": 0.4215954840183258,
+    "insertion": 1.1049079895019531
+  },
+  {
+    "step": 55,
+    "loss": 3.529064178466797,
+    "diagonal_ce": 2.1948883533477783,
+    "finite": 0.4323095381259918,
+    "insertion": 1.2373384237289429
+  },
+  {
+    "step": 56,
+    "loss": 3.7779269218444824,
+    "diagonal_ce": 2.292588472366333,
+    "finite": 0.40430882573127747,
+    "insertion": 1.3931561708450317
+  },
+  {
+    "step": 57,
+    "loss": 3.5772390365600586,
+    "diagonal_ce": 2.412482976913452,
+    "finite": 0.408047080039978,
+    "insertion": 1.0700892210006714
+  },
+  {
+    "step": 58,
+    "loss": 3.5305051803588867,
+    "diagonal_ce": 2.213139295578003,
+    "finite": 0.4286162257194519,
+    "insertion": 1.2162123918533325
+  },
+  {
+    "step": 59,
+    "loss": 3.4769601821899414,
+    "diagonal_ce": 2.3553895950317383,
+    "finite": 0.4210539758205414,
+    "insertion": 1.0205174684524536
+  },
+  {
+    "step": 60,
+    "loss": 3.488874912261963,
+    "diagonal_ce": 2.3018879890441895,
+    "finite": 0.468137264251709,
+    "insertion": 1.0727615356445312
+  },
+  {
+    "step": 61,
+    "loss": 3.473961353302002,
+    "diagonal_ce": 2.2684109210968018,
+    "finite": 0.39274996519088745,
+    "insertion": 1.1081483364105225
+  },
+  {
+    "step": 62,
+    "loss": 3.3615527153015137,
+    "diagonal_ce": 2.202925443649292,
+    "finite": 0.4050542116165161,
+    "insertion": 1.056553602218628
+  },
+  {
+    "step": 63,
+    "loss": 3.594829559326172,
+    "diagonal_ce": 2.3024721145629883,
+    "finite": 0.35920026898384094,
+    "insertion": 1.2004023790359497
+  },
+  {
+    "step": 64,
+    "loss": 3.6154823303222656,
+    "diagonal_ce": 2.3031022548675537,
+    "finite": 0.30561843514442444,
+    "insertion": 1.2329190969467163
+  },
+  {
+    "step": 65,
+    "loss": 3.4904632568359375,
+    "diagonal_ce": 2.13360857963562,
+    "finite": 0.377585232257843,
+    "insertion": 1.2571719884872437
+  },
+  {
+    "step": 66,
+    "loss": 3.2968344688415527,
+    "diagonal_ce": 2.1962008476257324,
+    "finite": 0.32769307494163513,
+    "insertion": 1.0128120183944702
+  },
+  {
+    "step": 67,
+    "loss": 3.5209999084472656,
+    "diagonal_ce": 2.24006986618042,
+    "finite": 0.32959964871406555,
+    "insertion": 1.1912789344787598
+  },
+  {
+    "step": 68,
+    "loss": 3.6110360622406006,
+    "diagonal_ce": 2.380244493484497,
+    "finite": 0.322647362947464,
+    "insertion": 1.1417407989501953
+  },
+  {
+    "step": 69,
+    "loss": 3.3483638763427734,
+    "diagonal_ce": 2.158958673477173,
+    "finite": 0.3399808704853058,
+    "insertion": 1.0942106246948242
+  },
+  {
+    "step": 70,
+    "loss": 3.389394760131836,
+    "diagonal_ce": 2.207643985748291,
+    "finite": 0.29633429646492004,
+    "insertion": 1.0975919961929321
+  },
+  {
+    "step": 71,
+    "loss": 3.5016403198242188,
+    "diagonal_ce": 2.302980422973633,
+    "finite": 0.2916043698787689,
+    "insertion": 1.1146780252456665
+  },
+  {
+    "step": 72,
+    "loss": 3.2755963802337646,
+    "diagonal_ce": 2.181091547012329,
+    "finite": 0.24250736832618713,
+    "insertion": 1.0236926078796387
+  },
+  {
+    "step": 73,
+    "loss": 3.454946517944336,
+    "diagonal_ce": 2.2870006561279297,
+    "finite": 0.24872073531150818,
+    "insertion": 1.0943244695663452
+  },
+  {
+    "step": 74,
+    "loss": 3.144958019256592,
+    "diagonal_ce": 2.1625418663024902,
+    "finite": 0.28686994314193726,
+    "insertion": 0.8963552713394165
+  },
+  {
+    "step": 75,
+    "loss": 3.3882129192352295,
+    "diagonal_ce": 2.209657669067383,
+    "finite": 0.24585799872875214,
+    "insertion": 1.1038143634796143
+  },
+  {
+    "step": 76,
+    "loss": 3.3836963176727295,
+    "diagonal_ce": 2.2652084827423096,
+    "finite": 0.24794211983680725,
+    "insertion": 1.0421216487884521
+  },
+  {
+    "step": 77,
+    "loss": 3.2953693866729736,
+    "diagonal_ce": 2.2597005367279053,
+    "finite": 0.23167671263217926,
+    "insertion": 0.9633857607841492
+  },
+  {
+    "step": 78,
+    "loss": 3.4637041091918945,
+    "diagonal_ce": 2.2280914783477783,
+    "finite": 0.24469202756881714,
+    "insertion": 1.1582900285720825
+  },
+  {
+    "step": 79,
+    "loss": 3.243652105331421,
+    "diagonal_ce": 2.2477800846099854,
+    "finite": 0.21510598063468933,
+    "insertion": 0.9270381331443787
+  },
+  {
+    "step": 80,
+    "loss": 3.412630081176758,
+    "diagonal_ce": 2.296280860900879,
+    "finite": 0.23593445122241974,
+    "insertion": 1.039906620979309
+  },
+  {
+    "step": 81,
+    "loss": 3.2763171195983887,
+    "diagonal_ce": 2.2865052223205566,
+    "finite": 0.23885565996170044,
+    "insertion": 0.9114672541618347
+  },
+  {
+    "step": 82,
+    "loss": 3.508612632751465,
+    "diagonal_ce": 2.350382089614868,
+    "finite": 0.1795511543750763,
+    "insertion": 1.0986193418502808
+  },
+  {
+    "step": 83,
+    "loss": 3.3411917686462402,
+    "diagonal_ce": 2.3214855194091797,
+    "finite": 0.2075740396976471,
+    "insertion": 0.9499613642692566
+  },
+  {
+    "step": 84,
+    "loss": 3.3972039222717285,
+    "diagonal_ce": 2.2090511322021484,
+    "finite": 0.21424998342990875,
+    "insertion": 1.1153076887130737
+  },
+  {
+    "step": 85,
+    "loss": 3.424044132232666,
+    "diagonal_ce": 2.2181038856506348,
+    "finite": 0.19329355657100677,
+    "insertion": 1.1394472122192383
+  },
+  {
+    "step": 86,
+    "loss": 3.283778667449951,
+    "diagonal_ce": 2.3035120964050293,
+    "finite": 0.18443234264850616,
+    "insertion": 0.9160839915275574
+  },
+  {
+    "step": 87,
+    "loss": 3.3189563751220703,
+    "diagonal_ce": 2.3435752391815186,
+    "finite": 0.19737006723880768,
+    "insertion": 0.9059067964553833
+  },
+  {
+    "step": 88,
+    "loss": 3.425424098968506,
+    "diagonal_ce": 2.3220455646514893,
+    "finite": 0.1704925298690796,
+    "insertion": 1.0426831245422363
+  },
+  {
+    "step": 89,
+    "loss": 3.262514591217041,
+    "diagonal_ce": 2.2669951915740967,
+    "finite": 0.19087421894073486,
+    "insertion": 0.9268049001693726
+  },
+  {
+    "step": 90,
+    "loss": 3.7809085845947266,
+    "diagonal_ce": 2.5433735847473145,
+    "finite": 0.15131765604019165,
+    "insertion": 1.18245530128479
+  },
+  {
+    "step": 91,
+    "loss": 3.238821506500244,
+    "diagonal_ce": 2.1449012756347656,
+    "finite": 0.19614845514297485,
+    "insertion": 1.0217374563217163
+  },
+  {
+    "step": 92,
+    "loss": 3.1131250858306885,
+    "diagonal_ce": 2.1912362575531006,
+    "finite": 0.1860009729862213,
+    "insertion": 0.8526964783668518
+  },
+  {
+    "step": 93,
+    "loss": 3.353074550628662,
+    "diagonal_ce": 2.2454006671905518,
+    "finite": 0.1705334335565567,
+    "insertion": 1.0435532331466675
+  },
+  {
+    "step": 94,
+    "loss": 3.40732479095459,
+    "diagonal_ce": 2.33181095123291,
+    "finite": 0.15629662573337555,
+    "insertion": 1.0161212682724
+  },
+  {
+    "step": 95,
+    "loss": 3.298666000366211,
+    "diagonal_ce": 2.2468888759613037,
+    "finite": 0.16627611219882965,
+    "insertion": 0.9879273176193237
+  },
+  {
+    "step": 96,
+    "loss": 3.1724002361297607,
+    "diagonal_ce": 2.18021297454834,
+    "finite": 0.16446244716644287,
+    "insertion": 0.9283756613731384
+  },
+  {
+    "step": 97,
+    "loss": 3.0795679092407227,
+    "diagonal_ce": 2.1158485412597656,
+    "finite": 0.170152947306633,
+    "insertion": 0.8970193266868591
+  },
+  {
+    "step": 98,
+    "loss": 3.174428939819336,
+    "diagonal_ce": 2.2052764892578125,
+    "finite": 0.1531352698802948,
+    "insertion": 0.9085109233856201
+  },
+  {
+    "step": 99,
+    "loss": 3.3339905738830566,
+    "diagonal_ce": 2.2317090034484863,
+    "finite": 0.1449938416481018,
+    "insertion": 1.0442839860916138
+  },
+  {
+    "step": 100,
+    "loss": 3.1784815788269043,
+    "diagonal_ce": 2.28957200050354,
+    "finite": 0.164586141705513,
+    "insertion": 0.8224167227745056
+  },
+  {
+    "step": 101,
+    "loss": 3.34070086479187,
+    "diagonal_ce": 2.27768611907959,
+    "finite": 0.15585331618785858,
+    "insertion": 0.9994266629219055
+  },
+  {
+    "step": 102,
+    "loss": 2.9219799041748047,
+    "diagonal_ce": 2.151343822479248,
+    "finite": 0.17088991403579712,
+    "insertion": 0.7002294063568115
+  },
+  {
+    "step": 103,
+    "loss": 3.2088136672973633,
+    "diagonal_ce": 2.286501407623291,
+    "finite": 0.15801528096199036,
+    "insertion": 0.85657799243927
+  },
+  {
+    "step": 104,
+    "loss": 3.312283515930176,
+    "diagonal_ce": 2.3516218662261963,
+    "finite": 0.15392173826694489,
+    "insertion": 0.8960144519805908
+  },
+  {
+    "step": 105,
+    "loss": 3.0555171966552734,
+    "diagonal_ce": 2.1778061389923096,
+    "finite": 0.1527211219072342,
+    "insertion": 0.812957227230072
+  },
+  {
+    "step": 106,
+    "loss": 3.2058064937591553,
+    "diagonal_ce": 2.132418394088745,
+    "finite": 0.16744878888130188,
+    "insertion": 1.0017199516296387
+  },
+  {
+    "step": 107,
+    "loss": 3.201734781265259,
+    "diagonal_ce": 2.316281318664551,
+    "finite": 0.14315596222877502,
+    "insertion": 0.8236100673675537
+  },
+  {
+    "step": 108,
+    "loss": 3.212009906768799,
+    "diagonal_ce": 2.236609697341919,
+    "finite": 0.15217448770999908,
+    "insertion": 0.9090521931648254
+  },
+  {
+    "step": 109,
+    "loss": 3.221879720687866,
+    "diagonal_ce": 2.2003440856933594,
+    "finite": 0.14151328802108765,
+    "insertion": 0.9592697024345398
+  },
+  {
+    "step": 110,
+    "loss": 3.2027487754821777,
+    "diagonal_ce": 2.308077096939087,
+    "finite": 0.16204185783863068,
+    "insertion": 0.8227249383926392
+  },
+  {
+    "step": 111,
+    "loss": 3.2027573585510254,
+    "diagonal_ce": 2.2084662914276123,
+    "finite": 0.12364893406629562,
+    "insertion": 0.9388964176177979
+  },
+  {
+    "step": 112,
+    "loss": 3.2376708984375,
+    "diagonal_ce": 2.3421013355255127,
+    "finite": 0.12914101779460907,
+    "insertion": 0.8371978998184204
+  },
+  {
+    "step": 113,
+    "loss": 3.2476768493652344,
+    "diagonal_ce": 2.3428943157196045,
+    "finite": 0.12932005524635315,
+    "insertion": 0.8458126783370972
+  },
+  {
+    "step": 114,
+    "loss": 3.4673266410827637,
+    "diagonal_ce": 2.4499146938323975,
+    "finite": 0.1147841364145279,
+    "insertion": 0.9646114110946655
+  },
+  {
+    "step": 115,
+    "loss": 3.4891247749328613,
+    "diagonal_ce": 2.3962724208831787,
+    "finite": 0.11392495036125183,
+    "insertion": 1.039991021156311
+  },
+  {
+    "step": 116,
+    "loss": 3.311891794204712,
+    "diagonal_ce": 2.3014800548553467,
+    "finite": 0.11223285645246506,
+    "insertion": 0.9578867554664612
+  },
+  {
+    "step": 117,
+    "loss": 3.0620248317718506,
+    "diagonal_ce": 2.1231982707977295,
+    "finite": 0.12150134891271591,
+    "insertion": 0.8814778327941895
+  },
+  {
+    "step": 118,
+    "loss": 3.2981228828430176,
+    "diagonal_ce": 2.338994264602661,
+    "finite": 0.10570789128541946,
+    "insertion": 0.9088115692138672
+  },
+  {
+    "step": 119,
+    "loss": 3.1938436031341553,
+    "diagonal_ce": 2.2390542030334473,
+    "finite": 0.10326967388391495,
+    "insertion": 0.9052199721336365
+  },
+  {
+    "step": 120,
+    "loss": 3.108470916748047,
+    "diagonal_ce": 2.2302393913269043,
+    "finite": 0.11912059038877487,
+    "insertion": 0.8205771446228027
+  },
+  {
+    "step": 121,
+    "loss": 2.8785037994384766,
+    "diagonal_ce": 2.144479274749756,
+    "finite": 0.10216785222291946,
+    "insertion": 0.684166669845581
+  },
+  {
+    "step": 122,
+    "loss": 3.164175271987915,
+    "diagonal_ce": 2.214282751083374,
+    "finite": 0.10125131160020828,
+    "insertion": 0.9000768065452576
+  },
+  {
+    "step": 123,
+    "loss": 3.0959525108337402,
+    "diagonal_ce": 2.259469747543335,
+    "finite": 0.09210029989480972,
+    "insertion": 0.7908010482788086
+  },
+  {
+    "step": 124,
+    "loss": 3.2919368743896484,
+    "diagonal_ce": 2.2770326137542725,
+    "finite": 0.09518905729055405,
+    "insertion": 0.9673097133636475
+  },
+  {
+    "step": 125,
+    "loss": 3.3819260597229004,
+    "diagonal_ce": 2.3232715129852295,
+    "finite": 0.08187269419431686,
+    "insertion": 1.0173906087875366
+  },
+  {
+    "step": 126,
+    "loss": 3.242124557495117,
+    "diagonal_ce": 2.2034058570861816,
+    "finite": 0.08333835005760193,
+    "insertion": 0.9963827729225159
+  },
+  {
+    "step": 127,
+    "loss": 3.044595241546631,
+    "diagonal_ce": 2.1942014694213867,
+    "finite": 0.09198322147130966,
+    "insertion": 0.8032984733581543
+  },
+  {
+    "step": 128,
+    "loss": 3.258221387863159,
+    "diagonal_ce": 2.2935380935668945,
+    "finite": 0.08358963578939438,
+    "insertion": 0.9215510487556458
+  },
+  {
+    "step": 129,
+    "loss": 3.009781837463379,
+    "diagonal_ce": 2.18729567527771,
+    "finite": 0.08009526133537292,
+    "insertion": 0.7808365821838379
+  },
+  {
+    "step": 130,
+    "loss": 3.196768283843994,
+    "diagonal_ce": 2.2435970306396484,
+    "finite": 0.08748528361320496,
+    "insertion": 0.9073289632797241
+  },
+  {
+    "step": 131,
+    "loss": 3.1986653804779053,
+    "diagonal_ce": 2.3193492889404297,
+    "finite": 0.08020572364330292,
+    "insertion": 0.8369674682617188
+  },
+  {
+    "step": 132,
+    "loss": 2.9418833255767822,
+    "diagonal_ce": 2.0976662635803223,
+    "finite": 0.09211179614067078,
+    "insertion": 0.7952136993408203
+  },
+  {
+    "step": 133,
+    "loss": 3.0144200325012207,
+    "diagonal_ce": 2.0884311199188232,
+    "finite": 0.09231873601675034,
+    "insertion": 0.8765062093734741
+  },
+  {
+    "step": 134,
+    "loss": 3.1797330379486084,
+    "diagonal_ce": 2.271730422973633,
+    "finite": 0.09246812015771866,
+    "insertion": 0.858069896697998
+  },
+  {
+    "step": 135,
+    "loss": 3.412766695022583,
+    "diagonal_ce": 2.366564989089966,
+    "finite": 0.06929690390825272,
+    "insertion": 1.0085041522979736
+  },
+  {
+    "step": 136,
+    "loss": 3.236565589904785,
+    "diagonal_ce": 2.2828640937805176,
+    "finite": 0.07969542592763901,
+    "insertion": 0.9100284576416016
+  },
+  {
+    "step": 137,
+    "loss": 3.2845053672790527,
+    "diagonal_ce": 2.3422553539276123,
+    "finite": 0.08559741079807281,
+    "insertion": 0.8950003385543823
+  },
+  {
+    "step": 138,
+    "loss": 3.188660144805908,
+    "diagonal_ce": 2.2576756477355957,
+    "finite": 0.09670793265104294,
+    "insertion": 0.877214789390564
+  },
+  {
+    "step": 139,
+    "loss": 3.25876522064209,
+    "diagonal_ce": 2.3000175952911377,
+    "finite": 0.10281785577535629,
+    "insertion": 0.9011695384979248
+  },
+  {
+    "step": 140,
+    "loss": 3.3780460357666016,
+    "diagonal_ce": 2.3687312602996826,
+    "finite": 0.06924358010292053,
+    "insertion": 0.9702613949775696
+  },
+  {
+    "step": 141,
+    "loss": 3.0331125259399414,
+    "diagonal_ce": 2.161752462387085,
+    "finite": 0.10814594477415085,
+    "insertion": 0.809933066368103
+  },
+  {
+    "step": 142,
+    "loss": 3.119931221008301,
+    "diagonal_ce": 2.228961229324341,
+    "finite": 0.08789246529340744,
+    "insertion": 0.840695321559906
+  },
+  {
+    "step": 143,
+    "loss": 3.2675082683563232,
+    "diagonal_ce": 2.303166627883911,
+    "finite": 0.06192057207226753,
+    "insertion": 0.9286754727363586
+  },
+  {
+    "step": 144,
+    "loss": 3.2813613414764404,
+    "diagonal_ce": 2.283406972885132,
+    "finite": 0.0780240148305893,
+    "insertion": 0.9527004361152649
+  },
+  {
+    "step": 145,
+    "loss": 3.060642719268799,
+    "diagonal_ce": 2.1690268516540527,
+    "finite": 0.0813981145620346,
+    "insertion": 0.844079315662384
+  },
+  {
+    "step": 146,
+    "loss": 3.0031898021698,
+    "diagonal_ce": 2.135213613510132,
+    "finite": 0.06806234270334244,
+    "insertion": 0.8279554843902588
+  },
+  {
+    "step": 147,
+    "loss": 3.117366075515747,
+    "diagonal_ce": 2.2917187213897705,
+    "finite": 0.06460101902484894,
+    "insertion": 0.7874035835266113
+  },
+  {
+    "step": 148,
+    "loss": 3.0945162773132324,
+    "diagonal_ce": 2.259600877761841,
+    "finite": 0.04628828167915344,
+    "insertion": 0.8073275685310364
+  },
+  {
+    "step": 149,
+    "loss": 3.0933585166931152,
+    "diagonal_ce": 2.1890413761138916,
+    "finite": 0.055413827300071716,
+    "insertion": 0.8710689544677734
+  },
+  {
+    "step": 150,
+    "loss": 2.9821958541870117,
+    "diagonal_ce": 2.2162015438079834,
+    "finite": 0.04931940138339996,
+    "insertion": 0.7362052798271179
+  },
+  {
+    "step": 151,
+    "loss": 3.1855032444000244,
+    "diagonal_ce": 2.1985411643981934,
+    "finite": 0.05011262372136116,
+    "insertion": 0.9564935564994812
+  },
+  {
+    "step": 152,
+    "loss": 3.1039633750915527,
+    "diagonal_ce": 2.191821336746216,
+    "finite": 0.060234297066926956,
+    "insertion": 0.8752785921096802
+  },
+  {
+    "step": 153,
+    "loss": 2.959747552871704,
+    "diagonal_ce": 2.1163878440856934,
+    "finite": 0.06756388396024704,
+    "insertion": 0.8017403483390808
+  },
+  {
+    "step": 154,
+    "loss": 3.062105178833008,
+    "diagonal_ce": 2.200839042663574,
+    "finite": 0.05606904625892639,
+    "insertion": 0.8265032768249512
+  },
+  {
+    "step": 155,
+    "loss": 3.4570298194885254,
+    "diagonal_ce": 2.3255839347839355,
+    "finite": 0.06425981223583221,
+    "insertion": 1.0913478136062622
+  },
+  {
+    "step": 156,
+    "loss": 3.0110392570495605,
+    "diagonal_ce": 2.178800106048584,
+    "finite": 0.06103556975722313,
+    "insertion": 0.7939088344573975
+  },
+  {
+    "step": 157,
+    "loss": 3.2789714336395264,
+    "diagonal_ce": 2.322402000427246,
+    "finite": 0.04944673180580139,
+    "insertion": 0.925319254398346
+  },
+  {
+    "step": 158,
+    "loss": 3.1871719360351562,
+    "diagonal_ce": 2.2832279205322266,
+    "finite": 0.05461353436112404,
+    "insertion": 0.8692098259925842
+  },
+  {
+    "step": 159,
+    "loss": 2.8384318351745605,
+    "diagonal_ce": 2.0270795822143555,
+    "finite": 0.06127849593758583,
+    "insertion": 0.7721339464187622
+  },
+  {
+    "step": 160,
+    "loss": 3.00020694732666,
+    "diagonal_ce": 2.0720760822296143,
+    "finite": 0.04513505846261978,
+    "insertion": 0.8990639448165894
+  },
+  {
+    "step": 161,
+    "loss": 3.1838181018829346,
+    "diagonal_ce": 2.239133358001709,
+    "finite": 0.04687097296118736,
+    "insertion": 0.9143123626708984
+  },
+  {
+    "step": 162,
+    "loss": 3.491781711578369,
+    "diagonal_ce": 2.4528636932373047,
+    "finite": 0.03455851227045059,
+    "insertion": 1.016385793685913
+  },
+  {
+    "step": 163,
+    "loss": 3.0458290576934814,
+    "diagonal_ce": 2.117694854736328,
+    "finite": 0.07061047852039337,
+    "insertion": 0.8818137645721436
+  },
+  {
+    "step": 164,
+    "loss": 3.0351386070251465,
+    "diagonal_ce": 2.1728124618530273,
+    "finite": 0.05535486713051796,
+    "insertion": 0.8257918953895569
+  },
+  {
+    "step": 165,
+    "loss": 3.0698394775390625,
+    "diagonal_ce": 2.151620864868164,
+    "finite": 0.056253787130117416,
+    "insertion": 0.8808659315109253
+  },
+  {
+    "step": 166,
+    "loss": 3.1329896450042725,
+    "diagonal_ce": 2.259751796722412,
+    "finite": 0.04879153147339821,
+    "insertion": 0.8406450748443604
+  },
+  {
+    "step": 167,
+    "loss": 2.817441701889038,
+    "diagonal_ce": 2.1055908203125,
+    "finite": 0.06574724614620209,
+    "insertion": 0.6676688194274902
+  },
+  {
+    "step": 168,
+    "loss": 3.149001359939575,
+    "diagonal_ce": 2.2373363971710205,
+    "finite": 0.0466034896671772,
+    "insertion": 0.8801611065864563
+  },
+  {
+    "step": 169,
+    "loss": 2.981492042541504,
+    "diagonal_ce": 2.1308531761169434,
+    "finite": 0.061574336141347885,
+    "insertion": 0.8087682127952576
+  },
+  {
+    "step": 170,
+    "loss": 3.1601905822753906,
+    "diagonal_ce": 2.251713275909424,
+    "finite": 0.060236480087041855,
+    "insertion": 0.8672754168510437
+  },
+  {
+    "step": 171,
+    "loss": 2.8925228118896484,
+    "diagonal_ce": 2.088602066040039,
+    "finite": 0.05372338369488716,
+    "insertion": 0.766959011554718
+  },
+  {
+    "step": 172,
+    "loss": 3.18601131439209,
+    "diagonal_ce": 2.3081953525543213,
+    "finite": 0.041102923452854156,
+    "insertion": 0.8493726253509521
+  },
+  {
+    "step": 173,
+    "loss": 2.989624500274658,
+    "diagonal_ce": 2.182507276535034,
+    "finite": 0.05111384764313698,
+    "insertion": 0.7715420126914978
+  },
+  {
+    "step": 174,
+    "loss": 2.9090940952301025,
+    "diagonal_ce": 2.082160472869873,
+    "finite": 0.0533919632434845,
+    "insertion": 0.7895594239234924
+  },
+  {
+    "step": 175,
+    "loss": 2.862161159515381,
+    "diagonal_ce": 2.0159153938293457,
+    "finite": 0.04357042536139488,
+    "insertion": 0.8155723810195923
+  },
+  {
+    "step": 176,
+    "loss": 2.898921489715576,
+    "diagonal_ce": 2.0596413612365723,
+    "finite": 0.04307855665683746,
+    "insertion": 0.8087804913520813
+  },
+  {
+    "step": 177,
+    "loss": 3.3803460597991943,
+    "diagonal_ce": 2.3317415714263916,
+    "finite": 0.038212910294532776,
+    "insertion": 1.0213968753814697
+  },
+  {
+    "step": 178,
+    "loss": 2.9221553802490234,
+    "diagonal_ce": 2.1661252975463867,
+    "finite": 0.035096876323223114,
+    "insertion": 0.7309007048606873
+  },
+  {
+    "step": 179,
+    "loss": 2.9894723892211914,
+    "diagonal_ce": 2.211850881576538,
+    "finite": 0.05043092742562294,
+    "insertion": 0.7413113117218018
+  },
+  {
+    "step": 180,
+    "loss": 2.79970121383667,
+    "diagonal_ce": 2.0222251415252686,
+    "finite": 0.06291984766721725,
+    "insertion": 0.7319221496582031
+  },
+  {
+    "step": 181,
+    "loss": 2.8158419132232666,
+    "diagonal_ce": 2.0014591217041016,
+    "finite": 0.05245541036128998,
+    "insertion": 0.7761953473091125
+  },
+  {
+    "step": 182,
+    "loss": 3.1599292755126953,
+    "diagonal_ce": 2.155832052230835,
+    "finite": 0.03629911690950394,
+    "insertion": 0.9775263071060181
+  },
+  {
+    "step": 183,
+    "loss": 3.1262450218200684,
+    "diagonal_ce": 2.2822341918945312,
+    "finite": 0.0413619801402092,
+    "insertion": 0.8135683536529541
+  },
+  {
+    "step": 184,
+    "loss": 3.2089831829071045,
+    "diagonal_ce": 2.235483169555664,
+    "finite": 0.0513954684138298,
+    "insertion": 0.9354674220085144
+  },
+  {
+    "step": 185,
+    "loss": 3.0061373710632324,
+    "diagonal_ce": 2.158968687057495,
+    "finite": 0.048174336552619934,
+    "insertion": 0.8113270401954651
+  },
+  {
+    "step": 186,
+    "loss": 2.9856486320495605,
+    "diagonal_ce": 2.114281415939331,
+    "finite": 0.05990017578005791,
+    "insertion": 0.8265620470046997
+  },
+  {
+    "step": 187,
+    "loss": 3.1795127391815186,
+    "diagonal_ce": 2.265486478805542,
+    "finite": 0.0382673516869545,
+    "insertion": 0.8852491974830627
+  },
+  {
+    "step": 188,
+    "loss": 3.151441812515259,
+    "diagonal_ce": 2.1492862701416016,
+    "finite": 0.04090055823326111,
+    "insertion": 0.9712347984313965
+  },
+  {
+    "step": 189,
+    "loss": 3.282818555831909,
+    "diagonal_ce": 2.309302568435669,
+    "finite": 0.03696522116661072,
+    "insertion": 0.9454224705696106
+  },
+  {
+    "step": 190,
+    "loss": 3.1983819007873535,
+    "diagonal_ce": 2.2796998023986816,
+    "finite": 0.04182911664247513,
+    "insertion": 0.886724591255188
+  },
+  {
+    "step": 191,
+    "loss": 3.227088212966919,
+    "diagonal_ce": 2.3198771476745605,
+    "finite": 0.03451799973845482,
+    "insertion": 0.8807013034820557
+  },
+  {
+    "step": 192,
+    "loss": 2.8358731269836426,
+    "diagonal_ce": 2.0542807579040527,
+    "finite": 0.04604768380522728,
+    "insertion": 0.7460434436798096
+  },
+  {
+    "step": 193,
+    "loss": 3.117482900619507,
+    "diagonal_ce": 2.194491147994995,
+    "finite": 0.049497589468955994,
+    "insertion": 0.8845815062522888
+  },
+  {
+    "step": 194,
+    "loss": 3.087092399597168,
+    "diagonal_ce": 2.1272873878479004,
+    "finite": 0.03309304267168045,
+    "insertion": 0.9339925050735474
+  },
+  {
+    "step": 195,
+    "loss": 2.981776237487793,
+    "diagonal_ce": 2.1806066036224365,
+    "finite": 0.03740697354078293,
+    "insertion": 0.771842360496521
+  },
+  {
+    "step": 196,
+    "loss": 3.21573543548584,
+    "diagonal_ce": 2.235788106918335,
+    "finite": 0.027338193729519844,
+    "insertion": 0.9584047794342041
+  },
+  {
+    "step": 197,
+    "loss": 2.9139153957366943,
+    "diagonal_ce": 2.0984930992126465,
+    "finite": 0.035833775997161865,
+    "insertion": 0.7870419025421143
+  },
+  {
+    "step": 198,
+    "loss": 3.0828633308410645,
+    "diagonal_ce": 2.2528648376464844,
+    "finite": 0.025336721912026405,
+    "insertion": 0.8098305463790894
+  },
+  {
+    "step": 199,
+    "loss": 3.079449415206909,
+    "diagonal_ce": 2.183499574661255,
+    "finite": 0.03004918433725834,
+    "insertion": 0.8719106316566467
+  },
+  {
+    "step": 200,
+    "loss": 3.1381185054779053,
+    "diagonal_ce": 2.229013681411743,
+    "finite": 0.02229727990925312,
+    "insertion": 0.8911779522895813
+  },
+  {
+    "step": 201,
+    "loss": 3.0351345539093018,
+    "diagonal_ce": 2.2289328575134277,
+    "finite": 0.033850520849227905,
+    "insertion": 0.7788504958152771
+  },
+  {
+    "step": 202,
+    "loss": 3.063352346420288,
+    "diagonal_ce": 2.168311595916748,
+    "finite": 0.030535589903593063,
+    "insertion": 0.8702459335327148
+  },
+  {
+    "step": 203,
+    "loss": 2.9228508472442627,
+    "diagonal_ce": 2.0666375160217285,
+    "finite": 0.038708072155714035,
+    "insertion": 0.824627697467804
+  },
+  {
+    "step": 204,
+    "loss": 3.268995761871338,
+    "diagonal_ce": 2.1949455738067627,
+    "finite": 0.02873476780951023,
+    "insertion": 1.050487756729126
+  },
+  {
+    "step": 205,
+    "loss": 2.923090696334839,
+    "diagonal_ce": 2.1117045879364014,
+    "finite": 0.031361207365989685,
+    "insertion": 0.7855443358421326
+  },
+  {
+    "step": 206,
+    "loss": 3.062163829803467,
+    "diagonal_ce": 2.2453653812408447,
+    "finite": 0.030953096225857735,
+    "insertion": 0.7911692261695862
+  },
+  {
+    "step": 207,
+    "loss": 3.0764384269714355,
+    "diagonal_ce": 2.1853418350219727,
+    "finite": 0.029911408200860023,
+    "insertion": 0.8662102818489075
+  },
+  {
+    "step": 208,
+    "loss": 3.064512014389038,
+    "diagonal_ce": 2.187877655029297,
+    "finite": 0.0338771715760231,
+    "insertion": 0.84831303358078
+  },
+  {
+    "step": 209,
+    "loss": 3.178335428237915,
+    "diagonal_ce": 2.262042760848999,
+    "finite": 0.030916107818484306,
+    "insertion": 0.8903231620788574
+  },
+  {
+    "step": 210,
+    "loss": 3.010190963745117,
+    "diagonal_ce": 2.138704538345337,
+    "finite": 0.04712260514497757,
+    "insertion": 0.8317148089408875
+  },
+  {
+    "step": 211,
+    "loss": 3.0374698638916016,
+    "diagonal_ce": 2.138848066329956,
+    "finite": 0.038093384355306625,
+    "insertion": 0.8663186430931091
+  },
+  {
+    "step": 212,
+    "loss": 3.0666074752807617,
+    "diagonal_ce": 2.2255914211273193,
+    "finite": 0.030714310705661774,
+    "insertion": 0.8148475289344788
+  },
+  {
+    "step": 213,
+    "loss": 3.3233370780944824,
+    "diagonal_ce": 2.2870900630950928,
+    "finite": 0.0283161923289299,
+    "insertion": 1.0120083093643188
+  },
+  {
+    "step": 214,
+    "loss": 2.9545960426330566,
+    "diagonal_ce": 2.195774793624878,
+    "finite": 0.02600991725921631,
+    "insertion": 0.7364528775215149
+  },
+  {
+    "step": 215,
+    "loss": 2.9124197959899902,
+    "diagonal_ce": 2.1167049407958984,
+    "finite": 0.03948594629764557,
+    "insertion": 0.7615990042686462
+  },
+  {
+    "step": 216,
+    "loss": 2.9911611080169678,
+    "diagonal_ce": 2.070570230484009,
+    "finite": 0.031185930594801903,
+    "insertion": 0.8935215473175049
+  },
+  {
+    "step": 217,
+    "loss": 3.043330669403076,
+    "diagonal_ce": 2.1237337589263916,
+    "finite": 0.027573665603995323,
+    "insertion": 0.8955526351928711
+  },
+  {
+    "step": 218,
+    "loss": 2.753310203552246,
+    "diagonal_ce": 1.9481470584869385,
+    "finite": 0.04429159685969353,
+    "insertion": 0.7663636207580566
+  },
+  {
+    "step": 219,
+    "loss": 3.196178913116455,
+    "diagonal_ce": 2.251838445663452,
+    "finite": 0.023741519078612328,
+    "insertion": 0.923447847366333
+  },
+  {
+    "step": 220,
+    "loss": 3.1744933128356934,
+    "diagonal_ce": 2.2538914680480957,
+    "finite": 0.02510218322277069,
+    "insertion": 0.8984116315841675
+  },
+  {
+    "step": 221,
+    "loss": 3.0636119842529297,
+    "diagonal_ce": 2.106200933456421,
+    "finite": 0.037137847393751144,
+    "insertion": 0.9244327545166016
+  },
+  {
+    "step": 222,
+    "loss": 3.191922426223755,
+    "diagonal_ce": 2.2953991889953613,
+    "finite": 0.03306560218334198,
+    "insertion": 0.8670287728309631
+  },
+  {
+    "step": 223,
+    "loss": 3.0467188358306885,
+    "diagonal_ce": 2.220616579055786,
+    "finite": 0.0255946796387434,
+    "insertion": 0.8031695485115051
+  },
+  {
+    "step": 224,
+    "loss": 3.168344736099243,
+    "diagonal_ce": 2.21001935005188,
+    "finite": 0.028075702488422394,
+    "insertion": 0.9330573081970215
+  },
+  {
+    "step": 225,
+    "loss": 2.737393379211426,
+    "diagonal_ce": 1.978149175643921,
+    "finite": 0.040366336703300476,
+    "insertion": 0.7227529287338257
+  },
+  {
+    "step": 226,
+    "loss": 2.9973323345184326,
+    "diagonal_ce": 2.201982021331787,
+    "finite": 0.031265389174222946,
+    "insertion": 0.7669612765312195
+  },
+  {
+    "step": 227,
+    "loss": 2.8749547004699707,
+    "diagonal_ce": 2.0729541778564453,
+    "finite": 0.027929391711950302,
+    "insertion": 0.7765288352966309
+  },
+  {
+    "step": 228,
+    "loss": 2.775151252746582,
+    "diagonal_ce": 1.9847780466079712,
+    "finite": 0.04250079765915871,
+    "insertion": 0.7514424920082092
+  },
+  {
+    "step": 229,
+    "loss": 3.1657960414886475,
+    "diagonal_ce": 2.262320041656494,
+    "finite": 0.03050306625664234,
+    "insertion": 0.8754132390022278
+  },
+  {
+    "step": 230,
+    "loss": 2.9288101196289062,
+    "diagonal_ce": 1.9986050128936768,
+    "finite": 0.03616635128855705,
+    "insertion": 0.8967875242233276
+  },
+  {
+    "step": 231,
+    "loss": 2.7808001041412354,
+    "diagonal_ce": 2.0006864070892334,
+    "finite": 0.03698781132698059,
+    "insertion": 0.745789110660553
+  },
+  {
+    "step": 232,
+    "loss": 3.0784051418304443,
+    "diagonal_ce": 2.19003963470459,
+    "finite": 0.034382764250040054,
+    "insertion": 0.8563209176063538
+  },
+  {
+    "step": 233,
+    "loss": 2.8920717239379883,
+    "diagonal_ce": 2.0388541221618652,
+    "finite": 0.03490053117275238,
+    "insertion": 0.8205507397651672
+  },
+  {
+    "step": 234,
+    "loss": 3.1283771991729736,
+    "diagonal_ce": 2.183051109313965,
+    "finite": 0.02484600432217121,
+    "insertion": 0.9219708442687988
+  },
+  {
+    "step": 235,
+    "loss": 3.1368918418884277,
+    "diagonal_ce": 2.2152693271636963,
+    "finite": 0.03419286385178566,
+    "insertion": 0.8893443942070007
+  },
+  {
+    "step": 236,
+    "loss": 3.0500662326812744,
+    "diagonal_ce": 2.1700809001922607,
+    "finite": 0.0275594349950552,
+    "insertion": 0.8538589477539062
+  },
+  {
+    "step": 237,
+    "loss": 3.148913621902466,
+    "diagonal_ce": 2.263535976409912,
+    "finite": 0.026483334600925446,
+    "insertion": 0.8601656556129456
+  },
+  {
+    "step": 238,
+    "loss": 2.995408058166504,
+    "diagonal_ce": 2.141934633255005,
+    "finite": 0.02859112061560154,
+    "insertion": 0.8261404037475586
+  },
+  {
+    "step": 239,
+    "loss": 2.649538040161133,
+    "diagonal_ce": 1.9201979637145996,
+    "finite": 0.04490772634744644,
+    "insertion": 0.6862286329269409
+  },
+  {
+    "step": 240,
+    "loss": 3.015939712524414,
+    "diagonal_ce": 2.123957395553589,
+    "finite": 0.02966718189418316,
+    "insertion": 0.8633829355239868
+  },
+  {
+    "step": 241,
+    "loss": 2.849839210510254,
+    "diagonal_ce": 2.070741653442383,
+    "finite": 0.03907112032175064,
+    "insertion": 0.741276741027832
+  },
+  {
+    "step": 242,
+    "loss": 2.8335533142089844,
+    "diagonal_ce": 1.9319438934326172,
+    "finite": 0.04546495899558067,
+    "insertion": 0.8574174642562866
+  },
+  {
+    "step": 243,
+    "loss": 3.2640435695648193,
+    "diagonal_ce": 2.3163270950317383,
+    "finite": 0.026409976184368134,
+    "insertion": 0.921940267086029
+  },
+  {
+    "step": 244,
+    "loss": 2.8962807655334473,
+    "diagonal_ce": 2.0659549236297607,
+    "finite": 0.03581460192799568,
+    "insertion": 0.7952274680137634
+  },
+  {
+    "step": 245,
+    "loss": 3.1086313724517822,
+    "diagonal_ce": 2.1533679962158203,
+    "finite": 0.03553054481744766,
+    "insertion": 0.9203012585639954
+  },
+  {
+    "step": 246,
+    "loss": 3.1603479385375977,
+    "diagonal_ce": 2.204195499420166,
+    "finite": 0.021382298320531845,
+    "insertion": 0.9350267648696899
+  },
+  {
+    "step": 247,
+    "loss": 3.25799560546875,
+    "diagonal_ce": 2.2974166870117188,
+    "finite": 0.020541483536362648,
+    "insertion": 0.9402018189430237
+  },
+  {
+    "step": 248,
+    "loss": 3.091552972793579,
+    "diagonal_ce": 2.208888530731201,
+    "finite": 0.029531395062804222,
+    "insertion": 0.8532512187957764
+  },
+  {
+    "step": 249,
+    "loss": 2.83528470993042,
+    "diagonal_ce": 1.9026896953582764,
+    "finite": 0.032301049679517746,
+    "insertion": 0.9002940058708191
+  },
+  {
+    "step": 250,
+    "loss": 2.9396743774414062,
+    "diagonal_ce": 2.045118808746338,
+    "finite": 0.03563491627573967,
+    "insertion": 0.8589206337928772
+  },
+  {
+    "step": 251,
+    "loss": 3.19118070602417,
+    "diagonal_ce": 2.2572848796844482,
+    "finite": 0.02268018200993538,
+    "insertion": 0.9112154245376587
+  },
+  {
+    "step": 252,
+    "loss": 3.037236213684082,
+    "diagonal_ce": 2.1159615516662598,
+    "finite": 0.028438931331038475,
+    "insertion": 0.8928355574607849
+  },
+  {
+    "step": 253,
+    "loss": 2.733067750930786,
+    "diagonal_ce": 2.048414945602417,
+    "finite": 0.027805646881461143,
+    "insertion": 0.6568472385406494
+  },
+  {
+    "step": 254,
+    "loss": 2.8498542308807373,
+    "diagonal_ce": 2.0506930351257324,
+    "finite": 0.033264681696891785,
+    "insertion": 0.7658965587615967
+  },
+  {
+    "step": 255,
+    "loss": 3.113518238067627,
+    "diagonal_ce": 2.236309051513672,
+    "finite": 0.028638795018196106,
+    "insertion": 0.8485703468322754
+  },
+  {
+    "step": 256,
+    "loss": 3.1614797115325928,
+    "diagonal_ce": 2.2050509452819824,
+    "finite": 0.03349211812019348,
+    "insertion": 0.922936737537384
+  },
+  {
+    "step": 257,
+    "loss": 2.8354475498199463,
+    "diagonal_ce": 1.9995038509368896,
+    "finite": 0.035151053220033646,
+    "insertion": 0.8007926344871521
+  },
+  {
+    "step": 258,
+    "loss": 3.0254645347595215,
+    "diagonal_ce": 2.0737147331237793,
+    "finite": 0.03838852792978287,
+    "insertion": 0.9133613705635071
+  },
+  {
+    "step": 259,
+    "loss": 2.875399589538574,
+    "diagonal_ce": 2.0544321537017822,
+    "finite": 0.034839700907468796,
+    "insertion": 0.7861278057098389
+  },
+  {
+    "step": 260,
+    "loss": 3.0373828411102295,
+    "diagonal_ce": 2.250704526901245,
+    "finite": 0.024747949093580246,
+    "insertion": 0.761930525302887
+  },
+  {
+    "step": 261,
+    "loss": 3.1451072692871094,
+    "diagonal_ce": 2.169912815093994,
+    "finite": 0.037611305713653564,
+    "insertion": 0.937583327293396
+  },
+  {
+    "step": 262,
+    "loss": 2.941169023513794,
+    "diagonal_ce": 2.092562437057495,
+    "finite": 0.028294332325458527,
+    "insertion": 0.8203123211860657
+  },
+  {
+    "step": 263,
+    "loss": 3.051204204559326,
+    "diagonal_ce": 2.1349899768829346,
+    "finite": 0.020909860730171204,
+    "insertion": 0.8953043222427368
+  },
+  {
+    "step": 264,
+    "loss": 3.1249125003814697,
+    "diagonal_ce": 2.1065545082092285,
+    "finite": 0.02725410833954811,
+    "insertion": 0.9911038875579834
+  },
+  {
+    "step": 265,
+    "loss": 2.908564329147339,
+    "diagonal_ce": 2.0666191577911377,
+    "finite": 0.028939342126250267,
+    "insertion": 0.8130059242248535
+  },
+  {
+    "step": 266,
+    "loss": 3.121814250946045,
+    "diagonal_ce": 2.3025550842285156,
+    "finite": 0.02777833677828312,
+    "insertion": 0.7914807796478271
+  },
+  {
+    "step": 267,
+    "loss": 3.3114612102508545,
+    "diagonal_ce": 2.340855836868286,
+    "finite": 0.023220840841531754,
+    "insertion": 0.9473846554756165
+  },
+  {
+    "step": 268,
+    "loss": 2.9765255451202393,
+    "diagonal_ce": 2.1424648761749268,
+    "finite": 0.028766443952918053,
+    "insertion": 0.8052942156791687
+  },
+  {
+    "step": 269,
+    "loss": 3.0092968940734863,
+    "diagonal_ce": 2.151578187942505,
+    "finite": 0.026103459298610687,
+    "insertion": 0.8316153287887573
+  },
+  {
+    "step": 270,
+    "loss": 3.377300500869751,
+    "diagonal_ce": 2.4147489070892334,
+    "finite": 0.023683693259954453,
+    "insertion": 0.9388678669929504
+  },
+  {
+    "step": 271,
+    "loss": 2.8551676273345947,
+    "diagonal_ce": 2.091564655303955,
+    "finite": 0.019214412197470665,
+    "insertion": 0.7443885803222656
+  },
+  {
+    "step": 272,
+    "loss": 3.253331184387207,
+    "diagonal_ce": 2.3022634983062744,
+    "finite": 0.022824449464678764,
+    "insertion": 0.9282432794570923
+  },
+  {
+    "step": 273,
+    "loss": 3.124753952026367,
+    "diagonal_ce": 2.1526684761047363,
+    "finite": 0.020941050723195076,
+    "insertion": 0.9511444568634033
+  },
+  {
+    "step": 274,
+    "loss": 2.8493189811706543,
+    "diagonal_ce": 2.0854334831237793,
+    "finite": 0.02533300220966339,
+    "insertion": 0.7385526299476624
+  },
+  {
+    "step": 275,
+    "loss": 3.073068141937256,
+    "diagonal_ce": 2.1303319931030273,
+    "finite": 0.017873909324407578,
+    "insertion": 0.9248621463775635
+  },
+  {
+    "step": 276,
+    "loss": 3.078702211380005,
+    "diagonal_ce": 2.2057340145111084,
+    "finite": 0.01661287248134613,
+    "insertion": 0.8563553690910339
+  },
+  {
+    "step": 277,
+    "loss": 3.2087676525115967,
+    "diagonal_ce": 2.253239870071411,
+    "finite": 0.01713789999485016,
+    "insertion": 0.938389778137207
+  },
+  {
+    "step": 278,
+    "loss": 2.9564504623413086,
+    "diagonal_ce": 2.175855875015259,
+    "finite": 0.018807077780365944,
+    "insertion": 0.7617874145507812
+  },
+  {
+    "step": 279,
+    "loss": 2.6589226722717285,
+    "diagonal_ce": 1.9357439279556274,
+    "finite": 0.02105432190001011,
+    "insertion": 0.7021245956420898
+  },
+  {
+    "step": 280,
+    "loss": 2.9990994930267334,
+    "diagonal_ce": 2.1390249729156494,
+    "finite": 0.020872849971055984,
+    "insertion": 0.8392016887664795
+  },
+  {
+    "step": 281,
+    "loss": 2.728628396987915,
+    "diagonal_ce": 1.9041380882263184,
+    "finite": 0.026257436722517014,
+    "insertion": 0.7982329726219177
+  },
+  {
+    "step": 282,
+    "loss": 3.157712936401367,
+    "diagonal_ce": 2.2825653553009033,
+    "finite": 0.02074812725186348,
+    "insertion": 0.8543993234634399
+  },
+  {
+    "step": 283,
+    "loss": 2.9906535148620605,
+    "diagonal_ce": 2.172938823699951,
+    "finite": 0.025506509467959404,
+    "insertion": 0.7922083139419556
+  },
+  {
+    "step": 284,
+    "loss": 3.010685443878174,
+    "diagonal_ce": 2.1886723041534424,
+    "finite": 0.026715481653809547,
+    "insertion": 0.7952977418899536
+  },
+  {
+    "step": 285,
+    "loss": 2.819676637649536,
+    "diagonal_ce": 1.9627811908721924,
+    "finite": 0.03066726215183735,
+    "insertion": 0.8262282013893127
+  },
+  {
+    "step": 286,
+    "loss": 2.792377233505249,
+    "diagonal_ce": 2.059818744659424,
+    "finite": 0.034040845930576324,
+    "insertion": 0.6985176205635071
+  },
+  {
+    "step": 287,
+    "loss": 2.7239649295806885,
+    "diagonal_ce": 1.9830964803695679,
+    "finite": 0.04278494045138359,
+    "insertion": 0.6980834603309631
+  },
+  {
+    "step": 288,
+    "loss": 2.9892916679382324,
+    "diagonal_ce": 2.152911424636841,
+    "finite": 0.03564061224460602,
+    "insertion": 0.8007396459579468
+  },
+  {
+    "step": 289,
+    "loss": 2.6694846153259277,
+    "diagonal_ce": 1.9457753896713257,
+    "finite": 0.042122043669223785,
+    "insertion": 0.6815871000289917
+  },
+  {
+    "step": 290,
+    "loss": 3.142341136932373,
+    "diagonal_ce": 2.1935384273529053,
+    "finite": 0.03741106763482094,
+    "insertion": 0.9113916754722595
+  },
+  {
+    "step": 291,
+    "loss": 2.9089627265930176,
+    "diagonal_ce": 2.0381417274475098,
+    "finite": 0.03246775269508362,
+    "insertion": 0.8383532166481018
+  },
+  {
+    "step": 292,
+    "loss": 2.9225077629089355,
+    "diagonal_ce": 2.0516433715820312,
+    "finite": 0.030307408422231674,
+    "insertion": 0.8405570387840271
+  },
+  {
+    "step": 293,
+    "loss": 3.150623321533203,
+    "diagonal_ce": 2.2081856727600098,
+    "finite": 0.020731713622808456,
+    "insertion": 0.9217058420181274
+  },
+  {
+    "step": 294,
+    "loss": 3.089787244796753,
+    "diagonal_ce": 2.122293710708618,
+    "finite": 0.03028343990445137,
+    "insertion": 0.9372100830078125
+  },
+  {
+    "step": 295,
+    "loss": 2.840442180633545,
+    "diagonal_ce": 2.0742597579956055,
+    "finite": 0.028987841680645943,
+    "insertion": 0.7371946573257446
+  },
+  {
+    "step": 296,
+    "loss": 3.1534423828125,
+    "diagonal_ce": 2.1833255290985107,
+    "finite": 0.028091778978705406,
+    "insertion": 0.9420252442359924
+  },
+  {
+    "step": 297,
+    "loss": 3.0244686603546143,
+    "diagonal_ce": 2.1173031330108643,
+    "finite": 0.028579523786902428,
+    "insertion": 0.8785860538482666
+  },
+  {
+    "step": 298,
+    "loss": 3.054309129714966,
+    "diagonal_ce": 2.0940933227539062,
+    "finite": 0.025317378342151642,
+    "insertion": 0.9348984360694885
+  },
+  {
+    "step": 299,
+    "loss": 3.0453085899353027,
+    "diagonal_ce": 2.195120334625244,
+    "finite": 0.026723407208919525,
+    "insertion": 0.8234648704528809
+  },
+  {
+    "step": 300,
+    "loss": 3.1356430053710938,
+    "diagonal_ce": 2.1532161235809326,
+    "finite": 0.02735823392868042,
+    "insertion": 0.9550685882568359
+  },
+  {
+    "step": 301,
+    "loss": 3.012434482574463,
+    "diagonal_ce": 2.2114310264587402,
+    "finite": 0.027599086984992027,
+    "insertion": 0.7734043002128601
+  },
+  {
+    "step": 302,
+    "loss": 3.395805835723877,
+    "diagonal_ce": 2.3931939601898193,
+    "finite": 0.02153555303812027,
+    "insertion": 0.9810761213302612
+  },
+  {
+    "step": 303,
+    "loss": 3.029759407043457,
+    "diagonal_ce": 2.1792824268341064,
+    "finite": 0.022228354588150978,
+    "insertion": 0.8282486200332642
+  },
+  {
+    "step": 304,
+    "loss": 2.70428204536438,
+    "diagonal_ce": 1.9475582838058472,
+    "finite": 0.02938496693968773,
+    "insertion": 0.7273388504981995
+  },
+  {
+    "step": 305,
+    "loss": 2.9762070178985596,
+    "diagonal_ce": 2.1679084300994873,
+    "finite": 0.023122910410165787,
+    "insertion": 0.7851755619049072
+  },
+  {
+    "step": 306,
+    "loss": 2.7736992835998535,
+    "diagonal_ce": 2.041400909423828,
+    "finite": 0.028359059244394302,
+    "insertion": 0.7039390802383423
+  },
+  {
+    "step": 307,
+    "loss": 2.9026381969451904,
+    "diagonal_ce": 2.0055930614471436,
+    "finite": 0.022554147988557816,
+    "insertion": 0.8744909763336182
+  },
+  {
+    "step": 308,
+    "loss": 2.928290367126465,
+    "diagonal_ce": 2.05696702003479,
+    "finite": 0.020651772618293762,
+    "insertion": 0.8506714105606079
+  },
+  {
+    "step": 309,
+    "loss": 3.0967912673950195,
+    "diagonal_ce": 2.189228057861328,
+    "finite": 0.018009992316365242,
+    "insertion": 0.889553427696228
+  },
+  {
+    "step": 310,
+    "loss": 2.9559881687164307,
+    "diagonal_ce": 2.058199405670166,
+    "finite": 0.021528949961066246,
+    "insertion": 0.8762597441673279
+  },
+  {
+    "step": 311,
+    "loss": 3.0200705528259277,
+    "diagonal_ce": 2.1468896865844727,
+    "finite": 0.019425420090556145,
+    "insertion": 0.853755533695221
+  },
+  {
+    "step": 312,
+    "loss": 3.0467655658721924,
+    "diagonal_ce": 2.1462597846984863,
+    "finite": 0.019203374162316322,
+    "insertion": 0.8813024163246155
+  },
+  {
+    "step": 313,
+    "loss": 2.9921088218688965,
+    "diagonal_ce": 2.07782244682312,
+    "finite": 0.018201477825641632,
+    "insertion": 0.896084725856781
+  },
+  {
+    "step": 314,
+    "loss": 3.1929564476013184,
+    "diagonal_ce": 2.238285541534424,
+    "finite": 0.019975580275058746,
+    "insertion": 0.9346953630447388
+  },
+  {
+    "step": 315,
+    "loss": 3.1675314903259277,
+    "diagonal_ce": 2.2602458000183105,
+    "finite": 0.02237657830119133,
+    "insertion": 0.8849090933799744
+  },
+  {
+    "step": 316,
+    "loss": 2.854884624481201,
+    "diagonal_ce": 1.9954211711883545,
+    "finite": 0.01926552876830101,
+    "insertion": 0.8401979207992554
+  },
+  {
+    "step": 317,
+    "loss": 2.904130697250366,
+    "diagonal_ce": 2.08046293258667,
+    "finite": 0.02646210789680481,
+    "insertion": 0.7972057461738586
+  },
+  {
+    "step": 318,
+    "loss": 3.093787431716919,
+    "diagonal_ce": 2.2434799671173096,
+    "finite": 0.02131679467856884,
+    "insertion": 0.8289907574653625
+  },
+  {
+    "step": 319,
+    "loss": 3.390350341796875,
+    "diagonal_ce": 2.299804925918579,
+    "finite": 0.02153303474187851,
+    "insertion": 1.0690125226974487
+  },
+  {
+    "step": 320,
+    "loss": 2.8620171546936035,
+    "diagonal_ce": 2.0052194595336914,
+    "finite": 0.018670834600925446,
+    "insertion": 0.8381270170211792
+  },
+  {
+    "step": 321,
+    "loss": 2.7224607467651367,
+    "diagonal_ce": 1.9551012516021729,
+    "finite": 0.021771015599370003,
+    "insertion": 0.7455885410308838
+  },
+  {
+    "step": 322,
+    "loss": 2.7472481727600098,
+    "diagonal_ce": 1.9504648447036743,
+    "finite": 0.025680819526314735,
+    "insertion": 0.7711026072502136
+  },
+  {
+    "step": 323,
+    "loss": 2.910195827484131,
+    "diagonal_ce": 2.116307020187378,
+    "finite": 0.019038302823901176,
+    "insertion": 0.7748507261276245
+  },
+  {
+    "step": 324,
+    "loss": 3.2276840209960938,
+    "diagonal_ce": 2.2636098861694336,
+    "finite": 0.021194597706198692,
+    "insertion": 0.9428795576095581
+  },
+  {
+    "step": 325,
+    "loss": 2.9099597930908203,
+    "diagonal_ce": 2.142976999282837,
+    "finite": 0.017944395542144775,
+    "insertion": 0.7490384578704834
+  },
+  {
+    "step": 326,
+    "loss": 3.096906900405884,
+    "diagonal_ce": 2.217283010482788,
+    "finite": 0.017888309434056282,
+    "insertion": 0.8617355823516846
+  },
+  {
+    "step": 327,
+    "loss": 3.0053815841674805,
+    "diagonal_ce": 2.1462080478668213,
+    "finite": 0.01887037232518196,
+    "insertion": 0.8403031229972839
+  },
+  {
+    "step": 328,
+    "loss": 2.796339988708496,
+    "diagonal_ce": 2.0102577209472656,
+    "finite": 0.020120007917284966,
+    "insertion": 0.7659624218940735
+  },
+  {
+    "step": 329,
+    "loss": 2.6177186965942383,
+    "diagonal_ce": 1.97322678565979,
+    "finite": 0.020732704550027847,
+    "insertion": 0.6237591505050659
+  },
+  {
+    "step": 330,
+    "loss": 3.088286876678467,
+    "diagonal_ce": 2.1959922313690186,
+    "finite": 0.023119695484638214,
+    "insertion": 0.8691749572753906
+  },
+  {
+    "step": 331,
+    "loss": 2.8074400424957275,
+    "diagonal_ce": 2.0030601024627686,
+    "finite": 0.023292938247323036,
+    "insertion": 0.7810869216918945
+  },
+  {
+    "step": 332,
+    "loss": 2.8918309211730957,
+    "diagonal_ce": 1.9989831447601318,
+    "finite": 0.024967676028609276,
+    "insertion": 0.8678800463676453
+  },
+  {
+    "step": 333,
+    "loss": 3.2098917961120605,
+    "diagonal_ce": 2.213552474975586,
+    "finite": 0.020927991718053818,
+    "insertion": 0.9754113554954529
+  },
+  {
+    "step": 334,
+    "loss": 2.8063573837280273,
+    "diagonal_ce": 2.0743942260742188,
+    "finite": 0.021875642240047455,
+    "insertion": 0.7100876569747925
+  },
+  {
+    "step": 335,
+    "loss": 3.0382463932037354,
+    "diagonal_ce": 2.1071465015411377,
+    "finite": 0.02595389448106289,
+    "insertion": 0.9051458835601807
+  },
+  {
+    "step": 336,
+    "loss": 2.8563849925994873,
+    "diagonal_ce": 2.089808225631714,
+    "finite": 0.021572059020400047,
+    "insertion": 0.7450045943260193
+  },
+  {
+    "step": 337,
+    "loss": 2.991110324859619,
+    "diagonal_ce": 2.053840160369873,
+    "finite": 0.021647877991199493,
+    "insertion": 0.9156221151351929
+  },
+  {
+    "step": 338,
+    "loss": 2.7350072860717773,
+    "diagonal_ce": 1.9333385229110718,
+    "finite": 0.026715239509940147,
+    "insertion": 0.7749534249305725
+  },
+  {
+    "step": 339,
+    "loss": 2.6952900886535645,
+    "diagonal_ce": 1.9171708822250366,
+    "finite": 0.026954783126711845,
+    "insertion": 0.751164436340332
+  },
+  {
+    "step": 340,
+    "loss": 3.0245509147644043,
+    "diagonal_ce": 2.2389488220214844,
+    "finite": 0.01904134824872017,
+    "insertion": 0.7665607333183289
+  },
+  {
+    "step": 341,
+    "loss": 3.272810935974121,
+    "diagonal_ce": 2.3093388080596924,
+    "finite": 0.02000804990530014,
+    "insertion": 0.9434641003608704
+  },
+  {
+    "step": 342,
+    "loss": 2.7213170528411865,
+    "diagonal_ce": 1.9614973068237305,
+    "finite": 0.0240589939057827,
+    "insertion": 0.7357607483863831
+  },
+  {
+    "step": 343,
+    "loss": 2.837742328643799,
+    "diagonal_ce": 2.0326168537139893,
+    "finite": 0.022398652508854866,
+    "insertion": 0.7827268242835999
+  },
+  {
+    "step": 344,
+    "loss": 2.859417676925659,
+    "diagonal_ce": 2.0494749546051025,
+    "finite": 0.020114365965127945,
+    "insertion": 0.7898283004760742
+  },
+  {
+    "step": 345,
+    "loss": 2.976972818374634,
+    "diagonal_ce": 2.0917155742645264,
+    "finite": 0.024074940010905266,
+    "insertion": 0.8611822724342346
+  },
+  {
+    "step": 346,
+    "loss": 2.812542200088501,
+    "diagonal_ce": 1.9966615438461304,
+    "finite": 0.01957438886165619,
+    "insertion": 0.7963064312934875
+  },
+  {
+    "step": 347,
+    "loss": 2.8455207347869873,
+    "diagonal_ce": 2.018690824508667,
+    "finite": 0.025568656623363495,
+    "insertion": 0.8012611269950867
+  },
+  {
+    "step": 348,
+    "loss": 2.6108286380767822,
+    "diagonal_ce": 1.8847928047180176,
+    "finite": 0.020988676697015762,
+    "insertion": 0.705047070980072
+  },
+  {
+    "step": 349,
+    "loss": 2.8343513011932373,
+    "diagonal_ce": 2.0319557189941406,
+    "finite": 0.01904764026403427,
+    "insertion": 0.7833478450775146
+  },
+  {
+    "step": 350,
+    "loss": 2.8683924674987793,
+    "diagonal_ce": 2.051140785217285,
+    "finite": 0.021119724959135056,
+    "insertion": 0.7961317300796509
+  },
+  {
+    "step": 351,
+    "loss": 2.713651418685913,
+    "diagonal_ce": 1.9554377794265747,
+    "finite": 0.0232714656740427,
+    "insertion": 0.7349421977996826
+  },
+  {
+    "step": 352,
+    "loss": 3.082550048828125,
+    "diagonal_ce": 2.204739809036255,
+    "finite": 0.025306327268481255,
+    "insertion": 0.8525039553642273
+  },
+  {
+    "step": 353,
+    "loss": 2.8186662197113037,
+    "diagonal_ce": 2.0286526679992676,
+    "finite": 0.024193380028009415,
+    "insertion": 0.7658202648162842
+  },
+  {
+    "step": 354,
+    "loss": 3.141378879547119,
+    "diagonal_ce": 2.194617748260498,
+    "finite": 0.021488340571522713,
+    "insertion": 0.9252728223800659
+  },
+  {
+    "step": 355,
+    "loss": 3.0448057651519775,
+    "diagonal_ce": 2.1858303546905518,
+    "finite": 0.024908415973186493,
+    "insertion": 0.8340671062469482
+  },
+  {
+    "step": 356,
+    "loss": 2.8207361698150635,
+    "diagonal_ce": 1.9954137802124023,
+    "finite": 0.022738071158528328,
+    "insertion": 0.8025843501091003
+  },
+  {
+    "step": 357,
+    "loss": 3.001067876815796,
+    "diagonal_ce": 2.1191015243530273,
+    "finite": 0.01789206825196743,
+    "insertion": 0.8640742897987366
+  },
+  {
+    "step": 358,
+    "loss": 2.904259443283081,
+    "diagonal_ce": 2.0556294918060303,
+    "finite": 0.022845376282930374,
+    "insertion": 0.8257846236228943
+  },
+  {
+    "step": 359,
+    "loss": 3.001211166381836,
+    "diagonal_ce": 2.08682918548584,
+    "finite": 0.023853445425629616,
+    "insertion": 0.8905284404754639
+  },
+  {
+    "step": 360,
+    "loss": 2.6895861625671387,
+    "diagonal_ce": 1.9548490047454834,
+    "finite": 0.02234714850783348,
+    "insertion": 0.7123901844024658
+  },
+  {
+    "step": 361,
+    "loss": 2.782353162765503,
+    "diagonal_ce": 1.9314295053482056,
+    "finite": 0.020934561267495155,
+    "insertion": 0.8299891352653503
+  },
+  {
+    "step": 362,
+    "loss": 2.699099540710449,
+    "diagonal_ce": 1.9949806928634644,
+    "finite": 0.023366738110780716,
+    "insertion": 0.6807519197463989
+  },
+  {
+    "step": 363,
+    "loss": 3.144632577896118,
+    "diagonal_ce": 2.1689839363098145,
+    "finite": 0.025074323639273643,
+    "insertion": 0.9505743980407715
+  },
+  {
+    "step": 364,
+    "loss": 2.858708381652832,
+    "diagonal_ce": 2.092285633087158,
+    "finite": 0.01779511757194996,
+    "insertion": 0.7486275434494019
+  },
+  {
+    "step": 365,
+    "loss": 3.216254711151123,
+    "diagonal_ce": 2.2790887355804443,
+    "finite": 0.01774304173886776,
+    "insertion": 0.91942298412323
+  },
+  {
+    "step": 366,
+    "loss": 2.9567580223083496,
+    "diagonal_ce": 2.026376247406006,
+    "finite": 0.021184099838137627,
+    "insertion": 0.9091974496841431
+  },
+  {
+    "step": 367,
+    "loss": 2.9809300899505615,
+    "diagonal_ce": 2.161886692047119,
+    "finite": 0.020851092413067818,
+    "insertion": 0.7981923222541809
+  },
+  {
+    "step": 368,
+    "loss": 3.3297364711761475,
+    "diagonal_ce": 2.3634936809539795,
+    "finite": 0.022549420595169067,
+    "insertion": 0.9436933994293213
+  },
+  {
+    "step": 369,
+    "loss": 2.8505048751831055,
+    "diagonal_ce": 1.9925310611724854,
+    "finite": 0.028312282636761665,
+    "insertion": 0.8296617269515991
+  },
+  {
+    "step": 370,
+    "loss": 2.7860560417175293,
+    "diagonal_ce": 2.01064395904541,
+    "finite": 0.020644167438149452,
+    "insertion": 0.7547677755355835
+  },
+  {
+    "step": 371,
+    "loss": 3.279904365539551,
+    "diagonal_ce": 2.2348074913024902,
+    "finite": 0.01830163784325123,
+    "insertion": 1.0267950296401978
+  },
+  {
+    "step": 372,
+    "loss": 2.965769052505493,
+    "diagonal_ce": 2.093268632888794,
+    "finite": 0.01872129738330841,
+    "insertion": 0.8537790775299072
+  },
+  {
+    "step": 373,
+    "loss": 2.6739394664764404,
+    "diagonal_ce": 1.942107081413269,
+    "finite": 0.022024916484951973,
+    "insertion": 0.7098075747489929
+  },
+  {
+    "step": 374,
+    "loss": 2.8005599975585938,
+    "diagonal_ce": 2.049675226211548,
+    "finite": 0.01936245709657669,
+    "insertion": 0.7315223813056946
+  },
+  {
+    "step": 375,
+    "loss": 2.7034502029418945,
+    "diagonal_ce": 1.9230657815933228,
+    "finite": 0.02102799154818058,
+    "insertion": 0.7593564391136169
+  },
+  {
+    "step": 376,
+    "loss": 3.1775171756744385,
+    "diagonal_ce": 2.297004461288452,
+    "finite": 0.01693052053451538,
+    "insertion": 0.863582193851471
+  },
+  {
+    "step": 377,
+    "loss": 2.9802584648132324,
+    "diagonal_ce": 2.068514347076416,
+    "finite": 0.020468072965741158,
+    "insertion": 0.8912761211395264
+  },
+  {
+    "step": 378,
+    "loss": 2.9760868549346924,
+    "diagonal_ce": 2.1212174892425537,
+    "finite": 0.018176207318902016,
+    "insertion": 0.8366929888725281
+  },
+  {
+    "step": 379,
+    "loss": 3.1634092330932617,
+    "diagonal_ce": 2.2164783477783203,
+    "finite": 0.017866255715489388,
+    "insertion": 0.9290646314620972
+  },
+  {
+    "step": 380,
+    "loss": 2.749908924102783,
+    "diagonal_ce": 1.933083176612854,
+    "finite": 0.018197644501924515,
+    "insertion": 0.7986280918121338
+  },
+  {
+    "step": 381,
+    "loss": 3.249669075012207,
+    "diagonal_ce": 2.3748791217803955,
+    "finite": 0.016565633937716484,
+    "insertion": 0.8582245111465454
+  },
+  {
+    "step": 382,
+    "loss": 3.3226425647735596,
+    "diagonal_ce": 2.2751898765563965,
+    "finite": 0.01699610985815525,
+    "insertion": 1.03045654296875
+  },
+  {
+    "step": 383,
+    "loss": 2.8676540851593018,
+    "diagonal_ce": 1.9969621896743774,
+    "finite": 0.021098647266626358,
+    "insertion": 0.8495931625366211
+  },
+  {
+    "step": 384,
+    "loss": 3.074723482131958,
+    "diagonal_ce": 2.1703529357910156,
+    "finite": 0.018158605322241783,
+    "insertion": 0.8862118721008301
+  },
+  {
+    "step": 385,
+    "loss": 2.7792117595672607,
+    "diagonal_ce": 1.949379324913025,
+    "finite": 0.018071262165904045,
+    "insertion": 0.8117610812187195
+  },
+  {
+    "step": 386,
+    "loss": 3.2546353340148926,
+    "diagonal_ce": 2.290536403656006,
+    "finite": 0.01699179969727993,
+    "insertion": 0.947107195854187
+  },
+  {
+    "step": 387,
+    "loss": 2.95314884185791,
+    "diagonal_ce": 2.1098623275756836,
+    "finite": 0.020447850227355957,
+    "insertion": 0.8228387236595154
+  },
+  {
+    "step": 388,
+    "loss": 2.900015354156494,
+    "diagonal_ce": 2.020986557006836,
+    "finite": 0.022057345137000084,
+    "insertion": 0.8569713830947876
+  },
+  {
+    "step": 389,
+    "loss": 2.765627384185791,
+    "diagonal_ce": 1.9918674230575562,
+    "finite": 0.01803007163107395,
+    "insertion": 0.7557300329208374
+  },
+  {
+    "step": 390,
+    "loss": 2.876429557800293,
+    "diagonal_ce": 2.082885265350342,
+    "finite": 0.01486328337341547,
+    "insertion": 0.7786810994148254
+  },
+  {
+    "step": 391,
+    "loss": 2.890820026397705,
+    "diagonal_ce": 2.0207927227020264,
+    "finite": 0.016770275309681892,
+    "insertion": 0.85325688123703
+  },
+  {
+    "step": 392,
+    "loss": 2.7813007831573486,
+    "diagonal_ce": 1.9696133136749268,
+    "finite": 0.019859541207551956,
+    "insertion": 0.7918278574943542
+  },
+  {
+    "step": 393,
+    "loss": 3.0007455348968506,
+    "diagonal_ce": 2.123365640640259,
+    "finite": 0.016174133867025375,
+    "insertion": 0.8612057566642761
+  },
+  {
+    "step": 394,
+    "loss": 3.094956398010254,
+    "diagonal_ce": 2.176239252090454,
+    "finite": 0.02034663036465645,
+    "insertion": 0.898370623588562
+  },
+  {
+    "step": 395,
+    "loss": 2.657559633255005,
+    "diagonal_ce": 1.9611046314239502,
+    "finite": 0.02154514193534851,
+    "insertion": 0.674909770488739
+  },
+  {
+    "step": 396,
+    "loss": 2.9097821712493896,
+    "diagonal_ce": 2.0989434719085693,
+    "finite": 0.017514586448669434,
+    "insertion": 0.7933241724967957
+  },
+  {
+    "step": 397,
+    "loss": 2.906874179840088,
+    "diagonal_ce": 2.0018508434295654,
+    "finite": 0.0200965516269207,
+    "insertion": 0.8849268555641174
+  },
+  {
+    "step": 398,
+    "loss": 3.3021743297576904,
+    "diagonal_ce": 2.3123362064361572,
+    "finite": 0.01538757048547268,
+    "insertion": 0.9744505286216736
+  },
+  {
+    "step": 399,
+    "loss": 3.2970869541168213,
+    "diagonal_ce": 2.2621607780456543,
+    "finite": 0.01783173531293869,
+    "insertion": 1.017094373703003
+  },
+  {
+    "step": 400,
+    "loss": 3.0048093795776367,
+    "diagonal_ce": 2.0594749450683594,
+    "finite": 0.01988663524389267,
+    "insertion": 0.9254475831985474
+  },
+  {
+    "step": 401,
+    "loss": 2.973017692565918,
+    "diagonal_ce": 2.1230247020721436,
+    "finite": 0.01869945041835308,
+    "insertion": 0.8312936425209045
+  },
+  {
+    "step": 402,
+    "loss": 3.1814191341400146,
+    "diagonal_ce": 2.227660894393921,
+    "finite": 0.018864858895540237,
+    "insertion": 0.9348933696746826
+  },
+  {
+    "step": 403,
+    "loss": 3.0557351112365723,
+    "diagonal_ce": 2.2075228691101074,
+    "finite": 0.021957628428936005,
+    "insertion": 0.8262547254562378
+  },
+  {
+    "step": 404,
+    "loss": 2.8425402641296387,
+    "diagonal_ce": 2.090947151184082,
+    "finite": 0.018023604527115822,
+    "insertion": 0.7335696220397949
+  },
+  {
+    "step": 405,
+    "loss": 3.003981113433838,
+    "diagonal_ce": 2.134813070297241,
+    "finite": 0.020429734140634537,
+    "insertion": 0.8487381339073181
+  },
+  {
+    "step": 406,
+    "loss": 3.0122697353363037,
+    "diagonal_ce": 2.1180264949798584,
+    "finite": 0.01890440471470356,
+    "insertion": 0.8753388524055481
+  },
+  {
+    "step": 407,
+    "loss": 3.2264304161071777,
+    "diagonal_ce": 2.2725744247436523,
+    "finite": 0.017326507717370987,
+    "insertion": 0.9365293979644775
+  },
+  {
+    "step": 408,
+    "loss": 2.9778504371643066,
+    "diagonal_ce": 2.1266427040100098,
+    "finite": 0.020260535180568695,
+    "insertion": 0.8309472799301147
+  },
+  {
+    "step": 409,
+    "loss": 3.064098596572876,
+    "diagonal_ce": 2.1316990852355957,
+    "finite": 0.020247971639037132,
+    "insertion": 0.9121515154838562
+  },
+  {
+    "step": 410,
+    "loss": 2.842419147491455,
+    "diagonal_ce": 1.9864190816879272,
+    "finite": 0.016266053542494774,
+    "insertion": 0.8397341370582581
+  },
+  {
+    "step": 411,
+    "loss": 2.9057507514953613,
+    "diagonal_ce": 2.0929062366485596,
+    "finite": 0.01795247755944729,
+    "insertion": 0.7948920130729675
+  },
+  {
+    "step": 412,
+    "loss": 2.823568820953369,
+    "diagonal_ce": 2.0112051963806152,
+    "finite": 0.01564798876643181,
+    "insertion": 0.7967156767845154
+  },
+  {
+    "step": 413,
+    "loss": 3.167476177215576,
+    "diagonal_ce": 2.194512367248535,
+    "finite": 0.018806971609592438,
+    "insertion": 0.9541568160057068
+  },
+  {
+    "step": 414,
+    "loss": 2.8716564178466797,
+    "diagonal_ce": 1.9977048635482788,
+    "finite": 0.019999004900455475,
+    "insertion": 0.8539525866508484
+  },
+  {
+    "step": 415,
+    "loss": 3.0672006607055664,
+    "diagonal_ce": 2.151477813720703,
+    "finite": 0.017873188480734825,
+    "insertion": 0.8978496193885803
+  },
+  {
+    "step": 416,
+    "loss": 2.6363539695739746,
+    "diagonal_ce": 1.8356192111968994,
+    "finite": 0.019459733739495277,
+    "insertion": 0.7812749743461609
+  },
+  {
+    "step": 417,
+    "loss": 2.881711959838867,
+    "diagonal_ce": 2.077643632888794,
+    "finite": 0.01998754031956196,
+    "insertion": 0.7840807437896729
+  },
+  {
+    "step": 418,
+    "loss": 2.7717626094818115,
+    "diagonal_ce": 1.988057255744934,
+    "finite": 0.02010595239698887,
+    "insertion": 0.7635993361473083
+  },
+  {
+    "step": 419,
+    "loss": 2.901376724243164,
+    "diagonal_ce": 2.1146719455718994,
+    "finite": 0.01816238835453987,
+    "insertion": 0.7685422897338867
+  },
+  {
+    "step": 420,
+    "loss": 2.9751970767974854,
+    "diagonal_ce": 2.066279888153076,
+    "finite": 0.018055766820907593,
+    "insertion": 0.8908615112304688
+  },
+  {
+    "step": 421,
+    "loss": 2.8557610511779785,
+    "diagonal_ce": 2.0485715866088867,
+    "finite": 0.018883749842643738,
+    "insertion": 0.7883058786392212
+  },
+  {
+    "step": 422,
+    "loss": 2.7818455696105957,
+    "diagonal_ce": 1.959000587463379,
+    "finite": 0.017939522862434387,
+    "insertion": 0.8049055337905884
+  },
+  {
+    "step": 423,
+    "loss": 2.968625783920288,
+    "diagonal_ce": 2.1641428470611572,
+    "finite": 0.016300326213240623,
+    "insertion": 0.7881825566291809
+  },
+  {
+    "step": 424,
+    "loss": 2.993867874145508,
+    "diagonal_ce": 2.2169809341430664,
+    "finite": 0.015168711543083191,
+    "insertion": 0.7617183327674866
+  },
+  {
+    "step": 425,
+    "loss": 3.00931453704834,
+    "diagonal_ce": 2.0351431369781494,
+    "finite": 0.02152263931930065,
+    "insertion": 0.9526488184928894
+  },
+  {
+    "step": 426,
+    "loss": 3.1473653316497803,
+    "diagonal_ce": 2.267681837081909,
+    "finite": 0.016051463782787323,
+    "insertion": 0.8636319637298584
+  },
+  {
+    "step": 427,
+    "loss": 3.065317392349243,
+    "diagonal_ce": 2.083261013031006,
+    "finite": 0.01799062266945839,
+    "insertion": 0.9640658497810364
+  },
+  {
+    "step": 428,
+    "loss": 3.0672366619110107,
+    "diagonal_ce": 2.1143314838409424,
+    "finite": 0.01957162469625473,
+    "insertion": 0.9333335757255554
+  },
+  {
+    "step": 429,
+    "loss": 2.7535035610198975,
+    "diagonal_ce": 2.023620128631592,
+    "finite": 0.020020531490445137,
+    "insertion": 0.7098628878593445
+  },
+  {
+    "step": 430,
+    "loss": 3.080597162246704,
+    "diagonal_ce": 2.080803394317627,
+    "finite": 0.02450297586619854,
+    "insertion": 0.9752907752990723
+  },
+  {
+    "step": 431,
+    "loss": 2.566830635070801,
+    "diagonal_ce": 1.7935709953308105,
+    "finite": 0.02705378644168377,
+    "insertion": 0.7462056875228882
+  },
+  {
+    "step": 432,
+    "loss": 3.1095457077026367,
+    "diagonal_ce": 2.176863193511963,
+    "finite": 0.02040252648293972,
+    "insertion": 0.9122800230979919
+  },
+  {
+    "step": 433,
+    "loss": 2.782949447631836,
+    "diagonal_ce": 1.9246644973754883,
+    "finite": 0.028244631364941597,
+    "insertion": 0.830040454864502
+  },
+  {
+    "step": 434,
+    "loss": 3.045022487640381,
+    "diagonal_ce": 2.199687957763672,
+    "finite": 0.025573041290044785,
+    "insertion": 0.8197615742683411
+  },
+  {
+    "step": 435,
+    "loss": 2.772632122039795,
+    "diagonal_ce": 2.011479139328003,
+    "finite": 0.025172051042318344,
+    "insertion": 0.7359809875488281
+  },
+  {
+    "step": 436,
+    "loss": 3.1168689727783203,
+    "diagonal_ce": 2.182504653930664,
+    "finite": 0.0173366516828537,
+    "insertion": 0.9170277714729309
+  },
+  {
+    "step": 437,
+    "loss": 2.9889309406280518,
+    "diagonal_ce": 2.0980734825134277,
+    "finite": 0.018888819962739944,
+    "insertion": 0.8719688057899475
+  },
+  {
+    "step": 438,
+    "loss": 3.299107074737549,
+    "diagonal_ce": 2.339324474334717,
+    "finite": 0.017862416803836823,
+    "insertion": 0.941920280456543
+  },
+  {
+    "step": 439,
+    "loss": 2.936959743499756,
+    "diagonal_ce": 2.0661275386810303,
+    "finite": 0.022798404097557068,
+    "insertion": 0.8480339050292969
+  },
+  {
+    "step": 440,
+    "loss": 3.0470001697540283,
+    "diagonal_ce": 2.135422706604004,
+    "finite": 0.018209680914878845,
+    "insertion": 0.8933678269386292
+  },
+  {
+    "step": 441,
+    "loss": 2.967804431915283,
+    "diagonal_ce": 2.0461912155151367,
+    "finite": 0.018626006320118904,
+    "insertion": 0.9029871821403503
+  },
+  {
+    "step": 442,
+    "loss": 2.800154209136963,
+    "diagonal_ce": 2.035877227783203,
+    "finite": 0.01794365793466568,
+    "insertion": 0.7463334798812866
+  },
+  {
+    "step": 443,
+    "loss": 2.367269277572632,
+    "diagonal_ce": 1.7551770210266113,
+    "finite": 0.02336287871003151,
+    "insertion": 0.5887293815612793
+  },
+  {
+    "step": 444,
+    "loss": 2.805603504180908,
+    "diagonal_ce": 2.0401341915130615,
+    "finite": 0.017149267718195915,
+    "insertion": 0.7483200430870056
+  },
+  {
+    "step": 445,
+    "loss": 3.0169358253479004,
+    "diagonal_ce": 2.1844680309295654,
+    "finite": 0.01681373454630375,
+    "insertion": 0.8156541585922241
+  },
+  {
+    "step": 446,
+    "loss": 2.958221435546875,
+    "diagonal_ce": 2.1091699600219727,
+    "finite": 0.01712457835674286,
+    "insertion": 0.8319268822669983
+  },
+  {
+    "step": 447,
+    "loss": 2.932070016860962,
+    "diagonal_ce": 2.1037614345550537,
+    "finite": 0.016294363886117935,
+    "insertion": 0.812014102935791
+  },
+  {
+    "step": 448,
+    "loss": 2.802220106124878,
+    "diagonal_ce": 1.9025180339813232,
+    "finite": 0.018472379073500633,
+    "insertion": 0.8812296390533447
+  },
+  {
+    "step": 449,
+    "loss": 2.8376071453094482,
+    "diagonal_ce": 2.0473709106445312,
+    "finite": 0.01571265421807766,
+    "insertion": 0.7745234370231628
+  },
+  {
+    "step": 450,
+    "loss": 2.748107433319092,
+    "diagonal_ce": 1.9404828548431396,
+    "finite": 0.016769392415881157,
+    "insertion": 0.7908551692962646
+  },
+  {
+    "step": 451,
+    "loss": 2.5685341358184814,
+    "diagonal_ce": 1.7233308553695679,
+    "finite": 0.021470027044415474,
+    "insertion": 0.8237331509590149
+  },
+  {
+    "step": 452,
+    "loss": 3.203428030014038,
+    "diagonal_ce": 2.1753664016723633,
+    "finite": 0.014730185270309448,
+    "insertion": 1.013331413269043
+  },
+  {
+    "step": 453,
+    "loss": 2.632711887359619,
+    "diagonal_ce": 1.846809983253479,
+    "finite": 0.01660284958779812,
+    "insertion": 0.7692990303039551
+  },
+  {
+    "step": 454,
+    "loss": 2.6479387283325195,
+    "diagonal_ce": 1.8937557935714722,
+    "finite": 0.016879349946975708,
+    "insertion": 0.7373037338256836
+  },
+  {
+    "step": 455,
+    "loss": 2.892894983291626,
+    "diagonal_ce": 2.0178959369659424,
+    "finite": 0.019451498985290527,
+    "insertion": 0.8555476665496826
+  },
+  {
+    "step": 456,
+    "loss": 2.85225248336792,
+    "diagonal_ce": 1.9527117013931274,
+    "finite": 0.020222749561071396,
+    "insertion": 0.8793180584907532
+  },
+  {
+    "step": 457,
+    "loss": 2.590402603149414,
+    "diagonal_ce": 1.8938723802566528,
+    "finite": 0.022479580715298653,
+    "insertion": 0.6740506291389465
+  },
+  {
+    "step": 458,
+    "loss": 3.0398292541503906,
+    "diagonal_ce": 2.085550546646118,
+    "finite": 0.02056211419403553,
+    "insertion": 0.9337164759635925
+  },
+  {
+    "step": 459,
+    "loss": 2.811460018157959,
+    "diagonal_ce": 1.9398216009140015,
+    "finite": 0.02433251217007637,
+    "insertion": 0.8473058938980103
+  },
+  {
+    "step": 460,
+    "loss": 3.057748556137085,
+    "diagonal_ce": 2.099289894104004,
+    "finite": 0.0193789005279541,
+    "insertion": 0.9390797019004822
+  },
+  {
+    "step": 461,
+    "loss": 2.8812406063079834,
+    "diagonal_ce": 2.0178327560424805,
+    "finite": 0.02573375403881073,
+    "insertion": 0.837674081325531
+  },
+  {
+    "step": 462,
+    "loss": 3.024066686630249,
+    "diagonal_ce": 2.1890506744384766,
+    "finite": 0.01788056269288063,
+    "insertion": 0.8171353340148926
+  },
+  {
+    "step": 463,
+    "loss": 2.2698938846588135,
+    "diagonal_ce": 1.5933481454849243,
+    "finite": 0.02343631349503994,
+    "insertion": 0.6531094908714294
+  },
+  {
+    "step": 464,
+    "loss": 2.8511576652526855,
+    "diagonal_ce": 2.037919044494629,
+    "finite": 0.015677178278565407,
+    "insertion": 0.7975612878799438
+  },
+  {
+    "step": 465,
+    "loss": 2.9781112670898438,
+    "diagonal_ce": 2.08750319480896,
+    "finite": 0.018769925460219383,
+    "insertion": 0.8718380331993103
+  },
+  {
+    "step": 466,
+    "loss": 2.608335494995117,
+    "diagonal_ce": 1.9034225940704346,
+    "finite": 0.015976639464497566,
+    "insertion": 0.688936173915863
+  },
+  {
+    "step": 467,
+    "loss": 2.795578956604004,
+    "diagonal_ce": 1.9661288261413574,
+    "finite": 0.01641610451042652,
+    "insertion": 0.813034176826477
+  },
+  {
+    "step": 468,
+    "loss": 2.869034767150879,
+    "diagonal_ce": 2.0727407932281494,
+    "finite": 0.016263939440250397,
+    "insertion": 0.7800299525260925
+  },
+  {
+    "step": 469,
+    "loss": 2.5910680294036865,
+    "diagonal_ce": 1.904354453086853,
+    "finite": 0.018491072580218315,
+    "insertion": 0.6682225465774536
+  },
+  {
+    "step": 470,
+    "loss": 2.9359841346740723,
+    "diagonal_ce": 2.0166571140289307,
+    "finite": 0.01615777611732483,
+    "insertion": 0.9031692743301392
+  },
+  {
+    "step": 471,
+    "loss": 3.050666332244873,
+    "diagonal_ce": 2.132195472717285,
+    "finite": 0.020706847310066223,
+    "insertion": 0.8977639675140381
+  },
+  {
+    "step": 472,
+    "loss": 2.538935661315918,
+    "diagonal_ce": 1.7552833557128906,
+    "finite": 0.01666124351322651,
+    "insertion": 0.7669909000396729
+  },
+  {
+    "step": 473,
+    "loss": 2.916322708129883,
+    "diagonal_ce": 2.0690319538116455,
+    "finite": 0.018594298511743546,
+    "insertion": 0.8286963701248169
+  },
+  {
+    "step": 474,
+    "loss": 2.9660167694091797,
+    "diagonal_ce": 2.0696516036987305,
+    "finite": 0.019430577754974365,
+    "insertion": 0.8769345283508301
+  },
+  {
+    "step": 475,
+    "loss": 3.082801342010498,
+    "diagonal_ce": 2.113806962966919,
+    "finite": 0.019976137205958366,
+    "insertion": 0.9490181803703308
+  },
+  {
+    "step": 476,
+    "loss": 3.019275188446045,
+    "diagonal_ce": 2.1310548782348633,
+    "finite": 0.017758268862962723,
+    "insertion": 0.8704618811607361
+  },
+  {
+    "step": 477,
+    "loss": 3.149660110473633,
+    "diagonal_ce": 2.2038750648498535,
+    "finite": 0.018600041046738625,
+    "insertion": 0.92718505859375
+  },
+  {
+    "step": 478,
+    "loss": 3.2482242584228516,
+    "diagonal_ce": 2.2478713989257812,
+    "finite": 0.018857300281524658,
+    "insertion": 0.9814956784248352
+  },
+  {
+    "step": 479,
+    "loss": 2.6878128051757812,
+    "diagonal_ce": 1.93100905418396,
+    "finite": 0.022672705352306366,
+    "insertion": 0.7341310381889343
+  },
+  {
+    "step": 480,
+    "loss": 3.237156391143799,
+    "diagonal_ce": 2.265916109085083,
+    "finite": 0.019153520464897156,
+    "insertion": 0.9520868062973022
+  },
+  {
+    "step": 481,
+    "loss": 2.5167858600616455,
+    "diagonal_ce": 1.8008264303207397,
+    "finite": 0.02094145119190216,
+    "insertion": 0.6950179934501648
+  },
+  {
+    "step": 482,
+    "loss": 2.8208765983581543,
+    "diagonal_ce": 2.0132641792297363,
+    "finite": 0.017189795151352882,
+    "insertion": 0.7904227375984192
+  },
+  {
+    "step": 483,
+    "loss": 2.933607816696167,
+    "diagonal_ce": 1.9853168725967407,
+    "finite": 0.019443228840827942,
+    "insertion": 0.9288477301597595
+  },
+  {
+    "step": 484,
+    "loss": 2.9651737213134766,
+    "diagonal_ce": 1.996638536453247,
+    "finite": 0.02414596453309059,
+    "insertion": 0.9443891644477844
+  },
+  {
+    "step": 485,
+    "loss": 2.7474524974823,
+    "diagonal_ce": 1.9837418794631958,
+    "finite": 0.01808423176407814,
+    "insertion": 0.7456265091896057
+  },
+  {
+    "step": 486,
+    "loss": 2.7802741527557373,
+    "diagonal_ce": 1.9941908121109009,
+    "finite": 0.017931165173649788,
+    "insertion": 0.7681522369384766
+  },
+  {
+    "step": 487,
+    "loss": 3.0000979900360107,
+    "diagonal_ce": 2.073749542236328,
+    "finite": 0.025616565719246864,
+    "insertion": 0.9007318615913391
+  },
+  {
+    "step": 488,
+    "loss": 2.9079670906066895,
+    "diagonal_ce": 1.9388116598129272,
+    "finite": 0.0244863573461771,
+    "insertion": 0.9446691870689392
+  },
+  {
+    "step": 489,
+    "loss": 2.9314842224121094,
+    "diagonal_ce": 2.020961284637451,
+    "finite": 0.022381694987416267,
+    "insertion": 0.8881410956382751
+  },
+  {
+    "step": 490,
+    "loss": 2.9867846965789795,
+    "diagonal_ce": 2.0510268211364746,
+    "finite": 0.020908866077661514,
+    "insertion": 0.9148491024971008
+  },
+  {
+    "step": 491,
+    "loss": 3.076322555541992,
+    "diagonal_ce": 2.1384100914001465,
+    "finite": 0.02807709202170372,
+    "insertion": 0.9098352193832397
+  },
+  {
+    "step": 492,
+    "loss": 2.810642719268799,
+    "diagonal_ce": 1.954545259475708,
+    "finite": 0.018646663054823875,
+    "insertion": 0.8374506831169128
+  },
+  {
+    "step": 493,
+    "loss": 2.9445648193359375,
+    "diagonal_ce": 2.0689139366149902,
+    "finite": 0.01915447600185871,
+    "insertion": 0.856496274471283
+  },
+  {
+    "step": 494,
+    "loss": 3.0689759254455566,
+    "diagonal_ce": 2.1906065940856934,
+    "finite": 0.019052375108003616,
+    "insertion": 0.8593170642852783
+  },
+  {
+    "step": 495,
+    "loss": 2.98980450630188,
+    "diagonal_ce": 2.174699544906616,
+    "finite": 0.020056646317243576,
+    "insertion": 0.7950482964515686
+  },
+  {
+    "step": 496,
+    "loss": 2.6237995624542236,
+    "diagonal_ce": 1.908290147781372,
+    "finite": 0.02346094138920307,
+    "insertion": 0.6920484900474548
+  },
+  {
+    "step": 497,
+    "loss": 2.649747610092163,
+    "diagonal_ce": 1.8583943843841553,
+    "finite": 0.0208524689078331,
+    "insertion": 0.7705008387565613
+  },
+  {
+    "step": 498,
+    "loss": 2.567347288131714,
+    "diagonal_ce": 1.757096767425537,
+    "finite": 0.018748288974165916,
+    "insertion": 0.7915022969245911
+  },
+  {
+    "step": 499,
+    "loss": 3.15920352935791,
+    "diagonal_ce": 2.1591577529907227,
+    "finite": 0.0172080360352993,
+    "insertion": 0.9828377962112427
+  },
+  {
+    "step": 500,
+    "loss": 2.927797794342041,
+    "diagonal_ce": 2.048417806625366,
+    "finite": 0.019888827577233315,
+    "insertion": 0.8594911098480225
+  },
+  {
+    "step": 501,
+    "loss": 2.6630349159240723,
+    "diagonal_ce": 1.8960546255111694,
+    "finite": 0.019266508519649506,
+    "insertion": 0.7477139234542847
+  },
+  {
+    "step": 502,
+    "loss": 3.079862594604492,
+    "diagonal_ce": 2.1041371822357178,
+    "finite": 0.018881086260080338,
+    "insertion": 0.9568443894386292
+  },
+  {
+    "step": 503,
+    "loss": 3.1401236057281494,
+    "diagonal_ce": 2.1964850425720215,
+    "finite": 0.02026916854083538,
+    "insertion": 0.9233693480491638
+  },
+  {
+    "step": 504,
+    "loss": 2.81375789642334,
+    "diagonal_ce": 1.9016163349151611,
+    "finite": 0.017726140096783638,
+    "insertion": 0.8944154977798462
+  },
+  {
+    "step": 505,
+    "loss": 2.879884719848633,
+    "diagonal_ce": 2.1041369438171387,
+    "finite": 0.01698295958340168,
+    "insertion": 0.7587647438049316
+  },
+  {
+    "step": 506,
+    "loss": 2.3226935863494873,
+    "diagonal_ce": 1.692588448524475,
+    "finite": 0.01710924692451954,
+    "insertion": 0.6129959225654602
+  },
+  {
+    "step": 507,
+    "loss": 2.8366968631744385,
+    "diagonal_ce": 2.026982545852661,
+    "finite": 0.013688984327018261,
+    "insertion": 0.7960252165794373
+  },
+  {
+    "step": 508,
+    "loss": 2.799053192138672,
+    "diagonal_ce": 2.0642664432525635,
+    "finite": 0.015688013285398483,
+    "insertion": 0.7190988063812256
+  },
+  {
+    "step": 509,
+    "loss": 2.8121795654296875,
+    "diagonal_ce": 2.010772943496704,
+    "finite": 0.016470834612846375,
+    "insertion": 0.7849358320236206
+  },
+  {
+    "step": 510,
+    "loss": 2.5728142261505127,
+    "diagonal_ce": 1.849826693534851,
+    "finite": 0.01430455781519413,
+    "insertion": 0.7086830735206604
+  },
+  {
+    "step": 511,
+    "loss": 2.7568912506103516,
+    "diagonal_ce": 1.9525307416915894,
+    "finite": 0.01589113101363182,
+    "insertion": 0.7884694337844849
+  },
+  {
+    "step": 512,
+    "loss": 3.197600841522217,
+    "diagonal_ce": 2.2442824840545654,
+    "finite": 0.01432973425835371,
+    "insertion": 0.9389886260032654
+  },
+  {
+    "step": 513,
+    "loss": 2.6052491664886475,
+    "diagonal_ce": 1.7844511270523071,
+    "finite": 0.020736824721097946,
+    "insertion": 0.8000612258911133
+  },
+  {
+    "step": 514,
+    "loss": 3.0703065395355225,
+    "diagonal_ce": 2.1660304069519043,
+    "finite": 0.017989981919527054,
+    "insertion": 0.886286199092865
+  },
+  {
+    "step": 515,
+    "loss": 2.987609624862671,
+    "diagonal_ce": 2.189303159713745,
+    "finite": 0.021489489823579788,
+    "insertion": 0.7768170237541199
+  },
+  {
+    "step": 516,
+    "loss": 2.748352289199829,
+    "diagonal_ce": 1.9056514501571655,
+    "finite": 0.020598823204636574,
+    "insertion": 0.8221021294593811
+  },
+  {
+    "step": 517,
+    "loss": 2.8061349391937256,
+    "diagonal_ce": 2.0793254375457764,
+    "finite": 0.017981598153710365,
+    "insertion": 0.7088280320167542
+  },
+  {
+    "step": 518,
+    "loss": 2.677368640899658,
+    "diagonal_ce": 1.9002869129180908,
+    "finite": 0.017356112599372864,
+    "insertion": 0.7597255706787109
+  },
+  {
+    "step": 519,
+    "loss": 2.809998035430908,
+    "diagonal_ce": 2.0061020851135254,
+    "finite": 0.018034713342785835,
+    "insertion": 0.7858612537384033
+  },
+  {
+    "step": 520,
+    "loss": 2.7883739471435547,
+    "diagonal_ce": 2.046630620956421,
+    "finite": 0.017951495945453644,
+    "insertion": 0.7237918972969055
+  },
+  {
+    "step": 521,
+    "loss": 3.1206917762756348,
+    "diagonal_ce": 2.2266621589660645,
+    "finite": 0.01830662600696087,
+    "insertion": 0.8757228851318359
+  },
+  {
+    "step": 522,
+    "loss": 3.0144145488739014,
+    "diagonal_ce": 2.089015245437622,
+    "finite": 0.018752846866846085,
+    "insertion": 0.9066464900970459
+  },
+  {
+    "step": 523,
+    "loss": 2.944150686264038,
+    "diagonal_ce": 2.160026788711548,
+    "finite": 0.01853957027196884,
+    "insertion": 0.7655842900276184
+  },
+  {
+    "step": 524,
+    "loss": 2.287351131439209,
+    "diagonal_ce": 1.666991114616394,
+    "finite": 0.020554307848215103,
+    "insertion": 0.5998057723045349
+  },
+  {
+    "step": 525,
+    "loss": 3.135084390640259,
+    "diagonal_ce": 2.1754698753356934,
+    "finite": 0.02594822272658348,
+    "insertion": 0.9336662292480469
+  },
+  {
+    "step": 526,
+    "loss": 2.478492259979248,
+    "diagonal_ce": 1.708902359008789,
+    "finite": 0.02036617510020733,
+    "insertion": 0.7492236495018005
+  },
+  {
+    "step": 527,
+    "loss": 3.0100231170654297,
+    "diagonal_ce": 2.0976593494415283,
+    "finite": 0.017542902380228043,
+    "insertion": 0.8948208689689636
+  },
+  {
+    "step": 528,
+    "loss": 2.4539694786071777,
+    "diagonal_ce": 1.7367957830429077,
+    "finite": 0.02208300679922104,
+    "insertion": 0.6950905323028564
+  },
+  {
+    "step": 529,
+    "loss": 2.6457204818725586,
+    "diagonal_ce": 1.8846943378448486,
+    "finite": 0.019266752526164055,
+    "insertion": 0.7417593002319336
+  },
+  {
+    "step": 530,
+    "loss": 3.215524911880493,
+    "diagonal_ce": 2.3030478954315186,
+    "finite": 0.01691661775112152,
+    "insertion": 0.8955604434013367
+  },
+  {
+    "step": 531,
+    "loss": 2.848116874694824,
+    "diagonal_ce": 1.951750636100769,
+    "finite": 0.022231310606002808,
+    "insertion": 0.8741348385810852
+  },
+  {
+    "step": 532,
+    "loss": 2.758025646209717,
+    "diagonal_ce": 1.9961683750152588,
+    "finite": 0.021294981241226196,
+    "insertion": 0.7405620813369751
+  },
+  {
+    "step": 533,
+    "loss": 2.4923863410949707,
+    "diagonal_ce": 1.8109415769577026,
+    "finite": 0.017907297238707542,
+    "insertion": 0.6635375618934631
+  },
+  {
+    "step": 534,
+    "loss": 2.682269334793091,
+    "diagonal_ce": 1.8601325750350952,
+    "finite": 0.018248552456498146,
+    "insertion": 0.803888201713562
+  },
+  {
+    "step": 535,
+    "loss": 3.027050733566284,
+    "diagonal_ce": 2.1002349853515625,
+    "finite": 0.017947634682059288,
+    "insertion": 0.908868134021759
+  },
+  {
+    "step": 536,
+    "loss": 2.5694427490234375,
+    "diagonal_ce": 1.8172545433044434,
+    "finite": 0.023432377725839615,
+    "insertion": 0.7287558317184448
+  },
+  {
+    "step": 537,
+    "loss": 2.697699546813965,
+    "diagonal_ce": 1.814329981803894,
+    "finite": 0.020338324829936028,
+    "insertion": 0.863031268119812
+  },
+  {
+    "step": 538,
+    "loss": 2.670426368713379,
+    "diagonal_ce": 1.7996834516525269,
+    "finite": 0.020800184458494186,
+    "insertion": 0.849942684173584
+  },
+  {
+    "step": 539,
+    "loss": 2.5619587898254395,
+    "diagonal_ce": 1.7535085678100586,
+    "finite": 0.021662933751940727,
+    "insertion": 0.786787211894989
+  },
+  {
+    "step": 540,
+    "loss": 3.226451873779297,
+    "diagonal_ce": 2.248779296875,
+    "finite": 0.022024767473340034,
+    "insertion": 0.9556476473808289
+  },
+  {
+    "step": 541,
+    "loss": 2.8585610389709473,
+    "diagonal_ce": 2.0270156860351562,
+    "finite": 0.020541571080684662,
+    "insertion": 0.8110036849975586
+  },
+  {
+    "step": 542,
+    "loss": 2.4168851375579834,
+    "diagonal_ce": 1.7746915817260742,
+    "finite": 0.017294790595769882,
+    "insertion": 0.6248987913131714
+  },
+  {
+    "step": 543,
+    "loss": 3.238790988922119,
+    "diagonal_ce": 2.387457847595215,
+    "finite": 0.012387269176542759,
+    "insertion": 0.8389458656311035
+  },
+  {
+    "step": 544,
+    "loss": 3.0200672149658203,
+    "diagonal_ce": 2.1092488765716553,
+    "finite": 0.01795440912246704,
+    "insertion": 0.8928638696670532
+  },
+  {
+    "step": 545,
+    "loss": 2.9997072219848633,
+    "diagonal_ce": 2.0270464420318604,
+    "finite": 0.014933418482542038,
+    "insertion": 0.9577275514602661
+  },
+  {
+    "step": 546,
+    "loss": 2.903130531311035,
+    "diagonal_ce": 2.1303417682647705,
+    "finite": 0.01673031784594059,
+    "insertion": 0.756058394908905
+  },
+  {
+    "step": 547,
+    "loss": 3.132702350616455,
+    "diagonal_ce": 2.19240665435791,
+    "finite": 0.015661876648664474,
+    "insertion": 0.9246338605880737
+  },
+  {
+    "step": 548,
+    "loss": 3.09572172164917,
+    "diagonal_ce": 2.1452572345733643,
+    "finite": 0.018196100369095802,
+    "insertion": 0.9322682619094849
+  },
+  {
+    "step": 549,
+    "loss": 3.0153205394744873,
+    "diagonal_ce": 2.097311019897461,
+    "finite": 0.014918400906026363,
+    "insertion": 0.9030912518501282
+  },
+  {
+    "step": 550,
+    "loss": 2.67885684967041,
+    "diagonal_ce": 1.8880527019500732,
+    "finite": 0.020827148109674454,
+    "insertion": 0.7699768543243408
+  },
+  {
+    "step": 551,
+    "loss": 2.779344320297241,
+    "diagonal_ce": 2.0084574222564697,
+    "finite": 0.01897609978914261,
+    "insertion": 0.7519106864929199
+  },
+  {
+    "step": 552,
+    "loss": 2.9186692237854004,
+    "diagonal_ce": 2.089191198348999,
+    "finite": 0.01850229687988758,
+    "insertion": 0.8109757304191589
+  },
+  {
+    "step": 553,
+    "loss": 2.71431040763855,
+    "diagonal_ce": 1.8709230422973633,
+    "finite": 0.019478753209114075,
+    "insertion": 0.8239086270332336
+  },
+  {
+    "step": 554,
+    "loss": 2.7823853492736816,
+    "diagonal_ce": 1.9917937517166138,
+    "finite": 0.021119901910424232,
+    "insertion": 0.7694716453552246
+  },
+  {
+    "step": 555,
+    "loss": 2.6905572414398193,
+    "diagonal_ce": 1.931403398513794,
+    "finite": 0.019128747284412384,
+    "insertion": 0.7400251030921936
+  },
+  {
+    "step": 556,
+    "loss": 2.6121668815612793,
+    "diagonal_ce": 1.8459649085998535,
+    "finite": 0.026416296139359474,
+    "insertion": 0.7397857308387756
+  },
+  {
+    "step": 557,
+    "loss": 2.6246981620788574,
+    "diagonal_ce": 1.8607537746429443,
+    "finite": 0.020395437255501747,
+    "insertion": 0.743549108505249
+  },
+  {
+    "step": 558,
+    "loss": 2.6755290031433105,
+    "diagonal_ce": 1.8946588039398193,
+    "finite": 0.018459178507328033,
+    "insertion": 0.7624111175537109
+  },
+  {
+    "step": 559,
+    "loss": 2.997093915939331,
+    "diagonal_ce": 2.172189950942993,
+    "finite": 0.022057775408029556,
+    "insertion": 0.8028461337089539
+  },
+  {
+    "step": 560,
+    "loss": 2.949119806289673,
+    "diagonal_ce": 2.042832136154175,
+    "finite": 0.015273023396730423,
+    "insertion": 0.8910146355628967
+  },
+  {
+    "step": 561,
+    "loss": 2.679084539413452,
+    "diagonal_ce": 1.8659223318099976,
+    "finite": 0.01790347881615162,
+    "insertion": 0.7952588200569153
+  },
+  {
+    "step": 562,
+    "loss": 2.9511559009552,
+    "diagonal_ce": 2.078915596008301,
+    "finite": 0.018031498417258263,
+    "insertion": 0.854208767414093
+  },
+  {
+    "step": 563,
+    "loss": 2.80532169342041,
+    "diagonal_ce": 1.9187003374099731,
+    "finite": 0.019527088850736618,
+    "insertion": 0.8670942187309265
+  },
+  {
+    "step": 564,
+    "loss": 3.1057305335998535,
+    "diagonal_ce": 2.207446336746216,
+    "finite": 0.01598687842488289,
+    "insertion": 0.882297158241272
+  },
+  {
+    "step": 565,
+    "loss": 2.8530831336975098,
+    "diagonal_ce": 2.0043435096740723,
+    "finite": 0.019918927922844887,
+    "insertion": 0.8288207650184631
+  },
+  {
+    "step": 566,
+    "loss": 3.1792774200439453,
+    "diagonal_ce": 2.165109872817993,
+    "finite": 0.02172035351395607,
+    "insertion": 0.9924471378326416
+  },
+  {
+    "step": 567,
+    "loss": 2.6524806022644043,
+    "diagonal_ce": 1.9527487754821777,
+    "finite": 0.013451023027300835,
+    "insertion": 0.6862809658050537
+  },
+  {
+    "step": 568,
+    "loss": 2.789198875427246,
+    "diagonal_ce": 2.0562000274658203,
+    "finite": 0.01608346775174141,
+    "insertion": 0.7169153094291687
+  },
+  {
+    "step": 569,
+    "loss": 2.7796454429626465,
+    "diagonal_ce": 1.9453412294387817,
+    "finite": 0.014944626949727535,
+    "insertion": 0.8193596601486206
+  },
+  {
+    "step": 570,
+    "loss": 3.2825894355773926,
+    "diagonal_ce": 2.2020537853240967,
+    "finite": 0.020931903272867203,
+    "insertion": 1.0596038103103638
+  },
+  {
+    "step": 571,
+    "loss": 2.9512135982513428,
+    "diagonal_ce": 2.1330726146698,
+    "finite": 0.016482627019286156,
+    "insertion": 0.8016583323478699
+  },
+  {
+    "step": 572,
+    "loss": 2.6818408966064453,
+    "diagonal_ce": 1.9779824018478394,
+    "finite": 0.018063984811306,
+    "insertion": 0.6857945919036865
+  },
+  {
+    "step": 573,
+    "loss": 2.632880210876465,
+    "diagonal_ce": 1.8356372117996216,
+    "finite": 0.015636669471859932,
+    "insertion": 0.7816064357757568
+  },
+  {
+    "step": 574,
+    "loss": 2.8103315830230713,
+    "diagonal_ce": 1.959043264389038,
+    "finite": 0.017458589747548103,
+    "insertion": 0.8338297009468079
+  },
+  {
+    "step": 575,
+    "loss": 2.864271640777588,
+    "diagonal_ce": 2.021017074584961,
+    "finite": 0.012667297385632992,
+    "insertion": 0.8305874466896057
+  },
+  {
+    "step": 576,
+    "loss": 2.7460126876831055,
+    "diagonal_ce": 1.8754663467407227,
+    "finite": 0.019286729395389557,
+    "insertion": 0.8512596487998962
+  },
+  {
+    "step": 577,
+    "loss": 2.7691471576690674,
+    "diagonal_ce": 1.9678267240524292,
+    "finite": 0.015186264179646969,
+    "insertion": 0.7861341238021851
+  },
+  {
+    "step": 578,
+    "loss": 2.6964566707611084,
+    "diagonal_ce": 1.8655704259872437,
+    "finite": 0.02053261175751686,
+    "insertion": 0.8103536367416382
+  },
+  {
+    "step": 579,
+    "loss": 2.70163893699646,
+    "diagonal_ce": 1.9392622709274292,
+    "finite": 0.01888437382876873,
+    "insertion": 0.7434923052787781
+  },
+  {
+    "step": 580,
+    "loss": 2.8450136184692383,
+    "diagonal_ce": 1.9863301515579224,
+    "finite": 0.015582474879920483,
+    "insertion": 0.8431011438369751
+  },
+  {
+    "step": 581,
+    "loss": 2.8959736824035645,
+    "diagonal_ce": 2.0385360717773438,
+    "finite": 0.014104416593909264,
+    "insertion": 0.84333336353302
+  },
+  {
+    "step": 582,
+    "loss": 2.7577075958251953,
+    "diagonal_ce": 1.9706213474273682,
+    "finite": 0.01964893564581871,
+    "insertion": 0.7674374580383301
+  },
+  {
+    "step": 583,
+    "loss": 2.835024833679199,
+    "diagonal_ce": 1.963073492050171,
+    "finite": 0.018574900925159454,
+    "insertion": 0.8533763885498047
+  },
+  {
+    "step": 584,
+    "loss": 2.7335095405578613,
+    "diagonal_ce": 1.9283169507980347,
+    "finite": 0.017778249457478523,
+    "insertion": 0.7874142527580261
+  },
+  {
+    "step": 585,
+    "loss": 2.82317852973938,
+    "diagonal_ce": 2.0057079792022705,
+    "finite": 0.017403636127710342,
+    "insertion": 0.8000668883323669
+  },
+  {
+    "step": 586,
+    "loss": 2.917358160018921,
+    "diagonal_ce": 2.101149082183838,
+    "finite": 0.014253453351557255,
+    "insertion": 0.8019556999206543
+  },
+  {
+    "step": 587,
+    "loss": 2.980933427810669,
+    "diagonal_ce": 2.1256370544433594,
+    "finite": 0.019090615212917328,
+    "insertion": 0.8362057209014893
+  },
+  {
+    "step": 588,
+    "loss": 2.656588077545166,
+    "diagonal_ce": 1.9025757312774658,
+    "finite": 0.01478381548076868,
+    "insertion": 0.7392286062240601
+  },
+  {
+    "step": 589,
+    "loss": 2.875587224960327,
+    "diagonal_ce": 2.0002286434173584,
+    "finite": 0.014344538561999798,
+    "insertion": 0.8610140681266785
+  },
+  {
+    "step": 590,
+    "loss": 2.707176685333252,
+    "diagonal_ce": 1.9429068565368652,
+    "finite": 0.013755030930042267,
+    "insertion": 0.7505147457122803
+  },
+  {
+    "step": 591,
+    "loss": 2.7581048011779785,
+    "diagonal_ce": 1.9154677391052246,
+    "finite": 0.01281811948865652,
+    "insertion": 0.8298190832138062
+  },
+  {
+    "step": 592,
+    "loss": 2.697828769683838,
+    "diagonal_ce": 1.9376882314682007,
+    "finite": 0.01183364912867546,
+    "insertion": 0.7483069896697998
+  },
+  {
+    "step": 593,
+    "loss": 2.951798439025879,
+    "diagonal_ce": 2.09128737449646,
+    "finite": 0.012932884506881237,
+    "insertion": 0.8475782871246338
+  },
+  {
+    "step": 594,
+    "loss": 2.7636590003967285,
+    "diagonal_ce": 1.9342328310012817,
+    "finite": 0.011862652376294136,
+    "insertion": 0.8175634741783142
+  },
+  {
+    "step": 595,
+    "loss": 2.68198561668396,
+    "diagonal_ce": 1.9367257356643677,
+    "finite": 0.012319824658334255,
+    "insertion": 0.7329400181770325
+  },
+  {
+    "step": 596,
+    "loss": 3.043591022491455,
+    "diagonal_ce": 2.1340174674987793,
+    "finite": 0.014635352417826653,
+    "insertion": 0.8949382901191711
+  },
+  {
+    "step": 597,
+    "loss": 3.126638889312744,
+    "diagonal_ce": 2.189046621322632,
+    "finite": 0.01318928599357605,
+    "insertion": 0.9244030714035034
+  },
+  {
+    "step": 598,
+    "loss": 2.757282257080078,
+    "diagonal_ce": 1.9484074115753174,
+    "finite": 0.01285004522651434,
+    "insertion": 0.7960246801376343
+  },
+  {
+    "step": 599,
+    "loss": 3.1730594635009766,
+    "diagonal_ce": 2.2466959953308105,
+    "finite": 0.010216381400823593,
+    "insertion": 0.9161468744277954
+  },
+  {
+    "step": 600,
+    "loss": 3.066211700439453,
+    "diagonal_ce": 2.1643269062042236,
+    "finite": 0.012446217238903046,
+    "insertion": 0.8894385099411011
+  },
+  {
+    "step": 601,
+    "loss": 2.684128761291504,
+    "diagonal_ce": 1.8905179500579834,
+    "finite": 0.012462153099477291,
+    "insertion": 0.7811486721038818
+  },
+  {
+    "step": 602,
+    "loss": 2.589155673980713,
+    "diagonal_ce": 1.8180729150772095,
+    "finite": 0.011916602030396461,
+    "insertion": 0.7591661810874939
+  },
+  {
+    "step": 603,
+    "loss": 2.790565013885498,
+    "diagonal_ce": 1.8929487466812134,
+    "finite": 0.013816761784255505,
+    "insertion": 0.8837994933128357
+  },
+  {
+    "step": 604,
+    "loss": 2.800767660140991,
+    "diagonal_ce": 1.8965893983840942,
+    "finite": 0.013833893463015556,
+    "insertion": 0.8903443217277527
+  },
+  {
+    "step": 605,
+    "loss": 3.1693930625915527,
+    "diagonal_ce": 2.1702020168304443,
+    "finite": 0.011597411707043648,
+    "insertion": 0.9875935316085815
+  },
+  {
+    "step": 606,
+    "loss": 3.022670030593872,
+    "diagonal_ce": 2.1724703311920166,
+    "finite": 0.013947456143796444,
+    "insertion": 0.8362522721290588
+  },
+  {
+    "step": 607,
+    "loss": 2.9027316570281982,
+    "diagonal_ce": 1.9941692352294922,
+    "finite": 0.015638085082173347,
+    "insertion": 0.8929242491722107
+  },
+  {
+    "step": 608,
+    "loss": 3.1300106048583984,
+    "diagonal_ce": 2.1774866580963135,
+    "finite": 0.012388847768306732,
+    "insertion": 0.94013512134552
+  },
+  {
+    "step": 609,
+    "loss": 2.6835691928863525,
+    "diagonal_ce": 1.9734219312667847,
+    "finite": 0.015312103554606438,
+    "insertion": 0.6948351860046387
+  },
+  {
+    "step": 610,
+    "loss": 3.002607822418213,
+    "diagonal_ce": 2.1386682987213135,
+    "finite": 0.015396799892187119,
+    "insertion": 0.8485425710678101
+  },
+  {
+    "step": 611,
+    "loss": 2.84635066986084,
+    "diagonal_ce": 1.945068359375,
+    "finite": 0.011426934041082859,
+    "insertion": 0.8898553848266602
+  },
+  {
+    "step": 612,
+    "loss": 2.741074323654175,
+    "diagonal_ce": 1.89711332321167,
+    "finite": 0.01776154339313507,
+    "insertion": 0.8261994123458862
+  },
+  {
+    "step": 613,
+    "loss": 3.025254011154175,
+    "diagonal_ce": 2.0334181785583496,
+    "finite": 0.017060227692127228,
+    "insertion": 0.9747756123542786
+  },
+  {
+    "step": 614,
+    "loss": 2.8107705116271973,
+    "diagonal_ce": 1.9158087968826294,
+    "finite": 0.01116265170276165,
+    "insertion": 0.883799135684967
+  },
+  {
+    "step": 615,
+    "loss": 2.8338630199432373,
+    "diagonal_ce": 2.08685040473938,
+    "finite": 0.014387044124305248,
+    "insertion": 0.732625424861908
+  },
+  {
+    "step": 616,
+    "loss": 2.9466261863708496,
+    "diagonal_ce": 2.1024086475372314,
+    "finite": 0.014146072790026665,
+    "insertion": 0.8300714492797852
+  },
+  {
+    "step": 617,
+    "loss": 2.9831552505493164,
+    "diagonal_ce": 2.105365037918091,
+    "finite": 0.015184753574430943,
+    "insertion": 0.8626055121421814
+  },
+  {
+    "step": 618,
+    "loss": 2.3951380252838135,
+    "diagonal_ce": 1.7460201978683472,
+    "finite": 0.014444434083998203,
+    "insertion": 0.6346733570098877
+  },
+  {
+    "step": 619,
+    "loss": 2.901376247406006,
+    "diagonal_ce": 2.0738227367401123,
+    "finite": 0.013225593604147434,
+    "insertion": 0.8143278956413269
+  },
+  {
+    "step": 620,
+    "loss": 2.816154718399048,
+    "diagonal_ce": 1.9839335680007935,
+    "finite": 0.013690070249140263,
+    "insertion": 0.8185310959815979
+  },
+  {
+    "step": 621,
+    "loss": 2.5874836444854736,
+    "diagonal_ce": 1.784459114074707,
+    "finite": 0.016071682795882225,
+    "insertion": 0.7869529128074646
+  },
+  {
+    "step": 622,
+    "loss": 2.7730040550231934,
+    "diagonal_ce": 1.9716240167617798,
+    "finite": 0.016150251030921936,
+    "insertion": 0.7852298617362976
+  },
+  {
+    "step": 623,
+    "loss": 2.404588222503662,
+    "diagonal_ce": 1.6790897846221924,
+    "finite": 0.014709447510540485,
+    "insertion": 0.710788905620575
+  },
+  {
+    "step": 624,
+    "loss": 2.959622383117676,
+    "diagonal_ce": 2.027177095413208,
+    "finite": 0.017192911356687546,
+    "insertion": 0.9152525663375854
+  },
+  {
+    "step": 625,
+    "loss": 3.1914453506469727,
+    "diagonal_ce": 2.1854236125946045,
+    "finite": 0.015622220002114773,
+    "insertion": 0.9903994798660278
+  },
+  {
+    "step": 626,
+    "loss": 3.041161298751831,
+    "diagonal_ce": 2.1001107692718506,
+    "finite": 0.013895503245294094,
+    "insertion": 0.9271549582481384
+  },
+  {
+    "step": 627,
+    "loss": 2.8680224418640137,
+    "diagonal_ce": 1.9809566736221313,
+    "finite": 0.01384682022035122,
+    "insertion": 0.8732188940048218
+  },
+  {
+    "step": 628,
+    "loss": 3.1178481578826904,
+    "diagonal_ce": 2.0978848934173584,
+    "finite": 0.015814049169421196,
+    "insertion": 1.0041491985321045
+  },
+  {
+    "step": 629,
+    "loss": 3.1040520668029785,
+    "diagonal_ce": 2.0829389095306396,
+    "finite": 0.013352758251130581,
+    "insertion": 1.0077604055404663
+  },
+  {
+    "step": 630,
+    "loss": 2.4212965965270996,
+    "diagonal_ce": 1.717965841293335,
+    "finite": 0.015258504077792168,
+    "insertion": 0.6880720853805542
+  },
+  {
+    "step": 631,
+    "loss": 2.7902541160583496,
+    "diagonal_ce": 1.9733060598373413,
+    "finite": 0.011456291191279888,
+    "insertion": 0.8054917454719543
+  },
+  {
+    "step": 632,
+    "loss": 2.576303005218506,
+    "diagonal_ce": 1.7483673095703125,
+    "finite": 0.015897631645202637,
+    "insertion": 0.8120381832122803
+  },
+  {
+    "step": 633,
+    "loss": 2.775257110595703,
+    "diagonal_ce": 1.9118627309799194,
+    "finite": 0.013101763091981411,
+    "insertion": 0.8502926826477051
+  },
+  {
+    "step": 634,
+    "loss": 2.7707772254943848,
+    "diagonal_ce": 1.9322081804275513,
+    "finite": 0.01506598200649023,
+    "insertion": 0.8235029578208923
+  },
+  {
+    "step": 635,
+    "loss": 2.7965450286865234,
+    "diagonal_ce": 1.9739872217178345,
+    "finite": 0.011449886485934258,
+    "insertion": 0.8111078143119812
+  },
+  {
+    "step": 636,
+    "loss": 2.582225799560547,
+    "diagonal_ce": 1.8994152545928955,
+    "finite": 0.01311702374368906,
+    "insertion": 0.6696935892105103
+  },
+  {
+    "step": 637,
+    "loss": 2.8517844676971436,
+    "diagonal_ce": 2.0576720237731934,
+    "finite": 0.012888322584331036,
+    "insertion": 0.7812240719795227
+  },
+  {
+    "step": 638,
+    "loss": 3.1570076942443848,
+    "diagonal_ce": 2.324129104614258,
+    "finite": 0.013224472291767597,
+    "insertion": 0.8196542263031006
+  },
+  {
+    "step": 639,
+    "loss": 2.6048851013183594,
+    "diagonal_ce": 1.7587577104568481,
+    "finite": 0.013208632357418537,
+    "insertion": 0.8329187035560608
+  },
+  {
+    "step": 640,
+    "loss": 2.936950922012329,
+    "diagonal_ce": 2.026520252227783,
+    "finite": 0.014431828632950783,
+    "insertion": 0.895999014377594
+  },
+  {
+    "step": 641,
+    "loss": 2.893010377883911,
+    "diagonal_ce": 2.01743221282959,
+    "finite": 0.01581767201423645,
+    "insertion": 0.859760582447052
+  },
+  {
+    "step": 642,
+    "loss": 3.076835870742798,
+    "diagonal_ce": 2.160639524459839,
+    "finite": 0.014639009721577168,
+    "insertion": 0.901557445526123
+  },
+  {
+    "step": 643,
+    "loss": 3.0036754608154297,
+    "diagonal_ce": 2.0686376094818115,
+    "finite": 0.013297796249389648,
+    "insertion": 0.9217401742935181
+  },
+  {
+    "step": 644,
+    "loss": 2.994502305984497,
+    "diagonal_ce": 2.1286544799804688,
+    "finite": 0.015018326230347157,
+    "insertion": 0.8508296608924866
+  },
+  {
+    "step": 645,
+    "loss": 2.666836738586426,
+    "diagonal_ce": 1.9023302793502808,
+    "finite": 0.01257532462477684,
+    "insertion": 0.7519312500953674
+  },
+  {
+    "step": 646,
+    "loss": 3.071053981781006,
+    "diagonal_ce": 2.2558364868164062,
+    "finite": 0.017851348966360092,
+    "insertion": 0.7973660230636597
+  },
+  {
+    "step": 647,
+    "loss": 2.893662929534912,
+    "diagonal_ce": 2.069777011871338,
+    "finite": 0.013405540958046913,
+    "insertion": 0.8104804158210754
+  },
+  {
+    "step": 648,
+    "loss": 3.054936408996582,
+    "diagonal_ce": 2.1554489135742188,
+    "finite": 0.01258899737149477,
+    "insertion": 0.8868985772132874
+  },
+  {
+    "step": 649,
+    "loss": 2.8722758293151855,
+    "diagonal_ce": 2.07029128074646,
+    "finite": 0.013967467471957207,
+    "insertion": 0.7880169749259949
+  },
+  {
+    "step": 650,
+    "loss": 2.7405762672424316,
+    "diagonal_ce": 1.9263774156570435,
+    "finite": 0.012164843268692493,
+    "insertion": 0.8020340800285339
+  },
+  {
+    "step": 651,
+    "loss": 2.8636507987976074,
+    "diagonal_ce": 1.9873652458190918,
+    "finite": 0.012377689592540264,
+    "insertion": 0.8639077544212341
+  },
+  {
+    "step": 652,
+    "loss": 2.7265634536743164,
+    "diagonal_ce": 1.9667623043060303,
+    "finite": 0.011311856098473072,
+    "insertion": 0.7484893798828125
+  },
+  {
+    "step": 653,
+    "loss": 2.675981044769287,
+    "diagonal_ce": 1.8649358749389648,
+    "finite": 0.01249605044722557,
+    "insertion": 0.7985492944717407
+  },
+  {
+    "step": 654,
+    "loss": 2.98071551322937,
+    "diagonal_ce": 2.084693670272827,
+    "finite": 0.01612355373799801,
+    "insertion": 0.8798982501029968
+  },
+  {
+    "step": 655,
+    "loss": 3.0188050270080566,
+    "diagonal_ce": 2.088580846786499,
+    "finite": 0.015314661897718906,
+    "insertion": 0.9149095416069031
+  },
+  {
+    "step": 656,
+    "loss": 2.8616254329681396,
+    "diagonal_ce": 2.0034148693084717,
+    "finite": 0.013804587535560131,
+    "insertion": 0.8444058299064636
+  },
+  {
+    "step": 657,
+    "loss": 2.4717559814453125,
+    "diagonal_ce": 1.732447862625122,
+    "finite": 0.01372364442795515,
+    "insertion": 0.7255843877792358
+  },
+  {
+    "step": 658,
+    "loss": 2.847498893737793,
+    "diagonal_ce": 1.9899234771728516,
+    "finite": 0.013569003902375698,
+    "insertion": 0.8440062403678894
+  },
+  {
+    "step": 659,
+    "loss": 2.712965726852417,
+    "diagonal_ce": 1.8302890062332153,
+    "finite": 0.016175229102373123,
+    "insertion": 0.8665013909339905
+  },
+  {
+    "step": 660,
+    "loss": 2.8993444442749023,
+    "diagonal_ce": 2.0613765716552734,
+    "finite": 0.013878884725272655,
+    "insertion": 0.8240891695022583
+  },
+  {
+    "step": 661,
+    "loss": 2.7193527221679688,
+    "diagonal_ce": 1.8763651847839355,
+    "finite": 0.014569618739187717,
+    "insertion": 0.8284180164337158
+  },
+  {
+    "step": 662,
+    "loss": 2.730907440185547,
+    "diagonal_ce": 1.8727399110794067,
+    "finite": 0.015510311350226402,
+    "insertion": 0.842657208442688
+  },
+  {
+    "step": 663,
+    "loss": 3.134700298309326,
+    "diagonal_ce": 2.127246379852295,
+    "finite": 0.017801271751523018,
+    "insertion": 0.989652693271637
+  },
+  {
+    "step": 664,
+    "loss": 2.7942075729370117,
+    "diagonal_ce": 1.9051027297973633,
+    "finite": 0.011999839916825294,
+    "insertion": 0.8771051168441772
+  },
+  {
+    "step": 665,
+    "loss": 2.725703477859497,
+    "diagonal_ce": 1.9236608743667603,
+    "finite": 0.013833177275955677,
+    "insertion": 0.7882094979286194
+  },
+  {
+    "step": 666,
+    "loss": 2.5875041484832764,
+    "diagonal_ce": 1.9208632707595825,
+    "finite": 0.015379299409687519,
+    "insertion": 0.6512616276741028
+  },
+  {
+    "step": 667,
+    "loss": 2.8555104732513428,
+    "diagonal_ce": 2.0427956581115723,
+    "finite": 0.013342347927391529,
+    "insertion": 0.7993723750114441
+  },
+  {
+    "step": 668,
+    "loss": 2.980522632598877,
+    "diagonal_ce": 2.0540785789489746,
+    "finite": 0.01187614630907774,
+    "insertion": 0.9145679473876953
+  },
+  {
+    "step": 669,
+    "loss": 2.708409070968628,
+    "diagonal_ce": 1.8561890125274658,
+    "finite": 0.015002946369349957,
+    "insertion": 0.8372171521186829
+  },
+  {
+    "step": 670,
+    "loss": 2.679610252380371,
+    "diagonal_ce": 1.8498435020446777,
+    "finite": 0.012914546765387058,
+    "insertion": 0.8168520927429199
+  },
+  {
+    "step": 671,
+    "loss": 3.0685698986053467,
+    "diagonal_ce": 2.0887598991394043,
+    "finite": 0.011399433016777039,
+    "insertion": 0.9684104323387146
+  },
+  {
+    "step": 672,
+    "loss": 2.875804901123047,
+    "diagonal_ce": 2.032876491546631,
+    "finite": 0.012304033152759075,
+    "insertion": 0.8306244015693665
+  },
+  {
+    "step": 673,
+    "loss": 3.2264389991760254,
+    "diagonal_ce": 2.1402719020843506,
+    "finite": 0.013400835916399956,
+    "insertion": 1.0727661848068237
+  },
+  {
+    "step": 674,
+    "loss": 3.016371011734009,
+    "diagonal_ce": 2.0900137424468994,
+    "finite": 0.012240886688232422,
+    "insertion": 0.9141164422035217
+  },
+  {
+    "step": 675,
+    "loss": 2.720512866973877,
+    "diagonal_ce": 1.8847752809524536,
+    "finite": 0.013523304834961891,
+    "insertion": 0.8222142457962036
+  },
+  {
+    "step": 676,
+    "loss": 2.6265952587127686,
+    "diagonal_ce": 1.8338176012039185,
+    "finite": 0.011983389966189861,
+    "insertion": 0.7807943224906921
+  },
+  {
+    "step": 677,
+    "loss": 3.0534303188323975,
+    "diagonal_ce": 2.1308934688568115,
+    "finite": 0.015047782100737095,
+    "insertion": 0.907489001750946
+  },
+  {
+    "step": 678,
+    "loss": 2.5502843856811523,
+    "diagonal_ce": 1.7317273616790771,
+    "finite": 0.017079437151551247,
+    "insertion": 0.8014776110649109
+  },
+  {
+    "step": 679,
+    "loss": 2.862326145172119,
+    "diagonal_ce": 2.030172824859619,
+    "finite": 0.013967514038085938,
+    "insertion": 0.8181858062744141
+  },
+  {
+    "step": 680,
+    "loss": 3.1546077728271484,
+    "diagonal_ce": 2.1682016849517822,
+    "finite": 0.01409293431788683,
+    "insertion": 0.9723131656646729
+  },
+  {
+    "step": 681,
+    "loss": 2.674126148223877,
+    "diagonal_ce": 1.8874071836471558,
+    "finite": 0.010253941640257835,
+    "insertion": 0.7764649391174316
+  },
+  {
+    "step": 682,
+    "loss": 2.6974573135375977,
+    "diagonal_ce": 1.8598498106002808,
+    "finite": 0.013768290169537067,
+    "insertion": 0.8238391280174255
+  },
+  {
+    "step": 683,
+    "loss": 2.746866226196289,
+    "diagonal_ce": 2.0534329414367676,
+    "finite": 0.012464789673686028,
+    "insertion": 0.6809684634208679
+  },
+  {
+    "step": 684,
+    "loss": 2.9455995559692383,
+    "diagonal_ce": 2.08450984954834,
+    "finite": 0.012305077165365219,
+    "insertion": 0.8487847447395325
+  },
+  {
+    "step": 685,
+    "loss": 2.7228121757507324,
+    "diagonal_ce": 1.920437216758728,
+    "finite": 0.014464444480836391,
+    "insertion": 0.7879104018211365
+  },
+  {
+    "step": 686,
+    "loss": 2.7201998233795166,
+    "diagonal_ce": 1.8424298763275146,
+    "finite": 0.015793509781360626,
+    "insertion": 0.8619764447212219
+  },
+  {
+    "step": 687,
+    "loss": 2.822727680206299,
+    "diagonal_ce": 1.9416621923446655,
+    "finite": 0.010901340283453465,
+    "insertion": 0.8701642155647278
+  },
+  {
+    "step": 688,
+    "loss": 2.999924659729004,
+    "diagonal_ce": 2.1438591480255127,
+    "finite": 0.012330452911555767,
+    "insertion": 0.8437349796295166
+  },
+  {
+    "step": 689,
+    "loss": 2.9076390266418457,
+    "diagonal_ce": 2.0547609329223633,
+    "finite": 0.012436135672032833,
+    "insertion": 0.8404418230056763
+  },
+  {
+    "step": 690,
+    "loss": 3.316290855407715,
+    "diagonal_ce": 2.2871086597442627,
+    "finite": 0.015290451236069202,
+    "insertion": 1.013891577720642
+  },
+  {
+    "step": 691,
+    "loss": 2.9270753860473633,
+    "diagonal_ce": 2.07177734375,
+    "finite": 0.018330540508031845,
+    "insertion": 0.836967408657074
+  },
+  {
+    "step": 692,
+    "loss": 2.888798713684082,
+    "diagonal_ce": 2.0703508853912354,
+    "finite": 0.01669503189623356,
+    "insertion": 0.8017528057098389
+  },
+  {
+    "step": 693,
+    "loss": 2.9969239234924316,
+    "diagonal_ce": 2.1377062797546387,
+    "finite": 0.014881730079650879,
+    "insertion": 0.8443360924720764
+  },
+  {
+    "step": 694,
+    "loss": 2.593947172164917,
+    "diagonal_ce": 1.7803908586502075,
+    "finite": 0.015046353451907635,
+    "insertion": 0.7985098958015442
+  },
+  {
+    "step": 695,
+    "loss": 2.9864754676818848,
+    "diagonal_ce": 2.0310938358306885,
+    "finite": 0.01616669073700905,
+    "insertion": 0.9392149448394775
+  },
+  {
+    "step": 696,
+    "loss": 2.523782253265381,
+    "diagonal_ce": 1.7943429946899414,
+    "finite": 0.015565975569188595,
+    "insertion": 0.7138733267784119
+  },
+  {
+    "step": 697,
+    "loss": 3.1895785331726074,
+    "diagonal_ce": 2.232435464859009,
+    "finite": 0.013350826688110828,
+    "insertion": 0.9437923431396484
+  },
+  {
+    "step": 698,
+    "loss": 2.8230698108673096,
+    "diagonal_ce": 1.9168541431427002,
+    "finite": 0.015524757094681263,
+    "insertion": 0.8906908631324768
+  },
+  {
+    "step": 699,
+    "loss": 2.5545220375061035,
+    "diagonal_ce": 1.7658064365386963,
+    "finite": 0.013976420275866985,
+    "insertion": 0.7747390270233154
+  },
+  {
+    "step": 700,
+    "loss": 2.7389791011810303,
+    "diagonal_ce": 1.9137444496154785,
+    "finite": 0.013163289055228233,
+    "insertion": 0.8120713233947754
+  },
+  {
+    "step": 701,
+    "loss": 3.100956439971924,
+    "diagonal_ce": 2.1273159980773926,
+    "finite": 0.014291557483375072,
+    "insertion": 0.9593487977981567
+  },
+  {
+    "step": 702,
+    "loss": 2.4181909561157227,
+    "diagonal_ce": 1.731763482093811,
+    "finite": 0.015399525873363018,
+    "insertion": 0.6710277795791626
+  },
+  {
+    "step": 703,
+    "loss": 3.1203322410583496,
+    "diagonal_ce": 2.1390645503997803,
+    "finite": 0.01567324437201023,
+    "insertion": 0.9655944108963013
+  },
+  {
+    "step": 704,
+    "loss": 2.903369903564453,
+    "diagonal_ce": 1.8807834386825562,
+    "finite": 0.017582090571522713,
+    "insertion": 1.0050045251846313
+  },
+  {
+    "step": 705,
+    "loss": 2.872784376144409,
+    "diagonal_ce": 2.006524085998535,
+    "finite": 0.013555106706917286,
+    "insertion": 0.8527052402496338
+  },
+  {
+    "step": 706,
+    "loss": 2.704874277114868,
+    "diagonal_ce": 1.8492493629455566,
+    "finite": 0.017536602914333344,
+    "insertion": 0.8380882740020752
+  },
+  {
+    "step": 707,
+    "loss": 2.6631617546081543,
+    "diagonal_ce": 1.858220100402832,
+    "finite": 0.015829402953386307,
+    "insertion": 0.7891120910644531
+  },
+  {
+    "step": 708,
+    "loss": 2.457411289215088,
+    "diagonal_ce": 1.7792315483093262,
+    "finite": 0.015685155987739563,
+    "insertion": 0.662494421005249
+  },
+  {
+    "step": 709,
+    "loss": 2.7455201148986816,
+    "diagonal_ce": 1.9249027967453003,
+    "finite": 0.01618010737001896,
+    "insertion": 0.8044371604919434
+  },
+  {
+    "step": 710,
+    "loss": 2.914754867553711,
+    "diagonal_ce": 2.036912202835083,
+    "finite": 0.01645004190504551,
+    "insertion": 0.8613927364349365
+  },
+  {
+    "step": 711,
+    "loss": 3.0729713439941406,
+    "diagonal_ce": 2.1833741664886475,
+    "finite": 0.017455916851758957,
+    "insertion": 0.8721413612365723
+  },
+  {
+    "step": 712,
+    "loss": 2.786531925201416,
+    "diagonal_ce": 1.9402406215667725,
+    "finite": 0.020505201071500778,
+    "insertion": 0.8257859945297241
+  },
+  {
+    "step": 713,
+    "loss": 3.0636470317840576,
+    "diagonal_ce": 2.1573891639709473,
+    "finite": 0.016082948073744774,
+    "insertion": 0.890174925327301
+  },
+  {
+    "step": 714,
+    "loss": 2.884681463241577,
+    "diagonal_ce": 2.0591089725494385,
+    "finite": 0.018175356090068817,
+    "insertion": 0.8073970675468445
+  },
+  {
+    "step": 715,
+    "loss": 2.607363700866699,
+    "diagonal_ce": 1.9032870531082153,
+    "finite": 0.019456222653388977,
+    "insertion": 0.6846203804016113
+  },
+  {
+    "step": 716,
+    "loss": 2.820312976837158,
+    "diagonal_ce": 1.9453197717666626,
+    "finite": 0.01793375425040722,
+    "insertion": 0.8570595979690552
+  },
+  {
+    "step": 717,
+    "loss": 2.634164333343506,
+    "diagonal_ce": 1.8772276639938354,
+    "finite": 0.018829725682735443,
+    "insertion": 0.7381069660186768
+  },
+  {
+    "step": 718,
+    "loss": 2.836369037628174,
+    "diagonal_ce": 2.020825147628784,
+    "finite": 0.01937667652964592,
+    "insertion": 0.796167254447937
+  },
+  {
+    "step": 719,
+    "loss": 3.0018577575683594,
+    "diagonal_ce": 2.0848515033721924,
+    "finite": 0.014149551279842854,
+    "insertion": 0.902856707572937
+  },
+  {
+    "step": 720,
+    "loss": 2.9834344387054443,
+    "diagonal_ce": 2.0930612087249756,
+    "finite": 0.019742662087082863,
+    "insertion": 0.8706305623054504
+  },
+  {
+    "step": 721,
+    "loss": 3.2736029624938965,
+    "diagonal_ce": 2.304211139678955,
+    "finite": 0.013691573403775692,
+    "insertion": 0.9557002186775208
+  },
+  {
+    "step": 722,
+    "loss": 2.9577016830444336,
+    "diagonal_ce": 2.0546655654907227,
+    "finite": 0.015819717198610306,
+    "insertion": 0.8872164487838745
+  },
+  {
+    "step": 723,
+    "loss": 2.6130213737487793,
+    "diagonal_ce": 1.892980694770813,
+    "finite": 0.014311603270471096,
+    "insertion": 0.7057291865348816
+  },
+  {
+    "step": 724,
+    "loss": 2.805461883544922,
+    "diagonal_ce": 1.9574395418167114,
+    "finite": 0.014522222802042961,
+    "insertion": 0.8335001468658447
+  },
+  {
+    "step": 725,
+    "loss": 2.7199931144714355,
+    "diagonal_ce": 1.9481452703475952,
+    "finite": 0.01662914641201496,
+    "insertion": 0.7552186250686646
+  },
+  {
+    "step": 726,
+    "loss": 2.802879810333252,
+    "diagonal_ce": 1.987866997718811,
+    "finite": 0.019356515258550644,
+    "insertion": 0.7956562042236328
+  },
+  {
+    "step": 727,
+    "loss": 2.708343267440796,
+    "diagonal_ce": 1.9033972024917603,
+    "finite": 0.017990201711654663,
+    "insertion": 0.7869557738304138
+  },
+  {
+    "step": 728,
+    "loss": 2.8798000812530518,
+    "diagonal_ce": 2.0013835430145264,
+    "finite": 0.02060207538306713,
+    "insertion": 0.857814610004425
+  },
+  {
+    "step": 729,
+    "loss": 2.6169161796569824,
+    "diagonal_ce": 1.7847295999526978,
+    "finite": 0.02102387510240078,
+    "insertion": 0.8111627101898193
+  },
+  {
+    "step": 730,
+    "loss": 2.779890537261963,
+    "diagonal_ce": 1.9465243816375732,
+    "finite": 0.017797410488128662,
+    "insertion": 0.8155686855316162
+  },
+  {
+    "step": 731,
+    "loss": 2.5221352577209473,
+    "diagonal_ce": 1.774499773979187,
+    "finite": 0.01638699322938919,
+    "insertion": 0.7312484383583069
+  },
+  {
+    "step": 732,
+    "loss": 2.523925304412842,
+    "diagonal_ce": 1.7874934673309326,
+    "finite": 0.017437947914004326,
+    "insertion": 0.7189940214157104
+  },
+  {
+    "step": 733,
+    "loss": 3.0968189239501953,
+    "diagonal_ce": 2.16076397895813,
+    "finite": 0.016654571518301964,
+    "insertion": 0.9194003939628601
+  },
+  {
+    "step": 734,
+    "loss": 2.8111815452575684,
+    "diagonal_ce": 2.018784761428833,
+    "finite": 0.012860925868153572,
+    "insertion": 0.779535710811615
+  },
+  {
+    "step": 735,
+    "loss": 3.127411365509033,
+    "diagonal_ce": 2.1007742881774902,
+    "finite": 0.013783124275505543,
+    "insertion": 1.012853980064392
+  },
+  {
+    "step": 736,
+    "loss": 2.7481796741485596,
+    "diagonal_ce": 1.9363785982131958,
+    "finite": 0.01250536274164915,
+    "insertion": 0.7992956638336182
+  },
+  {
+    "step": 737,
+    "loss": 2.7502989768981934,
+    "diagonal_ce": 1.9249118566513062,
+    "finite": 0.01151700783520937,
+    "insertion": 0.8138701915740967
+  },
+  {
+    "step": 738,
+    "loss": 3.150226354598999,
+    "diagonal_ce": 2.1657285690307617,
+    "finite": 0.011942064389586449,
+    "insertion": 0.9725556969642639
+  },
+  {
+    "step": 739,
+    "loss": 2.393631935119629,
+    "diagonal_ce": 1.747600793838501,
+    "finite": 0.010829897597432137,
+    "insertion": 0.6352011561393738
+  },
+  {
+    "step": 740,
+    "loss": 2.8836097717285156,
+    "diagonal_ce": 1.9936751127243042,
+    "finite": 0.016142040491104126,
+    "insertion": 0.8737925887107849
+  },
+  {
+    "step": 741,
+    "loss": 2.928007125854492,
+    "diagonal_ce": 2.0632126331329346,
+    "finite": 0.012502864934504032,
+    "insertion": 0.8522916436195374
+  },
+  {
+    "step": 742,
+    "loss": 2.497189521789551,
+    "diagonal_ce": 1.7381396293640137,
+    "finite": 0.012102651409804821,
+    "insertion": 0.746947169303894
+  },
+  {
+    "step": 743,
+    "loss": 2.8003594875335693,
+    "diagonal_ce": 1.9456340074539185,
+    "finite": 0.01133300643414259,
+    "insertion": 0.8433924317359924
+  },
+  {
+    "step": 744,
+    "loss": 2.7727060317993164,
+    "diagonal_ce": 1.950531244277954,
+    "finite": 0.010363971814513206,
+    "insertion": 0.8118109107017517
+  },
+  {
+    "step": 745,
+    "loss": 2.8799097537994385,
+    "diagonal_ce": 2.068228244781494,
+    "finite": 0.009701525792479515,
+    "insertion": 0.8019800186157227
+  },
+  {
+    "step": 746,
+    "loss": 2.671509265899658,
+    "diagonal_ce": 1.94292151927948,
+    "finite": 0.009435441344976425,
+    "insertion": 0.7191522717475891
+  },
+  {
+    "step": 747,
+    "loss": 2.824934720993042,
+    "diagonal_ce": 2.0145370960235596,
+    "finite": 0.014902211725711823,
+    "insertion": 0.7954954504966736
+  },
+  {
+    "step": 748,
+    "loss": 2.608274221420288,
+    "diagonal_ce": 1.8306398391723633,
+    "finite": 0.01249939389526844,
+    "insertion": 0.7651349902153015
+  },
+  {
+    "step": 749,
+    "loss": 3.0017905235290527,
+    "diagonal_ce": 2.115644693374634,
+    "finite": 0.011063800193369389,
+    "insertion": 0.8750821352005005
+  },
+  {
+    "step": 750,
+    "loss": 2.6891679763793945,
+    "diagonal_ce": 1.8800890445709229,
+    "finite": 0.01194747630506754,
+    "insertion": 0.797131359577179
+  },
+  {
+    "step": 751,
+    "loss": 2.8559508323669434,
+    "diagonal_ce": 1.9934476613998413,
+    "finite": 0.01395271997898817,
+    "insertion": 0.84855055809021
+  },
+  {
+    "step": 752,
+    "loss": 2.9961180686950684,
+    "diagonal_ce": 2.0787620544433594,
+    "finite": 0.012112180702388287,
+    "insertion": 0.9052437543869019
+  },
+  {
+    "step": 753,
+    "loss": 2.801133632659912,
+    "diagonal_ce": 2.0665132999420166,
+    "finite": 0.012935035862028599,
+    "insertion": 0.7216854691505432
+  },
+  {
+    "step": 754,
+    "loss": 3.1058483123779297,
+    "diagonal_ce": 2.2000510692596436,
+    "finite": 0.012667953968048096,
+    "insertion": 0.8931294679641724
+  },
+  {
+    "step": 755,
+    "loss": 2.8295373916625977,
+    "diagonal_ce": 2.0051021575927734,
+    "finite": 0.013930209912359715,
+    "insertion": 0.8105049133300781
+  },
+  {
+    "step": 756,
+    "loss": 2.376089572906494,
+    "diagonal_ce": 1.680736780166626,
+    "finite": 0.01420603971928358,
+    "insertion": 0.6811468005180359
+  },
+  {
+    "step": 757,
+    "loss": 2.6782712936401367,
+    "diagonal_ce": 1.8853732347488403,
+    "finite": 0.014020993374288082,
+    "insertion": 0.7788769602775574
+  },
+  {
+    "step": 758,
+    "loss": 2.4511637687683105,
+    "diagonal_ce": 1.703825831413269,
+    "finite": 0.016931142657995224,
+    "insertion": 0.7304067611694336
+  },
+  {
+    "step": 759,
+    "loss": 3.189206600189209,
+    "diagonal_ce": 2.1331787109375,
+    "finite": 0.012270859442651272,
+    "insertion": 1.0437568426132202
+  },
+  {
+    "step": 760,
+    "loss": 2.4473845958709717,
+    "diagonal_ce": 1.6603763103485107,
+    "finite": 0.014633440412580967,
+    "insertion": 0.7723748087882996
+  },
+  {
+    "step": 761,
+    "loss": 3.2745978832244873,
+    "diagonal_ce": 2.372666120529175,
+    "finite": 0.011421028524637222,
+    "insertion": 0.8905107378959656
+  },
+  {
+    "step": 762,
+    "loss": 2.9743051528930664,
+    "diagonal_ce": 2.1072704792022705,
+    "finite": 0.013499215245246887,
+    "insertion": 0.853535532951355
+  },
+  {
+    "step": 763,
+    "loss": 2.9057250022888184,
+    "diagonal_ce": 2.1100502014160156,
+    "finite": 0.016530197113752365,
+    "insertion": 0.7791445255279541
+  },
+  {
+    "step": 764,
+    "loss": 2.8042688369750977,
+    "diagonal_ce": 1.963912844657898,
+    "finite": 0.01266807783395052,
+    "insertion": 0.8276877999305725
+  },
+  {
+    "step": 765,
+    "loss": 2.744284152984619,
+    "diagonal_ce": 1.9428902864456177,
+    "finite": 0.012944784946739674,
+    "insertion": 0.7884491086006165
+  },
+  {
+    "step": 766,
+    "loss": 2.7656807899475098,
+    "diagonal_ce": 1.9547659158706665,
+    "finite": 0.009846010245382786,
+    "insertion": 0.8010688424110413
+  },
+  {
+    "step": 767,
+    "loss": 3.1557838916778564,
+    "diagonal_ce": 2.194141387939453,
+    "finite": 0.011570642702281475,
+    "insertion": 0.9500717520713806
+  },
+  {
+    "step": 768,
+    "loss": 3.2958102226257324,
+    "diagonal_ce": 2.2000880241394043,
+    "finite": 0.010026972740888596,
+    "insertion": 1.0856953859329224
+  },
+  {
+    "step": 769,
+    "loss": 2.96402907371521,
+    "diagonal_ce": 2.111142873764038,
+    "finite": 0.009727411903440952,
+    "insertion": 0.8431586623191833
+  },
+  {
+    "step": 770,
+    "loss": 2.6769607067108154,
+    "diagonal_ce": 1.8760136365890503,
+    "finite": 0.011759413406252861,
+    "insertion": 0.7891876101493835
+  },
+  {
+    "step": 771,
+    "loss": 2.9360604286193848,
+    "diagonal_ce": 2.1179773807525635,
+    "finite": 0.00929088331758976,
+    "insertion": 0.808791995048523
+  },
+  {
+    "step": 772,
+    "loss": 2.930615186691284,
+    "diagonal_ce": 1.9980909824371338,
+    "finite": 0.01425197347998619,
+    "insertion": 0.9182723164558411
+  },
+  {
+    "step": 773,
+    "loss": 3.2086217403411865,
+    "diagonal_ce": 2.247220277786255,
+    "finite": 0.012817944400012493,
+    "insertion": 0.9485836625099182
+  },
+  {
+    "step": 774,
+    "loss": 2.7067055702209473,
+    "diagonal_ce": 1.8328320980072021,
+    "finite": 0.01296659279614687,
+    "insertion": 0.860906720161438
+  },
+  {
+    "step": 775,
+    "loss": 3.088764190673828,
+    "diagonal_ce": 2.0613303184509277,
+    "finite": 0.014889930374920368,
+    "insertion": 1.0125439167022705
+  },
+  {
+    "step": 776,
+    "loss": 2.808241367340088,
+    "diagonal_ce": 2.0333645343780518,
+    "finite": 0.00957939401268959,
+    "insertion": 0.765297532081604
+  },
+  {
+    "step": 777,
+    "loss": 2.8436226844787598,
+    "diagonal_ce": 1.982056736946106,
+    "finite": 0.01135728508234024,
+    "insertion": 0.850208580493927
+  },
+  {
+    "step": 778,
+    "loss": 2.8963301181793213,
+    "diagonal_ce": 2.0349929332733154,
+    "finite": 0.01014106534421444,
+    "insertion": 0.8511959910392761
+  },
+  {
+    "step": 779,
+    "loss": 3.0605762004852295,
+    "diagonal_ce": 2.2179758548736572,
+    "finite": 0.013836023397743702,
+    "insertion": 0.8287644386291504
+  },
+  {
+    "step": 780,
+    "loss": 2.601317882537842,
+    "diagonal_ce": 1.8407095670700073,
+    "finite": 0.013921074569225311,
+    "insertion": 0.7466872334480286
+  },
+  {
+    "step": 781,
+    "loss": 2.6626412868499756,
+    "diagonal_ce": 1.9288763999938965,
+    "finite": 0.01285130437463522,
+    "insertion": 0.7209134697914124
+  },
+  {
+    "step": 782,
+    "loss": 2.9936132431030273,
+    "diagonal_ce": 2.026125192642212,
+    "finite": 0.011782295070588589,
+    "insertion": 0.9557055234909058
+  },
+  {
+    "step": 783,
+    "loss": 2.926955223083496,
+    "diagonal_ce": 2.1084189414978027,
+    "finite": 0.01100658718496561,
+    "insertion": 0.8075298070907593
+  },
+  {
+    "step": 784,
+    "loss": 2.8539979457855225,
+    "diagonal_ce": 1.9326808452606201,
+    "finite": 0.010585767216980457,
+    "insertion": 0.910731315612793
+  },
+  {
+    "step": 785,
+    "loss": 2.871513843536377,
+    "diagonal_ce": 2.00976824760437,
+    "finite": 0.011017479933798313,
+    "insertion": 0.8507280349731445
+  },
+  {
+    "step": 786,
+    "loss": 2.8927414417266846,
+    "diagonal_ce": 2.066511392593384,
+    "finite": 0.012706906534731388,
+    "insertion": 0.8135230541229248
+  },
+  {
+    "step": 787,
+    "loss": 2.4772658348083496,
+    "diagonal_ce": 1.7677061557769775,
+    "finite": 0.011164591647684574,
+    "insertion": 0.6983952522277832
+  },
+  {
+    "step": 788,
+    "loss": 2.8357930183410645,
+    "diagonal_ce": 1.9840062856674194,
+    "finite": 0.009947235696017742,
+    "insertion": 0.8418394923210144
+  },
+  {
+    "step": 789,
+    "loss": 2.5200440883636475,
+    "diagonal_ce": 1.7904038429260254,
+    "finite": 0.012063574977219105,
+    "insertion": 0.7175765633583069
+  },
+  {
+    "step": 790,
+    "loss": 2.64479923248291,
+    "diagonal_ce": 1.898918867111206,
+    "finite": 0.0103384330868721,
+    "insertion": 0.7355419993400574
+  },
+  {
+    "step": 791,
+    "loss": 3.095107316970825,
+    "diagonal_ce": 2.101595401763916,
+    "finite": 0.011136556975543499,
+    "insertion": 0.98237544298172
+  },
+  {
+    "step": 792,
+    "loss": 2.7364280223846436,
+    "diagonal_ce": 1.928524136543274,
+    "finite": 0.01452411338686943,
+    "insertion": 0.7933797240257263
+  },
+  {
+    "step": 793,
+    "loss": 3.1256961822509766,
+    "diagonal_ce": 2.158723831176758,
+    "finite": 0.011750506237149239,
+    "insertion": 0.9552218914031982
+  },
+  {
+    "step": 794,
+    "loss": 2.7457337379455566,
+    "diagonal_ce": 1.8128209114074707,
+    "finite": 0.008501600474119186,
+    "insertion": 0.9244110584259033
+  },
+  {
+    "step": 795,
+    "loss": 2.7201690673828125,
+    "diagonal_ce": 1.9289984703063965,
+    "finite": 0.011096607893705368,
+    "insertion": 0.7800740599632263
+  },
+  {
+    "step": 796,
+    "loss": 3.316483974456787,
+    "diagonal_ce": 2.3170907497406006,
+    "finite": 0.008685451000928879,
+    "insertion": 0.9907079339027405
+  },
+  {
+    "step": 797,
+    "loss": 2.6479766368865967,
+    "diagonal_ce": 1.9117603302001953,
+    "finite": 0.01224672980606556,
+    "insertion": 0.7239695191383362
+  },
+  {
+    "step": 798,
+    "loss": 3.1915132999420166,
+    "diagonal_ce": 2.2155399322509766,
+    "finite": 0.010508963838219643,
+    "insertion": 0.9654643535614014
+  },
+  {
+    "step": 799,
+    "loss": 2.8058457374572754,
+    "diagonal_ce": 1.95842707157135,
+    "finite": 0.011365040205419064,
+    "insertion": 0.836053729057312
+  },
+  {
+    "step": 800,
+    "loss": 2.6441614627838135,
+    "diagonal_ce": 1.75534188747406,
+    "finite": 0.010749876499176025,
+    "insertion": 0.8780696988105774
+  },
+  {
+    "step": 801,
+    "loss": 2.422882556915283,
+    "diagonal_ce": 1.7509737014770508,
+    "finite": 0.012278351001441479,
+    "insertion": 0.659630537033081
+  },
+  {
+    "step": 802,
+    "loss": 3.199860095977783,
+    "diagonal_ce": 2.1842589378356934,
+    "finite": 0.010429254733026028,
+    "insertion": 1.0051721334457397
+  },
+  {
+    "step": 803,
+    "loss": 2.9730069637298584,
+    "diagonal_ce": 2.041762113571167,
+    "finite": 0.009477837011218071,
+    "insertion": 0.9217669367790222
+  },
+  {
+    "step": 804,
+    "loss": 2.8484690189361572,
+    "diagonal_ce": 1.913421392440796,
+    "finite": 0.009372605942189693,
+    "insertion": 0.9256749749183655
+  },
+  {
+    "step": 805,
+    "loss": 2.7311158180236816,
+    "diagonal_ce": 1.967518925666809,
+    "finite": 0.011815865524113178,
+    "insertion": 0.7517811059951782
+  },
+  {
+    "step": 806,
+    "loss": 2.8560028076171875,
+    "diagonal_ce": 2.00630259513855,
+    "finite": 0.01311663817614317,
+    "insertion": 0.8365837335586548
+  },
+  {
+    "step": 807,
+    "loss": 2.9388036727905273,
+    "diagonal_ce": 2.054980754852295,
+    "finite": 0.011662675999104977,
+    "insertion": 0.8721600770950317
+  },
+  {
+    "step": 808,
+    "loss": 2.815216302871704,
+    "diagonal_ce": 2.0333034992218018,
+    "finite": 0.010380636900663376,
+    "insertion": 0.7715319991111755
+  },
+  {
+    "step": 809,
+    "loss": 2.834874153137207,
+    "diagonal_ce": 1.96532142162323,
+    "finite": 0.012100896798074245,
+    "insertion": 0.8574516773223877
+  },
+  {
+    "step": 810,
+    "loss": 2.609074354171753,
+    "diagonal_ce": 1.8056927919387817,
+    "finite": 0.011125428602099419,
+    "insertion": 0.7922561764717102
+  },
+  {
+    "step": 811,
+    "loss": 2.8624401092529297,
+    "diagonal_ce": 1.9853343963623047,
+    "finite": 0.010519441217184067,
+    "insertion": 0.8665862083435059
+  },
+  {
+    "step": 812,
+    "loss": 2.800682544708252,
+    "diagonal_ce": 1.7927387952804565,
+    "finite": 0.01332502719014883,
+    "insertion": 0.9946187138557434
+  },
+  {
+    "step": 813,
+    "loss": 3.180135726928711,
+    "diagonal_ce": 2.2636194229125977,
+    "finite": 0.012196863070130348,
+    "insertion": 0.9043195247650146
+  },
+  {
+    "step": 814,
+    "loss": 2.659588575363159,
+    "diagonal_ce": 1.8285657167434692,
+    "finite": 0.009399492293596268,
+    "insertion": 0.8216233849525452
+  },
+  {
+    "step": 815,
+    "loss": 2.807818651199341,
+    "diagonal_ce": 1.9433406591415405,
+    "finite": 0.011274653486907482,
+    "insertion": 0.8532032370567322
+  },
+  {
+    "step": 816,
+    "loss": 2.639147996902466,
+    "diagonal_ce": 1.9369230270385742,
+    "finite": 0.011340152472257614,
+    "insertion": 0.6908848881721497
+  },
+  {
+    "step": 817,
+    "loss": 2.6280009746551514,
+    "diagonal_ce": 1.7975023984909058,
+    "finite": 0.012514494359493256,
+    "insertion": 0.8179841041564941
+  },
+  {
+    "step": 818,
+    "loss": 2.6965246200561523,
+    "diagonal_ce": 1.9677637815475464,
+    "finite": 0.011377710849046707,
+    "insertion": 0.7173832058906555
+  },
+  {
+    "step": 819,
+    "loss": 2.4423093795776367,
+    "diagonal_ce": 1.7270523309707642,
+    "finite": 0.012422679923474789,
+    "insertion": 0.7028344869613647
+  },
+  {
+    "step": 820,
+    "loss": 2.7933411598205566,
+    "diagonal_ce": 1.9576129913330078,
+    "finite": 0.014588070102036,
+    "insertion": 0.8211401700973511
+  },
+  {
+    "step": 821,
+    "loss": 2.7447571754455566,
+    "diagonal_ce": 1.9928991794586182,
+    "finite": 0.011792291887104511,
+    "insertion": 0.74006587266922
+  },
+  {
+    "step": 822,
+    "loss": 2.579257011413574,
+    "diagonal_ce": 1.8277863264083862,
+    "finite": 0.016532089561223984,
+    "insertion": 0.7349385619163513
+  },
+  {
+    "step": 823,
+    "loss": 2.818626642227173,
+    "diagonal_ce": 2.0032551288604736,
+    "finite": 0.015156042762100697,
+    "insertion": 0.8002154231071472
+  },
+  {
+    "step": 824,
+    "loss": 2.916626453399658,
+    "diagonal_ce": 2.124439239501953,
+    "finite": 0.014232311397790909,
+    "insertion": 0.7779548168182373
+  },
+  {
+    "step": 825,
+    "loss": 2.454965114593506,
+    "diagonal_ce": 1.7691017389297485,
+    "finite": 0.014901534654200077,
+    "insertion": 0.670961856842041
+  },
+  {
+    "step": 826,
+    "loss": 2.732330799102783,
+    "diagonal_ce": 1.8472768068313599,
+    "finite": 0.01278182677924633,
+    "insertion": 0.8722721338272095
+  },
+  {
+    "step": 827,
+    "loss": 2.9033362865448,
+    "diagonal_ce": 2.0764248371124268,
+    "finite": 0.009614340960979462,
+    "insertion": 0.8172972202301025
+  },
+  {
+    "step": 828,
+    "loss": 2.735056161880493,
+    "diagonal_ce": 1.8847126960754395,
+    "finite": 0.011391010135412216,
+    "insertion": 0.8389524221420288
+  },
+  {
+    "step": 829,
+    "loss": 2.4490604400634766,
+    "diagonal_ce": 1.6743513345718384,
+    "finite": 0.01181352324783802,
+    "insertion": 0.7628954648971558
+  },
+  {
+    "step": 830,
+    "loss": 2.927121877670288,
+    "diagonal_ce": 1.9810912609100342,
+    "finite": 0.011395575478672981,
+    "insertion": 0.9346349835395813
+  },
+  {
+    "step": 831,
+    "loss": 2.8691506385803223,
+    "diagonal_ce": 2.011749029159546,
+    "finite": 0.011510418727993965,
+    "insertion": 0.8458913564682007
+  },
+  {
+    "step": 832,
+    "loss": 2.5570268630981445,
+    "diagonal_ce": 1.7936389446258545,
+    "finite": 0.012739690952003002,
+    "insertion": 0.7506481409072876
+  },
+  {
+    "step": 833,
+    "loss": 2.742978811264038,
+    "diagonal_ce": 1.9217162132263184,
+    "finite": 0.012825839221477509,
+    "insertion": 0.8084368109703064
+  },
+  {
+    "step": 834,
+    "loss": 2.6811699867248535,
+    "diagonal_ce": 1.9195958375930786,
+    "finite": 0.010926141403615475,
+    "insertion": 0.7506479620933533
+  },
+  {
+    "step": 835,
+    "loss": 2.8160479068756104,
+    "diagonal_ce": 2.0052411556243896,
+    "finite": 0.014089255593717098,
+    "insertion": 0.7967174649238586
+  },
+  {
+    "step": 836,
+    "loss": 2.6743364334106445,
+    "diagonal_ce": 1.8568536043167114,
+    "finite": 0.013496632687747478,
+    "insertion": 0.803986132144928
+  },
+  {
+    "step": 837,
+    "loss": 2.555297613143921,
+    "diagonal_ce": 1.8356003761291504,
+    "finite": 0.01151432003825903,
+    "insertion": 0.7081829309463501
+  },
+  {
+    "step": 838,
+    "loss": 2.9370079040527344,
+    "diagonal_ce": 2.079711675643921,
+    "finite": 0.013330675661563873,
+    "insertion": 0.843965470790863
+  },
+  {
+    "step": 839,
+    "loss": 2.7733850479125977,
+    "diagonal_ce": 1.9347461462020874,
+    "finite": 0.011916578747332096,
+    "insertion": 0.826722264289856
+  },
+  {
+    "step": 840,
+    "loss": 2.9477503299713135,
+    "diagonal_ce": 2.1620166301727295,
+    "finite": 0.009077019058167934,
+    "insertion": 0.7766565680503845
+  },
+  {
+    "step": 841,
+    "loss": 3.0706334114074707,
+    "diagonal_ce": 2.078552722930908,
+    "finite": 0.013855288736522198,
+    "insertion": 0.9782254099845886
+  },
+  {
+    "step": 842,
+    "loss": 2.709463596343994,
+    "diagonal_ce": 1.961384654045105,
+    "finite": 0.011448932811617851,
+    "insertion": 0.7366300821304321
+  },
+  {
+    "step": 843,
+    "loss": 3.11159610748291,
+    "diagonal_ce": 2.1265108585357666,
+    "finite": 0.013374892994761467,
+    "insertion": 0.9717103242874146
+  },
+  {
+    "step": 844,
+    "loss": 3.066413640975952,
+    "diagonal_ce": 2.0224719047546387,
+    "finite": 0.014244277030229568,
+    "insertion": 1.0296974182128906
+  },
+  {
+    "step": 845,
+    "loss": 2.8378899097442627,
+    "diagonal_ce": 1.9294065237045288,
+    "finite": 0.013626018539071083,
+    "insertion": 0.8948574066162109
+  },
+  {
+    "step": 846,
+    "loss": 2.6241660118103027,
+    "diagonal_ce": 1.8449078798294067,
+    "finite": 0.013483790680766106,
+    "insertion": 0.7657744288444519
+  },
+  {
+    "step": 847,
+    "loss": 2.6603565216064453,
+    "diagonal_ce": 1.8637175559997559,
+    "finite": 0.015397327020764351,
+    "insertion": 0.7812415361404419
+  },
+  {
+    "step": 848,
+    "loss": 2.3824679851531982,
+    "diagonal_ce": 1.713560700416565,
+    "finite": 0.01194266602396965,
+    "insertion": 0.6569647192955017
+  },
+  {
+    "step": 849,
+    "loss": 2.984672784805298,
+    "diagonal_ce": 2.106513261795044,
+    "finite": 0.012203864753246307,
+    "insertion": 0.8659555912017822
+  },
+  {
+    "step": 850,
+    "loss": 3.1215980052948,
+    "diagonal_ce": 2.1790504455566406,
+    "finite": 0.012128349393606186,
+    "insertion": 0.9304191470146179
+  },
+  {
+    "step": 851,
+    "loss": 2.9731388092041016,
+    "diagonal_ce": 2.0840611457824707,
+    "finite": 0.012426696717739105,
+    "insertion": 0.8766510486602783
+  },
+  {
+    "step": 852,
+    "loss": 2.626173973083496,
+    "diagonal_ce": 1.8536169528961182,
+    "finite": 0.012254348024725914,
+    "insertion": 0.7603027820587158
+  },
+  {
+    "step": 853,
+    "loss": 3.069434404373169,
+    "diagonal_ce": 2.141085386276245,
+    "finite": 0.012354845181107521,
+    "insertion": 0.9159941077232361
+  },
+  {
+    "step": 854,
+    "loss": 3.1548919677734375,
+    "diagonal_ce": 2.1347928047180176,
+    "finite": 0.011196685023605824,
+    "insertion": 1.008902668952942
+  },
+  {
+    "step": 855,
+    "loss": 3.125887870788574,
+    "diagonal_ce": 2.1784889698028564,
+    "finite": 0.011442954652011395,
+    "insertion": 0.9359561204910278
+  },
+  {
+    "step": 856,
+    "loss": 2.67440128326416,
+    "diagonal_ce": 1.8022218942642212,
+    "finite": 0.01185804232954979,
+    "insertion": 0.8603215217590332
+  },
+  {
+    "step": 857,
+    "loss": 2.7077202796936035,
+    "diagonal_ce": 1.90653395652771,
+    "finite": 0.014324776828289032,
+    "insertion": 0.7868615984916687
+  },
+  {
+    "step": 858,
+    "loss": 3.040173053741455,
+    "diagonal_ce": 1.9884250164031982,
+    "finite": 0.012986164540052414,
+    "insertion": 1.0387619733810425
+  },
+  {
+    "step": 859,
+    "loss": 2.8259117603302,
+    "diagonal_ce": 1.9217426776885986,
+    "finite": 0.0142630934715271,
+    "insertion": 0.8899059295654297
+  },
+  {
+    "step": 860,
+    "loss": 2.8338615894317627,
+    "diagonal_ce": 1.8812695741653442,
+    "finite": 0.014204192906618118,
+    "insertion": 0.9383878707885742
+  },
+  {
+    "step": 861,
+    "loss": 2.8695595264434814,
+    "diagonal_ce": 1.9715254306793213,
+    "finite": 0.013572138734161854,
+    "insertion": 0.8844619989395142
+  },
+  {
+    "step": 862,
+    "loss": 2.9936633110046387,
+    "diagonal_ce": 2.0368778705596924,
+    "finite": 0.016112325713038445,
+    "insertion": 0.9406731128692627
+  },
+  {
+    "step": 863,
+    "loss": 2.7224903106689453,
+    "diagonal_ce": 1.9600129127502441,
+    "finite": 0.013330353423953056,
+    "insertion": 0.7491470575332642
+  },
+  {
+    "step": 864,
+    "loss": 2.8063817024230957,
+    "diagonal_ce": 1.9619953632354736,
+    "finite": 0.015889262780547142,
+    "insertion": 0.8284969925880432
+  },
+  {
+    "step": 865,
+    "loss": 3.0316364765167236,
+    "diagonal_ce": 2.131531238555908,
+    "finite": 0.013215643353760242,
+    "insertion": 0.886889636516571
+  },
+  {
+    "step": 866,
+    "loss": 2.92875075340271,
+    "diagonal_ce": 2.0972373485565186,
+    "finite": 0.015961630269885063,
+    "insertion": 0.8155517578125
+  },
+  {
+    "step": 867,
+    "loss": 2.5376124382019043,
+    "diagonal_ce": 1.7842355966567993,
+    "finite": 0.01607266068458557,
+    "insertion": 0.7373043298721313
+  },
+  {
+    "step": 868,
+    "loss": 2.903273582458496,
+    "diagonal_ce": 2.07027530670166,
+    "finite": 0.011462616734206676,
+    "insertion": 0.821535587310791
+  },
+  {
+    "step": 869,
+    "loss": 2.348503828048706,
+    "diagonal_ce": 1.6512565612792969,
+    "finite": 0.013761632144451141,
+    "insertion": 0.6834856867790222
+  },
+  {
+    "step": 870,
+    "loss": 2.8993642330169678,
+    "diagonal_ce": 1.958292007446289,
+    "finite": 0.015465077944099903,
+    "insertion": 0.9256071448326111
+  },
+  {
+    "step": 871,
+    "loss": 3.0455307960510254,
+    "diagonal_ce": 2.0425426959991455,
+    "finite": 0.012800049968063831,
+    "insertion": 0.9901880025863647
+  },
+  {
+    "step": 872,
+    "loss": 2.829564332962036,
+    "diagonal_ce": 2.020850419998169,
+    "finite": 0.015153240412473679,
+    "insertion": 0.793560802936554
+  },
+  {
+    "step": 873,
+    "loss": 2.6594088077545166,
+    "diagonal_ce": 1.8710401058197021,
+    "finite": 0.015909645706415176,
+    "insertion": 0.7724589705467224
+  },
+  {
+    "step": 874,
+    "loss": 2.9318044185638428,
+    "diagonal_ce": 1.997868537902832,
+    "finite": 0.016166720539331436,
+    "insertion": 0.917769193649292
+  },
+  {
+    "step": 875,
+    "loss": 2.408082962036133,
+    "diagonal_ce": 1.619950294494629,
+    "finite": 0.01473298855125904,
+    "insertion": 0.7733997106552124
+  },
+  {
+    "step": 876,
+    "loss": 2.9713141918182373,
+    "diagonal_ce": 2.1194934844970703,
+    "finite": 0.015469876118004322,
+    "insertion": 0.8363509178161621
+  },
+  {
+    "step": 877,
+    "loss": 2.8151233196258545,
+    "diagonal_ce": 1.956671118736267,
+    "finite": 0.018327008932828903,
+    "insertion": 0.8401252031326294
+  },
+  {
+    "step": 878,
+    "loss": 2.884568691253662,
+    "diagonal_ce": 2.081778049468994,
+    "finite": 0.017695119604468346,
+    "insertion": 0.7850955724716187
+  },
+  {
+    "step": 879,
+    "loss": 2.56242036819458,
+    "diagonal_ce": 1.7608872652053833,
+    "finite": 0.016409069299697876,
+    "insertion": 0.7851241827011108
+  },
+  {
+    "step": 880,
+    "loss": 2.6378116607666016,
+    "diagonal_ce": 1.8104182481765747,
+    "finite": 0.013540244661271572,
+    "insertion": 0.8138530850410461
+  },
+  {
+    "step": 881,
+    "loss": 3.0236551761627197,
+    "diagonal_ce": 2.1346514225006104,
+    "finite": 0.016731495037674904,
+    "insertion": 0.872272253036499
+  },
+  {
+    "step": 882,
+    "loss": 2.8297030925750732,
+    "diagonal_ce": 2.020773410797119,
+    "finite": 0.012916496023535728,
+    "insertion": 0.7960131168365479
+  },
+  {
+    "step": 883,
+    "loss": 2.96165132522583,
+    "diagonal_ce": 2.037461996078491,
+    "finite": 0.013517647050321102,
+    "insertion": 0.9106716513633728
+  },
+  {
+    "step": 884,
+    "loss": 2.910916805267334,
+    "diagonal_ce": 1.9972091913223267,
+    "finite": 0.013406433165073395,
+    "insertion": 0.9003013372421265
+  },
+  {
+    "step": 885,
+    "loss": 2.8431572914123535,
+    "diagonal_ce": 1.9741582870483398,
+    "finite": 0.01622341014444828,
+    "insertion": 0.8527755737304688
+  },
+  {
+    "step": 886,
+    "loss": 2.848865270614624,
+    "diagonal_ce": 1.9801265001296997,
+    "finite": 0.011939630843698978,
+    "insertion": 0.8567991256713867
+  },
+  {
+    "step": 887,
+    "loss": 3.0418591499328613,
+    "diagonal_ce": 2.07186222076416,
+    "finite": 0.01027274876832962,
+    "insertion": 0.9597242474555969
+  },
+  {
+    "step": 888,
+    "loss": 2.7957568168640137,
+    "diagonal_ce": 1.9913609027862549,
+    "finite": 0.01679275557398796,
+    "insertion": 0.7876030206680298
+  },
+  {
+    "step": 889,
+    "loss": 3.1161227226257324,
+    "diagonal_ce": 2.2354235649108887,
+    "finite": 0.014168836176395416,
+    "insertion": 0.8665304183959961
+  },
+  {
+    "step": 890,
+    "loss": 2.5632381439208984,
+    "diagonal_ce": 1.7828320264816284,
+    "finite": 0.014660239219665527,
+    "insertion": 0.7657457590103149
+  },
+  {
+    "step": 891,
+    "loss": 2.375896453857422,
+    "diagonal_ce": 1.596864938735962,
+    "finite": 0.013839886523783207,
+    "insertion": 0.7651917934417725
+  },
+  {
+    "step": 892,
+    "loss": 2.8531763553619385,
+    "diagonal_ce": 1.9780938625335693,
+    "finite": 0.013696467503905296,
+    "insertion": 0.8613861203193665
+  },
+  {
+    "step": 893,
+    "loss": 2.8207480907440186,
+    "diagonal_ce": 2.0935895442962646,
+    "finite": 0.01393009815365076,
+    "insertion": 0.7132284045219421
+  },
+  {
+    "step": 894,
+    "loss": 2.546535015106201,
+    "diagonal_ce": 1.804440975189209,
+    "finite": 0.012765944004058838,
+    "insertion": 0.7293281555175781
+  },
+  {
+    "step": 895,
+    "loss": 2.9067459106445312,
+    "diagonal_ce": 2.0606534481048584,
+    "finite": 0.011055788956582546,
+    "insertion": 0.8350366950035095
+  },
+  {
+    "step": 896,
+    "loss": 2.902479648590088,
+    "diagonal_ce": 2.024409532546997,
+    "finite": 0.012352220714092255,
+    "insertion": 0.8657178282737732
+  },
+  {
+    "step": 897,
+    "loss": 3.04938006401062,
+    "diagonal_ce": 2.19256854057312,
+    "finite": 0.011386769823729992,
+    "insertion": 0.8454247117042542
+  },
+  {
+    "step": 898,
+    "loss": 2.7523908615112305,
+    "diagonal_ce": 1.884428858757019,
+    "finite": 0.011818982660770416,
+    "insertion": 0.856143057346344
+  },
+  {
+    "step": 899,
+    "loss": 3.0251617431640625,
+    "diagonal_ce": 2.1810879707336426,
+    "finite": 0.011231009848415852,
+    "insertion": 0.8328429460525513
+  },
+  {
+    "step": 900,
+    "loss": 3.0104165077209473,
+    "diagonal_ce": 2.168372631072998,
+    "finite": 0.012535992078483105,
+    "insertion": 0.8295078277587891
+  },
+  {
+    "step": 901,
+    "loss": 2.766420841217041,
+    "diagonal_ce": 1.9676060676574707,
+    "finite": 0.010367648676037788,
+    "insertion": 0.7884470820426941
+  },
+  {
+    "step": 902,
+    "loss": 2.994704246520996,
+    "diagonal_ce": 1.997263789176941,
+    "finite": 0.01194672379642725,
+    "insertion": 0.985493540763855
+  },
+  {
+    "step": 903,
+    "loss": 2.913428783416748,
+    "diagonal_ce": 2.068702459335327,
+    "finite": 0.013366949744522572,
+    "insertion": 0.8313595056533813
+  },
+  {
+    "step": 904,
+    "loss": 2.887359619140625,
+    "diagonal_ce": 2.0344505310058594,
+    "finite": 0.012116258963942528,
+    "insertion": 0.8407928347587585
+  },
+  {
+    "step": 905,
+    "loss": 3.12223219871521,
+    "diagonal_ce": 2.212341547012329,
+    "finite": 0.011471081525087357,
+    "insertion": 0.8984196782112122
+  },
+  {
+    "step": 906,
+    "loss": 2.720855474472046,
+    "diagonal_ce": 1.9052679538726807,
+    "finite": 0.015451046638190746,
+    "insertion": 0.800136387348175
+  },
+  {
+    "step": 907,
+    "loss": 2.7742671966552734,
+    "diagonal_ce": 1.9536479711532593,
+    "finite": 0.01280284021049738,
+    "insertion": 0.8078164458274841
+  },
+  {
+    "step": 908,
+    "loss": 2.974794864654541,
+    "diagonal_ce": 2.0769660472869873,
+    "finite": 0.01606292836368084,
+    "insertion": 0.8817659020423889
+  },
+  {
+    "step": 909,
+    "loss": 2.80869722366333,
+    "diagonal_ce": 2.00447416305542,
+    "finite": 0.013870183378458023,
+    "insertion": 0.7903527617454529
+  },
+  {
+    "step": 910,
+    "loss": 2.895219564437866,
+    "diagonal_ce": 2.005161762237549,
+    "finite": 0.011450760066509247,
+    "insertion": 0.8786069750785828
+  },
+  {
+    "step": 911,
+    "loss": 2.695134162902832,
+    "diagonal_ce": 1.9303723573684692,
+    "finite": 0.0098801851272583,
+    "insertion": 0.7548816800117493
+  },
+  {
+    "step": 912,
+    "loss": 2.4926445484161377,
+    "diagonal_ce": 1.7611091136932373,
+    "finite": 0.01147988811135292,
+    "insertion": 0.7200556397438049
+  },
+  {
+    "step": 913,
+    "loss": 3.0305593013763428,
+    "diagonal_ce": 2.0925490856170654,
+    "finite": 0.01127126719802618,
+    "insertion": 0.9267390370368958
+  },
+  {
+    "step": 914,
+    "loss": 2.528820276260376,
+    "diagonal_ce": 1.791420578956604,
+    "finite": 0.010118967853486538,
+    "insertion": 0.7272807955741882
+  },
+  {
+    "step": 915,
+    "loss": 2.8603765964508057,
+    "diagonal_ce": 1.9593452215194702,
+    "finite": 0.009902192279696465,
+    "insertion": 0.8911291360855103
+  },
+  {
+    "step": 916,
+    "loss": 2.9598183631896973,
+    "diagonal_ce": 2.0093135833740234,
+    "finite": 0.010220471769571304,
+    "insertion": 0.940284252166748
+  },
+  {
+    "step": 917,
+    "loss": 3.0442280769348145,
+    "diagonal_ce": 2.178077220916748,
+    "finite": 0.012571895495057106,
+    "insertion": 0.8535791039466858
+  },
+  {
+    "step": 918,
+    "loss": 2.9367928504943848,
+    "diagonal_ce": 2.114450216293335,
+    "finite": 0.011827797628939152,
+    "insertion": 0.8105149269104004
+  },
+  {
+    "step": 919,
+    "loss": 3.051074266433716,
+    "diagonal_ce": 2.0766119956970215,
+    "finite": 0.011525488458573818,
+    "insertion": 0.9629368185997009
+  },
+  {
+    "step": 920,
+    "loss": 2.3969368934631348,
+    "diagonal_ce": 1.6586580276489258,
+    "finite": 0.012086650356650352,
+    "insertion": 0.7261922359466553
+  },
+  {
+    "step": 921,
+    "loss": 2.9181950092315674,
+    "diagonal_ce": 2.0961973667144775,
+    "finite": 0.012960953637957573,
+    "insertion": 0.8090366721153259
+  },
+  {
+    "step": 922,
+    "loss": 2.430189847946167,
+    "diagonal_ce": 1.755660057067871,
+    "finite": 0.01391982939094305,
+    "insertion": 0.6606099009513855
+  },
+  {
+    "step": 923,
+    "loss": 2.561007499694824,
+    "diagonal_ce": 1.9146897792816162,
+    "finite": 0.011925985105335712,
+    "insertion": 0.634391725063324
+  },
+  {
+    "step": 924,
+    "loss": 2.448812246322632,
+    "diagonal_ce": 1.7294743061065674,
+    "finite": 0.011074552312493324,
+    "insertion": 0.7082633376121521
+  },
+  {
+    "step": 925,
+    "loss": 2.7457637786865234,
+    "diagonal_ce": 1.8176567554473877,
+    "finite": 0.011425063945353031,
+    "insertion": 0.9166819453239441
+  },
+  {
+    "step": 926,
+    "loss": 2.8496410846710205,
+    "diagonal_ce": 1.9931639432907104,
+    "finite": 0.012314857915043831,
+    "insertion": 0.8441622853279114
+  },
+  {
+    "step": 927,
+    "loss": 3.1112005710601807,
+    "diagonal_ce": 2.1379499435424805,
+    "finite": 0.009713124483823776,
+    "insertion": 0.9635374546051025
+  },
+  {
+    "step": 928,
+    "loss": 2.735203266143799,
+    "diagonal_ce": 1.9307005405426025,
+    "finite": 0.011464728973805904,
+    "insertion": 0.7930380702018738
+  },
+  {
+    "step": 929,
+    "loss": 2.506899356842041,
+    "diagonal_ce": 1.8016875982284546,
+    "finite": 0.011534413322806358,
+    "insertion": 0.6936774253845215
+  },
+  {
+    "step": 930,
+    "loss": 2.5456807613372803,
+    "diagonal_ce": 1.7117345333099365,
+    "finite": 0.010784521698951721,
+    "insertion": 0.823161780834198
+  },
+  {
+    "step": 931,
+    "loss": 2.943938970565796,
+    "diagonal_ce": 2.087606906890869,
+    "finite": 0.014502523466944695,
+    "insertion": 0.8418295383453369
+  },
+  {
+    "step": 932,
+    "loss": 2.680971622467041,
+    "diagonal_ce": 1.921292781829834,
+    "finite": 0.01118084043264389,
+    "insertion": 0.7484979629516602
+  },
+  {
+    "step": 933,
+    "loss": 2.9681320190429688,
+    "diagonal_ce": 2.0717456340789795,
+    "finite": 0.0112859345972538,
+    "insertion": 0.8851004838943481
+  },
+  {
+    "step": 934,
+    "loss": 3.0466861724853516,
+    "diagonal_ce": 2.149686098098755,
+    "finite": 0.01251524593681097,
+    "insertion": 0.8844847083091736
+  },
+  {
+    "step": 935,
+    "loss": 2.886315107345581,
+    "diagonal_ce": 2.0043299198150635,
+    "finite": 0.011094089597463608,
+    "insertion": 0.8708910942077637
+  },
+  {
+    "step": 936,
+    "loss": 3.2053182125091553,
+    "diagonal_ce": 2.2462081909179688,
+    "finite": 0.008603802882134914,
+    "insertion": 0.9505062699317932
+  },
+  {
+    "step": 937,
+    "loss": 2.6977837085723877,
+    "diagonal_ce": 1.9312708377838135,
+    "finite": 0.009312084876000881,
+    "insertion": 0.7572007775306702
+  },
+  {
+    "step": 938,
+    "loss": 2.6736788749694824,
+    "diagonal_ce": 1.9050005674362183,
+    "finite": 0.013455660082399845,
+    "insertion": 0.7552227973937988
+  },
+  {
+    "step": 939,
+    "loss": 2.626732587814331,
+    "diagonal_ce": 1.8732675313949585,
+    "finite": 0.011334394104778767,
+    "insertion": 0.7421305775642395
+  },
+  {
+    "step": 940,
+    "loss": 2.661341667175293,
+    "diagonal_ce": 1.8074864149093628,
+    "finite": 0.0127858342602849,
+    "insertion": 0.8410695791244507
+  },
+  {
+    "step": 941,
+    "loss": 3.1034348011016846,
+    "diagonal_ce": 2.133124828338623,
+    "finite": 0.011205868795514107,
+    "insertion": 0.9591040015220642
+  },
+  {
+    "step": 942,
+    "loss": 2.8159801959991455,
+    "diagonal_ce": 1.959049940109253,
+    "finite": 0.011295621283352375,
+    "insertion": 0.8456345796585083
+  },
+  {
+    "step": 943,
+    "loss": 3.0687220096588135,
+    "diagonal_ce": 2.2577593326568604,
+    "finite": 0.01112546306103468,
+    "insertion": 0.799837052822113
+  },
+  {
+    "step": 944,
+    "loss": 2.7985761165618896,
+    "diagonal_ce": 1.98299241065979,
+    "finite": 0.013256886042654514,
+    "insertion": 0.8023268580436707
+  },
+  {
+    "step": 945,
+    "loss": 2.697489023208618,
+    "diagonal_ce": 1.9034161567687988,
+    "finite": 0.012329555116593838,
+    "insertion": 0.7817432284355164
+  },
+  {
+    "step": 946,
+    "loss": 2.6959943771362305,
+    "diagonal_ce": 1.9295189380645752,
+    "finite": 0.013858724385499954,
+    "insertion": 0.7526167631149292
+  },
+  {
+    "step": 947,
+    "loss": 2.6483991146087646,
+    "diagonal_ce": 1.7988940477371216,
+    "finite": 0.013806927017867565,
+    "insertion": 0.8356981873512268
+  },
+  {
+    "step": 948,
+    "loss": 2.492763042449951,
+    "diagonal_ce": 1.7464373111724854,
+    "finite": 0.011712237261235714,
+    "insertion": 0.7346136569976807
+  },
+  {
+    "step": 949,
+    "loss": 2.869781017303467,
+    "diagonal_ce": 2.0315256118774414,
+    "finite": 0.011920563876628876,
+    "insertion": 0.8263348937034607
+  },
+  {
+    "step": 950,
+    "loss": 3.066742420196533,
+    "diagonal_ce": 2.026392698287964,
+    "finite": 0.0120182940736413,
+    "insertion": 1.0283313989639282
+  },
+  {
+    "step": 951,
+    "loss": 3.099029302597046,
+    "diagonal_ce": 2.195284605026245,
+    "finite": 0.012009046040475368,
+    "insertion": 0.8917355537414551
+  },
+  {
+    "step": 952,
+    "loss": 2.6246519088745117,
+    "diagonal_ce": 1.8670157194137573,
+    "finite": 0.010371956042945385,
+    "insertion": 0.7472642660140991
+  },
+  {
+    "step": 953,
+    "loss": 2.7669990062713623,
+    "diagonal_ce": 1.909584641456604,
+    "finite": 0.010146645829081535,
+    "insertion": 0.847267746925354
+  },
+  {
+    "step": 954,
+    "loss": 2.5954408645629883,
+    "diagonal_ce": 1.8338125944137573,
+    "finite": 0.008593114092946053,
+    "insertion": 0.7530351281166077
+  },
+  {
+    "step": 955,
+    "loss": 2.8737857341766357,
+    "diagonal_ce": 2.014695167541504,
+    "finite": 0.01019858568906784,
+    "insertion": 0.8488920331001282
+  },
+  {
+    "step": 956,
+    "loss": 3.2192294597625732,
+    "diagonal_ce": 2.3196938037872314,
+    "finite": 0.009527887217700481,
+    "insertion": 0.890007734298706
+  },
+  {
+    "step": 957,
+    "loss": 3.0408501625061035,
+    "diagonal_ce": 2.165649175643921,
+    "finite": 0.010967360809445381,
+    "insertion": 0.864233672618866
+  },
+  {
+    "step": 958,
+    "loss": 2.792935609817505,
+    "diagonal_ce": 1.9412262439727783,
+    "finite": 0.008868717588484287,
+    "insertion": 0.8428407311439514
+  },
+  {
+    "step": 959,
+    "loss": 2.3522210121154785,
+    "diagonal_ce": 1.6295175552368164,
+    "finite": 0.011910486035048962,
+    "insertion": 0.710793137550354
+  },
+  {
+    "step": 960,
+    "loss": 2.9022302627563477,
+    "diagonal_ce": 1.9922269582748413,
+    "finite": 0.012561407871544361,
+    "insertion": 0.8974418640136719
+  },
+  {
+    "step": 961,
+    "loss": 2.770293712615967,
+    "diagonal_ce": 1.9277783632278442,
+    "finite": 0.00985189899802208,
+    "insertion": 0.8326635360717773
+  },
+  {
+    "step": 962,
+    "loss": 2.6268348693847656,
+    "diagonal_ce": 1.8129559755325317,
+    "finite": 0.010463048703968525,
+    "insertion": 0.803415834903717
+  },
+  {
+    "step": 963,
+    "loss": 3.3047053813934326,
+    "diagonal_ce": 2.263671875,
+    "finite": 0.010179247707128525,
+    "insertion": 1.0308542251586914
+  },
+  {
+    "step": 964,
+    "loss": 2.6686673164367676,
+    "diagonal_ce": 1.8579096794128418,
+    "finite": 0.011234583333134651,
+    "insertion": 0.7995230555534363
+  },
+  {
+    "step": 965,
+    "loss": 2.629220962524414,
+    "diagonal_ce": 1.778921365737915,
+    "finite": 0.01120844203978777,
+    "insertion": 0.8390912413597107
+  },
+  {
+    "step": 966,
+    "loss": 2.5894320011138916,
+    "diagonal_ce": 1.838196039199829,
+    "finite": 0.009977986104786396,
+    "insertion": 0.7412579655647278
+  },
+  {
+    "step": 967,
+    "loss": 2.5723679065704346,
+    "diagonal_ce": 1.7434409856796265,
+    "finite": 0.01004054769873619,
+    "insertion": 0.818886399269104
+  },
+  {
+    "step": 968,
+    "loss": 2.618643045425415,
+    "diagonal_ce": 1.8536036014556885,
+    "finite": 0.008988534100353718,
+    "insertion": 0.7560510039329529
+  },
+  {
+    "step": 969,
+    "loss": 3.093975067138672,
+    "diagonal_ce": 2.1372718811035156,
+    "finite": 0.009426743723452091,
+    "insertion": 0.9472763538360596
+  },
+  {
+    "step": 970,
+    "loss": 2.4476869106292725,
+    "diagonal_ce": 1.7470498085021973,
+    "finite": 0.008219855837523937,
+    "insertion": 0.692417323589325
+  },
+  {
+    "step": 971,
+    "loss": 2.876080274581909,
+    "diagonal_ce": 1.9624536037445068,
+    "finite": 0.010363293811678886,
+    "insertion": 0.9032633304595947
+  },
+  {
+    "step": 972,
+    "loss": 2.6523149013519287,
+    "diagonal_ce": 1.9115513563156128,
+    "finite": 0.009278373792767525,
+    "insertion": 0.7314850687980652
+  },
+  {
+    "step": 973,
+    "loss": 2.840231418609619,
+    "diagonal_ce": 1.9626704454421997,
+    "finite": 0.009868820197880268,
+    "insertion": 0.8676921129226685
+  },
+  {
+    "step": 974,
+    "loss": 2.7701303958892822,
+    "diagonal_ce": 1.840203881263733,
+    "finite": 0.01086332369595766,
+    "insertion": 0.919063150882721
+  },
+  {
+    "step": 975,
+    "loss": 3.0034096240997314,
+    "diagonal_ce": 2.0863895416259766,
+    "finite": 0.0096090417355299,
+    "insertion": 0.9074110388755798
+  },
+  {
+    "step": 976,
+    "loss": 2.723256826400757,
+    "diagonal_ce": 1.930292010307312,
+    "finite": 0.011979268863797188,
+    "insertion": 0.7809855937957764
+  },
+  {
+    "step": 977,
+    "loss": 2.628697395324707,
+    "diagonal_ce": 1.8083584308624268,
+    "finite": 0.010850068181753159,
+    "insertion": 0.809488832950592
+  },
+  {
+    "step": 978,
+    "loss": 2.3670494556427,
+    "diagonal_ce": 1.6319178342819214,
+    "finite": 0.009322252124547958,
+    "insertion": 0.7258093357086182
+  },
+  {
+    "step": 979,
+    "loss": 2.870908260345459,
+    "diagonal_ce": 2.030780076980591,
+    "finite": 0.011720960959792137,
+    "insertion": 0.8284074068069458
+  },
+  {
+    "step": 980,
+    "loss": 2.51664400100708,
+    "diagonal_ce": 1.7599027156829834,
+    "finite": 0.009229040704667568,
+    "insertion": 0.7475121021270752
+  },
+  {
+    "step": 981,
+    "loss": 2.9305996894836426,
+    "diagonal_ce": 2.0434234142303467,
+    "finite": 0.00881955400109291,
+    "insertion": 0.8783566355705261
+  },
+  {
+    "step": 982,
+    "loss": 2.4552621841430664,
+    "diagonal_ce": 1.812659740447998,
+    "finite": 0.011764119379222393,
+    "insertion": 0.6308383345603943
+  },
+  {
+    "step": 983,
+    "loss": 3.070547580718994,
+    "diagonal_ce": 2.1869380474090576,
+    "finite": 0.009779429994523525,
+    "insertion": 0.8738300800323486
+  },
+  {
+    "step": 984,
+    "loss": 2.9174282550811768,
+    "diagonal_ce": 2.0566396713256836,
+    "finite": 0.008637200109660625,
+    "insertion": 0.8521513938903809
+  },
+  {
+    "step": 985,
+    "loss": 2.9324309825897217,
+    "diagonal_ce": 2.1149213314056396,
+    "finite": 0.007898758165538311,
+    "insertion": 0.8096108436584473
+  },
+  {
+    "step": 986,
+    "loss": 3.116227149963379,
+    "diagonal_ce": 2.1796114444732666,
+    "finite": 0.010388419963419437,
+    "insertion": 0.9262272715568542
+  },
+  {
+    "step": 987,
+    "loss": 2.9327640533447266,
+    "diagonal_ce": 2.0241193771362305,
+    "finite": 0.010575912892818451,
+    "insertion": 0.8980686068534851
+  },
+  {
+    "step": 988,
+    "loss": 3.389000654220581,
+    "diagonal_ce": 2.3397650718688965,
+    "finite": 0.010228186845779419,
+    "insertion": 1.0390074253082275
+  },
+  {
+    "step": 989,
+    "loss": 3.038020372390747,
+    "diagonal_ce": 2.20857572555542,
+    "finite": 0.008676714263856411,
+    "insertion": 0.820767879486084
+  },
+  {
+    "step": 990,
+    "loss": 2.6486520767211914,
+    "diagonal_ce": 1.832568645477295,
+    "finite": 0.00835596676915884,
+    "insertion": 0.807727575302124
+  },
+  {
+    "step": 991,
+    "loss": 3.0910892486572266,
+    "diagonal_ce": 2.204592704772949,
+    "finite": 0.010811598040163517,
+    "insertion": 0.8756850361824036
+  },
+  {
+    "step": 992,
+    "loss": 3.352440357208252,
+    "diagonal_ce": 2.3115394115448,
+    "finite": 0.012141572311520576,
+    "insertion": 1.0287595987319946
+  },
+  {
+    "step": 993,
+    "loss": 3.072592258453369,
+    "diagonal_ce": 2.072176694869995,
+    "finite": 0.013341984711587429,
+    "insertion": 0.9870736002922058
+  },
+  {
+    "step": 994,
+    "loss": 2.8868696689605713,
+    "diagonal_ce": 1.99189031124115,
+    "finite": 0.01193955633789301,
+    "insertion": 0.8830397129058838
+  },
+  {
+    "step": 995,
+    "loss": 2.5841751098632812,
+    "diagonal_ce": 1.8846776485443115,
+    "finite": 0.011145525611937046,
+    "insertion": 0.6883520483970642
+  },
+  {
+    "step": 996,
+    "loss": 2.716611862182617,
+    "diagonal_ce": 1.9459301233291626,
+    "finite": 0.016115540638566017,
+    "insertion": 0.7545660734176636
+  },
+  {
+    "step": 997,
+    "loss": 3.1200668811798096,
+    "diagonal_ce": 2.201894521713257,
+    "finite": 0.010642140172421932,
+    "insertion": 0.9075303673744202
+  },
+  {
+    "step": 998,
+    "loss": 2.699141025543213,
+    "diagonal_ce": 1.9214993715286255,
+    "finite": 0.011594917625188828,
+    "insertion": 0.7660468220710754
+  },
+  {
+    "step": 999,
+    "loss": 2.9175000190734863,
+    "diagonal_ce": 2.0691030025482178,
+    "finite": 0.011785409413278103,
+    "insertion": 0.8366116285324097
+  }
+]
diff --git a/lecture_6/verified_examples/expanding/report.json b/lecture_6/verified_examples/expanding/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..9f70d55c20c9f6eac7bd2716ae9f3c4f5c0aa412
--- /dev/null
+++ b/lecture_6/verified_examples/expanding/report.json
@@ -0,0 +1,1429 @@
+{
+  "method": "expanding",
+  "data_kind": "synthetic-text",
+  "train_loss_first_20_mean": 4.2571533679962155,
+  "train_loss_last_20_mean": 2.9194031715393067,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "unique_fraction": 0.34375,
+  "token_entropy": 2.5313878059387207,
+  "mean_length": 4.09375,
+  "empty_fraction": 0.0,
+  "training_support_fraction": 0.6171875,
+  "capped_proposed_insertions": 20,
+  "length_trajectories": [
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      3
+    ],
+    [
+      0,
+      0,
+      1,
+      3,
+      3,
+      3,
+      3,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      1,
+      1,
+      3
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      2,
+      3,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      3,
+      3,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      2,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      3,
+      3,
+      3,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      2,
+      2,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      3,
+      5,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      2,
+      2,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      2,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      3,
+      4,
+      4
+    ],
+    [
+      0,
+      2,
+      2,
+      2,
+      2,
+      2,
+      2,
+      2,
+      2
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      1
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      2,
+      2,
+      3,
+      3
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      2,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      4,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      1,
+      1,
+      2,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      2,
+      4,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      1,
+      4,
+      4,
+      4,
+      4,
+      4,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      2,
+      2,
+      2,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      3,
+      3,
+      4,
+      4,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      2,
+      2,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      3,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      2
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      2,
+      2,
+      2
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      2,
+      2,
+      3,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      2,
+      3
+    ],
+    [
+      0,
+      0,
+      2,
+      2,
+      2,
+      3,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      2,
+      3,
+      3,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      4,
+      4,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      2,
+      2,
+      3,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      1,
+      3,
+      3,
+      4,
+      5,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      2,
+      3,
+      3
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      3,
+      5,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      1
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      4,
+      4,
+      4,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      3,
+      3,
+      4,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      2,
+      2,
+      2
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      2,
+      2,
+      2,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      3,
+      3,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      5,
+      5,
+      5,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      1,
+      2,
+      3,
+      3,
+      3,
+      3,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      3,
+      4,
+      5,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      3,
+      4,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      2,
+      2,
+      2,
+      2,
+      2,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      1,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      2
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      3,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      2
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      2,
+      4,
+      4,
+      4,
+      4,
+      5
+    ],
+    [
+      0,
+      3,
+      3,
+      3,
+      3,
+      3,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      2,
+      3,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      3,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      3,
+      3,
+      3,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      2,
+      2,
+      2
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      3
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      3,
+      4
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      3,
+      3,
+      4
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      3,
+      4,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      2,
+      2,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      1,
+      2,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      2,
+      4,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      2,
+      4
+    ],
+    [
+      0,
+      2,
+      2,
+      3,
+      3,
+      5,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      3,
+      3
+    ],
+    [
+      0,
+      1,
+      1,
+      3,
+      3,
+      3,
+      3,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      2,
+      2,
+      2,
+      2,
+      2,
+      2,
+      4,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      3,
+      3,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      2,
+      4,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      2,
+      2,
+      2,
+      2,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      1,
+      1,
+      2,
+      3,
+      4,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      3,
+      3,
+      3,
+      3,
+      3,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      3
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      4,
+      4,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      3,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      2,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      1,
+      1,
+      3,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      1,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      2,
+      2,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      2,
+      3,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      1,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      3,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      2,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      3,
+      4,
+      4,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      2,
+      3,
+      4,
+      5,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      1,
+      2,
+      2,
+      2
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      2,
+      2,
+      2,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      2,
+      3,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      2,
+      3,
+      3,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      3,
+      4,
+      4,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      3,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      1,
+      2,
+      2,
+      3,
+      4,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      2,
+      2,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      3,
+      3,
+      3
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      2,
+      3,
+      3,
+      3,
+      4
+    ],
+    [
+      0,
+      0,
+      2,
+      2,
+      2,
+      3,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      1,
+      1,
+      1,
+      3,
+      5,
+      5
+    ],
+    [
+      0,
+      2,
+      3,
+      3,
+      4,
+      4,
+      4,
+      4,
+      4
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      1,
+      1,
+      1,
+      3
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      1,
+      1,
+      1,
+      2
+    ],
+    [
+      0,
+      0,
+      1,
+      3,
+      3,
+      3,
+      5,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      2,
+      2,
+      3,
+      3,
+      4
+    ],
+    [
+      0,
+      1,
+      1,
+      1,
+      1,
+      2,
+      3,
+      4,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      2,
+      2,
+      2,
+      2,
+      3
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      2,
+      2,
+      2,
+      2,
+      5
+    ],
+    [
+      0,
+      0,
+      1,
+      2,
+      3,
+      3,
+      3,
+      5,
+      5
+    ],
+    [
+      0,
+      0,
+      0,
+      0,
+      0,
+      0,
+      2,
+      2,
+      5
+    ]
+  ],
+  "elapsed_seconds": 21.383618507999927
+}
diff --git a/lecture_6/verified_examples/expanding/samples.txt b/lecture_6/verified_examples/expanding/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..04a23bb092f7fe5b95766b7f1c2784fc9715b1ff
--- /dev/null
+++ b/lecture_6/verified_examples/expanding/samples.txt
@@ -0,0 +1,128 @@
+green triangle moves
+green triangle moves up slowly
+red circle moves
+green moves up
+gold star moves
+gold star moves down twice
+red circle moves left twice
+green triangle moves up
+green triangle moves down
+green triangle moves up
+red circle moves left twice
+green triangle moves slowly
+blue square moves right
+green triangle moves up
+red circle
+green
+red circle moves
+green triangle moves up slowly
+green triangle moves up slowly
+green square moves slowly
+blue square moves right
+blue square moves
+green triangle moves up slowly
+green triangle moves up slowly
+red circle moves slowly
+green triangle moves slowly
+blue square moves right slowly
+green triangle moves up slowly
+gold star moves left twice
+red circle
+red circle
+red circle moves left slowly
+blue square moves right slowly
+green triangle moves up twice
+red circle moves
+gold star moves down slowly
+gold star moves down
+gold star moves slowly
+blue square moves right slowly
+red circle moves left slowly
+blue square moves right
+blue moves right
+red circle moves left twice
+green moves up
+blue square moves right slowly
+blue
+gold star moves down twice
+green triangle moves up slowly
+blue star
+green triangle moves up slowly
+blue square moves slowly
+gold star moves down twice
+blue square moves slowly
+green triangle moves up slowly
+green triangle moves slowly
+green triangle moves up slowly
+gold star moves down twice
+gold star moves down
+gold moves moves
+green triangle
+red circle moves left slowly
+red circle
+red circle moves left twice
+gold star moves down twice
+green triangle moves up
+blue square moves right slowly
+blue circle moves left
+green triangle moves slowly
+red circle moves left
+gold star
+green triangle moves left slowly
+blue moves moves
+green triangle moves up
+red circle moves slowly
+gold star moves down
+gold moves down
+red circle moves slowly
+blue square moves right
+blue square moves slowly
+green triangle moves up
+green triangle moves up slowly
+green triangle moves
+blue square moves slowly
+green triangle moves up
+blue square moves right twice
+gold star moves down twice
+blue square moves right slowly
+green moves left
+red circle moves left
+blue square moves right
+blue square moves right slowly
+blue square moves
+green triangle moves down slowly
+blue square moves slowly
+red circle moves left twice
+gold star moves down
+green triangle moves up slowly
+red circle moves left
+blue square moves right slowly
+green triangle moves up
+green triangle moves up twice
+red moves moves
+gold star moves down twice
+red circle moves left
+blue square moves right slowly
+green star moves down twice
+green triangle
+blue square moves slowly
+green triangle moves up slowly
+green circle moves slowly
+blue square moves right slowly
+red circle moves left
+red circle moves left twice
+green triangle moves up slowly
+red circle moves
+blue square moves right
+blue star moves down slowly
+red star moves left twice
+blue square moves right
+gold star moves
+gold star
+gold star moves down slowly
+green triangle moves slowly
+green square moves right slowly
+gold star moves
+green square moves right slowly
+blue square moves right slowly
+blue square moves right slowly
diff --git a/lecture_6/verified_examples/flow-matching/config.json b/lecture_6/verified_examples/flow-matching/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..3c96329b58c46ea37154dc9a01f64dd4e59de1f8
--- /dev/null
+++ b/lecture_6/verified_examples/flow-matching/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "flow-matching",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/flow-matching"
+}
diff --git a/lecture_6/verified_examples/flow-matching/losses.json b/lecture_6/verified_examples/flow-matching/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..390d49a57630b70970313a77aff092e7126b640a
--- /dev/null
+++ b/lecture_6/verified_examples/flow-matching/losses.json
@@ -0,0 +1,5002 @@
+[
+  {
+    "step": 0,
+    "loss": 3.3380019664764404,
+    "diagonal": 3.3380019664764404
+  },
+  {
+    "step": 1,
+    "loss": 3.901406764984131,
+    "diagonal": 3.901406764984131
+  },
+  {
+    "step": 2,
+    "loss": 3.1410484313964844,
+    "diagonal": 3.1410484313964844
+  },
+  {
+    "step": 3,
+    "loss": 3.4472012519836426,
+    "diagonal": 3.4472012519836426
+  },
+  {
+    "step": 4,
+    "loss": 3.286107301712036,
+    "diagonal": 3.286107301712036
+  },
+  {
+    "step": 5,
+    "loss": 3.2420201301574707,
+    "diagonal": 3.2420201301574707
+  },
+  {
+    "step": 6,
+    "loss": 3.7451963424682617,
+    "diagonal": 3.7451963424682617
+  },
+  {
+    "step": 7,
+    "loss": 3.4327750205993652,
+    "diagonal": 3.4327750205993652
+  },
+  {
+    "step": 8,
+    "loss": 3.227224588394165,
+    "diagonal": 3.227224588394165
+  },
+  {
+    "step": 9,
+    "loss": 2.928713321685791,
+    "diagonal": 2.928713321685791
+  },
+  {
+    "step": 10,
+    "loss": 3.07771897315979,
+    "diagonal": 3.07771897315979
+  },
+  {
+    "step": 11,
+    "loss": 3.5836005210876465,
+    "diagonal": 3.5836005210876465
+  },
+  {
+    "step": 12,
+    "loss": 3.298255205154419,
+    "diagonal": 3.298255205154419
+  },
+  {
+    "step": 13,
+    "loss": 3.356062889099121,
+    "diagonal": 3.356062889099121
+  },
+  {
+    "step": 14,
+    "loss": 2.9884204864501953,
+    "diagonal": 2.9884204864501953
+  },
+  {
+    "step": 15,
+    "loss": 3.1705894470214844,
+    "diagonal": 3.1705894470214844
+  },
+  {
+    "step": 16,
+    "loss": 2.9881367683410645,
+    "diagonal": 2.9881367683410645
+  },
+  {
+    "step": 17,
+    "loss": 2.736571788787842,
+    "diagonal": 2.736571788787842
+  },
+  {
+    "step": 18,
+    "loss": 2.8405778408050537,
+    "diagonal": 2.8405778408050537
+  },
+  {
+    "step": 19,
+    "loss": 3.079740524291992,
+    "diagonal": 3.079740524291992
+  },
+  {
+    "step": 20,
+    "loss": 3.9387435913085938,
+    "diagonal": 3.9387435913085938
+  },
+  {
+    "step": 21,
+    "loss": 2.297696590423584,
+    "diagonal": 2.297696590423584
+  },
+  {
+    "step": 22,
+    "loss": 3.0970983505249023,
+    "diagonal": 3.0970983505249023
+  },
+  {
+    "step": 23,
+    "loss": 3.1945102214813232,
+    "diagonal": 3.1945102214813232
+  },
+  {
+    "step": 24,
+    "loss": 3.138603448867798,
+    "diagonal": 3.138603448867798
+  },
+  {
+    "step": 25,
+    "loss": 3.1780786514282227,
+    "diagonal": 3.1780786514282227
+  },
+  {
+    "step": 26,
+    "loss": 2.8921985626220703,
+    "diagonal": 2.8921985626220703
+  },
+  {
+    "step": 27,
+    "loss": 2.849454402923584,
+    "diagonal": 2.849454402923584
+  },
+  {
+    "step": 28,
+    "loss": 2.551090717315674,
+    "diagonal": 2.551090717315674
+  },
+  {
+    "step": 29,
+    "loss": 2.8239452838897705,
+    "diagonal": 2.8239452838897705
+  },
+  {
+    "step": 30,
+    "loss": 2.76413631439209,
+    "diagonal": 2.76413631439209
+  },
+  {
+    "step": 31,
+    "loss": 2.7400290966033936,
+    "diagonal": 2.7400290966033936
+  },
+  {
+    "step": 32,
+    "loss": 2.8798418045043945,
+    "diagonal": 2.8798418045043945
+  },
+  {
+    "step": 33,
+    "loss": 2.600008726119995,
+    "diagonal": 2.600008726119995
+  },
+  {
+    "step": 34,
+    "loss": 2.22660756111145,
+    "diagonal": 2.22660756111145
+  },
+  {
+    "step": 35,
+    "loss": 3.1927566528320312,
+    "diagonal": 3.1927566528320312
+  },
+  {
+    "step": 36,
+    "loss": 3.0876779556274414,
+    "diagonal": 3.0876779556274414
+  },
+  {
+    "step": 37,
+    "loss": 3.0611953735351562,
+    "diagonal": 3.0611953735351562
+  },
+  {
+    "step": 38,
+    "loss": 3.214414119720459,
+    "diagonal": 3.214414119720459
+  },
+  {
+    "step": 39,
+    "loss": 2.408848762512207,
+    "diagonal": 2.408848762512207
+  },
+  {
+    "step": 40,
+    "loss": 2.7642476558685303,
+    "diagonal": 2.7642476558685303
+  },
+  {
+    "step": 41,
+    "loss": 2.994264602661133,
+    "diagonal": 2.994264602661133
+  },
+  {
+    "step": 42,
+    "loss": 2.7499873638153076,
+    "diagonal": 2.7499873638153076
+  },
+  {
+    "step": 43,
+    "loss": 3.2647781372070312,
+    "diagonal": 3.2647781372070312
+  },
+  {
+    "step": 44,
+    "loss": 2.493619203567505,
+    "diagonal": 2.493619203567505
+  },
+  {
+    "step": 45,
+    "loss": 2.8053481578826904,
+    "diagonal": 2.8053481578826904
+  },
+  {
+    "step": 46,
+    "loss": 2.90826678276062,
+    "diagonal": 2.90826678276062
+  },
+  {
+    "step": 47,
+    "loss": 3.380341053009033,
+    "diagonal": 3.380341053009033
+  },
+  {
+    "step": 48,
+    "loss": 3.0862014293670654,
+    "diagonal": 3.0862014293670654
+  },
+  {
+    "step": 49,
+    "loss": 2.7059717178344727,
+    "diagonal": 2.7059717178344727
+  },
+  {
+    "step": 50,
+    "loss": 2.6777403354644775,
+    "diagonal": 2.6777403354644775
+  },
+  {
+    "step": 51,
+    "loss": 2.899153470993042,
+    "diagonal": 2.899153470993042
+  },
+  {
+    "step": 52,
+    "loss": 3.199681520462036,
+    "diagonal": 3.199681520462036
+  },
+  {
+    "step": 53,
+    "loss": 2.8687243461608887,
+    "diagonal": 2.8687243461608887
+  },
+  {
+    "step": 54,
+    "loss": 3.632868528366089,
+    "diagonal": 3.632868528366089
+  },
+  {
+    "step": 55,
+    "loss": 2.6427788734436035,
+    "diagonal": 2.6427788734436035
+  },
+  {
+    "step": 56,
+    "loss": 2.576784372329712,
+    "diagonal": 2.576784372329712
+  },
+  {
+    "step": 57,
+    "loss": 2.946423053741455,
+    "diagonal": 2.946423053741455
+  },
+  {
+    "step": 58,
+    "loss": 3.40364146232605,
+    "diagonal": 3.40364146232605
+  },
+  {
+    "step": 59,
+    "loss": 3.0133025646209717,
+    "diagonal": 3.0133025646209717
+  },
+  {
+    "step": 60,
+    "loss": 3.449383497238159,
+    "diagonal": 3.449383497238159
+  },
+  {
+    "step": 61,
+    "loss": 3.341169595718384,
+    "diagonal": 3.341169595718384
+  },
+  {
+    "step": 62,
+    "loss": 2.7576324939727783,
+    "diagonal": 2.7576324939727783
+  },
+  {
+    "step": 63,
+    "loss": 3.0752954483032227,
+    "diagonal": 3.0752954483032227
+  },
+  {
+    "step": 64,
+    "loss": 2.8348982334136963,
+    "diagonal": 2.8348982334136963
+  },
+  {
+    "step": 65,
+    "loss": 2.588801383972168,
+    "diagonal": 2.588801383972168
+  },
+  {
+    "step": 66,
+    "loss": 2.3946099281311035,
+    "diagonal": 2.3946099281311035
+  },
+  {
+    "step": 67,
+    "loss": 2.6684389114379883,
+    "diagonal": 2.6684389114379883
+  },
+  {
+    "step": 68,
+    "loss": 2.2620203495025635,
+    "diagonal": 2.2620203495025635
+  },
+  {
+    "step": 69,
+    "loss": 2.799905776977539,
+    "diagonal": 2.799905776977539
+  },
+  {
+    "step": 70,
+    "loss": 3.633082151412964,
+    "diagonal": 3.633082151412964
+  },
+  {
+    "step": 71,
+    "loss": 2.4327025413513184,
+    "diagonal": 2.4327025413513184
+  },
+  {
+    "step": 72,
+    "loss": 2.79103422164917,
+    "diagonal": 2.79103422164917
+  },
+  {
+    "step": 73,
+    "loss": 3.5643532276153564,
+    "diagonal": 3.5643532276153564
+  },
+  {
+    "step": 74,
+    "loss": 3.094212532043457,
+    "diagonal": 3.094212532043457
+  },
+  {
+    "step": 75,
+    "loss": 2.5090575218200684,
+    "diagonal": 2.5090575218200684
+  },
+  {
+    "step": 76,
+    "loss": 2.9076061248779297,
+    "diagonal": 2.9076061248779297
+  },
+  {
+    "step": 77,
+    "loss": 2.578817367553711,
+    "diagonal": 2.578817367553711
+  },
+  {
+    "step": 78,
+    "loss": 2.5341506004333496,
+    "diagonal": 2.5341506004333496
+  },
+  {
+    "step": 79,
+    "loss": 3.13346529006958,
+    "diagonal": 3.13346529006958
+  },
+  {
+    "step": 80,
+    "loss": 2.5481884479522705,
+    "diagonal": 2.5481884479522705
+  },
+  {
+    "step": 81,
+    "loss": 2.6338415145874023,
+    "diagonal": 2.6338415145874023
+  },
+  {
+    "step": 82,
+    "loss": 3.039618968963623,
+    "diagonal": 3.039618968963623
+  },
+  {
+    "step": 83,
+    "loss": 3.8365061283111572,
+    "diagonal": 3.8365061283111572
+  },
+  {
+    "step": 84,
+    "loss": 3.078603506088257,
+    "diagonal": 3.078603506088257
+  },
+  {
+    "step": 85,
+    "loss": 2.3504836559295654,
+    "diagonal": 2.3504836559295654
+  },
+  {
+    "step": 86,
+    "loss": 2.9083638191223145,
+    "diagonal": 2.9083638191223145
+  },
+  {
+    "step": 87,
+    "loss": 3.1519312858581543,
+    "diagonal": 3.1519312858581543
+  },
+  {
+    "step": 88,
+    "loss": 2.2187488079071045,
+    "diagonal": 2.2187488079071045
+  },
+  {
+    "step": 89,
+    "loss": 2.034611225128174,
+    "diagonal": 2.034611225128174
+  },
+  {
+    "step": 90,
+    "loss": 3.4911904335021973,
+    "diagonal": 3.4911904335021973
+  },
+  {
+    "step": 91,
+    "loss": 2.682511568069458,
+    "diagonal": 2.682511568069458
+  },
+  {
+    "step": 92,
+    "loss": 3.4035239219665527,
+    "diagonal": 3.4035239219665527
+  },
+  {
+    "step": 93,
+    "loss": 2.87746262550354,
+    "diagonal": 2.87746262550354
+  },
+  {
+    "step": 94,
+    "loss": 3.232576370239258,
+    "diagonal": 3.232576370239258
+  },
+  {
+    "step": 95,
+    "loss": 3.271571636199951,
+    "diagonal": 3.271571636199951
+  },
+  {
+    "step": 96,
+    "loss": 3.066450834274292,
+    "diagonal": 3.066450834274292
+  },
+  {
+    "step": 97,
+    "loss": 2.4883320331573486,
+    "diagonal": 2.4883320331573486
+  },
+  {
+    "step": 98,
+    "loss": 3.1873512268066406,
+    "diagonal": 3.1873512268066406
+  },
+  {
+    "step": 99,
+    "loss": 3.0392866134643555,
+    "diagonal": 3.0392866134643555
+  },
+  {
+    "step": 100,
+    "loss": 3.0829544067382812,
+    "diagonal": 3.0829544067382812
+  },
+  {
+    "step": 101,
+    "loss": 2.982844352722168,
+    "diagonal": 2.982844352722168
+  },
+  {
+    "step": 102,
+    "loss": 2.616631031036377,
+    "diagonal": 2.616631031036377
+  },
+  {
+    "step": 103,
+    "loss": 3.0702614784240723,
+    "diagonal": 3.0702614784240723
+  },
+  {
+    "step": 104,
+    "loss": 2.4900927543640137,
+    "diagonal": 2.4900927543640137
+  },
+  {
+    "step": 105,
+    "loss": 3.018010377883911,
+    "diagonal": 3.018010377883911
+  },
+  {
+    "step": 106,
+    "loss": 3.315645933151245,
+    "diagonal": 3.315645933151245
+  },
+  {
+    "step": 107,
+    "loss": 2.756361722946167,
+    "diagonal": 2.756361722946167
+  },
+  {
+    "step": 108,
+    "loss": 2.5551109313964844,
+    "diagonal": 2.5551109313964844
+  },
+  {
+    "step": 109,
+    "loss": 2.9737091064453125,
+    "diagonal": 2.9737091064453125
+  },
+  {
+    "step": 110,
+    "loss": 2.3771591186523438,
+    "diagonal": 2.3771591186523438
+  },
+  {
+    "step": 111,
+    "loss": 2.3506219387054443,
+    "diagonal": 2.3506219387054443
+  },
+  {
+    "step": 112,
+    "loss": 2.9604485034942627,
+    "diagonal": 2.9604485034942627
+  },
+  {
+    "step": 113,
+    "loss": 2.693345069885254,
+    "diagonal": 2.693345069885254
+  },
+  {
+    "step": 114,
+    "loss": 3.581080675125122,
+    "diagonal": 3.581080675125122
+  },
+  {
+    "step": 115,
+    "loss": 2.182196617126465,
+    "diagonal": 2.182196617126465
+  },
+  {
+    "step": 116,
+    "loss": 3.392946720123291,
+    "diagonal": 3.392946720123291
+  },
+  {
+    "step": 117,
+    "loss": 2.554527759552002,
+    "diagonal": 2.554527759552002
+  },
+  {
+    "step": 118,
+    "loss": 2.5017805099487305,
+    "diagonal": 2.5017805099487305
+  },
+  {
+    "step": 119,
+    "loss": 2.9702954292297363,
+    "diagonal": 2.9702954292297363
+  },
+  {
+    "step": 120,
+    "loss": 2.9659535884857178,
+    "diagonal": 2.9659535884857178
+  },
+  {
+    "step": 121,
+    "loss": 2.3964693546295166,
+    "diagonal": 2.3964693546295166
+  },
+  {
+    "step": 122,
+    "loss": 2.594660758972168,
+    "diagonal": 2.594660758972168
+  },
+  {
+    "step": 123,
+    "loss": 3.2971630096435547,
+    "diagonal": 3.2971630096435547
+  },
+  {
+    "step": 124,
+    "loss": 3.140481948852539,
+    "diagonal": 3.140481948852539
+  },
+  {
+    "step": 125,
+    "loss": 2.807556629180908,
+    "diagonal": 2.807556629180908
+  },
+  {
+    "step": 126,
+    "loss": 2.668325424194336,
+    "diagonal": 2.668325424194336
+  },
+  {
+    "step": 127,
+    "loss": 2.6989498138427734,
+    "diagonal": 2.6989498138427734
+  },
+  {
+    "step": 128,
+    "loss": 3.575807809829712,
+    "diagonal": 3.575807809829712
+  },
+  {
+    "step": 129,
+    "loss": 3.0602147579193115,
+    "diagonal": 3.0602147579193115
+  },
+  {
+    "step": 130,
+    "loss": 2.8473474979400635,
+    "diagonal": 2.8473474979400635
+  },
+  {
+    "step": 131,
+    "loss": 2.7160916328430176,
+    "diagonal": 2.7160916328430176
+  },
+  {
+    "step": 132,
+    "loss": 2.7418553829193115,
+    "diagonal": 2.7418553829193115
+  },
+  {
+    "step": 133,
+    "loss": 2.3619017601013184,
+    "diagonal": 2.3619017601013184
+  },
+  {
+    "step": 134,
+    "loss": 2.424551248550415,
+    "diagonal": 2.424551248550415
+  },
+  {
+    "step": 135,
+    "loss": 2.426988124847412,
+    "diagonal": 2.426988124847412
+  },
+  {
+    "step": 136,
+    "loss": 2.6174402236938477,
+    "diagonal": 2.6174402236938477
+  },
+  {
+    "step": 137,
+    "loss": 2.1457316875457764,
+    "diagonal": 2.1457316875457764
+  },
+  {
+    "step": 138,
+    "loss": 2.9255754947662354,
+    "diagonal": 2.9255754947662354
+  },
+  {
+    "step": 139,
+    "loss": 2.40743088722229,
+    "diagonal": 2.40743088722229
+  },
+  {
+    "step": 140,
+    "loss": 2.4960250854492188,
+    "diagonal": 2.4960250854492188
+  },
+  {
+    "step": 141,
+    "loss": 2.4131357669830322,
+    "diagonal": 2.4131357669830322
+  },
+  {
+    "step": 142,
+    "loss": 2.8186893463134766,
+    "diagonal": 2.8186893463134766
+  },
+  {
+    "step": 143,
+    "loss": 2.5264182090759277,
+    "diagonal": 2.5264182090759277
+  },
+  {
+    "step": 144,
+    "loss": 3.3760480880737305,
+    "diagonal": 3.3760480880737305
+  },
+  {
+    "step": 145,
+    "loss": 2.503302812576294,
+    "diagonal": 2.503302812576294
+  },
+  {
+    "step": 146,
+    "loss": 2.494697332382202,
+    "diagonal": 2.494697332382202
+  },
+  {
+    "step": 147,
+    "loss": 2.928159475326538,
+    "diagonal": 2.928159475326538
+  },
+  {
+    "step": 148,
+    "loss": 3.106919527053833,
+    "diagonal": 3.106919527053833
+  },
+  {
+    "step": 149,
+    "loss": 2.8014676570892334,
+    "diagonal": 2.8014676570892334
+  },
+  {
+    "step": 150,
+    "loss": 2.736227512359619,
+    "diagonal": 2.736227512359619
+  },
+  {
+    "step": 151,
+    "loss": 3.161252737045288,
+    "diagonal": 3.161252737045288
+  },
+  {
+    "step": 152,
+    "loss": 2.728236198425293,
+    "diagonal": 2.728236198425293
+  },
+  {
+    "step": 153,
+    "loss": 2.9906749725341797,
+    "diagonal": 2.9906749725341797
+  },
+  {
+    "step": 154,
+    "loss": 2.7437033653259277,
+    "diagonal": 2.7437033653259277
+  },
+  {
+    "step": 155,
+    "loss": 2.984703540802002,
+    "diagonal": 2.984703540802002
+  },
+  {
+    "step": 156,
+    "loss": 2.4177730083465576,
+    "diagonal": 2.4177730083465576
+  },
+  {
+    "step": 157,
+    "loss": 2.4449095726013184,
+    "diagonal": 2.4449095726013184
+  },
+  {
+    "step": 158,
+    "loss": 2.438872814178467,
+    "diagonal": 2.438872814178467
+  },
+  {
+    "step": 159,
+    "loss": 2.8149962425231934,
+    "diagonal": 2.8149962425231934
+  },
+  {
+    "step": 160,
+    "loss": 2.7595038414001465,
+    "diagonal": 2.7595038414001465
+  },
+  {
+    "step": 161,
+    "loss": 2.977097988128662,
+    "diagonal": 2.977097988128662
+  },
+  {
+    "step": 162,
+    "loss": 2.4518165588378906,
+    "diagonal": 2.4518165588378906
+  },
+  {
+    "step": 163,
+    "loss": 3.548116683959961,
+    "diagonal": 3.548116683959961
+  },
+  {
+    "step": 164,
+    "loss": 2.235485792160034,
+    "diagonal": 2.235485792160034
+  },
+  {
+    "step": 165,
+    "loss": 2.2145814895629883,
+    "diagonal": 2.2145814895629883
+  },
+  {
+    "step": 166,
+    "loss": 2.914485454559326,
+    "diagonal": 2.914485454559326
+  },
+  {
+    "step": 167,
+    "loss": 3.0176196098327637,
+    "diagonal": 3.0176196098327637
+  },
+  {
+    "step": 168,
+    "loss": 3.3361589908599854,
+    "diagonal": 3.3361589908599854
+  },
+  {
+    "step": 169,
+    "loss": 3.2125661373138428,
+    "diagonal": 3.2125661373138428
+  },
+  {
+    "step": 170,
+    "loss": 2.451528787612915,
+    "diagonal": 2.451528787612915
+  },
+  {
+    "step": 171,
+    "loss": 2.1553454399108887,
+    "diagonal": 2.1553454399108887
+  },
+  {
+    "step": 172,
+    "loss": 2.0767531394958496,
+    "diagonal": 2.0767531394958496
+  },
+  {
+    "step": 173,
+    "loss": 2.5880210399627686,
+    "diagonal": 2.5880210399627686
+  },
+  {
+    "step": 174,
+    "loss": 2.0260984897613525,
+    "diagonal": 2.0260984897613525
+  },
+  {
+    "step": 175,
+    "loss": 2.6314749717712402,
+    "diagonal": 2.6314749717712402
+  },
+  {
+    "step": 176,
+    "loss": 2.4482598304748535,
+    "diagonal": 2.4482598304748535
+  },
+  {
+    "step": 177,
+    "loss": 2.7871155738830566,
+    "diagonal": 2.7871155738830566
+  },
+  {
+    "step": 178,
+    "loss": 2.8353350162506104,
+    "diagonal": 2.8353350162506104
+  },
+  {
+    "step": 179,
+    "loss": 3.097609281539917,
+    "diagonal": 3.097609281539917
+  },
+  {
+    "step": 180,
+    "loss": 3.273047924041748,
+    "diagonal": 3.273047924041748
+  },
+  {
+    "step": 181,
+    "loss": 2.1703529357910156,
+    "diagonal": 2.1703529357910156
+  },
+  {
+    "step": 182,
+    "loss": 2.769788980484009,
+    "diagonal": 2.769788980484009
+  },
+  {
+    "step": 183,
+    "loss": 1.8867571353912354,
+    "diagonal": 1.8867571353912354
+  },
+  {
+    "step": 184,
+    "loss": 3.5887608528137207,
+    "diagonal": 3.5887608528137207
+  },
+  {
+    "step": 185,
+    "loss": 3.052025318145752,
+    "diagonal": 3.052025318145752
+  },
+  {
+    "step": 186,
+    "loss": 2.729703664779663,
+    "diagonal": 2.729703664779663
+  },
+  {
+    "step": 187,
+    "loss": 2.8614861965179443,
+    "diagonal": 2.8614861965179443
+  },
+  {
+    "step": 188,
+    "loss": 2.5053138732910156,
+    "diagonal": 2.5053138732910156
+  },
+  {
+    "step": 189,
+    "loss": 2.788351058959961,
+    "diagonal": 2.788351058959961
+  },
+  {
+    "step": 190,
+    "loss": 2.4792802333831787,
+    "diagonal": 2.4792802333831787
+  },
+  {
+    "step": 191,
+    "loss": 3.3415286540985107,
+    "diagonal": 3.3415286540985107
+  },
+  {
+    "step": 192,
+    "loss": 2.6152803897857666,
+    "diagonal": 2.6152803897857666
+  },
+  {
+    "step": 193,
+    "loss": 3.0854644775390625,
+    "diagonal": 3.0854644775390625
+  },
+  {
+    "step": 194,
+    "loss": 3.0651869773864746,
+    "diagonal": 3.0651869773864746
+  },
+  {
+    "step": 195,
+    "loss": 3.062260150909424,
+    "diagonal": 3.062260150909424
+  },
+  {
+    "step": 196,
+    "loss": 2.1973211765289307,
+    "diagonal": 2.1973211765289307
+  },
+  {
+    "step": 197,
+    "loss": 2.2911529541015625,
+    "diagonal": 2.2911529541015625
+  },
+  {
+    "step": 198,
+    "loss": 2.17130708694458,
+    "diagonal": 2.17130708694458
+  },
+  {
+    "step": 199,
+    "loss": 2.877288579940796,
+    "diagonal": 2.877288579940796
+  },
+  {
+    "step": 200,
+    "loss": 2.578622817993164,
+    "diagonal": 2.578622817993164
+  },
+  {
+    "step": 201,
+    "loss": 2.763925075531006,
+    "diagonal": 2.763925075531006
+  },
+  {
+    "step": 202,
+    "loss": 3.1008312702178955,
+    "diagonal": 3.1008312702178955
+  },
+  {
+    "step": 203,
+    "loss": 2.6838903427124023,
+    "diagonal": 2.6838903427124023
+  },
+  {
+    "step": 204,
+    "loss": 2.754502058029175,
+    "diagonal": 2.754502058029175
+  },
+  {
+    "step": 205,
+    "loss": 2.5738470554351807,
+    "diagonal": 2.5738470554351807
+  },
+  {
+    "step": 206,
+    "loss": 2.0295777320861816,
+    "diagonal": 2.0295777320861816
+  },
+  {
+    "step": 207,
+    "loss": 2.9621617794036865,
+    "diagonal": 2.9621617794036865
+  },
+  {
+    "step": 208,
+    "loss": 2.836729049682617,
+    "diagonal": 2.836729049682617
+  },
+  {
+    "step": 209,
+    "loss": 3.0909950733184814,
+    "diagonal": 3.0909950733184814
+  },
+  {
+    "step": 210,
+    "loss": 2.9521868228912354,
+    "diagonal": 2.9521868228912354
+  },
+  {
+    "step": 211,
+    "loss": 3.25711989402771,
+    "diagonal": 3.25711989402771
+  },
+  {
+    "step": 212,
+    "loss": 2.802520751953125,
+    "diagonal": 2.802520751953125
+  },
+  {
+    "step": 213,
+    "loss": 2.2989649772644043,
+    "diagonal": 2.2989649772644043
+  },
+  {
+    "step": 214,
+    "loss": 2.3911306858062744,
+    "diagonal": 2.3911306858062744
+  },
+  {
+    "step": 215,
+    "loss": 2.3632760047912598,
+    "diagonal": 2.3632760047912598
+  },
+  {
+    "step": 216,
+    "loss": 2.3578171730041504,
+    "diagonal": 2.3578171730041504
+  },
+  {
+    "step": 217,
+    "loss": 2.611440420150757,
+    "diagonal": 2.611440420150757
+  },
+  {
+    "step": 218,
+    "loss": 2.0135507583618164,
+    "diagonal": 2.0135507583618164
+  },
+  {
+    "step": 219,
+    "loss": 3.0303475856781006,
+    "diagonal": 3.0303475856781006
+  },
+  {
+    "step": 220,
+    "loss": 2.1588966846466064,
+    "diagonal": 2.1588966846466064
+  },
+  {
+    "step": 221,
+    "loss": 2.3835561275482178,
+    "diagonal": 2.3835561275482178
+  },
+  {
+    "step": 222,
+    "loss": 2.365422010421753,
+    "diagonal": 2.365422010421753
+  },
+  {
+    "step": 223,
+    "loss": 2.2092888355255127,
+    "diagonal": 2.2092888355255127
+  },
+  {
+    "step": 224,
+    "loss": 2.846055507659912,
+    "diagonal": 2.846055507659912
+  },
+  {
+    "step": 225,
+    "loss": 3.00839900970459,
+    "diagonal": 3.00839900970459
+  },
+  {
+    "step": 226,
+    "loss": 2.424142837524414,
+    "diagonal": 2.424142837524414
+  },
+  {
+    "step": 227,
+    "loss": 2.65916109085083,
+    "diagonal": 2.65916109085083
+  },
+  {
+    "step": 228,
+    "loss": 3.050374746322632,
+    "diagonal": 3.050374746322632
+  },
+  {
+    "step": 229,
+    "loss": 3.468303680419922,
+    "diagonal": 3.468303680419922
+  },
+  {
+    "step": 230,
+    "loss": 3.123563051223755,
+    "diagonal": 3.123563051223755
+  },
+  {
+    "step": 231,
+    "loss": 2.875823736190796,
+    "diagonal": 2.875823736190796
+  },
+  {
+    "step": 232,
+    "loss": 2.815274953842163,
+    "diagonal": 2.815274953842163
+  },
+  {
+    "step": 233,
+    "loss": 2.7984519004821777,
+    "diagonal": 2.7984519004821777
+  },
+  {
+    "step": 234,
+    "loss": 2.465291976928711,
+    "diagonal": 2.465291976928711
+  },
+  {
+    "step": 235,
+    "loss": 3.591860294342041,
+    "diagonal": 3.591860294342041
+  },
+  {
+    "step": 236,
+    "loss": 2.8899998664855957,
+    "diagonal": 2.8899998664855957
+  },
+  {
+    "step": 237,
+    "loss": 3.233903169631958,
+    "diagonal": 3.233903169631958
+  },
+  {
+    "step": 238,
+    "loss": 2.4339373111724854,
+    "diagonal": 2.4339373111724854
+  },
+  {
+    "step": 239,
+    "loss": 2.619418144226074,
+    "diagonal": 2.619418144226074
+  },
+  {
+    "step": 240,
+    "loss": 3.1350741386413574,
+    "diagonal": 3.1350741386413574
+  },
+  {
+    "step": 241,
+    "loss": 2.7541463375091553,
+    "diagonal": 2.7541463375091553
+  },
+  {
+    "step": 242,
+    "loss": 2.321298599243164,
+    "diagonal": 2.321298599243164
+  },
+  {
+    "step": 243,
+    "loss": 3.0070436000823975,
+    "diagonal": 3.0070436000823975
+  },
+  {
+    "step": 244,
+    "loss": 2.2858009338378906,
+    "diagonal": 2.2858009338378906
+  },
+  {
+    "step": 245,
+    "loss": 2.8445541858673096,
+    "diagonal": 2.8445541858673096
+  },
+  {
+    "step": 246,
+    "loss": 2.4375009536743164,
+    "diagonal": 2.4375009536743164
+  },
+  {
+    "step": 247,
+    "loss": 2.384930372238159,
+    "diagonal": 2.384930372238159
+  },
+  {
+    "step": 248,
+    "loss": 2.4598050117492676,
+    "diagonal": 2.4598050117492676
+  },
+  {
+    "step": 249,
+    "loss": 3.000308036804199,
+    "diagonal": 3.000308036804199
+  },
+  {
+    "step": 250,
+    "loss": 2.1328470706939697,
+    "diagonal": 2.1328470706939697
+  },
+  {
+    "step": 251,
+    "loss": 2.5604913234710693,
+    "diagonal": 2.5604913234710693
+  },
+  {
+    "step": 252,
+    "loss": 2.407003402709961,
+    "diagonal": 2.407003402709961
+  },
+  {
+    "step": 253,
+    "loss": 3.0906736850738525,
+    "diagonal": 3.0906736850738525
+  },
+  {
+    "step": 254,
+    "loss": 2.6120011806488037,
+    "diagonal": 2.6120011806488037
+  },
+  {
+    "step": 255,
+    "loss": 2.8960487842559814,
+    "diagonal": 2.8960487842559814
+  },
+  {
+    "step": 256,
+    "loss": 2.9932432174682617,
+    "diagonal": 2.9932432174682617
+  },
+  {
+    "step": 257,
+    "loss": 2.959514617919922,
+    "diagonal": 2.959514617919922
+  },
+  {
+    "step": 258,
+    "loss": 2.5693442821502686,
+    "diagonal": 2.5693442821502686
+  },
+  {
+    "step": 259,
+    "loss": 2.5485246181488037,
+    "diagonal": 2.5485246181488037
+  },
+  {
+    "step": 260,
+    "loss": 2.9597747325897217,
+    "diagonal": 2.9597747325897217
+  },
+  {
+    "step": 261,
+    "loss": 3.139350652694702,
+    "diagonal": 3.139350652694702
+  },
+  {
+    "step": 262,
+    "loss": 2.1854805946350098,
+    "diagonal": 2.1854805946350098
+  },
+  {
+    "step": 263,
+    "loss": 2.614201545715332,
+    "diagonal": 2.614201545715332
+  },
+  {
+    "step": 264,
+    "loss": 2.298342227935791,
+    "diagonal": 2.298342227935791
+  },
+  {
+    "step": 265,
+    "loss": 2.608518600463867,
+    "diagonal": 2.608518600463867
+  },
+  {
+    "step": 266,
+    "loss": 2.9840404987335205,
+    "diagonal": 2.9840404987335205
+  },
+  {
+    "step": 267,
+    "loss": 2.4747273921966553,
+    "diagonal": 2.4747273921966553
+  },
+  {
+    "step": 268,
+    "loss": 2.805720567703247,
+    "diagonal": 2.805720567703247
+  },
+  {
+    "step": 269,
+    "loss": 2.3453118801116943,
+    "diagonal": 2.3453118801116943
+  },
+  {
+    "step": 270,
+    "loss": 2.544576644897461,
+    "diagonal": 2.544576644897461
+  },
+  {
+    "step": 271,
+    "loss": 2.7962234020233154,
+    "diagonal": 2.7962234020233154
+  },
+  {
+    "step": 272,
+    "loss": 2.02878475189209,
+    "diagonal": 2.02878475189209
+  },
+  {
+    "step": 273,
+    "loss": 2.5377445220947266,
+    "diagonal": 2.5377445220947266
+  },
+  {
+    "step": 274,
+    "loss": 2.539750099182129,
+    "diagonal": 2.539750099182129
+  },
+  {
+    "step": 275,
+    "loss": 2.316021680831909,
+    "diagonal": 2.316021680831909
+  },
+  {
+    "step": 276,
+    "loss": 2.8193087577819824,
+    "diagonal": 2.8193087577819824
+  },
+  {
+    "step": 277,
+    "loss": 2.7136974334716797,
+    "diagonal": 2.7136974334716797
+  },
+  {
+    "step": 278,
+    "loss": 2.965078115463257,
+    "diagonal": 2.965078115463257
+  },
+  {
+    "step": 279,
+    "loss": 2.4512972831726074,
+    "diagonal": 2.4512972831726074
+  },
+  {
+    "step": 280,
+    "loss": 2.7718262672424316,
+    "diagonal": 2.7718262672424316
+  },
+  {
+    "step": 281,
+    "loss": 3.03421688079834,
+    "diagonal": 3.03421688079834
+  },
+  {
+    "step": 282,
+    "loss": 2.057283639907837,
+    "diagonal": 2.057283639907837
+  },
+  {
+    "step": 283,
+    "loss": 2.7213962078094482,
+    "diagonal": 2.7213962078094482
+  },
+  {
+    "step": 284,
+    "loss": 2.364745616912842,
+    "diagonal": 2.364745616912842
+  },
+  {
+    "step": 285,
+    "loss": 2.7134337425231934,
+    "diagonal": 2.7134337425231934
+  },
+  {
+    "step": 286,
+    "loss": 2.639509916305542,
+    "diagonal": 2.639509916305542
+  },
+  {
+    "step": 287,
+    "loss": 2.864023208618164,
+    "diagonal": 2.864023208618164
+  },
+  {
+    "step": 288,
+    "loss": 2.6124932765960693,
+    "diagonal": 2.6124932765960693
+  },
+  {
+    "step": 289,
+    "loss": 2.822211265563965,
+    "diagonal": 2.822211265563965
+  },
+  {
+    "step": 290,
+    "loss": 2.2118470668792725,
+    "diagonal": 2.2118470668792725
+  },
+  {
+    "step": 291,
+    "loss": 2.906317710876465,
+    "diagonal": 2.906317710876465
+  },
+  {
+    "step": 292,
+    "loss": 2.5515034198760986,
+    "diagonal": 2.5515034198760986
+  },
+  {
+    "step": 293,
+    "loss": 2.7370264530181885,
+    "diagonal": 2.7370264530181885
+  },
+  {
+    "step": 294,
+    "loss": 3.1598660945892334,
+    "diagonal": 3.1598660945892334
+  },
+  {
+    "step": 295,
+    "loss": 2.2287514209747314,
+    "diagonal": 2.2287514209747314
+  },
+  {
+    "step": 296,
+    "loss": 2.1892690658569336,
+    "diagonal": 2.1892690658569336
+  },
+  {
+    "step": 297,
+    "loss": 2.4771673679351807,
+    "diagonal": 2.4771673679351807
+  },
+  {
+    "step": 298,
+    "loss": 2.776715040206909,
+    "diagonal": 2.776715040206909
+  },
+  {
+    "step": 299,
+    "loss": 2.1198322772979736,
+    "diagonal": 2.1198322772979736
+  },
+  {
+    "step": 300,
+    "loss": 2.7929630279541016,
+    "diagonal": 2.7929630279541016
+  },
+  {
+    "step": 301,
+    "loss": 2.947385787963867,
+    "diagonal": 2.947385787963867
+  },
+  {
+    "step": 302,
+    "loss": 2.820801258087158,
+    "diagonal": 2.820801258087158
+  },
+  {
+    "step": 303,
+    "loss": 2.6626944541931152,
+    "diagonal": 2.6626944541931152
+  },
+  {
+    "step": 304,
+    "loss": 2.6162543296813965,
+    "diagonal": 2.6162543296813965
+  },
+  {
+    "step": 305,
+    "loss": 2.1423377990722656,
+    "diagonal": 2.1423377990722656
+  },
+  {
+    "step": 306,
+    "loss": 3.156432628631592,
+    "diagonal": 3.156432628631592
+  },
+  {
+    "step": 307,
+    "loss": 2.7144179344177246,
+    "diagonal": 2.7144179344177246
+  },
+  {
+    "step": 308,
+    "loss": 2.5314722061157227,
+    "diagonal": 2.5314722061157227
+  },
+  {
+    "step": 309,
+    "loss": 2.296515464782715,
+    "diagonal": 2.296515464782715
+  },
+  {
+    "step": 310,
+    "loss": 2.774486780166626,
+    "diagonal": 2.774486780166626
+  },
+  {
+    "step": 311,
+    "loss": 2.160914182662964,
+    "diagonal": 2.160914182662964
+  },
+  {
+    "step": 312,
+    "loss": 2.5892271995544434,
+    "diagonal": 2.5892271995544434
+  },
+  {
+    "step": 313,
+    "loss": 2.3271539211273193,
+    "diagonal": 2.3271539211273193
+  },
+  {
+    "step": 314,
+    "loss": 2.9801578521728516,
+    "diagonal": 2.9801578521728516
+  },
+  {
+    "step": 315,
+    "loss": 2.471625804901123,
+    "diagonal": 2.471625804901123
+  },
+  {
+    "step": 316,
+    "loss": 2.412132501602173,
+    "diagonal": 2.412132501602173
+  },
+  {
+    "step": 317,
+    "loss": 3.077190637588501,
+    "diagonal": 3.077190637588501
+  },
+  {
+    "step": 318,
+    "loss": 2.3928561210632324,
+    "diagonal": 2.3928561210632324
+  },
+  {
+    "step": 319,
+    "loss": 2.3554959297180176,
+    "diagonal": 2.3554959297180176
+  },
+  {
+    "step": 320,
+    "loss": 2.5881404876708984,
+    "diagonal": 2.5881404876708984
+  },
+  {
+    "step": 321,
+    "loss": 2.3758602142333984,
+    "diagonal": 2.3758602142333984
+  },
+  {
+    "step": 322,
+    "loss": 2.858229160308838,
+    "diagonal": 2.858229160308838
+  },
+  {
+    "step": 323,
+    "loss": 2.534168004989624,
+    "diagonal": 2.534168004989624
+  },
+  {
+    "step": 324,
+    "loss": 2.6581408977508545,
+    "diagonal": 2.6581408977508545
+  },
+  {
+    "step": 325,
+    "loss": 2.5303640365600586,
+    "diagonal": 2.5303640365600586
+  },
+  {
+    "step": 326,
+    "loss": 2.6163651943206787,
+    "diagonal": 2.6163651943206787
+  },
+  {
+    "step": 327,
+    "loss": 1.959957242012024,
+    "diagonal": 1.959957242012024
+  },
+  {
+    "step": 328,
+    "loss": 2.7637462615966797,
+    "diagonal": 2.7637462615966797
+  },
+  {
+    "step": 329,
+    "loss": 2.9630370140075684,
+    "diagonal": 2.9630370140075684
+  },
+  {
+    "step": 330,
+    "loss": 2.591641426086426,
+    "diagonal": 2.591641426086426
+  },
+  {
+    "step": 331,
+    "loss": 1.951819658279419,
+    "diagonal": 1.951819658279419
+  },
+  {
+    "step": 332,
+    "loss": 3.1184608936309814,
+    "diagonal": 3.1184608936309814
+  },
+  {
+    "step": 333,
+    "loss": 2.504448890686035,
+    "diagonal": 2.504448890686035
+  },
+  {
+    "step": 334,
+    "loss": 2.5847508907318115,
+    "diagonal": 2.5847508907318115
+  },
+  {
+    "step": 335,
+    "loss": 2.1795120239257812,
+    "diagonal": 2.1795120239257812
+  },
+  {
+    "step": 336,
+    "loss": 2.5257792472839355,
+    "diagonal": 2.5257792472839355
+  },
+  {
+    "step": 337,
+    "loss": 2.1661863327026367,
+    "diagonal": 2.1661863327026367
+  },
+  {
+    "step": 338,
+    "loss": 1.870802640914917,
+    "diagonal": 1.870802640914917
+  },
+  {
+    "step": 339,
+    "loss": 2.841338872909546,
+    "diagonal": 2.841338872909546
+  },
+  {
+    "step": 340,
+    "loss": 3.040787935256958,
+    "diagonal": 3.040787935256958
+  },
+  {
+    "step": 341,
+    "loss": 2.973292350769043,
+    "diagonal": 2.973292350769043
+  },
+  {
+    "step": 342,
+    "loss": 2.3639984130859375,
+    "diagonal": 2.3639984130859375
+  },
+  {
+    "step": 343,
+    "loss": 2.1364057064056396,
+    "diagonal": 2.1364057064056396
+  },
+  {
+    "step": 344,
+    "loss": 3.170130729675293,
+    "diagonal": 3.170130729675293
+  },
+  {
+    "step": 345,
+    "loss": 2.7292327880859375,
+    "diagonal": 2.7292327880859375
+  },
+  {
+    "step": 346,
+    "loss": 3.0870800018310547,
+    "diagonal": 3.0870800018310547
+  },
+  {
+    "step": 347,
+    "loss": 2.210883378982544,
+    "diagonal": 2.210883378982544
+  },
+  {
+    "step": 348,
+    "loss": 2.3533034324645996,
+    "diagonal": 2.3533034324645996
+  },
+  {
+    "step": 349,
+    "loss": 2.2828116416931152,
+    "diagonal": 2.2828116416931152
+  },
+  {
+    "step": 350,
+    "loss": 2.294475793838501,
+    "diagonal": 2.294475793838501
+  },
+  {
+    "step": 351,
+    "loss": 2.6536457538604736,
+    "diagonal": 2.6536457538604736
+  },
+  {
+    "step": 352,
+    "loss": 2.330690383911133,
+    "diagonal": 2.330690383911133
+  },
+  {
+    "step": 353,
+    "loss": 2.356545925140381,
+    "diagonal": 2.356545925140381
+  },
+  {
+    "step": 354,
+    "loss": 2.3686349391937256,
+    "diagonal": 2.3686349391937256
+  },
+  {
+    "step": 355,
+    "loss": 2.4931750297546387,
+    "diagonal": 2.4931750297546387
+  },
+  {
+    "step": 356,
+    "loss": 2.3811051845550537,
+    "diagonal": 2.3811051845550537
+  },
+  {
+    "step": 357,
+    "loss": 2.5438194274902344,
+    "diagonal": 2.5438194274902344
+  },
+  {
+    "step": 358,
+    "loss": 2.1439437866210938,
+    "diagonal": 2.1439437866210938
+  },
+  {
+    "step": 359,
+    "loss": 2.097500801086426,
+    "diagonal": 2.097500801086426
+  },
+  {
+    "step": 360,
+    "loss": 1.948765754699707,
+    "diagonal": 1.948765754699707
+  },
+  {
+    "step": 361,
+    "loss": 2.6703667640686035,
+    "diagonal": 2.6703667640686035
+  },
+  {
+    "step": 362,
+    "loss": 2.798196792602539,
+    "diagonal": 2.798196792602539
+  },
+  {
+    "step": 363,
+    "loss": 2.0277013778686523,
+    "diagonal": 2.0277013778686523
+  },
+  {
+    "step": 364,
+    "loss": 2.4919917583465576,
+    "diagonal": 2.4919917583465576
+  },
+  {
+    "step": 365,
+    "loss": 2.4291911125183105,
+    "diagonal": 2.4291911125183105
+  },
+  {
+    "step": 366,
+    "loss": 2.8751845359802246,
+    "diagonal": 2.8751845359802246
+  },
+  {
+    "step": 367,
+    "loss": 2.486759901046753,
+    "diagonal": 2.486759901046753
+  },
+  {
+    "step": 368,
+    "loss": 2.3286759853363037,
+    "diagonal": 2.3286759853363037
+  },
+  {
+    "step": 369,
+    "loss": 2.650007724761963,
+    "diagonal": 2.650007724761963
+  },
+  {
+    "step": 370,
+    "loss": 2.2563469409942627,
+    "diagonal": 2.2563469409942627
+  },
+  {
+    "step": 371,
+    "loss": 2.5313079357147217,
+    "diagonal": 2.5313079357147217
+  },
+  {
+    "step": 372,
+    "loss": 2.3408637046813965,
+    "diagonal": 2.3408637046813965
+  },
+  {
+    "step": 373,
+    "loss": 2.3552048206329346,
+    "diagonal": 2.3552048206329346
+  },
+  {
+    "step": 374,
+    "loss": 1.9531521797180176,
+    "diagonal": 1.9531521797180176
+  },
+  {
+    "step": 375,
+    "loss": 2.385242223739624,
+    "diagonal": 2.385242223739624
+  },
+  {
+    "step": 376,
+    "loss": 2.0202012062072754,
+    "diagonal": 2.0202012062072754
+  },
+  {
+    "step": 377,
+    "loss": 3.0155491828918457,
+    "diagonal": 3.0155491828918457
+  },
+  {
+    "step": 378,
+    "loss": 1.8683615922927856,
+    "diagonal": 1.8683615922927856
+  },
+  {
+    "step": 379,
+    "loss": 2.730496883392334,
+    "diagonal": 2.730496883392334
+  },
+  {
+    "step": 380,
+    "loss": 2.5795798301696777,
+    "diagonal": 2.5795798301696777
+  },
+  {
+    "step": 381,
+    "loss": 2.3370211124420166,
+    "diagonal": 2.3370211124420166
+  },
+  {
+    "step": 382,
+    "loss": 2.051016092300415,
+    "diagonal": 2.051016092300415
+  },
+  {
+    "step": 383,
+    "loss": 2.3651719093322754,
+    "diagonal": 2.3651719093322754
+  },
+  {
+    "step": 384,
+    "loss": 2.269071102142334,
+    "diagonal": 2.269071102142334
+  },
+  {
+    "step": 385,
+    "loss": 2.9150145053863525,
+    "diagonal": 2.9150145053863525
+  },
+  {
+    "step": 386,
+    "loss": 2.314084768295288,
+    "diagonal": 2.314084768295288
+  },
+  {
+    "step": 387,
+    "loss": 2.203941822052002,
+    "diagonal": 2.203941822052002
+  },
+  {
+    "step": 388,
+    "loss": 2.459775924682617,
+    "diagonal": 2.459775924682617
+  },
+  {
+    "step": 389,
+    "loss": 2.120778799057007,
+    "diagonal": 2.120778799057007
+  },
+  {
+    "step": 390,
+    "loss": 2.5368852615356445,
+    "diagonal": 2.5368852615356445
+  },
+  {
+    "step": 391,
+    "loss": 2.7503960132598877,
+    "diagonal": 2.7503960132598877
+  },
+  {
+    "step": 392,
+    "loss": 2.323734998703003,
+    "diagonal": 2.323734998703003
+  },
+  {
+    "step": 393,
+    "loss": 2.8268399238586426,
+    "diagonal": 2.8268399238586426
+  },
+  {
+    "step": 394,
+    "loss": 2.284104585647583,
+    "diagonal": 2.284104585647583
+  },
+  {
+    "step": 395,
+    "loss": 2.930692672729492,
+    "diagonal": 2.930692672729492
+  },
+  {
+    "step": 396,
+    "loss": 2.2757010459899902,
+    "diagonal": 2.2757010459899902
+  },
+  {
+    "step": 397,
+    "loss": 2.601962089538574,
+    "diagonal": 2.601962089538574
+  },
+  {
+    "step": 398,
+    "loss": 2.544767379760742,
+    "diagonal": 2.544767379760742
+  },
+  {
+    "step": 399,
+    "loss": 2.4444892406463623,
+    "diagonal": 2.4444892406463623
+  },
+  {
+    "step": 400,
+    "loss": 2.519465923309326,
+    "diagonal": 2.519465923309326
+  },
+  {
+    "step": 401,
+    "loss": 2.7695648670196533,
+    "diagonal": 2.7695648670196533
+  },
+  {
+    "step": 402,
+    "loss": 2.535677909851074,
+    "diagonal": 2.535677909851074
+  },
+  {
+    "step": 403,
+    "loss": 2.2869997024536133,
+    "diagonal": 2.2869997024536133
+  },
+  {
+    "step": 404,
+    "loss": 2.734858989715576,
+    "diagonal": 2.734858989715576
+  },
+  {
+    "step": 405,
+    "loss": 2.5606043338775635,
+    "diagonal": 2.5606043338775635
+  },
+  {
+    "step": 406,
+    "loss": 2.5902771949768066,
+    "diagonal": 2.5902771949768066
+  },
+  {
+    "step": 407,
+    "loss": 2.071711301803589,
+    "diagonal": 2.071711301803589
+  },
+  {
+    "step": 408,
+    "loss": 2.3208706378936768,
+    "diagonal": 2.3208706378936768
+  },
+  {
+    "step": 409,
+    "loss": 2.426178455352783,
+    "diagonal": 2.426178455352783
+  },
+  {
+    "step": 410,
+    "loss": 2.368302822113037,
+    "diagonal": 2.368302822113037
+  },
+  {
+    "step": 411,
+    "loss": 2.8010544776916504,
+    "diagonal": 2.8010544776916504
+  },
+  {
+    "step": 412,
+    "loss": 2.4780209064483643,
+    "diagonal": 2.4780209064483643
+  },
+  {
+    "step": 413,
+    "loss": 2.204986095428467,
+    "diagonal": 2.204986095428467
+  },
+  {
+    "step": 414,
+    "loss": 2.6150360107421875,
+    "diagonal": 2.6150360107421875
+  },
+  {
+    "step": 415,
+    "loss": 2.569836139678955,
+    "diagonal": 2.569836139678955
+  },
+  {
+    "step": 416,
+    "loss": 2.2033214569091797,
+    "diagonal": 2.2033214569091797
+  },
+  {
+    "step": 417,
+    "loss": 2.293917179107666,
+    "diagonal": 2.293917179107666
+  },
+  {
+    "step": 418,
+    "loss": 2.6978702545166016,
+    "diagonal": 2.6978702545166016
+  },
+  {
+    "step": 419,
+    "loss": 2.024690628051758,
+    "diagonal": 2.024690628051758
+  },
+  {
+    "step": 420,
+    "loss": 1.9185409545898438,
+    "diagonal": 1.9185409545898438
+  },
+  {
+    "step": 421,
+    "loss": 1.901416540145874,
+    "diagonal": 1.901416540145874
+  },
+  {
+    "step": 422,
+    "loss": 2.376030445098877,
+    "diagonal": 2.376030445098877
+  },
+  {
+    "step": 423,
+    "loss": 2.3764872550964355,
+    "diagonal": 2.3764872550964355
+  },
+  {
+    "step": 424,
+    "loss": 2.2065465450286865,
+    "diagonal": 2.2065465450286865
+  },
+  {
+    "step": 425,
+    "loss": 1.885845422744751,
+    "diagonal": 1.885845422744751
+  },
+  {
+    "step": 426,
+    "loss": 2.0240743160247803,
+    "diagonal": 2.0240743160247803
+  },
+  {
+    "step": 427,
+    "loss": 2.2583138942718506,
+    "diagonal": 2.2583138942718506
+  },
+  {
+    "step": 428,
+    "loss": 2.2090229988098145,
+    "diagonal": 2.2090229988098145
+  },
+  {
+    "step": 429,
+    "loss": 2.2476084232330322,
+    "diagonal": 2.2476084232330322
+  },
+  {
+    "step": 430,
+    "loss": 2.316814422607422,
+    "diagonal": 2.316814422607422
+  },
+  {
+    "step": 431,
+    "loss": 2.134904384613037,
+    "diagonal": 2.134904384613037
+  },
+  {
+    "step": 432,
+    "loss": 2.4820008277893066,
+    "diagonal": 2.4820008277893066
+  },
+  {
+    "step": 433,
+    "loss": 2.0759732723236084,
+    "diagonal": 2.0759732723236084
+  },
+  {
+    "step": 434,
+    "loss": 2.222262144088745,
+    "diagonal": 2.222262144088745
+  },
+  {
+    "step": 435,
+    "loss": 2.251136541366577,
+    "diagonal": 2.251136541366577
+  },
+  {
+    "step": 436,
+    "loss": 2.6798453330993652,
+    "diagonal": 2.6798453330993652
+  },
+  {
+    "step": 437,
+    "loss": 2.310671806335449,
+    "diagonal": 2.310671806335449
+  },
+  {
+    "step": 438,
+    "loss": 2.3624801635742188,
+    "diagonal": 2.3624801635742188
+  },
+  {
+    "step": 439,
+    "loss": 1.8689035177230835,
+    "diagonal": 1.8689035177230835
+  },
+  {
+    "step": 440,
+    "loss": 2.2233965396881104,
+    "diagonal": 2.2233965396881104
+  },
+  {
+    "step": 441,
+    "loss": 1.8515264987945557,
+    "diagonal": 1.8515264987945557
+  },
+  {
+    "step": 442,
+    "loss": 2.5921318531036377,
+    "diagonal": 2.5921318531036377
+  },
+  {
+    "step": 443,
+    "loss": 2.5083634853363037,
+    "diagonal": 2.5083634853363037
+  },
+  {
+    "step": 444,
+    "loss": 2.2118022441864014,
+    "diagonal": 2.2118022441864014
+  },
+  {
+    "step": 445,
+    "loss": 2.6380019187927246,
+    "diagonal": 2.6380019187927246
+  },
+  {
+    "step": 446,
+    "loss": 2.140806198120117,
+    "diagonal": 2.140806198120117
+  },
+  {
+    "step": 447,
+    "loss": 2.686286211013794,
+    "diagonal": 2.686286211013794
+  },
+  {
+    "step": 448,
+    "loss": 2.3787953853607178,
+    "diagonal": 2.3787953853607178
+  },
+  {
+    "step": 449,
+    "loss": 2.205317497253418,
+    "diagonal": 2.205317497253418
+  },
+  {
+    "step": 450,
+    "loss": 2.0804481506347656,
+    "diagonal": 2.0804481506347656
+  },
+  {
+    "step": 451,
+    "loss": 2.417571783065796,
+    "diagonal": 2.417571783065796
+  },
+  {
+    "step": 452,
+    "loss": 1.940251350402832,
+    "diagonal": 1.940251350402832
+  },
+  {
+    "step": 453,
+    "loss": 2.4458181858062744,
+    "diagonal": 2.4458181858062744
+  },
+  {
+    "step": 454,
+    "loss": 1.9642741680145264,
+    "diagonal": 1.9642741680145264
+  },
+  {
+    "step": 455,
+    "loss": 2.359781265258789,
+    "diagonal": 2.359781265258789
+  },
+  {
+    "step": 456,
+    "loss": 2.4934194087982178,
+    "diagonal": 2.4934194087982178
+  },
+  {
+    "step": 457,
+    "loss": 2.8263392448425293,
+    "diagonal": 2.8263392448425293
+  },
+  {
+    "step": 458,
+    "loss": 1.8227168321609497,
+    "diagonal": 1.8227168321609497
+  },
+  {
+    "step": 459,
+    "loss": 2.6996686458587646,
+    "diagonal": 2.6996686458587646
+  },
+  {
+    "step": 460,
+    "loss": 1.777098536491394,
+    "diagonal": 1.777098536491394
+  },
+  {
+    "step": 461,
+    "loss": 2.0497920513153076,
+    "diagonal": 2.0497920513153076
+  },
+  {
+    "step": 462,
+    "loss": 2.8322651386260986,
+    "diagonal": 2.8322651386260986
+  },
+  {
+    "step": 463,
+    "loss": 2.4379000663757324,
+    "diagonal": 2.4379000663757324
+  },
+  {
+    "step": 464,
+    "loss": 2.5994327068328857,
+    "diagonal": 2.5994327068328857
+  },
+  {
+    "step": 465,
+    "loss": 2.4286293983459473,
+    "diagonal": 2.4286293983459473
+  },
+  {
+    "step": 466,
+    "loss": 2.4965970516204834,
+    "diagonal": 2.4965970516204834
+  },
+  {
+    "step": 467,
+    "loss": 2.5646626949310303,
+    "diagonal": 2.5646626949310303
+  },
+  {
+    "step": 468,
+    "loss": 2.6757116317749023,
+    "diagonal": 2.6757116317749023
+  },
+  {
+    "step": 469,
+    "loss": 2.525010824203491,
+    "diagonal": 2.525010824203491
+  },
+  {
+    "step": 470,
+    "loss": 2.7200679779052734,
+    "diagonal": 2.7200679779052734
+  },
+  {
+    "step": 471,
+    "loss": 2.5570006370544434,
+    "diagonal": 2.5570006370544434
+  },
+  {
+    "step": 472,
+    "loss": 1.938812017440796,
+    "diagonal": 1.938812017440796
+  },
+  {
+    "step": 473,
+    "loss": 2.4102654457092285,
+    "diagonal": 2.4102654457092285
+  },
+  {
+    "step": 474,
+    "loss": 1.9537252187728882,
+    "diagonal": 1.9537252187728882
+  },
+  {
+    "step": 475,
+    "loss": 2.6765153408050537,
+    "diagonal": 2.6765153408050537
+  },
+  {
+    "step": 476,
+    "loss": 2.495410680770874,
+    "diagonal": 2.495410680770874
+  },
+  {
+    "step": 477,
+    "loss": 2.9544029235839844,
+    "diagonal": 2.9544029235839844
+  },
+  {
+    "step": 478,
+    "loss": 2.2635419368743896,
+    "diagonal": 2.2635419368743896
+  },
+  {
+    "step": 479,
+    "loss": 1.803313970565796,
+    "diagonal": 1.803313970565796
+  },
+  {
+    "step": 480,
+    "loss": 2.22306489944458,
+    "diagonal": 2.22306489944458
+  },
+  {
+    "step": 481,
+    "loss": 2.162999391555786,
+    "diagonal": 2.162999391555786
+  },
+  {
+    "step": 482,
+    "loss": 2.644319534301758,
+    "diagonal": 2.644319534301758
+  },
+  {
+    "step": 483,
+    "loss": 2.0709259510040283,
+    "diagonal": 2.0709259510040283
+  },
+  {
+    "step": 484,
+    "loss": 2.20365309715271,
+    "diagonal": 2.20365309715271
+  },
+  {
+    "step": 485,
+    "loss": 2.1432862281799316,
+    "diagonal": 2.1432862281799316
+  },
+  {
+    "step": 486,
+    "loss": 2.394937515258789,
+    "diagonal": 2.394937515258789
+  },
+  {
+    "step": 487,
+    "loss": 1.809800148010254,
+    "diagonal": 1.809800148010254
+  },
+  {
+    "step": 488,
+    "loss": 2.7102553844451904,
+    "diagonal": 2.7102553844451904
+  },
+  {
+    "step": 489,
+    "loss": 2.1654627323150635,
+    "diagonal": 2.1654627323150635
+  },
+  {
+    "step": 490,
+    "loss": 2.719970226287842,
+    "diagonal": 2.719970226287842
+  },
+  {
+    "step": 491,
+    "loss": 2.2715954780578613,
+    "diagonal": 2.2715954780578613
+  },
+  {
+    "step": 492,
+    "loss": 2.4320051670074463,
+    "diagonal": 2.4320051670074463
+  },
+  {
+    "step": 493,
+    "loss": 2.47289776802063,
+    "diagonal": 2.47289776802063
+  },
+  {
+    "step": 494,
+    "loss": 2.4320855140686035,
+    "diagonal": 2.4320855140686035
+  },
+  {
+    "step": 495,
+    "loss": 2.254634141921997,
+    "diagonal": 2.254634141921997
+  },
+  {
+    "step": 496,
+    "loss": 2.869704008102417,
+    "diagonal": 2.869704008102417
+  },
+  {
+    "step": 497,
+    "loss": 2.532266616821289,
+    "diagonal": 2.532266616821289
+  },
+  {
+    "step": 498,
+    "loss": 2.440246105194092,
+    "diagonal": 2.440246105194092
+  },
+  {
+    "step": 499,
+    "loss": 2.0100135803222656,
+    "diagonal": 2.0100135803222656
+  },
+  {
+    "step": 500,
+    "loss": 2.334827184677124,
+    "diagonal": 2.334827184677124
+  },
+  {
+    "step": 501,
+    "loss": 2.2060794830322266,
+    "diagonal": 2.2060794830322266
+  },
+  {
+    "step": 502,
+    "loss": 1.9999260902404785,
+    "diagonal": 1.9999260902404785
+  },
+  {
+    "step": 503,
+    "loss": 2.5185861587524414,
+    "diagonal": 2.5185861587524414
+  },
+  {
+    "step": 504,
+    "loss": 2.31067156791687,
+    "diagonal": 2.31067156791687
+  },
+  {
+    "step": 505,
+    "loss": 2.182509183883667,
+    "diagonal": 2.182509183883667
+  },
+  {
+    "step": 506,
+    "loss": 2.2273502349853516,
+    "diagonal": 2.2273502349853516
+  },
+  {
+    "step": 507,
+    "loss": 2.102839469909668,
+    "diagonal": 2.102839469909668
+  },
+  {
+    "step": 508,
+    "loss": 2.0385615825653076,
+    "diagonal": 2.0385615825653076
+  },
+  {
+    "step": 509,
+    "loss": 1.9411349296569824,
+    "diagonal": 1.9411349296569824
+  },
+  {
+    "step": 510,
+    "loss": 2.3909287452697754,
+    "diagonal": 2.3909287452697754
+  },
+  {
+    "step": 511,
+    "loss": 2.471893310546875,
+    "diagonal": 2.471893310546875
+  },
+  {
+    "step": 512,
+    "loss": 2.2603330612182617,
+    "diagonal": 2.2603330612182617
+  },
+  {
+    "step": 513,
+    "loss": 2.0381968021392822,
+    "diagonal": 2.0381968021392822
+  },
+  {
+    "step": 514,
+    "loss": 1.761939525604248,
+    "diagonal": 1.761939525604248
+  },
+  {
+    "step": 515,
+    "loss": 2.2788047790527344,
+    "diagonal": 2.2788047790527344
+  },
+  {
+    "step": 516,
+    "loss": 1.8310987949371338,
+    "diagonal": 1.8310987949371338
+  },
+  {
+    "step": 517,
+    "loss": 2.506380081176758,
+    "diagonal": 2.506380081176758
+  },
+  {
+    "step": 518,
+    "loss": 2.6439731121063232,
+    "diagonal": 2.6439731121063232
+  },
+  {
+    "step": 519,
+    "loss": 1.8406102657318115,
+    "diagonal": 1.8406102657318115
+  },
+  {
+    "step": 520,
+    "loss": 2.115565299987793,
+    "diagonal": 2.115565299987793
+  },
+  {
+    "step": 521,
+    "loss": 2.5038342475891113,
+    "diagonal": 2.5038342475891113
+  },
+  {
+    "step": 522,
+    "loss": 2.371829032897949,
+    "diagonal": 2.371829032897949
+  },
+  {
+    "step": 523,
+    "loss": 2.3765437602996826,
+    "diagonal": 2.3765437602996826
+  },
+  {
+    "step": 524,
+    "loss": 1.6947085857391357,
+    "diagonal": 1.6947085857391357
+  },
+  {
+    "step": 525,
+    "loss": 2.2526278495788574,
+    "diagonal": 2.2526278495788574
+  },
+  {
+    "step": 526,
+    "loss": 2.1528801918029785,
+    "diagonal": 2.1528801918029785
+  },
+  {
+    "step": 527,
+    "loss": 2.6126508712768555,
+    "diagonal": 2.6126508712768555
+  },
+  {
+    "step": 528,
+    "loss": 2.4591879844665527,
+    "diagonal": 2.4591879844665527
+  },
+  {
+    "step": 529,
+    "loss": 2.376840829849243,
+    "diagonal": 2.376840829849243
+  },
+  {
+    "step": 530,
+    "loss": 2.2392337322235107,
+    "diagonal": 2.2392337322235107
+  },
+  {
+    "step": 531,
+    "loss": 1.9292361736297607,
+    "diagonal": 1.9292361736297607
+  },
+  {
+    "step": 532,
+    "loss": 2.0089499950408936,
+    "diagonal": 2.0089499950408936
+  },
+  {
+    "step": 533,
+    "loss": 2.372446298599243,
+    "diagonal": 2.372446298599243
+  },
+  {
+    "step": 534,
+    "loss": 1.8981057405471802,
+    "diagonal": 1.8981057405471802
+  },
+  {
+    "step": 535,
+    "loss": 2.126054286956787,
+    "diagonal": 2.126054286956787
+  },
+  {
+    "step": 536,
+    "loss": 2.43430495262146,
+    "diagonal": 2.43430495262146
+  },
+  {
+    "step": 537,
+    "loss": 2.237797975540161,
+    "diagonal": 2.237797975540161
+  },
+  {
+    "step": 538,
+    "loss": 2.8435542583465576,
+    "diagonal": 2.8435542583465576
+  },
+  {
+    "step": 539,
+    "loss": 2.139444589614868,
+    "diagonal": 2.139444589614868
+  },
+  {
+    "step": 540,
+    "loss": 2.442709445953369,
+    "diagonal": 2.442709445953369
+  },
+  {
+    "step": 541,
+    "loss": 2.3113412857055664,
+    "diagonal": 2.3113412857055664
+  },
+  {
+    "step": 542,
+    "loss": 2.128322124481201,
+    "diagonal": 2.128322124481201
+  },
+  {
+    "step": 543,
+    "loss": 2.326047658920288,
+    "diagonal": 2.326047658920288
+  },
+  {
+    "step": 544,
+    "loss": 1.973818063735962,
+    "diagonal": 1.973818063735962
+  },
+  {
+    "step": 545,
+    "loss": 2.0975279808044434,
+    "diagonal": 2.0975279808044434
+  },
+  {
+    "step": 546,
+    "loss": 2.1324141025543213,
+    "diagonal": 2.1324141025543213
+  },
+  {
+    "step": 547,
+    "loss": 2.7699875831604004,
+    "diagonal": 2.7699875831604004
+  },
+  {
+    "step": 548,
+    "loss": 2.566066026687622,
+    "diagonal": 2.566066026687622
+  },
+  {
+    "step": 549,
+    "loss": 2.63130521774292,
+    "diagonal": 2.63130521774292
+  },
+  {
+    "step": 550,
+    "loss": 2.9935593605041504,
+    "diagonal": 2.9935593605041504
+  },
+  {
+    "step": 551,
+    "loss": 2.350905418395996,
+    "diagonal": 2.350905418395996
+  },
+  {
+    "step": 552,
+    "loss": 2.2310540676116943,
+    "diagonal": 2.2310540676116943
+  },
+  {
+    "step": 553,
+    "loss": 1.9168003797531128,
+    "diagonal": 1.9168003797531128
+  },
+  {
+    "step": 554,
+    "loss": 2.206772565841675,
+    "diagonal": 2.206772565841675
+  },
+  {
+    "step": 555,
+    "loss": 2.6383955478668213,
+    "diagonal": 2.6383955478668213
+  },
+  {
+    "step": 556,
+    "loss": 1.9248192310333252,
+    "diagonal": 1.9248192310333252
+  },
+  {
+    "step": 557,
+    "loss": 1.8401598930358887,
+    "diagonal": 1.8401598930358887
+  },
+  {
+    "step": 558,
+    "loss": 2.415344476699829,
+    "diagonal": 2.415344476699829
+  },
+  {
+    "step": 559,
+    "loss": 2.314849376678467,
+    "diagonal": 2.314849376678467
+  },
+  {
+    "step": 560,
+    "loss": 2.4018235206604004,
+    "diagonal": 2.4018235206604004
+  },
+  {
+    "step": 561,
+    "loss": 2.239661931991577,
+    "diagonal": 2.239661931991577
+  },
+  {
+    "step": 562,
+    "loss": 1.8675265312194824,
+    "diagonal": 1.8675265312194824
+  },
+  {
+    "step": 563,
+    "loss": 2.1583383083343506,
+    "diagonal": 2.1583383083343506
+  },
+  {
+    "step": 564,
+    "loss": 2.460236072540283,
+    "diagonal": 2.460236072540283
+  },
+  {
+    "step": 565,
+    "loss": 2.5957984924316406,
+    "diagonal": 2.5957984924316406
+  },
+  {
+    "step": 566,
+    "loss": 2.1696794033050537,
+    "diagonal": 2.1696794033050537
+  },
+  {
+    "step": 567,
+    "loss": 2.2690372467041016,
+    "diagonal": 2.2690372467041016
+  },
+  {
+    "step": 568,
+    "loss": 1.6935899257659912,
+    "diagonal": 1.6935899257659912
+  },
+  {
+    "step": 569,
+    "loss": 2.152951717376709,
+    "diagonal": 2.152951717376709
+  },
+  {
+    "step": 570,
+    "loss": 2.1162123680114746,
+    "diagonal": 2.1162123680114746
+  },
+  {
+    "step": 571,
+    "loss": 2.6212029457092285,
+    "diagonal": 2.6212029457092285
+  },
+  {
+    "step": 572,
+    "loss": 2.230719804763794,
+    "diagonal": 2.230719804763794
+  },
+  {
+    "step": 573,
+    "loss": 2.1365737915039062,
+    "diagonal": 2.1365737915039062
+  },
+  {
+    "step": 574,
+    "loss": 1.989514708518982,
+    "diagonal": 1.989514708518982
+  },
+  {
+    "step": 575,
+    "loss": 2.017305612564087,
+    "diagonal": 2.017305612564087
+  },
+  {
+    "step": 576,
+    "loss": 2.3688132762908936,
+    "diagonal": 2.3688132762908936
+  },
+  {
+    "step": 577,
+    "loss": 2.3386383056640625,
+    "diagonal": 2.3386383056640625
+  },
+  {
+    "step": 578,
+    "loss": 2.3373637199401855,
+    "diagonal": 2.3373637199401855
+  },
+  {
+    "step": 579,
+    "loss": 2.3387179374694824,
+    "diagonal": 2.3387179374694824
+  },
+  {
+    "step": 580,
+    "loss": 2.382002353668213,
+    "diagonal": 2.382002353668213
+  },
+  {
+    "step": 581,
+    "loss": 2.0338335037231445,
+    "diagonal": 2.0338335037231445
+  },
+  {
+    "step": 582,
+    "loss": 1.8962420225143433,
+    "diagonal": 1.8962420225143433
+  },
+  {
+    "step": 583,
+    "loss": 2.1034164428710938,
+    "diagonal": 2.1034164428710938
+  },
+  {
+    "step": 584,
+    "loss": 2.517570972442627,
+    "diagonal": 2.517570972442627
+  },
+  {
+    "step": 585,
+    "loss": 2.345383644104004,
+    "diagonal": 2.345383644104004
+  },
+  {
+    "step": 586,
+    "loss": 1.9489655494689941,
+    "diagonal": 1.9489655494689941
+  },
+  {
+    "step": 587,
+    "loss": 2.641500949859619,
+    "diagonal": 2.641500949859619
+  },
+  {
+    "step": 588,
+    "loss": 2.6002860069274902,
+    "diagonal": 2.6002860069274902
+  },
+  {
+    "step": 589,
+    "loss": 2.006504774093628,
+    "diagonal": 2.006504774093628
+  },
+  {
+    "step": 590,
+    "loss": 2.5354127883911133,
+    "diagonal": 2.5354127883911133
+  },
+  {
+    "step": 591,
+    "loss": 1.7798017263412476,
+    "diagonal": 1.7798017263412476
+  },
+  {
+    "step": 592,
+    "loss": 2.6286723613739014,
+    "diagonal": 2.6286723613739014
+  },
+  {
+    "step": 593,
+    "loss": 2.29697585105896,
+    "diagonal": 2.29697585105896
+  },
+  {
+    "step": 594,
+    "loss": 2.2047767639160156,
+    "diagonal": 2.2047767639160156
+  },
+  {
+    "step": 595,
+    "loss": 2.318052053451538,
+    "diagonal": 2.318052053451538
+  },
+  {
+    "step": 596,
+    "loss": 2.215759754180908,
+    "diagonal": 2.215759754180908
+  },
+  {
+    "step": 597,
+    "loss": 2.2390692234039307,
+    "diagonal": 2.2390692234039307
+  },
+  {
+    "step": 598,
+    "loss": 2.26499080657959,
+    "diagonal": 2.26499080657959
+  },
+  {
+    "step": 599,
+    "loss": 2.0724503993988037,
+    "diagonal": 2.0724503993988037
+  },
+  {
+    "step": 600,
+    "loss": 2.201686382293701,
+    "diagonal": 2.201686382293701
+  },
+  {
+    "step": 601,
+    "loss": 1.8184738159179688,
+    "diagonal": 1.8184738159179688
+  },
+  {
+    "step": 602,
+    "loss": 2.3221099376678467,
+    "diagonal": 2.3221099376678467
+  },
+  {
+    "step": 603,
+    "loss": 2.18056058883667,
+    "diagonal": 2.18056058883667
+  },
+  {
+    "step": 604,
+    "loss": 2.279458522796631,
+    "diagonal": 2.279458522796631
+  },
+  {
+    "step": 605,
+    "loss": 1.638978123664856,
+    "diagonal": 1.638978123664856
+  },
+  {
+    "step": 606,
+    "loss": 2.160144567489624,
+    "diagonal": 2.160144567489624
+  },
+  {
+    "step": 607,
+    "loss": 2.5464885234832764,
+    "diagonal": 2.5464885234832764
+  },
+  {
+    "step": 608,
+    "loss": 2.54907488822937,
+    "diagonal": 2.54907488822937
+  },
+  {
+    "step": 609,
+    "loss": 2.270115852355957,
+    "diagonal": 2.270115852355957
+  },
+  {
+    "step": 610,
+    "loss": 2.4400181770324707,
+    "diagonal": 2.4400181770324707
+  },
+  {
+    "step": 611,
+    "loss": 2.0818064212799072,
+    "diagonal": 2.0818064212799072
+  },
+  {
+    "step": 612,
+    "loss": 2.1385717391967773,
+    "diagonal": 2.1385717391967773
+  },
+  {
+    "step": 613,
+    "loss": 2.405444622039795,
+    "diagonal": 2.405444622039795
+  },
+  {
+    "step": 614,
+    "loss": 2.3557536602020264,
+    "diagonal": 2.3557536602020264
+  },
+  {
+    "step": 615,
+    "loss": 1.8037314414978027,
+    "diagonal": 1.8037314414978027
+  },
+  {
+    "step": 616,
+    "loss": 2.1117539405822754,
+    "diagonal": 2.1117539405822754
+  },
+  {
+    "step": 617,
+    "loss": 2.4622366428375244,
+    "diagonal": 2.4622366428375244
+  },
+  {
+    "step": 618,
+    "loss": 2.2279064655303955,
+    "diagonal": 2.2279064655303955
+  },
+  {
+    "step": 619,
+    "loss": 1.8600637912750244,
+    "diagonal": 1.8600637912750244
+  },
+  {
+    "step": 620,
+    "loss": 2.180624485015869,
+    "diagonal": 2.180624485015869
+  },
+  {
+    "step": 621,
+    "loss": 2.105053186416626,
+    "diagonal": 2.105053186416626
+  },
+  {
+    "step": 622,
+    "loss": 2.284019947052002,
+    "diagonal": 2.284019947052002
+  },
+  {
+    "step": 623,
+    "loss": 2.366316318511963,
+    "diagonal": 2.366316318511963
+  },
+  {
+    "step": 624,
+    "loss": 2.445434808731079,
+    "diagonal": 2.445434808731079
+  },
+  {
+    "step": 625,
+    "loss": 2.199216604232788,
+    "diagonal": 2.199216604232788
+  },
+  {
+    "step": 626,
+    "loss": 1.8718445301055908,
+    "diagonal": 1.8718445301055908
+  },
+  {
+    "step": 627,
+    "loss": 2.701237678527832,
+    "diagonal": 2.701237678527832
+  },
+  {
+    "step": 628,
+    "loss": 2.0250842571258545,
+    "diagonal": 2.0250842571258545
+  },
+  {
+    "step": 629,
+    "loss": 1.9742870330810547,
+    "diagonal": 1.9742870330810547
+  },
+  {
+    "step": 630,
+    "loss": 2.2101194858551025,
+    "diagonal": 2.2101194858551025
+  },
+  {
+    "step": 631,
+    "loss": 2.109652042388916,
+    "diagonal": 2.109652042388916
+  },
+  {
+    "step": 632,
+    "loss": 2.7269604206085205,
+    "diagonal": 2.7269604206085205
+  },
+  {
+    "step": 633,
+    "loss": 2.577521562576294,
+    "diagonal": 2.577521562576294
+  },
+  {
+    "step": 634,
+    "loss": 2.0850913524627686,
+    "diagonal": 2.0850913524627686
+  },
+  {
+    "step": 635,
+    "loss": 2.5033063888549805,
+    "diagonal": 2.5033063888549805
+  },
+  {
+    "step": 636,
+    "loss": 2.043574810028076,
+    "diagonal": 2.043574810028076
+  },
+  {
+    "step": 637,
+    "loss": 2.2937393188476562,
+    "diagonal": 2.2937393188476562
+  },
+  {
+    "step": 638,
+    "loss": 2.678302526473999,
+    "diagonal": 2.678302526473999
+  },
+  {
+    "step": 639,
+    "loss": 2.493175745010376,
+    "diagonal": 2.493175745010376
+  },
+  {
+    "step": 640,
+    "loss": 2.4297845363616943,
+    "diagonal": 2.4297845363616943
+  },
+  {
+    "step": 641,
+    "loss": 2.126108407974243,
+    "diagonal": 2.126108407974243
+  },
+  {
+    "step": 642,
+    "loss": 1.9561444520950317,
+    "diagonal": 1.9561444520950317
+  },
+  {
+    "step": 643,
+    "loss": 2.016164541244507,
+    "diagonal": 2.016164541244507
+  },
+  {
+    "step": 644,
+    "loss": 1.9742783308029175,
+    "diagonal": 1.9742783308029175
+  },
+  {
+    "step": 645,
+    "loss": 2.4220163822174072,
+    "diagonal": 2.4220163822174072
+  },
+  {
+    "step": 646,
+    "loss": 2.392489194869995,
+    "diagonal": 2.392489194869995
+  },
+  {
+    "step": 647,
+    "loss": 1.988298773765564,
+    "diagonal": 1.988298773765564
+  },
+  {
+    "step": 648,
+    "loss": 1.6923115253448486,
+    "diagonal": 1.6923115253448486
+  },
+  {
+    "step": 649,
+    "loss": 1.9117268323898315,
+    "diagonal": 1.9117268323898315
+  },
+  {
+    "step": 650,
+    "loss": 1.9498322010040283,
+    "diagonal": 1.9498322010040283
+  },
+  {
+    "step": 651,
+    "loss": 2.352175712585449,
+    "diagonal": 2.352175712585449
+  },
+  {
+    "step": 652,
+    "loss": 2.1593070030212402,
+    "diagonal": 2.1593070030212402
+  },
+  {
+    "step": 653,
+    "loss": 2.3432328701019287,
+    "diagonal": 2.3432328701019287
+  },
+  {
+    "step": 654,
+    "loss": 1.8984967470169067,
+    "diagonal": 1.8984967470169067
+  },
+  {
+    "step": 655,
+    "loss": 2.2650177478790283,
+    "diagonal": 2.2650177478790283
+  },
+  {
+    "step": 656,
+    "loss": 2.2551238536834717,
+    "diagonal": 2.2551238536834717
+  },
+  {
+    "step": 657,
+    "loss": 2.40382719039917,
+    "diagonal": 2.40382719039917
+  },
+  {
+    "step": 658,
+    "loss": 2.0492923259735107,
+    "diagonal": 2.0492923259735107
+  },
+  {
+    "step": 659,
+    "loss": 2.215604305267334,
+    "diagonal": 2.215604305267334
+  },
+  {
+    "step": 660,
+    "loss": 1.8565599918365479,
+    "diagonal": 1.8565599918365479
+  },
+  {
+    "step": 661,
+    "loss": 2.474958896636963,
+    "diagonal": 2.474958896636963
+  },
+  {
+    "step": 662,
+    "loss": 1.983282446861267,
+    "diagonal": 1.983282446861267
+  },
+  {
+    "step": 663,
+    "loss": 2.004148244857788,
+    "diagonal": 2.004148244857788
+  },
+  {
+    "step": 664,
+    "loss": 2.2862038612365723,
+    "diagonal": 2.2862038612365723
+  },
+  {
+    "step": 665,
+    "loss": 2.125032901763916,
+    "diagonal": 2.125032901763916
+  },
+  {
+    "step": 666,
+    "loss": 1.7740790843963623,
+    "diagonal": 1.7740790843963623
+  },
+  {
+    "step": 667,
+    "loss": 2.233510971069336,
+    "diagonal": 2.233510971069336
+  },
+  {
+    "step": 668,
+    "loss": 2.161738395690918,
+    "diagonal": 2.161738395690918
+  },
+  {
+    "step": 669,
+    "loss": 2.094668388366699,
+    "diagonal": 2.094668388366699
+  },
+  {
+    "step": 670,
+    "loss": 1.80549156665802,
+    "diagonal": 1.80549156665802
+  },
+  {
+    "step": 671,
+    "loss": 1.657512903213501,
+    "diagonal": 1.657512903213501
+  },
+  {
+    "step": 672,
+    "loss": 2.705821990966797,
+    "diagonal": 2.705821990966797
+  },
+  {
+    "step": 673,
+    "loss": 2.0147476196289062,
+    "diagonal": 2.0147476196289062
+  },
+  {
+    "step": 674,
+    "loss": 2.605119228363037,
+    "diagonal": 2.605119228363037
+  },
+  {
+    "step": 675,
+    "loss": 1.962458610534668,
+    "diagonal": 1.962458610534668
+  },
+  {
+    "step": 676,
+    "loss": 2.254974842071533,
+    "diagonal": 2.254974842071533
+  },
+  {
+    "step": 677,
+    "loss": 1.9985215663909912,
+    "diagonal": 1.9985215663909912
+  },
+  {
+    "step": 678,
+    "loss": 1.89411199092865,
+    "diagonal": 1.89411199092865
+  },
+  {
+    "step": 679,
+    "loss": 1.9249975681304932,
+    "diagonal": 1.9249975681304932
+  },
+  {
+    "step": 680,
+    "loss": 1.9657363891601562,
+    "diagonal": 1.9657363891601562
+  },
+  {
+    "step": 681,
+    "loss": 2.1154308319091797,
+    "diagonal": 2.1154308319091797
+  },
+  {
+    "step": 682,
+    "loss": 2.2914047241210938,
+    "diagonal": 2.2914047241210938
+  },
+  {
+    "step": 683,
+    "loss": 2.3921563625335693,
+    "diagonal": 2.3921563625335693
+  },
+  {
+    "step": 684,
+    "loss": 2.561276435852051,
+    "diagonal": 2.561276435852051
+  },
+  {
+    "step": 685,
+    "loss": 2.9194695949554443,
+    "diagonal": 2.9194695949554443
+  },
+  {
+    "step": 686,
+    "loss": 1.6749964952468872,
+    "diagonal": 1.6749964952468872
+  },
+  {
+    "step": 687,
+    "loss": 2.226398468017578,
+    "diagonal": 2.226398468017578
+  },
+  {
+    "step": 688,
+    "loss": 1.9161006212234497,
+    "diagonal": 1.9161006212234497
+  },
+  {
+    "step": 689,
+    "loss": 1.9688382148742676,
+    "diagonal": 1.9688382148742676
+  },
+  {
+    "step": 690,
+    "loss": 2.013780355453491,
+    "diagonal": 2.013780355453491
+  },
+  {
+    "step": 691,
+    "loss": 2.040753126144409,
+    "diagonal": 2.040753126144409
+  },
+  {
+    "step": 692,
+    "loss": 2.484841823577881,
+    "diagonal": 2.484841823577881
+  },
+  {
+    "step": 693,
+    "loss": 3.0746922492980957,
+    "diagonal": 3.0746922492980957
+  },
+  {
+    "step": 694,
+    "loss": 2.0071728229522705,
+    "diagonal": 2.0071728229522705
+  },
+  {
+    "step": 695,
+    "loss": 2.2055797576904297,
+    "diagonal": 2.2055797576904297
+  },
+  {
+    "step": 696,
+    "loss": 1.9390347003936768,
+    "diagonal": 1.9390347003936768
+  },
+  {
+    "step": 697,
+    "loss": 2.4213433265686035,
+    "diagonal": 2.4213433265686035
+  },
+  {
+    "step": 698,
+    "loss": 2.4526116847991943,
+    "diagonal": 2.4526116847991943
+  },
+  {
+    "step": 699,
+    "loss": 1.8081233501434326,
+    "diagonal": 1.8081233501434326
+  },
+  {
+    "step": 700,
+    "loss": 2.000652313232422,
+    "diagonal": 2.000652313232422
+  },
+  {
+    "step": 701,
+    "loss": 1.5667924880981445,
+    "diagonal": 1.5667924880981445
+  },
+  {
+    "step": 702,
+    "loss": 2.157142400741577,
+    "diagonal": 2.157142400741577
+  },
+  {
+    "step": 703,
+    "loss": 2.247849941253662,
+    "diagonal": 2.247849941253662
+  },
+  {
+    "step": 704,
+    "loss": 1.759647250175476,
+    "diagonal": 1.759647250175476
+  },
+  {
+    "step": 705,
+    "loss": 2.3796231746673584,
+    "diagonal": 2.3796231746673584
+  },
+  {
+    "step": 706,
+    "loss": 2.0599520206451416,
+    "diagonal": 2.0599520206451416
+  },
+  {
+    "step": 707,
+    "loss": 1.9485870599746704,
+    "diagonal": 1.9485870599746704
+  },
+  {
+    "step": 708,
+    "loss": 1.6730626821517944,
+    "diagonal": 1.6730626821517944
+  },
+  {
+    "step": 709,
+    "loss": 2.1952311992645264,
+    "diagonal": 2.1952311992645264
+  },
+  {
+    "step": 710,
+    "loss": 1.8917654752731323,
+    "diagonal": 1.8917654752731323
+  },
+  {
+    "step": 711,
+    "loss": 2.107396364212036,
+    "diagonal": 2.107396364212036
+  },
+  {
+    "step": 712,
+    "loss": 1.6619594097137451,
+    "diagonal": 1.6619594097137451
+  },
+  {
+    "step": 713,
+    "loss": 1.967121958732605,
+    "diagonal": 1.967121958732605
+  },
+  {
+    "step": 714,
+    "loss": 2.4633829593658447,
+    "diagonal": 2.4633829593658447
+  },
+  {
+    "step": 715,
+    "loss": 2.3046247959136963,
+    "diagonal": 2.3046247959136963
+  },
+  {
+    "step": 716,
+    "loss": 2.061635971069336,
+    "diagonal": 2.061635971069336
+  },
+  {
+    "step": 717,
+    "loss": 2.1024250984191895,
+    "diagonal": 2.1024250984191895
+  },
+  {
+    "step": 718,
+    "loss": 2.215132713317871,
+    "diagonal": 2.215132713317871
+  },
+  {
+    "step": 719,
+    "loss": 1.8128832578659058,
+    "diagonal": 1.8128832578659058
+  },
+  {
+    "step": 720,
+    "loss": 2.2398977279663086,
+    "diagonal": 2.2398977279663086
+  },
+  {
+    "step": 721,
+    "loss": 2.236360788345337,
+    "diagonal": 2.236360788345337
+  },
+  {
+    "step": 722,
+    "loss": 2.6016933917999268,
+    "diagonal": 2.6016933917999268
+  },
+  {
+    "step": 723,
+    "loss": 1.845555305480957,
+    "diagonal": 1.845555305480957
+  },
+  {
+    "step": 724,
+    "loss": 1.9714497327804565,
+    "diagonal": 1.9714497327804565
+  },
+  {
+    "step": 725,
+    "loss": 1.792683482170105,
+    "diagonal": 1.792683482170105
+  },
+  {
+    "step": 726,
+    "loss": 2.1235978603363037,
+    "diagonal": 2.1235978603363037
+  },
+  {
+    "step": 727,
+    "loss": 1.9007561206817627,
+    "diagonal": 1.9007561206817627
+  },
+  {
+    "step": 728,
+    "loss": 2.3369696140289307,
+    "diagonal": 2.3369696140289307
+  },
+  {
+    "step": 729,
+    "loss": 1.722559928894043,
+    "diagonal": 1.722559928894043
+  },
+  {
+    "step": 730,
+    "loss": 1.9994769096374512,
+    "diagonal": 1.9994769096374512
+  },
+  {
+    "step": 731,
+    "loss": 1.8758680820465088,
+    "diagonal": 1.8758680820465088
+  },
+  {
+    "step": 732,
+    "loss": 1.9379502534866333,
+    "diagonal": 1.9379502534866333
+  },
+  {
+    "step": 733,
+    "loss": 2.1147947311401367,
+    "diagonal": 2.1147947311401367
+  },
+  {
+    "step": 734,
+    "loss": 2.001251220703125,
+    "diagonal": 2.001251220703125
+  },
+  {
+    "step": 735,
+    "loss": 1.9827958345413208,
+    "diagonal": 1.9827958345413208
+  },
+  {
+    "step": 736,
+    "loss": 2.334057569503784,
+    "diagonal": 2.334057569503784
+  },
+  {
+    "step": 737,
+    "loss": 2.3251988887786865,
+    "diagonal": 2.3251988887786865
+  },
+  {
+    "step": 738,
+    "loss": 2.3368000984191895,
+    "diagonal": 2.3368000984191895
+  },
+  {
+    "step": 739,
+    "loss": 1.9246766567230225,
+    "diagonal": 1.9246766567230225
+  },
+  {
+    "step": 740,
+    "loss": 2.077038288116455,
+    "diagonal": 2.077038288116455
+  },
+  {
+    "step": 741,
+    "loss": 1.8684139251708984,
+    "diagonal": 1.8684139251708984
+  },
+  {
+    "step": 742,
+    "loss": 1.5657638311386108,
+    "diagonal": 1.5657638311386108
+  },
+  {
+    "step": 743,
+    "loss": 2.0726072788238525,
+    "diagonal": 2.0726072788238525
+  },
+  {
+    "step": 744,
+    "loss": 1.9437029361724854,
+    "diagonal": 1.9437029361724854
+  },
+  {
+    "step": 745,
+    "loss": 1.9861266613006592,
+    "diagonal": 1.9861266613006592
+  },
+  {
+    "step": 746,
+    "loss": 1.763343334197998,
+    "diagonal": 1.763343334197998
+  },
+  {
+    "step": 747,
+    "loss": 2.588844060897827,
+    "diagonal": 2.588844060897827
+  },
+  {
+    "step": 748,
+    "loss": 2.395568609237671,
+    "diagonal": 2.395568609237671
+  },
+  {
+    "step": 749,
+    "loss": 2.111024856567383,
+    "diagonal": 2.111024856567383
+  },
+  {
+    "step": 750,
+    "loss": 2.35760498046875,
+    "diagonal": 2.35760498046875
+  },
+  {
+    "step": 751,
+    "loss": 2.39587664604187,
+    "diagonal": 2.39587664604187
+  },
+  {
+    "step": 752,
+    "loss": 1.6987173557281494,
+    "diagonal": 1.6987173557281494
+  },
+  {
+    "step": 753,
+    "loss": 2.278615713119507,
+    "diagonal": 2.278615713119507
+  },
+  {
+    "step": 754,
+    "loss": 2.1158437728881836,
+    "diagonal": 2.1158437728881836
+  },
+  {
+    "step": 755,
+    "loss": 1.9059932231903076,
+    "diagonal": 1.9059932231903076
+  },
+  {
+    "step": 756,
+    "loss": 2.269254684448242,
+    "diagonal": 2.269254684448242
+  },
+  {
+    "step": 757,
+    "loss": 1.761534571647644,
+    "diagonal": 1.761534571647644
+  },
+  {
+    "step": 758,
+    "loss": 2.233095407485962,
+    "diagonal": 2.233095407485962
+  },
+  {
+    "step": 759,
+    "loss": 2.0492405891418457,
+    "diagonal": 2.0492405891418457
+  },
+  {
+    "step": 760,
+    "loss": 2.5894885063171387,
+    "diagonal": 2.5894885063171387
+  },
+  {
+    "step": 761,
+    "loss": 1.598765254020691,
+    "diagonal": 1.598765254020691
+  },
+  {
+    "step": 762,
+    "loss": 2.2186973094940186,
+    "diagonal": 2.2186973094940186
+  },
+  {
+    "step": 763,
+    "loss": 2.360546112060547,
+    "diagonal": 2.360546112060547
+  },
+  {
+    "step": 764,
+    "loss": 2.017592430114746,
+    "diagonal": 2.017592430114746
+  },
+  {
+    "step": 765,
+    "loss": 1.7674713134765625,
+    "diagonal": 1.7674713134765625
+  },
+  {
+    "step": 766,
+    "loss": 1.9902849197387695,
+    "diagonal": 1.9902849197387695
+  },
+  {
+    "step": 767,
+    "loss": 2.4495348930358887,
+    "diagonal": 2.4495348930358887
+  },
+  {
+    "step": 768,
+    "loss": 2.2607672214508057,
+    "diagonal": 2.2607672214508057
+  },
+  {
+    "step": 769,
+    "loss": 2.482038736343384,
+    "diagonal": 2.482038736343384
+  },
+  {
+    "step": 770,
+    "loss": 1.827268123626709,
+    "diagonal": 1.827268123626709
+  },
+  {
+    "step": 771,
+    "loss": 2.175518751144409,
+    "diagonal": 2.175518751144409
+  },
+  {
+    "step": 772,
+    "loss": 2.322732448577881,
+    "diagonal": 2.322732448577881
+  },
+  {
+    "step": 773,
+    "loss": 1.9822473526000977,
+    "diagonal": 1.9822473526000977
+  },
+  {
+    "step": 774,
+    "loss": 2.2846078872680664,
+    "diagonal": 2.2846078872680664
+  },
+  {
+    "step": 775,
+    "loss": 2.5296669006347656,
+    "diagonal": 2.5296669006347656
+  },
+  {
+    "step": 776,
+    "loss": 2.0628762245178223,
+    "diagonal": 2.0628762245178223
+  },
+  {
+    "step": 777,
+    "loss": 2.0647647380828857,
+    "diagonal": 2.0647647380828857
+  },
+  {
+    "step": 778,
+    "loss": 2.1337833404541016,
+    "diagonal": 2.1337833404541016
+  },
+  {
+    "step": 779,
+    "loss": 1.9304577112197876,
+    "diagonal": 1.9304577112197876
+  },
+  {
+    "step": 780,
+    "loss": 2.0659914016723633,
+    "diagonal": 2.0659914016723633
+  },
+  {
+    "step": 781,
+    "loss": 2.454023599624634,
+    "diagonal": 2.454023599624634
+  },
+  {
+    "step": 782,
+    "loss": 2.517827033996582,
+    "diagonal": 2.517827033996582
+  },
+  {
+    "step": 783,
+    "loss": 1.9004958868026733,
+    "diagonal": 1.9004958868026733
+  },
+  {
+    "step": 784,
+    "loss": 1.8545926809310913,
+    "diagonal": 1.8545926809310913
+  },
+  {
+    "step": 785,
+    "loss": 1.8530958890914917,
+    "diagonal": 1.8530958890914917
+  },
+  {
+    "step": 786,
+    "loss": 2.1773641109466553,
+    "diagonal": 2.1773641109466553
+  },
+  {
+    "step": 787,
+    "loss": 1.9705356359481812,
+    "diagonal": 1.9705356359481812
+  },
+  {
+    "step": 788,
+    "loss": 2.361051082611084,
+    "diagonal": 2.361051082611084
+  },
+  {
+    "step": 789,
+    "loss": 3.210676670074463,
+    "diagonal": 3.210676670074463
+  },
+  {
+    "step": 790,
+    "loss": 2.1426892280578613,
+    "diagonal": 2.1426892280578613
+  },
+  {
+    "step": 791,
+    "loss": 2.172184467315674,
+    "diagonal": 2.172184467315674
+  },
+  {
+    "step": 792,
+    "loss": 1.8491175174713135,
+    "diagonal": 1.8491175174713135
+  },
+  {
+    "step": 793,
+    "loss": 1.9666355848312378,
+    "diagonal": 1.9666355848312378
+  },
+  {
+    "step": 794,
+    "loss": 2.29050612449646,
+    "diagonal": 2.29050612449646
+  },
+  {
+    "step": 795,
+    "loss": 1.6761009693145752,
+    "diagonal": 1.6761009693145752
+  },
+  {
+    "step": 796,
+    "loss": 1.6167274713516235,
+    "diagonal": 1.6167274713516235
+  },
+  {
+    "step": 797,
+    "loss": 2.3174760341644287,
+    "diagonal": 2.3174760341644287
+  },
+  {
+    "step": 798,
+    "loss": 1.7125362157821655,
+    "diagonal": 1.7125362157821655
+  },
+  {
+    "step": 799,
+    "loss": 2.0777485370635986,
+    "diagonal": 2.0777485370635986
+  },
+  {
+    "step": 800,
+    "loss": 2.319572925567627,
+    "diagonal": 2.319572925567627
+  },
+  {
+    "step": 801,
+    "loss": 2.269507884979248,
+    "diagonal": 2.269507884979248
+  },
+  {
+    "step": 802,
+    "loss": 2.179564952850342,
+    "diagonal": 2.179564952850342
+  },
+  {
+    "step": 803,
+    "loss": 1.6596641540527344,
+    "diagonal": 1.6596641540527344
+  },
+  {
+    "step": 804,
+    "loss": 1.8030784130096436,
+    "diagonal": 1.8030784130096436
+  },
+  {
+    "step": 805,
+    "loss": 2.48945951461792,
+    "diagonal": 2.48945951461792
+  },
+  {
+    "step": 806,
+    "loss": 1.8996620178222656,
+    "diagonal": 1.8996620178222656
+  },
+  {
+    "step": 807,
+    "loss": 1.7375788688659668,
+    "diagonal": 1.7375788688659668
+  },
+  {
+    "step": 808,
+    "loss": 2.368734359741211,
+    "diagonal": 2.368734359741211
+  },
+  {
+    "step": 809,
+    "loss": 2.1576778888702393,
+    "diagonal": 2.1576778888702393
+  },
+  {
+    "step": 810,
+    "loss": 2.32063889503479,
+    "diagonal": 2.32063889503479
+  },
+  {
+    "step": 811,
+    "loss": 2.195094585418701,
+    "diagonal": 2.195094585418701
+  },
+  {
+    "step": 812,
+    "loss": 2.0103516578674316,
+    "diagonal": 2.0103516578674316
+  },
+  {
+    "step": 813,
+    "loss": 2.475210428237915,
+    "diagonal": 2.475210428237915
+  },
+  {
+    "step": 814,
+    "loss": 1.9777880907058716,
+    "diagonal": 1.9777880907058716
+  },
+  {
+    "step": 815,
+    "loss": 1.9029037952423096,
+    "diagonal": 1.9029037952423096
+  },
+  {
+    "step": 816,
+    "loss": 2.0318078994750977,
+    "diagonal": 2.0318078994750977
+  },
+  {
+    "step": 817,
+    "loss": 2.3621325492858887,
+    "diagonal": 2.3621325492858887
+  },
+  {
+    "step": 818,
+    "loss": 2.254899740219116,
+    "diagonal": 2.254899740219116
+  },
+  {
+    "step": 819,
+    "loss": 2.4406442642211914,
+    "diagonal": 2.4406442642211914
+  },
+  {
+    "step": 820,
+    "loss": 2.3237085342407227,
+    "diagonal": 2.3237085342407227
+  },
+  {
+    "step": 821,
+    "loss": 1.8493590354919434,
+    "diagonal": 1.8493590354919434
+  },
+  {
+    "step": 822,
+    "loss": 2.3980205059051514,
+    "diagonal": 2.3980205059051514
+  },
+  {
+    "step": 823,
+    "loss": 2.281352996826172,
+    "diagonal": 2.281352996826172
+  },
+  {
+    "step": 824,
+    "loss": 1.9450032711029053,
+    "diagonal": 1.9450032711029053
+  },
+  {
+    "step": 825,
+    "loss": 2.132385730743408,
+    "diagonal": 2.132385730743408
+  },
+  {
+    "step": 826,
+    "loss": 2.287364959716797,
+    "diagonal": 2.287364959716797
+  },
+  {
+    "step": 827,
+    "loss": 2.0795719623565674,
+    "diagonal": 2.0795719623565674
+  },
+  {
+    "step": 828,
+    "loss": 2.344780445098877,
+    "diagonal": 2.344780445098877
+  },
+  {
+    "step": 829,
+    "loss": 1.8377163410186768,
+    "diagonal": 1.8377163410186768
+  },
+  {
+    "step": 830,
+    "loss": 1.8001002073287964,
+    "diagonal": 1.8001002073287964
+  },
+  {
+    "step": 831,
+    "loss": 1.9801875352859497,
+    "diagonal": 1.9801875352859497
+  },
+  {
+    "step": 832,
+    "loss": 1.7762541770935059,
+    "diagonal": 1.7762541770935059
+  },
+  {
+    "step": 833,
+    "loss": 2.16835618019104,
+    "diagonal": 2.16835618019104
+  },
+  {
+    "step": 834,
+    "loss": 2.497122287750244,
+    "diagonal": 2.497122287750244
+  },
+  {
+    "step": 835,
+    "loss": 2.642880916595459,
+    "diagonal": 2.642880916595459
+  },
+  {
+    "step": 836,
+    "loss": 2.0157623291015625,
+    "diagonal": 2.0157623291015625
+  },
+  {
+    "step": 837,
+    "loss": 2.1215856075286865,
+    "diagonal": 2.1215856075286865
+  },
+  {
+    "step": 838,
+    "loss": 2.2135980129241943,
+    "diagonal": 2.2135980129241943
+  },
+  {
+    "step": 839,
+    "loss": 2.273144006729126,
+    "diagonal": 2.273144006729126
+  },
+  {
+    "step": 840,
+    "loss": 2.0150458812713623,
+    "diagonal": 2.0150458812713623
+  },
+  {
+    "step": 841,
+    "loss": 2.2267065048217773,
+    "diagonal": 2.2267065048217773
+  },
+  {
+    "step": 842,
+    "loss": 2.351346015930176,
+    "diagonal": 2.351346015930176
+  },
+  {
+    "step": 843,
+    "loss": 2.2192296981811523,
+    "diagonal": 2.2192296981811523
+  },
+  {
+    "step": 844,
+    "loss": 1.8540608882904053,
+    "diagonal": 1.8540608882904053
+  },
+  {
+    "step": 845,
+    "loss": 1.842320442199707,
+    "diagonal": 1.842320442199707
+  },
+  {
+    "step": 846,
+    "loss": 2.3239948749542236,
+    "diagonal": 2.3239948749542236
+  },
+  {
+    "step": 847,
+    "loss": 2.305004358291626,
+    "diagonal": 2.305004358291626
+  },
+  {
+    "step": 848,
+    "loss": 1.6944580078125,
+    "diagonal": 1.6944580078125
+  },
+  {
+    "step": 849,
+    "loss": 1.7579190731048584,
+    "diagonal": 1.7579190731048584
+  },
+  {
+    "step": 850,
+    "loss": 1.819825291633606,
+    "diagonal": 1.819825291633606
+  },
+  {
+    "step": 851,
+    "loss": 1.8212847709655762,
+    "diagonal": 1.8212847709655762
+  },
+  {
+    "step": 852,
+    "loss": 2.180290460586548,
+    "diagonal": 2.180290460586548
+  },
+  {
+    "step": 853,
+    "loss": 2.658740758895874,
+    "diagonal": 2.658740758895874
+  },
+  {
+    "step": 854,
+    "loss": 1.6141786575317383,
+    "diagonal": 1.6141786575317383
+  },
+  {
+    "step": 855,
+    "loss": 2.38661527633667,
+    "diagonal": 2.38661527633667
+  },
+  {
+    "step": 856,
+    "loss": 2.3876702785491943,
+    "diagonal": 2.3876702785491943
+  },
+  {
+    "step": 857,
+    "loss": 2.3468379974365234,
+    "diagonal": 2.3468379974365234
+  },
+  {
+    "step": 858,
+    "loss": 1.8321902751922607,
+    "diagonal": 1.8321902751922607
+  },
+  {
+    "step": 859,
+    "loss": 2.0612778663635254,
+    "diagonal": 2.0612778663635254
+  },
+  {
+    "step": 860,
+    "loss": 2.2534749507904053,
+    "diagonal": 2.2534749507904053
+  },
+  {
+    "step": 861,
+    "loss": 1.931850790977478,
+    "diagonal": 1.931850790977478
+  },
+  {
+    "step": 862,
+    "loss": 1.6050480604171753,
+    "diagonal": 1.6050480604171753
+  },
+  {
+    "step": 863,
+    "loss": 2.2849278450012207,
+    "diagonal": 2.2849278450012207
+  },
+  {
+    "step": 864,
+    "loss": 1.6915687322616577,
+    "diagonal": 1.6915687322616577
+  },
+  {
+    "step": 865,
+    "loss": 2.068852663040161,
+    "diagonal": 2.068852663040161
+  },
+  {
+    "step": 866,
+    "loss": 2.0788567066192627,
+    "diagonal": 2.0788567066192627
+  },
+  {
+    "step": 867,
+    "loss": 3.7160658836364746,
+    "diagonal": 3.7160658836364746
+  },
+  {
+    "step": 868,
+    "loss": 2.2519357204437256,
+    "diagonal": 2.2519357204437256
+  },
+  {
+    "step": 869,
+    "loss": 2.048194408416748,
+    "diagonal": 2.048194408416748
+  },
+  {
+    "step": 870,
+    "loss": 2.0238308906555176,
+    "diagonal": 2.0238308906555176
+  },
+  {
+    "step": 871,
+    "loss": 1.7158353328704834,
+    "diagonal": 1.7158353328704834
+  },
+  {
+    "step": 872,
+    "loss": 2.326317071914673,
+    "diagonal": 2.326317071914673
+  },
+  {
+    "step": 873,
+    "loss": 2.3800854682922363,
+    "diagonal": 2.3800854682922363
+  },
+  {
+    "step": 874,
+    "loss": 2.358208656311035,
+    "diagonal": 2.358208656311035
+  },
+  {
+    "step": 875,
+    "loss": 2.327846050262451,
+    "diagonal": 2.327846050262451
+  },
+  {
+    "step": 876,
+    "loss": 2.1610710620880127,
+    "diagonal": 2.1610710620880127
+  },
+  {
+    "step": 877,
+    "loss": 1.6804957389831543,
+    "diagonal": 1.6804957389831543
+  },
+  {
+    "step": 878,
+    "loss": 1.5644558668136597,
+    "diagonal": 1.5644558668136597
+  },
+  {
+    "step": 879,
+    "loss": 1.8287338018417358,
+    "diagonal": 1.8287338018417358
+  },
+  {
+    "step": 880,
+    "loss": 2.494530439376831,
+    "diagonal": 2.494530439376831
+  },
+  {
+    "step": 881,
+    "loss": 2.166079521179199,
+    "diagonal": 2.166079521179199
+  },
+  {
+    "step": 882,
+    "loss": 2.234426975250244,
+    "diagonal": 2.234426975250244
+  },
+  {
+    "step": 883,
+    "loss": 2.0834760665893555,
+    "diagonal": 2.0834760665893555
+  },
+  {
+    "step": 884,
+    "loss": 1.8882312774658203,
+    "diagonal": 1.8882312774658203
+  },
+  {
+    "step": 885,
+    "loss": 1.9550460577011108,
+    "diagonal": 1.9550460577011108
+  },
+  {
+    "step": 886,
+    "loss": 1.9012473821640015,
+    "diagonal": 1.9012473821640015
+  },
+  {
+    "step": 887,
+    "loss": 2.0534074306488037,
+    "diagonal": 2.0534074306488037
+  },
+  {
+    "step": 888,
+    "loss": 2.133659839630127,
+    "diagonal": 2.133659839630127
+  },
+  {
+    "step": 889,
+    "loss": 1.824700951576233,
+    "diagonal": 1.824700951576233
+  },
+  {
+    "step": 890,
+    "loss": 2.3523313999176025,
+    "diagonal": 2.3523313999176025
+  },
+  {
+    "step": 891,
+    "loss": 2.3907880783081055,
+    "diagonal": 2.3907880783081055
+  },
+  {
+    "step": 892,
+    "loss": 2.4275710582733154,
+    "diagonal": 2.4275710582733154
+  },
+  {
+    "step": 893,
+    "loss": 2.515852689743042,
+    "diagonal": 2.515852689743042
+  },
+  {
+    "step": 894,
+    "loss": 2.579439640045166,
+    "diagonal": 2.579439640045166
+  },
+  {
+    "step": 895,
+    "loss": 1.990142822265625,
+    "diagonal": 1.990142822265625
+  },
+  {
+    "step": 896,
+    "loss": 1.7129621505737305,
+    "diagonal": 1.7129621505737305
+  },
+  {
+    "step": 897,
+    "loss": 2.1886496543884277,
+    "diagonal": 2.1886496543884277
+  },
+  {
+    "step": 898,
+    "loss": 1.9839586019515991,
+    "diagonal": 1.9839586019515991
+  },
+  {
+    "step": 899,
+    "loss": 1.6785597801208496,
+    "diagonal": 1.6785597801208496
+  },
+  {
+    "step": 900,
+    "loss": 2.2005810737609863,
+    "diagonal": 2.2005810737609863
+  },
+  {
+    "step": 901,
+    "loss": 1.7561392784118652,
+    "diagonal": 1.7561392784118652
+  },
+  {
+    "step": 902,
+    "loss": 2.527421474456787,
+    "diagonal": 2.527421474456787
+  },
+  {
+    "step": 903,
+    "loss": 2.675947666168213,
+    "diagonal": 2.675947666168213
+  },
+  {
+    "step": 904,
+    "loss": 1.9517478942871094,
+    "diagonal": 1.9517478942871094
+  },
+  {
+    "step": 905,
+    "loss": 1.8462445735931396,
+    "diagonal": 1.8462445735931396
+  },
+  {
+    "step": 906,
+    "loss": 2.3521065711975098,
+    "diagonal": 2.3521065711975098
+  },
+  {
+    "step": 907,
+    "loss": 2.353642463684082,
+    "diagonal": 2.353642463684082
+  },
+  {
+    "step": 908,
+    "loss": 1.8017290830612183,
+    "diagonal": 1.8017290830612183
+  },
+  {
+    "step": 909,
+    "loss": 1.6760977506637573,
+    "diagonal": 1.6760977506637573
+  },
+  {
+    "step": 910,
+    "loss": 1.8855234384536743,
+    "diagonal": 1.8855234384536743
+  },
+  {
+    "step": 911,
+    "loss": 1.7838928699493408,
+    "diagonal": 1.7838928699493408
+  },
+  {
+    "step": 912,
+    "loss": 2.3524200916290283,
+    "diagonal": 2.3524200916290283
+  },
+  {
+    "step": 913,
+    "loss": 2.0854275226593018,
+    "diagonal": 2.0854275226593018
+  },
+  {
+    "step": 914,
+    "loss": 1.8120168447494507,
+    "diagonal": 1.8120168447494507
+  },
+  {
+    "step": 915,
+    "loss": 2.4716103076934814,
+    "diagonal": 2.4716103076934814
+  },
+  {
+    "step": 916,
+    "loss": 2.093454122543335,
+    "diagonal": 2.093454122543335
+  },
+  {
+    "step": 917,
+    "loss": 2.476215124130249,
+    "diagonal": 2.476215124130249
+  },
+  {
+    "step": 918,
+    "loss": 2.2932162284851074,
+    "diagonal": 2.2932162284851074
+  },
+  {
+    "step": 919,
+    "loss": 2.182399272918701,
+    "diagonal": 2.182399272918701
+  },
+  {
+    "step": 920,
+    "loss": 1.6914942264556885,
+    "diagonal": 1.6914942264556885
+  },
+  {
+    "step": 921,
+    "loss": 2.245994806289673,
+    "diagonal": 2.245994806289673
+  },
+  {
+    "step": 922,
+    "loss": 2.2621490955352783,
+    "diagonal": 2.2621490955352783
+  },
+  {
+    "step": 923,
+    "loss": 2.2192633152008057,
+    "diagonal": 2.2192633152008057
+  },
+  {
+    "step": 924,
+    "loss": 1.789973258972168,
+    "diagonal": 1.789973258972168
+  },
+  {
+    "step": 925,
+    "loss": 1.8147717714309692,
+    "diagonal": 1.8147717714309692
+  },
+  {
+    "step": 926,
+    "loss": 2.0391323566436768,
+    "diagonal": 2.0391323566436768
+  },
+  {
+    "step": 927,
+    "loss": 2.3486745357513428,
+    "diagonal": 2.3486745357513428
+  },
+  {
+    "step": 928,
+    "loss": 1.8184235095977783,
+    "diagonal": 1.8184235095977783
+  },
+  {
+    "step": 929,
+    "loss": 2.173527240753174,
+    "diagonal": 2.173527240753174
+  },
+  {
+    "step": 930,
+    "loss": 1.9669605493545532,
+    "diagonal": 1.9669605493545532
+  },
+  {
+    "step": 931,
+    "loss": 3.1059203147888184,
+    "diagonal": 3.1059203147888184
+  },
+  {
+    "step": 932,
+    "loss": 2.087878465652466,
+    "diagonal": 2.087878465652466
+  },
+  {
+    "step": 933,
+    "loss": 2.591289758682251,
+    "diagonal": 2.591289758682251
+  },
+  {
+    "step": 934,
+    "loss": 2.900627613067627,
+    "diagonal": 2.900627613067627
+  },
+  {
+    "step": 935,
+    "loss": 2.4534389972686768,
+    "diagonal": 2.4534389972686768
+  },
+  {
+    "step": 936,
+    "loss": 1.9077186584472656,
+    "diagonal": 1.9077186584472656
+  },
+  {
+    "step": 937,
+    "loss": 1.8395687341690063,
+    "diagonal": 1.8395687341690063
+  },
+  {
+    "step": 938,
+    "loss": 1.9409185647964478,
+    "diagonal": 1.9409185647964478
+  },
+  {
+    "step": 939,
+    "loss": 2.730733871459961,
+    "diagonal": 2.730733871459961
+  },
+  {
+    "step": 940,
+    "loss": 1.790968894958496,
+    "diagonal": 1.790968894958496
+  },
+  {
+    "step": 941,
+    "loss": 2.1015501022338867,
+    "diagonal": 2.1015501022338867
+  },
+  {
+    "step": 942,
+    "loss": 1.7282519340515137,
+    "diagonal": 1.7282519340515137
+  },
+  {
+    "step": 943,
+    "loss": 2.090693950653076,
+    "diagonal": 2.090693950653076
+  },
+  {
+    "step": 944,
+    "loss": 1.968321442604065,
+    "diagonal": 1.968321442604065
+  },
+  {
+    "step": 945,
+    "loss": 2.2074930667877197,
+    "diagonal": 2.2074930667877197
+  },
+  {
+    "step": 946,
+    "loss": 2.6606605052948,
+    "diagonal": 2.6606605052948
+  },
+  {
+    "step": 947,
+    "loss": 2.4417026042938232,
+    "diagonal": 2.4417026042938232
+  },
+  {
+    "step": 948,
+    "loss": 2.1050262451171875,
+    "diagonal": 2.1050262451171875
+  },
+  {
+    "step": 949,
+    "loss": 1.677127718925476,
+    "diagonal": 1.677127718925476
+  },
+  {
+    "step": 950,
+    "loss": 2.0079760551452637,
+    "diagonal": 2.0079760551452637
+  },
+  {
+    "step": 951,
+    "loss": 1.9572124481201172,
+    "diagonal": 1.9572124481201172
+  },
+  {
+    "step": 952,
+    "loss": 2.1228175163269043,
+    "diagonal": 2.1228175163269043
+  },
+  {
+    "step": 953,
+    "loss": 1.6873012781143188,
+    "diagonal": 1.6873012781143188
+  },
+  {
+    "step": 954,
+    "loss": 1.894436240196228,
+    "diagonal": 1.894436240196228
+  },
+  {
+    "step": 955,
+    "loss": 1.9493869543075562,
+    "diagonal": 1.9493869543075562
+  },
+  {
+    "step": 956,
+    "loss": 2.4354825019836426,
+    "diagonal": 2.4354825019836426
+  },
+  {
+    "step": 957,
+    "loss": 2.102095127105713,
+    "diagonal": 2.102095127105713
+  },
+  {
+    "step": 958,
+    "loss": 2.4842867851257324,
+    "diagonal": 2.4842867851257324
+  },
+  {
+    "step": 959,
+    "loss": 1.9896478652954102,
+    "diagonal": 1.9896478652954102
+  },
+  {
+    "step": 960,
+    "loss": 2.0709950923919678,
+    "diagonal": 2.0709950923919678
+  },
+  {
+    "step": 961,
+    "loss": 1.9613511562347412,
+    "diagonal": 1.9613511562347412
+  },
+  {
+    "step": 962,
+    "loss": 2.7203943729400635,
+    "diagonal": 2.7203943729400635
+  },
+  {
+    "step": 963,
+    "loss": 2.1150922775268555,
+    "diagonal": 2.1150922775268555
+  },
+  {
+    "step": 964,
+    "loss": 1.8468514680862427,
+    "diagonal": 1.8468514680862427
+  },
+  {
+    "step": 965,
+    "loss": 2.135932207107544,
+    "diagonal": 2.135932207107544
+  },
+  {
+    "step": 966,
+    "loss": 1.6151516437530518,
+    "diagonal": 1.6151516437530518
+  },
+  {
+    "step": 967,
+    "loss": 1.8502635955810547,
+    "diagonal": 1.8502635955810547
+  },
+  {
+    "step": 968,
+    "loss": 2.240297317504883,
+    "diagonal": 2.240297317504883
+  },
+  {
+    "step": 969,
+    "loss": 2.2597877979278564,
+    "diagonal": 2.2597877979278564
+  },
+  {
+    "step": 970,
+    "loss": 2.589869260787964,
+    "diagonal": 2.589869260787964
+  },
+  {
+    "step": 971,
+    "loss": 1.6868627071380615,
+    "diagonal": 1.6868627071380615
+  },
+  {
+    "step": 972,
+    "loss": 2.0821456909179688,
+    "diagonal": 2.0821456909179688
+  },
+  {
+    "step": 973,
+    "loss": 2.470371723175049,
+    "diagonal": 2.470371723175049
+  },
+  {
+    "step": 974,
+    "loss": 1.6428524255752563,
+    "diagonal": 1.6428524255752563
+  },
+  {
+    "step": 975,
+    "loss": 2.339939594268799,
+    "diagonal": 2.339939594268799
+  },
+  {
+    "step": 976,
+    "loss": 2.3015856742858887,
+    "diagonal": 2.3015856742858887
+  },
+  {
+    "step": 977,
+    "loss": 2.12172269821167,
+    "diagonal": 2.12172269821167
+  },
+  {
+    "step": 978,
+    "loss": 1.9898761510849,
+    "diagonal": 1.9898761510849
+  },
+  {
+    "step": 979,
+    "loss": 1.7478129863739014,
+    "diagonal": 1.7478129863739014
+  },
+  {
+    "step": 980,
+    "loss": 2.1646978855133057,
+    "diagonal": 2.1646978855133057
+  },
+  {
+    "step": 981,
+    "loss": 2.0147008895874023,
+    "diagonal": 2.0147008895874023
+  },
+  {
+    "step": 982,
+    "loss": 2.2667555809020996,
+    "diagonal": 2.2667555809020996
+  },
+  {
+    "step": 983,
+    "loss": 2.081374406814575,
+    "diagonal": 2.081374406814575
+  },
+  {
+    "step": 984,
+    "loss": 1.9041953086853027,
+    "diagonal": 1.9041953086853027
+  },
+  {
+    "step": 985,
+    "loss": 1.5468676090240479,
+    "diagonal": 1.5468676090240479
+  },
+  {
+    "step": 986,
+    "loss": 2.2801942825317383,
+    "diagonal": 2.2801942825317383
+  },
+  {
+    "step": 987,
+    "loss": 2.298953056335449,
+    "diagonal": 2.298953056335449
+  },
+  {
+    "step": 988,
+    "loss": 2.4440886974334717,
+    "diagonal": 2.4440886974334717
+  },
+  {
+    "step": 989,
+    "loss": 1.9490998983383179,
+    "diagonal": 1.9490998983383179
+  },
+  {
+    "step": 990,
+    "loss": 2.2671611309051514,
+    "diagonal": 2.2671611309051514
+  },
+  {
+    "step": 991,
+    "loss": 2.164729595184326,
+    "diagonal": 2.164729595184326
+  },
+  {
+    "step": 992,
+    "loss": 1.882657766342163,
+    "diagonal": 1.882657766342163
+  },
+  {
+    "step": 993,
+    "loss": 1.9654134511947632,
+    "diagonal": 1.9654134511947632
+  },
+  {
+    "step": 994,
+    "loss": 1.9134342670440674,
+    "diagonal": 1.9134342670440674
+  },
+  {
+    "step": 995,
+    "loss": 1.8244130611419678,
+    "diagonal": 1.8244130611419678
+  },
+  {
+    "step": 996,
+    "loss": 2.4493749141693115,
+    "diagonal": 2.4493749141693115
+  },
+  {
+    "step": 997,
+    "loss": 1.617380142211914,
+    "diagonal": 1.617380142211914
+  },
+  {
+    "step": 998,
+    "loss": 1.616735577583313,
+    "diagonal": 1.616735577583313
+  },
+  {
+    "step": 999,
+    "loss": 1.8335378170013428,
+    "diagonal": 1.8335378170013428
+  }
+]
diff --git a/lecture_6/verified_examples/flow-matching/report.json b/lecture_6/verified_examples/flow-matching/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..19d69de9f824fe3cc9b84dbaee640d3b01cad0fb
--- /dev/null
+++ b/lecture_6/verified_examples/flow-matching/report.json
@@ -0,0 +1,23 @@
+{
+  "method": "flow-matching",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 3.24046847820282,
+  "train_loss_last_20_mean": 2.0242882668972015,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "finite_samples": true,
+  "mean_distance_to_center": 0.5745956301689148,
+  "mode_fractions": [
+    0.2421875,
+    0.2265625,
+    0.28125,
+    0.25
+  ],
+  "mode_entropy": 1.383159875869751,
+  "mean_target_log_density": -5.167024612426758,
+  "elapsed_seconds": 2.210745528995176
+}
diff --git a/lecture_6/verified_examples/flow-matching/samples.txt b/lecture_6/verified_examples/flow-matching/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..93ae8e41e005b36587840e00f39906eb591ed6d2
--- /dev/null
+++ b/lecture_6/verified_examples/flow-matching/samples.txt
@@ -0,0 +1,128 @@
+-1.0318449 1.9090396
+-1.5909061 1.7500445
+-1.8162498 -1.7074174
+-1.7028427 -0.0118737
+1.0298800 -1.4725351
+-1.4410820 1.8026438
+1.7033867 -1.7990711
+-1.5713065 -1.8976696
+-1.6137145 -1.5734078
+1.2403823 1.8339806
+0.5488814 1.4821441
+1.9050701 -1.2001956
+1.7748324 0.6629095
+1.0800235 -0.5433609
+-1.3479337 -1.6681588
+1.8408359 -1.6784062
+1.3695062 1.5660008
+1.4926842 -1.7994286
+0.8437617 1.0686233
+1.6571949 -1.6054533
+-1.6735055 1.7841157
+-1.6332281 -1.2158206
+-1.5766392 -1.8360946
+-1.3629527 -1.8664862
+0.7966055 -1.6983931
+-1.8409957 0.6454588
+1.3324664 0.0809314
+-0.1328692 -1.7704432
+-1.7323091 1.4778780
+-0.0552480 -1.8122578
+-1.1666288 -1.4769793
+-1.9261460 -1.6534350
+0.2719772 -1.9242232
+-1.5404308 -1.7011459
+1.7134253 1.6568899
+0.3579960 -1.5978668
+1.6920153 1.3670046
+0.2368303 1.8951914
+1.5904461 1.9720957
+1.6611606 -0.8729798
+0.6750110 1.7326972
+-1.8035369 -1.0521355
+0.1421167 -1.4766862
+1.8854622 1.0525250
+-1.6411744 -1.6622374
+-0.4883075 1.7425487
+-1.3870476 -1.5365516
+1.6876394 -1.6845965
+1.4309965 1.9082024
+-1.7352269 1.3477594
+0.9048604 1.7582762
+0.3387129 -0.9257002
+1.3196515 -1.3156081
+1.1158240 1.6264958
+-0.0085000 1.9557558
+-1.9601488 1.3807662
+1.4279454 -1.3398160
+-0.4112976 1.4072033
+-1.7161508 -1.4063334
+-1.7108748 2.1212487
+-1.7569723 -0.8373985
+1.2963234 1.7609347
+0.8295121 1.7016867
+1.7789630 0.6870071
+1.9174151 -1.7159016
+1.6606069 -1.8786029
+0.4614496 -1.3333619
+1.8482634 -1.6288730
+-1.5442491 -1.6358951
+-1.8114254 -1.1505499
+1.5764792 1.3302101
+1.6066120 0.1850797
+0.3415485 -0.6980461
+-0.5260218 1.5108008
+1.5973955 1.6423464
+0.7374820 -1.7513647
+1.6547995 -1.7687896
+1.8860717 -1.5679345
+1.5742874 1.5244415
+1.9450238 -1.4865844
+-0.8094668 1.9451088
+1.5721960 1.2914540
+1.4212058 1.8923714
+-1.3136820 2.2619441
+-1.3217148 -1.1627350
+-1.8807640 -1.1918917
+2.1143117 1.4721439
+-0.2694032 1.5524762
+-1.8566848 1.7491370
+-0.0264828 -0.7208664
+1.8965459 1.1964781
+-1.9573539 1.5651225
+2.0340216 -1.7020628
+1.4053469 1.5802072
+-1.8365707 0.7321306
+-0.9576587 1.5596290
+-0.4926800 1.4081123
+1.5288022 -1.6382427
+-1.7897409 -0.2667727
+1.3982477 -1.6348954
+-1.7479188 -1.6154966
+-1.6816280 1.0562203
+-0.5600754 1.9069816
+-1.9022895 -1.3489180
+-1.5629504 -1.8059248
+-1.7577504 1.6910453
+1.2949597 -1.7224350
+1.4993131 -1.6997749
+-1.9142194 -1.7006146
+-1.0565171 1.6055837
+-0.5462217 -1.7074597
+1.9190407 1.1008289
+1.0512414 1.1541172
+1.4812063 -1.6724906
+1.8621893 -1.5564522
+-1.4487495 -1.3075733
+1.4665880 1.8864069
+1.8450238 1.4775031
+1.3699889 -1.1621897
+-1.7825837 -1.6492997
+2.0470173 -1.6700866
+-1.9961063 0.0796640
+-1.7052243 1.6013174
+1.5563605 1.8264260
+1.5181524 -1.6774327
+-1.9748398 1.7358437
+-1.2843368 1.3664542
+1.8805618 -1.6605697
diff --git a/lecture_6/verified_examples/fmlm/config.json b/lecture_6/verified_examples/fmlm/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..51e615ae2332040fb7b75a2c0f7c4e97fd1e8f01
--- /dev/null
+++ b/lecture_6/verified_examples/fmlm/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "fmlm",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/fmlm"
+}
diff --git a/lecture_6/verified_examples/fmlm/losses.json b/lecture_6/verified_examples/fmlm/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..7615626239b5c884a47a4329438c7c7722592e96
--- /dev/null
+++ b/lecture_6/verified_examples/fmlm/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.5544071197509766,
+    "diagonal_ce": 2.5544071197509766,
+    "finite": 9.665265679359436e-06
+  },
+  {
+    "step": 1,
+    "loss": 2.5425899028778076,
+    "diagonal_ce": 2.5425896644592285,
+    "finite": 1.8433434888720512e-05
+  },
+  {
+    "step": 2,
+    "loss": 2.5348525047302246,
+    "diagonal_ce": 2.5348520278930664,
+    "finite": 4.0788669139146805e-05
+  },
+  {
+    "step": 3,
+    "loss": 2.535761594772339,
+    "diagonal_ce": 2.5357604026794434,
+    "finite": 8.044735295698047e-05
+  },
+  {
+    "step": 4,
+    "loss": 2.5233564376831055,
+    "diagonal_ce": 2.5233538150787354,
+    "finite": 0.0001352523686364293
+  },
+  {
+    "step": 5,
+    "loss": 2.5137054920196533,
+    "diagonal_ce": 2.5137007236480713,
+    "finite": 0.0002028903691098094
+  },
+  {
+    "step": 6,
+    "loss": 2.504711627960205,
+    "diagonal_ce": 2.5047030448913574,
+    "finite": 0.00030407728627324104
+  },
+  {
+    "step": 7,
+    "loss": 2.500145435333252,
+    "diagonal_ce": 2.5001327991485596,
+    "finite": 0.00039328669663518667
+  },
+  {
+    "step": 8,
+    "loss": 2.4877567291259766,
+    "diagonal_ce": 2.487738609313965,
+    "finite": 0.000500418886076659
+  },
+  {
+    "step": 9,
+    "loss": 2.485198736190796,
+    "diagonal_ce": 2.4851748943328857,
+    "finite": 0.0005944317672401667
+  },
+  {
+    "step": 10,
+    "loss": 2.4704959392547607,
+    "diagonal_ce": 2.470461845397949,
+    "finite": 0.0007756887353025377
+  },
+  {
+    "step": 11,
+    "loss": 2.467183828353882,
+    "diagonal_ce": 2.467137336730957,
+    "finite": 0.000967073196079582
+  },
+  {
+    "step": 12,
+    "loss": 2.4572551250457764,
+    "diagonal_ce": 2.4571950435638428,
+    "finite": 0.0011543373111635447
+  },
+  {
+    "step": 13,
+    "loss": 2.4415202140808105,
+    "diagonal_ce": 2.4414381980895996,
+    "finite": 0.001466238172724843
+  },
+  {
+    "step": 14,
+    "loss": 2.4346442222595215,
+    "diagonal_ce": 2.434539794921875,
+    "finite": 0.0017391538713127375
+  },
+  {
+    "step": 15,
+    "loss": 2.4232404232025146,
+    "diagonal_ce": 2.4231085777282715,
+    "finite": 0.002059491351246834
+  },
+  {
+    "step": 16,
+    "loss": 2.4118916988372803,
+    "diagonal_ce": 2.4117238521575928,
+    "finite": 0.0024690860882401466
+  },
+  {
+    "step": 17,
+    "loss": 2.3990516662597656,
+    "diagonal_ce": 2.3988327980041504,
+    "finite": 0.00304131000302732
+  },
+  {
+    "step": 18,
+    "loss": 2.388828992843628,
+    "diagonal_ce": 2.388559103012085,
+    "finite": 0.003550745779648423
+  },
+  {
+    "step": 19,
+    "loss": 2.3752591609954834,
+    "diagonal_ce": 2.3749256134033203,
+    "finite": 0.0041693225502967834
+  },
+  {
+    "step": 20,
+    "loss": 2.370630979537964,
+    "diagonal_ce": 2.370230197906494,
+    "finite": 0.004771225620061159
+  },
+  {
+    "step": 21,
+    "loss": 2.356440782546997,
+    "diagonal_ce": 2.355975866317749,
+    "finite": 0.005282049532979727
+  },
+  {
+    "step": 22,
+    "loss": 2.337785243988037,
+    "diagonal_ce": 2.337172269821167,
+    "finite": 0.006663620471954346
+  },
+  {
+    "step": 23,
+    "loss": 2.3271586894989014,
+    "diagonal_ce": 2.326474666595459,
+    "finite": 0.007126331329345703
+  },
+  {
+    "step": 24,
+    "loss": 2.3007686138153076,
+    "diagonal_ce": 2.299856185913086,
+    "finite": 0.00912382174283266
+  },
+  {
+    "step": 25,
+    "loss": 2.293839931488037,
+    "diagonal_ce": 2.2928411960601807,
+    "finite": 0.009603220038115978
+  },
+  {
+    "step": 26,
+    "loss": 2.2555348873138428,
+    "diagonal_ce": 2.254087448120117,
+    "finite": 0.013402543030679226
+  },
+  {
+    "step": 27,
+    "loss": 2.241184711456299,
+    "diagonal_ce": 2.2394979000091553,
+    "finite": 0.015061439946293831
+  },
+  {
+    "step": 28,
+    "loss": 2.2013208866119385,
+    "diagonal_ce": 2.1991777420043945,
+    "finite": 0.018476314842700958
+  },
+  {
+    "step": 29,
+    "loss": 2.2075157165527344,
+    "diagonal_ce": 2.205244302749634,
+    "finite": 0.018928287550807
+  },
+  {
+    "step": 30,
+    "loss": 2.1459481716156006,
+    "diagonal_ce": 2.1427667140960693,
+    "finite": 0.02565642073750496
+  },
+  {
+    "step": 31,
+    "loss": 2.1471364498138428,
+    "diagonal_ce": 2.1435773372650146,
+    "finite": 0.027805674821138382
+  },
+  {
+    "step": 32,
+    "loss": 2.109086751937866,
+    "diagonal_ce": 2.1046035289764404,
+    "finite": 0.03396359831094742
+  },
+  {
+    "step": 33,
+    "loss": 2.079298257827759,
+    "diagonal_ce": 2.0737905502319336,
+    "finite": 0.04049783945083618
+  },
+  {
+    "step": 34,
+    "loss": 2.0506374835968018,
+    "diagonal_ce": 2.0439369678497314,
+    "finite": 0.047861624509096146
+  },
+  {
+    "step": 35,
+    "loss": 2.042029619216919,
+    "diagonal_ce": 2.034566640853882,
+    "finite": 0.05182553455233574
+  },
+  {
+    "step": 36,
+    "loss": 2.018155336380005,
+    "diagonal_ce": 2.0092978477478027,
+    "finite": 0.05984818935394287
+  },
+  {
+    "step": 37,
+    "loss": 1.979705810546875,
+    "diagonal_ce": 1.9689399003982544,
+    "finite": 0.07082819938659668
+  },
+  {
+    "step": 38,
+    "loss": 1.90839684009552,
+    "diagonal_ce": 1.894446611404419,
+    "finite": 0.08942471444606781
+  },
+  {
+    "step": 39,
+    "loss": 1.9077069759368896,
+    "diagonal_ce": 1.8924719095230103,
+    "finite": 0.09521936625242233
+  },
+  {
+    "step": 40,
+    "loss": 1.8903276920318604,
+    "diagonal_ce": 1.8740651607513428,
+    "finite": 0.09916150569915771
+  },
+  {
+    "step": 41,
+    "loss": 1.8353967666625977,
+    "diagonal_ce": 1.813764214515686,
+    "finite": 0.12876512110233307
+  },
+  {
+    "step": 42,
+    "loss": 1.8131805658340454,
+    "diagonal_ce": 1.7884135246276855,
+    "finite": 0.1439942568540573
+  },
+  {
+    "step": 43,
+    "loss": 1.808759331703186,
+    "diagonal_ce": 1.7808465957641602,
+    "finite": 0.15859510004520416
+  },
+  {
+    "step": 44,
+    "loss": 1.7449713945388794,
+    "diagonal_ce": 1.7091397047042847,
+    "finite": 0.19906513392925262
+  },
+  {
+    "step": 45,
+    "loss": 1.6726977825164795,
+    "diagonal_ce": 1.6282963752746582,
+    "finite": 0.2413121461868286
+  },
+  {
+    "step": 46,
+    "loss": 1.6480586528778076,
+    "diagonal_ce": 1.5957919359207153,
+    "finite": 0.2780143618583679
+  },
+  {
+    "step": 47,
+    "loss": 1.666612148284912,
+    "diagonal_ce": 1.6133853197097778,
+    "finite": 0.2772233784198761
+  },
+  {
+    "step": 48,
+    "loss": 1.6349480152130127,
+    "diagonal_ce": 1.569636583328247,
+    "finite": 0.3332216739654541
+  },
+  {
+    "step": 49,
+    "loss": 1.6182621717453003,
+    "diagonal_ce": 1.5446269512176514,
+    "finite": 0.3681759238243103
+  },
+  {
+    "step": 50,
+    "loss": 1.546461582183838,
+    "diagonal_ce": 1.4586353302001953,
+    "finite": 0.430520623922348
+  },
+  {
+    "step": 51,
+    "loss": 1.522376537322998,
+    "diagonal_ce": 1.4154802560806274,
+    "finite": 0.5139243602752686
+  },
+  {
+    "step": 52,
+    "loss": 1.5201148986816406,
+    "diagonal_ce": 1.4096403121948242,
+    "finite": 0.5211063623428345
+  },
+  {
+    "step": 53,
+    "loss": 1.511034607887268,
+    "diagonal_ce": 1.3928769826889038,
+    "finite": 0.5470260977745056
+  },
+  {
+    "step": 54,
+    "loss": 1.5052982568740845,
+    "diagonal_ce": 1.3662676811218262,
+    "finite": 0.6319571733474731
+  },
+  {
+    "step": 55,
+    "loss": 1.500799536705017,
+    "diagonal_ce": 1.3549365997314453,
+    "finite": 0.6511738896369934
+  },
+  {
+    "step": 56,
+    "loss": 1.5142090320587158,
+    "diagonal_ce": 1.3585536479949951,
+    "finite": 0.6826990246772766
+  },
+  {
+    "step": 57,
+    "loss": 1.4986876249313354,
+    "diagonal_ce": 1.3182713985443115,
+    "finite": 0.777656078338623
+  },
+  {
+    "step": 58,
+    "loss": 1.4645854234695435,
+    "diagonal_ce": 1.258272647857666,
+    "finite": 0.8742067813873291
+  },
+  {
+    "step": 59,
+    "loss": 1.4867080450057983,
+    "diagonal_ce": 1.2661011219024658,
+    "finite": 0.9191955327987671
+  },
+  {
+    "step": 60,
+    "loss": 1.4936134815216064,
+    "diagonal_ce": 1.2852940559387207,
+    "finite": 0.8537683486938477
+  },
+  {
+    "step": 61,
+    "loss": 1.4740396738052368,
+    "diagonal_ce": 1.2438387870788574,
+    "finite": 0.9282295107841492
+  },
+  {
+    "step": 62,
+    "loss": 1.513140320777893,
+    "diagonal_ce": 1.3000590801239014,
+    "finite": 0.845560610294342
+  },
+  {
+    "step": 63,
+    "loss": 1.4937703609466553,
+    "diagonal_ce": 1.2330042123794556,
+    "finite": 1.018617868423462
+  },
+  {
+    "step": 64,
+    "loss": 1.4809751510620117,
+    "diagonal_ce": 1.1877583265304565,
+    "finite": 1.12775719165802
+  },
+  {
+    "step": 65,
+    "loss": 1.5129964351654053,
+    "diagonal_ce": 1.251839280128479,
+    "finite": 0.9892316460609436
+  },
+  {
+    "step": 66,
+    "loss": 1.4929176568984985,
+    "diagonal_ce": 1.2038071155548096,
+    "finite": 1.0787707567214966
+  },
+  {
+    "step": 67,
+    "loss": 1.4965603351593018,
+    "diagonal_ce": 1.2135652303695679,
+    "finite": 1.0404233932495117
+  },
+  {
+    "step": 68,
+    "loss": 1.4966710805892944,
+    "diagonal_ce": 1.1910219192504883,
+    "finite": 1.1074244976043701
+  },
+  {
+    "step": 69,
+    "loss": 1.4661729335784912,
+    "diagonal_ce": 1.1658294200897217,
+    "finite": 1.072655200958252
+  },
+  {
+    "step": 70,
+    "loss": 1.4808499813079834,
+    "diagonal_ce": 1.1882386207580566,
+    "finite": 1.0303215980529785
+  },
+  {
+    "step": 71,
+    "loss": 1.4895977973937988,
+    "diagonal_ce": 1.2028142213821411,
+    "finite": 0.9957764744758606
+  },
+  {
+    "step": 72,
+    "loss": 1.5238287448883057,
+    "diagonal_ce": 1.2058343887329102,
+    "finite": 1.0890215635299683
+  },
+  {
+    "step": 73,
+    "loss": 1.4745924472808838,
+    "diagonal_ce": 1.1930166482925415,
+    "finite": 0.9512693285942078
+  },
+  {
+    "step": 74,
+    "loss": 1.4671376943588257,
+    "diagonal_ce": 1.1666508913040161,
+    "finite": 1.0016225576400757
+  },
+  {
+    "step": 75,
+    "loss": 1.4529321193695068,
+    "diagonal_ce": 1.1574947834014893,
+    "finite": 0.9718334078788757
+  },
+  {
+    "step": 76,
+    "loss": 1.4776384830474854,
+    "diagonal_ce": 1.2053964138031006,
+    "finite": 0.8839027285575867
+  },
+  {
+    "step": 77,
+    "loss": 1.4724352359771729,
+    "diagonal_ce": 1.1521450281143188,
+    "finite": 1.0265711545944214
+  },
+  {
+    "step": 78,
+    "loss": 1.4720511436462402,
+    "diagonal_ce": 1.209426999092102,
+    "finite": 0.8310890793800354
+  },
+  {
+    "step": 79,
+    "loss": 1.4819809198379517,
+    "diagonal_ce": 1.2219501733779907,
+    "finite": 0.8125960826873779
+  },
+  {
+    "step": 80,
+    "loss": 1.4485422372817993,
+    "diagonal_ce": 1.1991393566131592,
+    "finite": 0.769761860370636
+  },
+  {
+    "step": 81,
+    "loss": 1.4526110887527466,
+    "diagonal_ce": 1.2039456367492676,
+    "finite": 0.7581263780593872
+  },
+  {
+    "step": 82,
+    "loss": 1.4569096565246582,
+    "diagonal_ce": 1.2181886434555054,
+    "finite": 0.7190393209457397
+  },
+  {
+    "step": 83,
+    "loss": 1.4444148540496826,
+    "diagonal_ce": 1.2071157693862915,
+    "finite": 0.7062473893165588
+  },
+  {
+    "step": 84,
+    "loss": 1.4416425228118896,
+    "diagonal_ce": 1.2125128507614136,
+    "finite": 0.6739106178283691
+  },
+  {
+    "step": 85,
+    "loss": 1.418421983718872,
+    "diagonal_ce": 1.188002347946167,
+    "finite": 0.669824481010437
+  },
+  {
+    "step": 86,
+    "loss": 1.424837350845337,
+    "diagonal_ce": 1.2117124795913696,
+    "finite": 0.6124278903007507
+  },
+  {
+    "step": 87,
+    "loss": 1.4151155948638916,
+    "diagonal_ce": 1.1843082904815674,
+    "finite": 0.655702531337738
+  },
+  {
+    "step": 88,
+    "loss": 1.4153375625610352,
+    "diagonal_ce": 1.1995313167572021,
+    "finite": 0.6061972975730896
+  },
+  {
+    "step": 89,
+    "loss": 1.4340195655822754,
+    "diagonal_ce": 1.2343782186508179,
+    "finite": 0.5545593500137329
+  },
+  {
+    "step": 90,
+    "loss": 1.4593743085861206,
+    "diagonal_ce": 1.267677903175354,
+    "finite": 0.5266385674476624
+  },
+  {
+    "step": 91,
+    "loss": 1.4182602167129517,
+    "diagonal_ce": 1.2151343822479248,
+    "finite": 0.5519724488258362
+  },
+  {
+    "step": 92,
+    "loss": 1.4048672914505005,
+    "diagonal_ce": 1.204967975616455,
+    "finite": 0.5373636484146118
+  },
+  {
+    "step": 93,
+    "loss": 1.4357935190200806,
+    "diagonal_ce": 1.2400394678115845,
+    "finite": 0.5206223726272583
+  },
+  {
+    "step": 94,
+    "loss": 1.4197332859039307,
+    "diagonal_ce": 1.217236876487732,
+    "finite": 0.5328851342201233
+  },
+  {
+    "step": 95,
+    "loss": 1.3971691131591797,
+    "diagonal_ce": 1.2107502222061157,
+    "finite": 0.48546597361564636
+  },
+  {
+    "step": 96,
+    "loss": 1.3836976289749146,
+    "diagonal_ce": 1.191712737083435,
+    "finite": 0.4948063790798187
+  },
+  {
+    "step": 97,
+    "loss": 1.4084125757217407,
+    "diagonal_ce": 1.2150237560272217,
+    "finite": 0.49333876371383667
+  },
+  {
+    "step": 98,
+    "loss": 1.410001516342163,
+    "diagonal_ce": 1.2136811017990112,
+    "finite": 0.4957585036754608
+  },
+  {
+    "step": 99,
+    "loss": 1.4198153018951416,
+    "diagonal_ce": 1.2301217317581177,
+    "finite": 0.4742338955402374
+  },
+  {
+    "step": 100,
+    "loss": 1.4025170803070068,
+    "diagonal_ce": 1.209215521812439,
+    "finite": 0.4784693121910095
+  },
+  {
+    "step": 101,
+    "loss": 1.431884527206421,
+    "diagonal_ce": 1.2440531253814697,
+    "finite": 0.46037107706069946
+  },
+  {
+    "step": 102,
+    "loss": 1.394848346710205,
+    "diagonal_ce": 1.200095534324646,
+    "finite": 0.4727010726928711
+  },
+  {
+    "step": 103,
+    "loss": 1.4092581272125244,
+    "diagonal_ce": 1.2102043628692627,
+    "finite": 0.47849464416503906
+  },
+  {
+    "step": 104,
+    "loss": 1.400463342666626,
+    "diagonal_ce": 1.2098054885864258,
+    "finite": 0.45394712686538696
+  },
+  {
+    "step": 105,
+    "loss": 1.3682994842529297,
+    "diagonal_ce": 1.1717346906661987,
+    "finite": 0.4635962247848511
+  },
+  {
+    "step": 106,
+    "loss": 1.4059349298477173,
+    "diagonal_ce": 1.215976595878601,
+    "finite": 0.4438278079032898
+  },
+  {
+    "step": 107,
+    "loss": 1.3730835914611816,
+    "diagonal_ce": 1.1752147674560547,
+    "finite": 0.4580296277999878
+  },
+  {
+    "step": 108,
+    "loss": 1.3584400415420532,
+    "diagonal_ce": 1.156075358390808,
+    "finite": 0.46413910388946533
+  },
+  {
+    "step": 109,
+    "loss": 1.3680614233016968,
+    "diagonal_ce": 1.1721885204315186,
+    "finite": 0.4451657235622406
+  },
+  {
+    "step": 110,
+    "loss": 1.34187912940979,
+    "diagonal_ce": 1.14189875125885,
+    "finite": 0.4504062235355377
+  },
+  {
+    "step": 111,
+    "loss": 1.3542495965957642,
+    "diagonal_ce": 1.157843828201294,
+    "finite": 0.4384056329727173
+  },
+  {
+    "step": 112,
+    "loss": 1.3728513717651367,
+    "diagonal_ce": 1.1810109615325928,
+    "finite": 0.4244258403778076
+  },
+  {
+    "step": 113,
+    "loss": 1.3469356298446655,
+    "diagonal_ce": 1.1419399976730347,
+    "finite": 0.4495518207550049
+  },
+  {
+    "step": 114,
+    "loss": 1.3425418138504028,
+    "diagonal_ce": 1.1428931951522827,
+    "finite": 0.4340188205242157
+  },
+  {
+    "step": 115,
+    "loss": 1.364851951599121,
+    "diagonal_ce": 1.1725355386734009,
+    "finite": 0.4144749641418457
+  },
+  {
+    "step": 116,
+    "loss": 1.3718316555023193,
+    "diagonal_ce": 1.1705399751663208,
+    "finite": 0.4301103353500366
+  },
+  {
+    "step": 117,
+    "loss": 1.3429925441741943,
+    "diagonal_ce": 1.148960828781128,
+    "finite": 0.4110840857028961
+  },
+  {
+    "step": 118,
+    "loss": 1.3546946048736572,
+    "diagonal_ce": 1.1619203090667725,
+    "finite": 0.4049880802631378
+  },
+  {
+    "step": 119,
+    "loss": 1.3089735507965088,
+    "diagonal_ce": 1.1056030988693237,
+    "finite": 0.4236883521080017
+  },
+  {
+    "step": 120,
+    "loss": 1.3121308088302612,
+    "diagonal_ce": 1.1210455894470215,
+    "finite": 0.3948041796684265
+  },
+  {
+    "step": 121,
+    "loss": 1.3063912391662598,
+    "diagonal_ce": 1.1168345212936401,
+    "finite": 0.38843581080436707
+  },
+  {
+    "step": 122,
+    "loss": 1.3137099742889404,
+    "diagonal_ce": 1.1210100650787354,
+    "finite": 0.3916664123535156
+  },
+  {
+    "step": 123,
+    "loss": 1.3026783466339111,
+    "diagonal_ce": 1.1150256395339966,
+    "finite": 0.3783321678638458
+  },
+  {
+    "step": 124,
+    "loss": 1.2967803478240967,
+    "diagonal_ce": 1.0992097854614258,
+    "finite": 0.395141065120697
+  },
+  {
+    "step": 125,
+    "loss": 1.3495876789093018,
+    "diagonal_ce": 1.1641627550125122,
+    "finite": 0.36790671944618225
+  },
+  {
+    "step": 126,
+    "loss": 1.3544185161590576,
+    "diagonal_ce": 1.164682388305664,
+    "finite": 0.37349629402160645
+  },
+  {
+    "step": 127,
+    "loss": 1.301410436630249,
+    "diagonal_ce": 1.1138907670974731,
+    "finite": 0.36624929308891296
+  },
+  {
+    "step": 128,
+    "loss": 1.2986738681793213,
+    "diagonal_ce": 1.1118593215942383,
+    "finite": 0.3620438277721405
+  },
+  {
+    "step": 129,
+    "loss": 1.2712814807891846,
+    "diagonal_ce": 1.0849756002426147,
+    "finite": 0.3582805097103119
+  },
+  {
+    "step": 130,
+    "loss": 1.2810783386230469,
+    "diagonal_ce": 1.1019755601882935,
+    "finite": 0.341799259185791
+  },
+  {
+    "step": 131,
+    "loss": 1.2759850025177002,
+    "diagonal_ce": 1.0932540893554688,
+    "finite": 0.3460812270641327
+  },
+  {
+    "step": 132,
+    "loss": 1.282578706741333,
+    "diagonal_ce": 1.0938035249710083,
+    "finite": 0.35484057664871216
+  },
+  {
+    "step": 133,
+    "loss": 1.262995719909668,
+    "diagonal_ce": 1.0765947103500366,
+    "finite": 0.3477630615234375
+  },
+  {
+    "step": 134,
+    "loss": 1.2292940616607666,
+    "diagonal_ce": 1.0408555269241333,
+    "finite": 0.3489603102207184
+  },
+  {
+    "step": 135,
+    "loss": 1.2545835971832275,
+    "diagonal_ce": 1.0745189189910889,
+    "finite": 0.3310012221336365
+  },
+  {
+    "step": 136,
+    "loss": 1.254140853881836,
+    "diagonal_ce": 1.077646017074585,
+    "finite": 0.32207098603248596
+  },
+  {
+    "step": 137,
+    "loss": 1.2671136856079102,
+    "diagonal_ce": 1.0794196128845215,
+    "finite": 0.3400256037712097
+  },
+  {
+    "step": 138,
+    "loss": 1.2263401746749878,
+    "diagonal_ce": 1.0434144735336304,
+    "finite": 0.32900312542915344
+  },
+  {
+    "step": 139,
+    "loss": 1.1916289329528809,
+    "diagonal_ce": 1.0104260444641113,
+    "finite": 0.3235766887664795
+  },
+  {
+    "step": 140,
+    "loss": 1.221106767654419,
+    "diagonal_ce": 1.0439388751983643,
+    "finite": 0.3141273856163025
+  },
+  {
+    "step": 141,
+    "loss": 1.2255955934524536,
+    "diagonal_ce": 1.0552383661270142,
+    "finite": 0.2999247610569
+  },
+  {
+    "step": 142,
+    "loss": 1.2147890329360962,
+    "diagonal_ce": 1.036612868309021,
+    "finite": 0.3114968538284302
+  },
+  {
+    "step": 143,
+    "loss": 1.1758666038513184,
+    "diagonal_ce": 0.9973285794258118,
+    "finite": 0.3099619448184967
+  },
+  {
+    "step": 144,
+    "loss": 1.190671682357788,
+    "diagonal_ce": 1.0035040378570557,
+    "finite": 0.3227028548717499
+  },
+  {
+    "step": 145,
+    "loss": 1.2197272777557373,
+    "diagonal_ce": 1.044622540473938,
+    "finite": 0.2998369336128235
+  },
+  {
+    "step": 146,
+    "loss": 1.1959136724472046,
+    "diagonal_ce": 1.0033291578292847,
+    "finite": 0.32752466201782227
+  },
+  {
+    "step": 147,
+    "loss": 1.1721996068954468,
+    "diagonal_ce": 0.9921860694885254,
+    "finite": 0.3040769696235657
+  },
+  {
+    "step": 148,
+    "loss": 1.1919156312942505,
+    "diagonal_ce": 1.0114697217941284,
+    "finite": 0.30276164412498474
+  },
+  {
+    "step": 149,
+    "loss": 1.1597578525543213,
+    "diagonal_ce": 0.9782337546348572,
+    "finite": 0.3025400638580322
+  },
+  {
+    "step": 150,
+    "loss": 1.1745418310165405,
+    "diagonal_ce": 0.9868951439857483,
+    "finite": 0.3106732964515686
+  },
+  {
+    "step": 151,
+    "loss": 1.1986502408981323,
+    "diagonal_ce": 1.015276312828064,
+    "finite": 0.3016018569469452
+  },
+  {
+    "step": 152,
+    "loss": 1.147903323173523,
+    "diagonal_ce": 0.9708317518234253,
+    "finite": 0.28933268785476685
+  },
+  {
+    "step": 153,
+    "loss": 1.2065064907073975,
+    "diagonal_ce": 1.0220566987991333,
+    "finite": 0.2994315028190613
+  },
+  {
+    "step": 154,
+    "loss": 1.158122181892395,
+    "diagonal_ce": 0.960889995098114,
+    "finite": 0.3181164264678955
+  },
+  {
+    "step": 155,
+    "loss": 1.162170648574829,
+    "diagonal_ce": 0.9782256484031677,
+    "finite": 0.29478374123573303
+  },
+  {
+    "step": 156,
+    "loss": 1.089599847793579,
+    "diagonal_ce": 0.9158610105514526,
+    "finite": 0.2766541540622711
+  },
+  {
+    "step": 157,
+    "loss": 1.1546579599380493,
+    "diagonal_ce": 0.9666519165039062,
+    "finite": 0.2974778413772583
+  },
+  {
+    "step": 158,
+    "loss": 1.1718746423721313,
+    "diagonal_ce": 0.9841826558113098,
+    "finite": 0.295113205909729
+  },
+  {
+    "step": 159,
+    "loss": 1.1367793083190918,
+    "diagonal_ce": 0.9449862241744995,
+    "finite": 0.2996767461299896
+  },
+  {
+    "step": 160,
+    "loss": 1.1434144973754883,
+    "diagonal_ce": 0.9729758501052856,
+    "finite": 0.26465630531311035
+  },
+  {
+    "step": 161,
+    "loss": 1.1073665618896484,
+    "diagonal_ce": 0.9287293553352356,
+    "finite": 0.2756747007369995
+  },
+  {
+    "step": 162,
+    "loss": 1.0645606517791748,
+    "diagonal_ce": 0.894693911075592,
+    "finite": 0.2605317533016205
+  },
+  {
+    "step": 163,
+    "loss": 1.059821367263794,
+    "diagonal_ce": 0.8814845681190491,
+    "finite": 0.27185478806495667
+  },
+  {
+    "step": 164,
+    "loss": 1.0992354154586792,
+    "diagonal_ce": 0.9269160032272339,
+    "finite": 0.2610900104045868
+  },
+  {
+    "step": 165,
+    "loss": 1.0911691188812256,
+    "diagonal_ce": 0.9151123762130737,
+    "finite": 0.2651456296443939
+  },
+  {
+    "step": 166,
+    "loss": 1.1688876152038574,
+    "diagonal_ce": 0.9928633570671082,
+    "finite": 0.26350945234298706
+  },
+  {
+    "step": 167,
+    "loss": 1.0563037395477295,
+    "diagonal_ce": 0.8698562383651733,
+    "finite": 0.27745169401168823
+  },
+  {
+    "step": 168,
+    "loss": 1.117122769355774,
+    "diagonal_ce": 0.9422245025634766,
+    "finite": 0.25872525572776794
+  },
+  {
+    "step": 169,
+    "loss": 1.0830824375152588,
+    "diagonal_ce": 0.9129875898361206,
+    "finite": 0.2501395642757416
+  },
+  {
+    "step": 170,
+    "loss": 1.14253830909729,
+    "diagonal_ce": 0.9662998914718628,
+    "finite": 0.25765857100486755
+  },
+  {
+    "step": 171,
+    "loss": 1.1098289489746094,
+    "diagonal_ce": 0.9329361319541931,
+    "finite": 0.2571115791797638
+  },
+  {
+    "step": 172,
+    "loss": 1.045320749282837,
+    "diagonal_ce": 0.8544630408287048,
+    "finite": 0.2758060097694397
+  },
+  {
+    "step": 173,
+    "loss": 1.0939055681228638,
+    "diagonal_ce": 0.8991106152534485,
+    "finite": 0.27987778186798096
+  },
+  {
+    "step": 174,
+    "loss": 1.1015263795852661,
+    "diagonal_ce": 0.9197486042976379,
+    "finite": 0.2596825659275055
+  },
+  {
+    "step": 175,
+    "loss": 1.0546261072158813,
+    "diagonal_ce": 0.8631795048713684,
+    "finite": 0.2719411849975586
+  },
+  {
+    "step": 176,
+    "loss": 1.1050788164138794,
+    "diagonal_ce": 0.9144638776779175,
+    "finite": 0.2692301869392395
+  },
+  {
+    "step": 177,
+    "loss": 1.1126868724822998,
+    "diagonal_ce": 0.9348247647285461,
+    "finite": 0.24980640411376953
+  },
+  {
+    "step": 178,
+    "loss": 1.0230746269226074,
+    "diagonal_ce": 0.8381792902946472,
+    "finite": 0.2582336366176605
+  },
+  {
+    "step": 179,
+    "loss": 1.0118484497070312,
+    "diagonal_ce": 0.8211116790771484,
+    "finite": 0.2649121582508087
+  },
+  {
+    "step": 180,
+    "loss": 1.070902943611145,
+    "diagonal_ce": 0.8566020131111145,
+    "finite": 0.2959957718849182
+  },
+  {
+    "step": 181,
+    "loss": 0.9419904947280884,
+    "diagonal_ce": 0.7162942886352539,
+    "finite": 0.3100222945213318
+  },
+  {
+    "step": 182,
+    "loss": 1.025388240814209,
+    "diagonal_ce": 0.8314894437789917,
+    "finite": 0.26488906145095825
+  },
+  {
+    "step": 183,
+    "loss": 0.9819016456604004,
+    "diagonal_ce": 0.7909053564071655,
+    "finite": 0.25950583815574646
+  },
+  {
+    "step": 184,
+    "loss": 1.0930722951889038,
+    "diagonal_ce": 0.9050772786140442,
+    "finite": 0.2540472745895386
+  },
+  {
+    "step": 185,
+    "loss": 1.0985808372497559,
+    "diagonal_ce": 0.9145126938819885,
+    "finite": 0.24740345776081085
+  },
+  {
+    "step": 186,
+    "loss": 0.9991390109062195,
+    "diagonal_ce": 0.8165022730827332,
+    "finite": 0.24416673183441162
+  },
+  {
+    "step": 187,
+    "loss": 1.0580997467041016,
+    "diagonal_ce": 0.8583152294158936,
+    "finite": 0.2656708359718323
+  },
+  {
+    "step": 188,
+    "loss": 0.9888953566551208,
+    "diagonal_ce": 0.7690372467041016,
+    "finite": 0.29081761837005615
+  },
+  {
+    "step": 189,
+    "loss": 1.1032724380493164,
+    "diagonal_ce": 0.9356632232666016,
+    "finite": 0.22053836286067963
+  },
+  {
+    "step": 190,
+    "loss": 0.9597960114479065,
+    "diagonal_ce": 0.7903249859809875,
+    "finite": 0.22182074189186096
+  },
+  {
+    "step": 191,
+    "loss": 1.0493662357330322,
+    "diagonal_ce": 0.8817939758300781,
+    "finite": 0.21819306910037994
+  },
+  {
+    "step": 192,
+    "loss": 1.0188969373703003,
+    "diagonal_ce": 0.8500211238861084,
+    "finite": 0.21875101327896118
+  },
+  {
+    "step": 193,
+    "loss": 0.9371954798698425,
+    "diagonal_ce": 0.760917603969574,
+    "finite": 0.2271622121334076
+  },
+  {
+    "step": 194,
+    "loss": 1.001916527748108,
+    "diagonal_ce": 0.8141700625419617,
+    "finite": 0.24070055782794952
+  },
+  {
+    "step": 195,
+    "loss": 1.0423332452774048,
+    "diagonal_ce": 0.8700363636016846,
+    "finite": 0.21976646780967712
+  },
+  {
+    "step": 196,
+    "loss": 1.031328558921814,
+    "diagonal_ce": 0.8624082207679749,
+    "finite": 0.2143659144639969
+  },
+  {
+    "step": 197,
+    "loss": 1.077846646308899,
+    "diagonal_ce": 0.9141042828559875,
+    "finite": 0.2067454308271408
+  },
+  {
+    "step": 198,
+    "loss": 1.1112067699432373,
+    "diagonal_ce": 0.9397355318069458,
+    "finite": 0.2154160737991333
+  },
+  {
+    "step": 199,
+    "loss": 0.9905627965927124,
+    "diagonal_ce": 0.813560426235199,
+    "finite": 0.2212529182434082
+  },
+  {
+    "step": 200,
+    "loss": 0.9370306730270386,
+    "diagonal_ce": 0.7525848150253296,
+    "finite": 0.22941023111343384
+  },
+  {
+    "step": 201,
+    "loss": 1.0484554767608643,
+    "diagonal_ce": 0.8498868942260742,
+    "finite": 0.2457531988620758
+  },
+  {
+    "step": 202,
+    "loss": 1.0603076219558716,
+    "diagonal_ce": 0.8836396932601929,
+    "finite": 0.21757137775421143
+  },
+  {
+    "step": 203,
+    "loss": 0.9716417193412781,
+    "diagonal_ce": 0.7802483439445496,
+    "finite": 0.23455068469047546
+  },
+  {
+    "step": 204,
+    "loss": 1.0352566242218018,
+    "diagonal_ce": 0.863673210144043,
+    "finite": 0.20924806594848633
+  },
+  {
+    "step": 205,
+    "loss": 1.0032896995544434,
+    "diagonal_ce": 0.8105376958847046,
+    "finite": 0.23392236232757568
+  },
+  {
+    "step": 206,
+    "loss": 1.0446094274520874,
+    "diagonal_ce": 0.8618814945220947,
+    "finite": 0.2206858992576599
+  },
+  {
+    "step": 207,
+    "loss": 1.0277208089828491,
+    "diagonal_ce": 0.869477391242981,
+    "finite": 0.1901964396238327
+  },
+  {
+    "step": 208,
+    "loss": 0.9796803593635559,
+    "diagonal_ce": 0.80974280834198,
+    "finite": 0.20327456295490265
+  },
+  {
+    "step": 209,
+    "loss": 1.0588281154632568,
+    "diagonal_ce": 0.8953762054443359,
+    "finite": 0.1945856511592865
+  },
+  {
+    "step": 210,
+    "loss": 0.9688242077827454,
+    "diagonal_ce": 0.8109255433082581,
+    "finite": 0.18708375096321106
+  },
+  {
+    "step": 211,
+    "loss": 0.988861083984375,
+    "diagonal_ce": 0.8353636264801025,
+    "finite": 0.1810111403465271
+  },
+  {
+    "step": 212,
+    "loss": 1.0524189472198486,
+    "diagonal_ce": 0.8896404504776001,
+    "finite": 0.1910545974969864
+  },
+  {
+    "step": 213,
+    "loss": 0.9415280222892761,
+    "diagonal_ce": 0.7721500992774963,
+    "finite": 0.1978713870048523
+  },
+  {
+    "step": 214,
+    "loss": 0.9732429385185242,
+    "diagonal_ce": 0.8010559678077698,
+    "finite": 0.2002173811197281
+  },
+  {
+    "step": 215,
+    "loss": 0.9969151020050049,
+    "diagonal_ce": 0.8261299133300781,
+    "finite": 0.19766804575920105
+  },
+  {
+    "step": 216,
+    "loss": 1.0179334878921509,
+    "diagonal_ce": 0.8697627782821655,
+    "finite": 0.17070354521274567
+  },
+  {
+    "step": 217,
+    "loss": 0.9761996269226074,
+    "diagonal_ce": 0.8125461935997009,
+    "finite": 0.18767596781253815
+  },
+  {
+    "step": 218,
+    "loss": 1.0670024156570435,
+    "diagonal_ce": 0.9256337881088257,
+    "finite": 0.16137973964214325
+  },
+  {
+    "step": 219,
+    "loss": 0.9545501470565796,
+    "diagonal_ce": 0.8033486008644104,
+    "finite": 0.17181995511054993
+  },
+  {
+    "step": 220,
+    "loss": 0.9959145784378052,
+    "diagonal_ce": 0.8245298862457275,
+    "finite": 0.1938740611076355
+  },
+  {
+    "step": 221,
+    "loss": 0.9989630579948425,
+    "diagonal_ce": 0.8599686026573181,
+    "finite": 0.15652528405189514
+  },
+  {
+    "step": 222,
+    "loss": 0.9823068380355835,
+    "diagonal_ce": 0.8368083834648132,
+    "finite": 0.16311483085155487
+  },
+  {
+    "step": 223,
+    "loss": 0.997157871723175,
+    "diagonal_ce": 0.8505481481552124,
+    "finite": 0.16362693905830383
+  },
+  {
+    "step": 224,
+    "loss": 1.040292501449585,
+    "diagonal_ce": 0.8917966485023499,
+    "finite": 0.16499535739421844
+  },
+  {
+    "step": 225,
+    "loss": 1.0898640155792236,
+    "diagonal_ce": 0.9456290602684021,
+    "finite": 0.1595519483089447
+  },
+  {
+    "step": 226,
+    "loss": 0.8768140077590942,
+    "diagonal_ce": 0.715377688407898,
+    "finite": 0.17779330909252167
+  },
+  {
+    "step": 227,
+    "loss": 0.9911782741546631,
+    "diagonal_ce": 0.838547945022583,
+    "finite": 0.16735780239105225
+  },
+  {
+    "step": 228,
+    "loss": 1.1501424312591553,
+    "diagonal_ce": 1.0195972919464111,
+    "finite": 0.1425165832042694
+  },
+  {
+    "step": 229,
+    "loss": 0.9305446147918701,
+    "diagonal_ce": 0.7865388989448547,
+    "finite": 0.15652792155742645
+  },
+  {
+    "step": 230,
+    "loss": 0.889840304851532,
+    "diagonal_ce": 0.7412747144699097,
+    "finite": 0.1607852429151535
+  },
+  {
+    "step": 231,
+    "loss": 1.0538791418075562,
+    "diagonal_ce": 0.9069494605064392,
+    "finite": 0.15832941234111786
+  },
+  {
+    "step": 232,
+    "loss": 0.9003673195838928,
+    "diagonal_ce": 0.7502447366714478,
+    "finite": 0.16107574105262756
+  },
+  {
+    "step": 233,
+    "loss": 1.060067892074585,
+    "diagonal_ce": 0.9251201152801514,
+    "finite": 0.14417502284049988
+  },
+  {
+    "step": 234,
+    "loss": 0.865860104560852,
+    "diagonal_ce": 0.7133923172950745,
+    "finite": 0.1621997356414795
+  },
+  {
+    "step": 235,
+    "loss": 0.9336057305335999,
+    "diagonal_ce": 0.8009375929832458,
+    "finite": 0.140538290143013
+  },
+  {
+    "step": 236,
+    "loss": 0.9663259983062744,
+    "diagonal_ce": 0.8313170671463013,
+    "finite": 0.14241446554660797
+  },
+  {
+    "step": 237,
+    "loss": 0.976011335849762,
+    "diagonal_ce": 0.8321892023086548,
+    "finite": 0.1510736495256424
+  },
+  {
+    "step": 238,
+    "loss": 0.9257371425628662,
+    "diagonal_ce": 0.7999933362007141,
+    "finite": 0.13153114914894104
+  },
+  {
+    "step": 239,
+    "loss": 0.9332742691040039,
+    "diagonal_ce": 0.7953871488571167,
+    "finite": 0.14363238215446472
+  },
+  {
+    "step": 240,
+    "loss": 0.9910545349121094,
+    "diagonal_ce": 0.8537766933441162,
+    "finite": 0.1424044370651245
+  },
+  {
+    "step": 241,
+    "loss": 0.9066179394721985,
+    "diagonal_ce": 0.7744333148002625,
+    "finite": 0.13655437529087067
+  },
+  {
+    "step": 242,
+    "loss": 0.8954262137413025,
+    "diagonal_ce": 0.7778791189193726,
+    "finite": 0.12093321979045868
+  },
+  {
+    "step": 243,
+    "loss": 0.9477486610412598,
+    "diagonal_ce": 0.8133076429367065,
+    "finite": 0.1377469301223755
+  },
+  {
+    "step": 244,
+    "loss": 0.9369418025016785,
+    "diagonal_ce": 0.797649085521698,
+    "finite": 0.1421354115009308
+  },
+  {
+    "step": 245,
+    "loss": 0.9107370972633362,
+    "diagonal_ce": 0.7711723446846008,
+    "finite": 0.1418341100215912
+  },
+  {
+    "step": 246,
+    "loss": 0.8831019401550293,
+    "diagonal_ce": 0.744125485420227,
+    "finite": 0.14066441357135773
+  },
+  {
+    "step": 247,
+    "loss": 0.8664068579673767,
+    "diagonal_ce": 0.7342923879623413,
+    "finite": 0.1331799179315567
+  },
+  {
+    "step": 248,
+    "loss": 0.9301141500473022,
+    "diagonal_ce": 0.8040568828582764,
+    "finite": 0.12656351923942566
+  },
+  {
+    "step": 249,
+    "loss": 0.8550145626068115,
+    "diagonal_ce": 0.7147697806358337,
+    "finite": 0.14024478197097778
+  },
+  {
+    "step": 250,
+    "loss": 1.0000978708267212,
+    "diagonal_ce": 0.8842875957489014,
+    "finite": 0.11581030488014221
+  },
+  {
+    "step": 251,
+    "loss": 0.922152578830719,
+    "diagonal_ce": 0.8037436604499817,
+    "finite": 0.1184089332818985
+  },
+  {
+    "step": 252,
+    "loss": 0.8409100770950317,
+    "diagonal_ce": 0.7208397388458252,
+    "finite": 0.12007030844688416
+  },
+  {
+    "step": 253,
+    "loss": 0.8334482312202454,
+    "diagonal_ce": 0.7182760834693909,
+    "finite": 0.1151721328496933
+  },
+  {
+    "step": 254,
+    "loss": 0.9945975542068481,
+    "diagonal_ce": 0.8807992339134216,
+    "finite": 0.11379833519458771
+  },
+  {
+    "step": 255,
+    "loss": 0.9113571047782898,
+    "diagonal_ce": 0.7973849177360535,
+    "finite": 0.11397217959165573
+  },
+  {
+    "step": 256,
+    "loss": 0.8789238929748535,
+    "diagonal_ce": 0.7706591486930847,
+    "finite": 0.10826475918292999
+  },
+  {
+    "step": 257,
+    "loss": 0.9523557424545288,
+    "diagonal_ce": 0.8482918739318848,
+    "finite": 0.10406388342380524
+  },
+  {
+    "step": 258,
+    "loss": 0.9057235717773438,
+    "diagonal_ce": 0.8053093552589417,
+    "finite": 0.10041418671607971
+  },
+  {
+    "step": 259,
+    "loss": 0.857684850692749,
+    "diagonal_ce": 0.7494542598724365,
+    "finite": 0.1082306057214737
+  },
+  {
+    "step": 260,
+    "loss": 0.9381929636001587,
+    "diagonal_ce": 0.8373594880104065,
+    "finite": 0.1008334681391716
+  },
+  {
+    "step": 261,
+    "loss": 0.938389241695404,
+    "diagonal_ce": 0.8290541768074036,
+    "finite": 0.10933507978916168
+  },
+  {
+    "step": 262,
+    "loss": 0.9117275476455688,
+    "diagonal_ce": 0.7960456013679504,
+    "finite": 0.11568192392587662
+  },
+  {
+    "step": 263,
+    "loss": 0.9223370552062988,
+    "diagonal_ce": 0.8003458976745605,
+    "finite": 0.12199113517999649
+  },
+  {
+    "step": 264,
+    "loss": 0.7963181138038635,
+    "diagonal_ce": 0.6809976100921631,
+    "finite": 0.11532048881053925
+  },
+  {
+    "step": 265,
+    "loss": 0.938710629940033,
+    "diagonal_ce": 0.8169845938682556,
+    "finite": 0.12172602862119675
+  },
+  {
+    "step": 266,
+    "loss": 0.9892823100090027,
+    "diagonal_ce": 0.881399393081665,
+    "finite": 0.10788292437791824
+  },
+  {
+    "step": 267,
+    "loss": 0.9508403539657593,
+    "diagonal_ce": 0.839931845664978,
+    "finite": 0.11090848594903946
+  },
+  {
+    "step": 268,
+    "loss": 1.019225835800171,
+    "diagonal_ce": 0.90911465883255,
+    "finite": 0.11011119186878204
+  },
+  {
+    "step": 269,
+    "loss": 0.8678252696990967,
+    "diagonal_ce": 0.7537190318107605,
+    "finite": 0.11410623043775558
+  },
+  {
+    "step": 270,
+    "loss": 0.874763011932373,
+    "diagonal_ce": 0.7567785978317261,
+    "finite": 0.11798439174890518
+  },
+  {
+    "step": 271,
+    "loss": 0.834746778011322,
+    "diagonal_ce": 0.7239617705345154,
+    "finite": 0.11078501492738724
+  },
+  {
+    "step": 272,
+    "loss": 0.8525373935699463,
+    "diagonal_ce": 0.7416106462478638,
+    "finite": 0.11092672497034073
+  },
+  {
+    "step": 273,
+    "loss": 0.9910345673561096,
+    "diagonal_ce": 0.8870100378990173,
+    "finite": 0.10402455180883408
+  },
+  {
+    "step": 274,
+    "loss": 0.8537419438362122,
+    "diagonal_ce": 0.7545726299285889,
+    "finite": 0.09916933625936508
+  },
+  {
+    "step": 275,
+    "loss": 0.875529408454895,
+    "diagonal_ce": 0.7831403017044067,
+    "finite": 0.09238913655281067
+  },
+  {
+    "step": 276,
+    "loss": 0.8633121848106384,
+    "diagonal_ce": 0.7644266486167908,
+    "finite": 0.09888552874326706
+  },
+  {
+    "step": 277,
+    "loss": 0.8781598806381226,
+    "diagonal_ce": 0.7831090092658997,
+    "finite": 0.0950508788228035
+  },
+  {
+    "step": 278,
+    "loss": 0.951271653175354,
+    "diagonal_ce": 0.8607878684997559,
+    "finite": 0.09048378467559814
+  },
+  {
+    "step": 279,
+    "loss": 0.8796981573104858,
+    "diagonal_ce": 0.7874358892440796,
+    "finite": 0.09226226061582565
+  },
+  {
+    "step": 280,
+    "loss": 0.8061283826828003,
+    "diagonal_ce": 0.7236934900283813,
+    "finite": 0.08243489265441895
+  },
+  {
+    "step": 281,
+    "loss": 0.9497950673103333,
+    "diagonal_ce": 0.8680870532989502,
+    "finite": 0.08170803636312485
+  },
+  {
+    "step": 282,
+    "loss": 0.8587799668312073,
+    "diagonal_ce": 0.7677980065345764,
+    "finite": 0.09098198264837265
+  },
+  {
+    "step": 283,
+    "loss": 0.8389340043067932,
+    "diagonal_ce": 0.7455376982688904,
+    "finite": 0.09339630603790283
+  },
+  {
+    "step": 284,
+    "loss": 0.8121779561042786,
+    "diagonal_ce": 0.724890410900116,
+    "finite": 0.08728756755590439
+  },
+  {
+    "step": 285,
+    "loss": 0.8531626462936401,
+    "diagonal_ce": 0.7644476890563965,
+    "finite": 0.08871497213840485
+  },
+  {
+    "step": 286,
+    "loss": 0.8164641261100769,
+    "diagonal_ce": 0.7320002913475037,
+    "finite": 0.08446382731199265
+  },
+  {
+    "step": 287,
+    "loss": 0.8887491822242737,
+    "diagonal_ce": 0.8035020232200623,
+    "finite": 0.08524714410305023
+  },
+  {
+    "step": 288,
+    "loss": 0.810847282409668,
+    "diagonal_ce": 0.7123432755470276,
+    "finite": 0.09850402176380157
+  },
+  {
+    "step": 289,
+    "loss": 0.8454877138137817,
+    "diagonal_ce": 0.7607654333114624,
+    "finite": 0.08472228050231934
+  },
+  {
+    "step": 290,
+    "loss": 0.8034873604774475,
+    "diagonal_ce": 0.7140897512435913,
+    "finite": 0.0893976166844368
+  },
+  {
+    "step": 291,
+    "loss": 0.8768965005874634,
+    "diagonal_ce": 0.7812336683273315,
+    "finite": 0.09566283226013184
+  },
+  {
+    "step": 292,
+    "loss": 1.001758098602295,
+    "diagonal_ce": 0.9055885076522827,
+    "finite": 0.09616954624652863
+  },
+  {
+    "step": 293,
+    "loss": 0.8084110021591187,
+    "diagonal_ce": 0.7202170491218567,
+    "finite": 0.08819395303726196
+  },
+  {
+    "step": 294,
+    "loss": 0.8581114411354065,
+    "diagonal_ce": 0.7739452123641968,
+    "finite": 0.08416623622179031
+  },
+  {
+    "step": 295,
+    "loss": 0.880357563495636,
+    "diagonal_ce": 0.7901055216789246,
+    "finite": 0.09025205671787262
+  },
+  {
+    "step": 296,
+    "loss": 0.7598339319229126,
+    "diagonal_ce": 0.6741465926170349,
+    "finite": 0.0856873169541359
+  },
+  {
+    "step": 297,
+    "loss": 0.8170952796936035,
+    "diagonal_ce": 0.7437975406646729,
+    "finite": 0.07329774647951126
+  },
+  {
+    "step": 298,
+    "loss": 0.7879429459571838,
+    "diagonal_ce": 0.6957524418830872,
+    "finite": 0.09219052642583847
+  },
+  {
+    "step": 299,
+    "loss": 0.7293734550476074,
+    "diagonal_ce": 0.6304517984390259,
+    "finite": 0.09892164170742035
+  },
+  {
+    "step": 300,
+    "loss": 0.7096850275993347,
+    "diagonal_ce": 0.6172824501991272,
+    "finite": 0.09240258485078812
+  },
+  {
+    "step": 301,
+    "loss": 0.9461839199066162,
+    "diagonal_ce": 0.8610371947288513,
+    "finite": 0.08514672517776489
+  },
+  {
+    "step": 302,
+    "loss": 0.8465473651885986,
+    "diagonal_ce": 0.7683687806129456,
+    "finite": 0.07817861437797546
+  },
+  {
+    "step": 303,
+    "loss": 0.8875083923339844,
+    "diagonal_ce": 0.8011846542358398,
+    "finite": 0.08632376790046692
+  },
+  {
+    "step": 304,
+    "loss": 0.9319552779197693,
+    "diagonal_ce": 0.8565643429756165,
+    "finite": 0.07539094984531403
+  },
+  {
+    "step": 305,
+    "loss": 0.8531303405761719,
+    "diagonal_ce": 0.7817275524139404,
+    "finite": 0.07140276581048965
+  },
+  {
+    "step": 306,
+    "loss": 0.8721145987510681,
+    "diagonal_ce": 0.7979727983474731,
+    "finite": 0.07414179295301437
+  },
+  {
+    "step": 307,
+    "loss": 0.7590292692184448,
+    "diagonal_ce": 0.6831918358802795,
+    "finite": 0.07583744078874588
+  },
+  {
+    "step": 308,
+    "loss": 0.8579744100570679,
+    "diagonal_ce": 0.7793697118759155,
+    "finite": 0.07860466837882996
+  },
+  {
+    "step": 309,
+    "loss": 0.8371602892875671,
+    "diagonal_ce": 0.756892740726471,
+    "finite": 0.0802675411105156
+  },
+  {
+    "step": 310,
+    "loss": 0.8238303661346436,
+    "diagonal_ce": 0.7423559427261353,
+    "finite": 0.0814744234085083
+  },
+  {
+    "step": 311,
+    "loss": 0.8272538185119629,
+    "diagonal_ce": 0.7581254243850708,
+    "finite": 0.06912842392921448
+  },
+  {
+    "step": 312,
+    "loss": 0.7866699695587158,
+    "diagonal_ce": 0.7158337235450745,
+    "finite": 0.07083627581596375
+  },
+  {
+    "step": 313,
+    "loss": 0.8183804154396057,
+    "diagonal_ce": 0.7450669407844543,
+    "finite": 0.07331348955631256
+  },
+  {
+    "step": 314,
+    "loss": 0.8441029787063599,
+    "diagonal_ce": 0.7805274724960327,
+    "finite": 0.06357551366090775
+  },
+  {
+    "step": 315,
+    "loss": 0.8363553285598755,
+    "diagonal_ce": 0.7659028172492981,
+    "finite": 0.07045253366231918
+  },
+  {
+    "step": 316,
+    "loss": 0.7647396326065063,
+    "diagonal_ce": 0.69652259349823,
+    "finite": 0.06821700930595398
+  },
+  {
+    "step": 317,
+    "loss": 0.7324907183647156,
+    "diagonal_ce": 0.653526246547699,
+    "finite": 0.078964464366436
+  },
+  {
+    "step": 318,
+    "loss": 0.8211366534233093,
+    "diagonal_ce": 0.7524149417877197,
+    "finite": 0.06872168928384781
+  },
+  {
+    "step": 319,
+    "loss": 0.8919054269790649,
+    "diagonal_ce": 0.8178339600563049,
+    "finite": 0.07407146692276001
+  },
+  {
+    "step": 320,
+    "loss": 0.8785467743873596,
+    "diagonal_ce": 0.8121369481086731,
+    "finite": 0.06640984117984772
+  },
+  {
+    "step": 321,
+    "loss": 0.8024300336837769,
+    "diagonal_ce": 0.7370883822441101,
+    "finite": 0.06534164398908615
+  },
+  {
+    "step": 322,
+    "loss": 0.7092490196228027,
+    "diagonal_ce": 0.6401316523551941,
+    "finite": 0.06911733746528625
+  },
+  {
+    "step": 323,
+    "loss": 0.7770361304283142,
+    "diagonal_ce": 0.7058175206184387,
+    "finite": 0.0712185949087143
+  },
+  {
+    "step": 324,
+    "loss": 0.7430390119552612,
+    "diagonal_ce": 0.6716083288192749,
+    "finite": 0.07143070548772812
+  },
+  {
+    "step": 325,
+    "loss": 0.7064995169639587,
+    "diagonal_ce": 0.6382654309272766,
+    "finite": 0.06823410093784332
+  },
+  {
+    "step": 326,
+    "loss": 0.8669720888137817,
+    "diagonal_ce": 0.7984285950660706,
+    "finite": 0.06854349374771118
+  },
+  {
+    "step": 327,
+    "loss": 0.8145223259925842,
+    "diagonal_ce": 0.7484801411628723,
+    "finite": 0.06604218482971191
+  },
+  {
+    "step": 328,
+    "loss": 0.7269554138183594,
+    "diagonal_ce": 0.6637232899665833,
+    "finite": 0.06323215365409851
+  },
+  {
+    "step": 329,
+    "loss": 0.8941803574562073,
+    "diagonal_ce": 0.8374278545379639,
+    "finite": 0.056752484291791916
+  },
+  {
+    "step": 330,
+    "loss": 0.7465731501579285,
+    "diagonal_ce": 0.6818251013755798,
+    "finite": 0.06474807113409042
+  },
+  {
+    "step": 331,
+    "loss": 0.7522512078285217,
+    "diagonal_ce": 0.689972460269928,
+    "finite": 0.06227874383330345
+  },
+  {
+    "step": 332,
+    "loss": 0.8134416937828064,
+    "diagonal_ce": 0.7478546500205994,
+    "finite": 0.06558705121278763
+  },
+  {
+    "step": 333,
+    "loss": 0.7979872822761536,
+    "diagonal_ce": 0.7341063022613525,
+    "finite": 0.06388096511363983
+  },
+  {
+    "step": 334,
+    "loss": 0.8784055113792419,
+    "diagonal_ce": 0.8200654983520508,
+    "finite": 0.05833999812602997
+  },
+  {
+    "step": 335,
+    "loss": 0.6886107325553894,
+    "diagonal_ce": 0.6260113716125488,
+    "finite": 0.06259935349225998
+  },
+  {
+    "step": 336,
+    "loss": 0.698371171951294,
+    "diagonal_ce": 0.6376957893371582,
+    "finite": 0.06067538261413574
+  },
+  {
+    "step": 337,
+    "loss": 0.8042593598365784,
+    "diagonal_ce": 0.7495782971382141,
+    "finite": 0.05468108505010605
+  },
+  {
+    "step": 338,
+    "loss": 0.7719369530677795,
+    "diagonal_ce": 0.7109969854354858,
+    "finite": 0.06093998998403549
+  },
+  {
+    "step": 339,
+    "loss": 0.7528045177459717,
+    "diagonal_ce": 0.6929252743721008,
+    "finite": 0.05987921729683876
+  },
+  {
+    "step": 340,
+    "loss": 0.7822110652923584,
+    "diagonal_ce": 0.7245707511901855,
+    "finite": 0.05764034390449524
+  },
+  {
+    "step": 341,
+    "loss": 0.8379612565040588,
+    "diagonal_ce": 0.775873601436615,
+    "finite": 0.06208764389157295
+  },
+  {
+    "step": 342,
+    "loss": 0.7077630758285522,
+    "diagonal_ce": 0.6451730728149414,
+    "finite": 0.06258998811244965
+  },
+  {
+    "step": 343,
+    "loss": 0.7881408333778381,
+    "diagonal_ce": 0.7303899526596069,
+    "finite": 0.05775086581707001
+  },
+  {
+    "step": 344,
+    "loss": 0.7661038637161255,
+    "diagonal_ce": 0.7088757157325745,
+    "finite": 0.057228151708841324
+  },
+  {
+    "step": 345,
+    "loss": 0.7762340903282166,
+    "diagonal_ce": 0.7169555425643921,
+    "finite": 0.05927856266498566
+  },
+  {
+    "step": 346,
+    "loss": 0.702468752861023,
+    "diagonal_ce": 0.643045961856842,
+    "finite": 0.05942276120185852
+  },
+  {
+    "step": 347,
+    "loss": 0.6657170057296753,
+    "diagonal_ce": 0.6074774861335754,
+    "finite": 0.058239489793777466
+  },
+  {
+    "step": 348,
+    "loss": 0.7442190647125244,
+    "diagonal_ce": 0.6855028867721558,
+    "finite": 0.058716170489788055
+  },
+  {
+    "step": 349,
+    "loss": 0.7189494371414185,
+    "diagonal_ce": 0.6574957966804504,
+    "finite": 0.06145366281270981
+  },
+  {
+    "step": 350,
+    "loss": 0.7335761189460754,
+    "diagonal_ce": 0.6805325150489807,
+    "finite": 0.053043611347675323
+  },
+  {
+    "step": 351,
+    "loss": 0.7632458209991455,
+    "diagonal_ce": 0.7085082530975342,
+    "finite": 0.05473756045103073
+  },
+  {
+    "step": 352,
+    "loss": 0.7140377759933472,
+    "diagonal_ce": 0.654437780380249,
+    "finite": 0.059599995613098145
+  },
+  {
+    "step": 353,
+    "loss": 0.8328208923339844,
+    "diagonal_ce": 0.7759858965873718,
+    "finite": 0.056835025548934937
+  },
+  {
+    "step": 354,
+    "loss": 0.7729576230049133,
+    "diagonal_ce": 0.7201107144355774,
+    "finite": 0.05284692719578743
+  },
+  {
+    "step": 355,
+    "loss": 0.8075690865516663,
+    "diagonal_ce": 0.7552520036697388,
+    "finite": 0.052317071706056595
+  },
+  {
+    "step": 356,
+    "loss": 0.7996595501899719,
+    "diagonal_ce": 0.7447338104248047,
+    "finite": 0.054925739765167236
+  },
+  {
+    "step": 357,
+    "loss": 0.7883434295654297,
+    "diagonal_ce": 0.7330160140991211,
+    "finite": 0.055327437818050385
+  },
+  {
+    "step": 358,
+    "loss": 0.728258490562439,
+    "diagonal_ce": 0.6718060374259949,
+    "finite": 0.056452423334121704
+  },
+  {
+    "step": 359,
+    "loss": 0.8645216226577759,
+    "diagonal_ce": 0.8160408139228821,
+    "finite": 0.048480793833732605
+  },
+  {
+    "step": 360,
+    "loss": 0.7316069602966309,
+    "diagonal_ce": 0.6794766783714294,
+    "finite": 0.05213030427694321
+  },
+  {
+    "step": 361,
+    "loss": 0.7191386222839355,
+    "diagonal_ce": 0.6642048954963684,
+    "finite": 0.054933734238147736
+  },
+  {
+    "step": 362,
+    "loss": 0.755139946937561,
+    "diagonal_ce": 0.7115224003791809,
+    "finite": 0.043617554008960724
+  },
+  {
+    "step": 363,
+    "loss": 0.7256749868392944,
+    "diagonal_ce": 0.6775842308998108,
+    "finite": 0.048090770840644836
+  },
+  {
+    "step": 364,
+    "loss": 0.7003388404846191,
+    "diagonal_ce": 0.6499407291412354,
+    "finite": 0.050398118793964386
+  },
+  {
+    "step": 365,
+    "loss": 0.761969804763794,
+    "diagonal_ce": 0.7140199542045593,
+    "finite": 0.04794982075691223
+  },
+  {
+    "step": 366,
+    "loss": 0.8694345355033875,
+    "diagonal_ce": 0.822935938835144,
+    "finite": 0.0464986227452755
+  },
+  {
+    "step": 367,
+    "loss": 0.7476141452789307,
+    "diagonal_ce": 0.7041852474212646,
+    "finite": 0.04342888668179512
+  },
+  {
+    "step": 368,
+    "loss": 0.752640962600708,
+    "diagonal_ce": 0.7070572376251221,
+    "finite": 0.045583754777908325
+  },
+  {
+    "step": 369,
+    "loss": 0.828853189945221,
+    "diagonal_ce": 0.782623827457428,
+    "finite": 0.04622938856482506
+  },
+  {
+    "step": 370,
+    "loss": 0.7565345764160156,
+    "diagonal_ce": 0.7112885117530823,
+    "finite": 0.04524604603648186
+  },
+  {
+    "step": 371,
+    "loss": 0.7422763705253601,
+    "diagonal_ce": 0.7003087401390076,
+    "finite": 0.04196761175990105
+  },
+  {
+    "step": 372,
+    "loss": 0.7507848143577576,
+    "diagonal_ce": 0.7041628956794739,
+    "finite": 0.046621907502412796
+  },
+  {
+    "step": 373,
+    "loss": 0.7433382868766785,
+    "diagonal_ce": 0.6946902871131897,
+    "finite": 0.04864802211523056
+  },
+  {
+    "step": 374,
+    "loss": 0.7284306287765503,
+    "diagonal_ce": 0.6876298189163208,
+    "finite": 0.040800780057907104
+  },
+  {
+    "step": 375,
+    "loss": 0.6241797208786011,
+    "diagonal_ce": 0.5782915353775024,
+    "finite": 0.04588818922638893
+  },
+  {
+    "step": 376,
+    "loss": 0.6565207242965698,
+    "diagonal_ce": 0.6112789511680603,
+    "finite": 0.045241743326187134
+  },
+  {
+    "step": 377,
+    "loss": 0.7078320384025574,
+    "diagonal_ce": 0.6597128510475159,
+    "finite": 0.048119209706783295
+  },
+  {
+    "step": 378,
+    "loss": 0.8540554046630859,
+    "diagonal_ce": 0.8100336790084839,
+    "finite": 0.04402172565460205
+  },
+  {
+    "step": 379,
+    "loss": 0.7703270316123962,
+    "diagonal_ce": 0.7272924184799194,
+    "finite": 0.04303460568189621
+  },
+  {
+    "step": 380,
+    "loss": 0.6500753164291382,
+    "diagonal_ce": 0.602606475353241,
+    "finite": 0.04746885597705841
+  },
+  {
+    "step": 381,
+    "loss": 0.7813249230384827,
+    "diagonal_ce": 0.7369853258132935,
+    "finite": 0.04433960095047951
+  },
+  {
+    "step": 382,
+    "loss": 0.6060816645622253,
+    "diagonal_ce": 0.561909556388855,
+    "finite": 0.04417213425040245
+  },
+  {
+    "step": 383,
+    "loss": 0.8059773445129395,
+    "diagonal_ce": 0.7633634209632874,
+    "finite": 0.042613912373781204
+  },
+  {
+    "step": 384,
+    "loss": 0.6437355875968933,
+    "diagonal_ce": 0.5997088551521301,
+    "finite": 0.044026728719472885
+  },
+  {
+    "step": 385,
+    "loss": 0.779283881187439,
+    "diagonal_ce": 0.7386923432350159,
+    "finite": 0.0405915193259716
+  },
+  {
+    "step": 386,
+    "loss": 0.7614390850067139,
+    "diagonal_ce": 0.7208130359649658,
+    "finite": 0.04062607139348984
+  },
+  {
+    "step": 387,
+    "loss": 0.6841847896575928,
+    "diagonal_ce": 0.6409086585044861,
+    "finite": 0.04327615350484848
+  },
+  {
+    "step": 388,
+    "loss": 0.622826874256134,
+    "diagonal_ce": 0.5806711912155151,
+    "finite": 0.04215565696358681
+  },
+  {
+    "step": 389,
+    "loss": 0.8417255878448486,
+    "diagonal_ce": 0.8018850684165955,
+    "finite": 0.03984051197767258
+  },
+  {
+    "step": 390,
+    "loss": 0.6449906229972839,
+    "diagonal_ce": 0.6034006476402283,
+    "finite": 0.04158996418118477
+  },
+  {
+    "step": 391,
+    "loss": 0.6859955191612244,
+    "diagonal_ce": 0.6444821953773499,
+    "finite": 0.04151333495974541
+  },
+  {
+    "step": 392,
+    "loss": 0.6929423213005066,
+    "diagonal_ce": 0.6558707356452942,
+    "finite": 0.03707157075405121
+  },
+  {
+    "step": 393,
+    "loss": 0.6679496169090271,
+    "diagonal_ce": 0.6269636154174805,
+    "finite": 0.04098598286509514
+  },
+  {
+    "step": 394,
+    "loss": 0.6919564604759216,
+    "diagonal_ce": 0.6538446545600891,
+    "finite": 0.038111813366413116
+  },
+  {
+    "step": 395,
+    "loss": 0.7029189467430115,
+    "diagonal_ce": 0.6644176244735718,
+    "finite": 0.0385013110935688
+  },
+  {
+    "step": 396,
+    "loss": 0.7061773538589478,
+    "diagonal_ce": 0.6658733487129211,
+    "finite": 0.04030401259660721
+  },
+  {
+    "step": 397,
+    "loss": 0.6755701303482056,
+    "diagonal_ce": 0.6347240209579468,
+    "finite": 0.040846116840839386
+  },
+  {
+    "step": 398,
+    "loss": 0.7997009754180908,
+    "diagonal_ce": 0.7638381719589233,
+    "finite": 0.03586282581090927
+  },
+  {
+    "step": 399,
+    "loss": 0.6798522472381592,
+    "diagonal_ce": 0.6374122500419617,
+    "finite": 0.04243997856974602
+  },
+  {
+    "step": 400,
+    "loss": 0.6840772032737732,
+    "diagonal_ce": 0.6448673009872437,
+    "finite": 0.03920990601181984
+  },
+  {
+    "step": 401,
+    "loss": 0.772079348564148,
+    "diagonal_ce": 0.7347631454467773,
+    "finite": 0.037316229194402695
+  },
+  {
+    "step": 402,
+    "loss": 0.7360487580299377,
+    "diagonal_ce": 0.7009060978889465,
+    "finite": 0.035142675042152405
+  },
+  {
+    "step": 403,
+    "loss": 0.6957468390464783,
+    "diagonal_ce": 0.6575039029121399,
+    "finite": 0.03824295103549957
+  },
+  {
+    "step": 404,
+    "loss": 0.6880466938018799,
+    "diagonal_ce": 0.6514582633972168,
+    "finite": 0.03658845275640488
+  },
+  {
+    "step": 405,
+    "loss": 0.672230064868927,
+    "diagonal_ce": 0.6395108699798584,
+    "finite": 0.032719217240810394
+  },
+  {
+    "step": 406,
+    "loss": 0.745858371257782,
+    "diagonal_ce": 0.7102791666984558,
+    "finite": 0.03557917848229408
+  },
+  {
+    "step": 407,
+    "loss": 0.6803626418113708,
+    "diagonal_ce": 0.6447337865829468,
+    "finite": 0.03562883287668228
+  },
+  {
+    "step": 408,
+    "loss": 0.5958722233772278,
+    "diagonal_ce": 0.5625735521316528,
+    "finite": 0.03329869359731674
+  },
+  {
+    "step": 409,
+    "loss": 0.6519477963447571,
+    "diagonal_ce": 0.619961142539978,
+    "finite": 0.03198666125535965
+  },
+  {
+    "step": 410,
+    "loss": 0.6538407802581787,
+    "diagonal_ce": 0.6183461546897888,
+    "finite": 0.03549462556838989
+  },
+  {
+    "step": 411,
+    "loss": 0.6660571694374084,
+    "diagonal_ce": 0.6323230266571045,
+    "finite": 0.033734146505594254
+  },
+  {
+    "step": 412,
+    "loss": 0.734285295009613,
+    "diagonal_ce": 0.7029938101768494,
+    "finite": 0.03129148855805397
+  },
+  {
+    "step": 413,
+    "loss": 0.724316418170929,
+    "diagonal_ce": 0.6902329325675964,
+    "finite": 0.03408351168036461
+  },
+  {
+    "step": 414,
+    "loss": 0.6935877799987793,
+    "diagonal_ce": 0.6570898294448853,
+    "finite": 0.03649797663092613
+  },
+  {
+    "step": 415,
+    "loss": 0.6473702192306519,
+    "diagonal_ce": 0.6127166748046875,
+    "finite": 0.034653548151254654
+  },
+  {
+    "step": 416,
+    "loss": 0.6528682112693787,
+    "diagonal_ce": 0.6165418028831482,
+    "finite": 0.03632639721035957
+  },
+  {
+    "step": 417,
+    "loss": 0.725594699382782,
+    "diagonal_ce": 0.6884629130363464,
+    "finite": 0.037131767719984055
+  },
+  {
+    "step": 418,
+    "loss": 0.6679285764694214,
+    "diagonal_ce": 0.6290229558944702,
+    "finite": 0.03890559449791908
+  },
+  {
+    "step": 419,
+    "loss": 0.6777970194816589,
+    "diagonal_ce": 0.6443149447441101,
+    "finite": 0.03348206356167793
+  },
+  {
+    "step": 420,
+    "loss": 0.6395509839057922,
+    "diagonal_ce": 0.6065166592597961,
+    "finite": 0.0330343134701252
+  },
+  {
+    "step": 421,
+    "loss": 0.6266172528266907,
+    "diagonal_ce": 0.5898182988166809,
+    "finite": 0.036798976361751556
+  },
+  {
+    "step": 422,
+    "loss": 0.6505120396614075,
+    "diagonal_ce": 0.6159793734550476,
+    "finite": 0.034532640129327774
+  },
+  {
+    "step": 423,
+    "loss": 0.6857754588127136,
+    "diagonal_ce": 0.6542816758155823,
+    "finite": 0.03149380162358284
+  },
+  {
+    "step": 424,
+    "loss": 0.5926023125648499,
+    "diagonal_ce": 0.5612164735794067,
+    "finite": 0.03138585761189461
+  },
+  {
+    "step": 425,
+    "loss": 0.7695260643959045,
+    "diagonal_ce": 0.735141932964325,
+    "finite": 0.03438412398099899
+  },
+  {
+    "step": 426,
+    "loss": 0.6036832928657532,
+    "diagonal_ce": 0.5694564580917358,
+    "finite": 0.034226857125759125
+  },
+  {
+    "step": 427,
+    "loss": 0.6883599758148193,
+    "diagonal_ce": 0.656253457069397,
+    "finite": 0.032106492668390274
+  },
+  {
+    "step": 428,
+    "loss": 0.6927639245986938,
+    "diagonal_ce": 0.6598751544952393,
+    "finite": 0.03288879990577698
+  },
+  {
+    "step": 429,
+    "loss": 0.6044228672981262,
+    "diagonal_ce": 0.5703247785568237,
+    "finite": 0.034098077565431595
+  },
+  {
+    "step": 430,
+    "loss": 0.6156982779502869,
+    "diagonal_ce": 0.5853370428085327,
+    "finite": 0.030361216515302658
+  },
+  {
+    "step": 431,
+    "loss": 0.5422447919845581,
+    "diagonal_ce": 0.5109097957611084,
+    "finite": 0.03133499622344971
+  },
+  {
+    "step": 432,
+    "loss": 0.610264003276825,
+    "diagonal_ce": 0.5791049003601074,
+    "finite": 0.03115907683968544
+  },
+  {
+    "step": 433,
+    "loss": 0.6918691992759705,
+    "diagonal_ce": 0.6598832011222839,
+    "finite": 0.031986016780138016
+  },
+  {
+    "step": 434,
+    "loss": 0.62947016954422,
+    "diagonal_ce": 0.5985528230667114,
+    "finite": 0.030917372554540634
+  },
+  {
+    "step": 435,
+    "loss": 0.777223527431488,
+    "diagonal_ce": 0.7443884611129761,
+    "finite": 0.03283509239554405
+  },
+  {
+    "step": 436,
+    "loss": 0.6131773591041565,
+    "diagonal_ce": 0.5800480842590332,
+    "finite": 0.0331292562186718
+  },
+  {
+    "step": 437,
+    "loss": 0.6339402794837952,
+    "diagonal_ce": 0.6029824614524841,
+    "finite": 0.030957821756601334
+  },
+  {
+    "step": 438,
+    "loss": 0.7208660244941711,
+    "diagonal_ce": 0.69011390209198,
+    "finite": 0.030752114951610565
+  },
+  {
+    "step": 439,
+    "loss": 0.5893957614898682,
+    "diagonal_ce": 0.5586613416671753,
+    "finite": 0.03073439560830593
+  },
+  {
+    "step": 440,
+    "loss": 0.6429782509803772,
+    "diagonal_ce": 0.6134486198425293,
+    "finite": 0.029529603198170662
+  },
+  {
+    "step": 441,
+    "loss": 0.6593799591064453,
+    "diagonal_ce": 0.6305404901504517,
+    "finite": 0.028839465230703354
+  },
+  {
+    "step": 442,
+    "loss": 0.6836521029472351,
+    "diagonal_ce": 0.6510353684425354,
+    "finite": 0.0326167494058609
+  },
+  {
+    "step": 443,
+    "loss": 0.643464982509613,
+    "diagonal_ce": 0.6136432886123657,
+    "finite": 0.029821686446666718
+  },
+  {
+    "step": 444,
+    "loss": 0.6440718173980713,
+    "diagonal_ce": 0.6133883595466614,
+    "finite": 0.030683431774377823
+  },
+  {
+    "step": 445,
+    "loss": 0.7005754113197327,
+    "diagonal_ce": 0.6716301441192627,
+    "finite": 0.028945282101631165
+  },
+  {
+    "step": 446,
+    "loss": 0.6729251146316528,
+    "diagonal_ce": 0.6411938071250916,
+    "finite": 0.03173127770423889
+  },
+  {
+    "step": 447,
+    "loss": 0.6459000110626221,
+    "diagonal_ce": 0.6164003014564514,
+    "finite": 0.02949969284236431
+  },
+  {
+    "step": 448,
+    "loss": 0.6246139407157898,
+    "diagonal_ce": 0.5961412787437439,
+    "finite": 0.028472648933529854
+  },
+  {
+    "step": 449,
+    "loss": 0.5163118839263916,
+    "diagonal_ce": 0.4872269034385681,
+    "finite": 0.02908499352633953
+  },
+  {
+    "step": 450,
+    "loss": 0.632628321647644,
+    "diagonal_ce": 0.6034817695617676,
+    "finite": 0.02914656326174736
+  },
+  {
+    "step": 451,
+    "loss": 0.6618408560752869,
+    "diagonal_ce": 0.6355544924736023,
+    "finite": 0.026286372914910316
+  },
+  {
+    "step": 452,
+    "loss": 0.6951032876968384,
+    "diagonal_ce": 0.6683224439620972,
+    "finite": 0.02678084187209606
+  },
+  {
+    "step": 453,
+    "loss": 0.6554176807403564,
+    "diagonal_ce": 0.6300609111785889,
+    "finite": 0.02535674348473549
+  },
+  {
+    "step": 454,
+    "loss": 0.7530895471572876,
+    "diagonal_ce": 0.7271292805671692,
+    "finite": 0.02596023678779602
+  },
+  {
+    "step": 455,
+    "loss": 0.5765879154205322,
+    "diagonal_ce": 0.5534546375274658,
+    "finite": 0.02313329093158245
+  },
+  {
+    "step": 456,
+    "loss": 0.680065929889679,
+    "diagonal_ce": 0.6556680798530579,
+    "finite": 0.024397842586040497
+  },
+  {
+    "step": 457,
+    "loss": 0.6546054482460022,
+    "diagonal_ce": 0.6290194392204285,
+    "finite": 0.025586020201444626
+  },
+  {
+    "step": 458,
+    "loss": 0.550418496131897,
+    "diagonal_ce": 0.5253052711486816,
+    "finite": 0.025113238021731377
+  },
+  {
+    "step": 459,
+    "loss": 0.6051831841468811,
+    "diagonal_ce": 0.5774967074394226,
+    "finite": 0.027686499059200287
+  },
+  {
+    "step": 460,
+    "loss": 0.6783481240272522,
+    "diagonal_ce": 0.6527076959609985,
+    "finite": 0.02564041130244732
+  },
+  {
+    "step": 461,
+    "loss": 0.6749248504638672,
+    "diagonal_ce": 0.6500979661941528,
+    "finite": 0.024826904758810997
+  },
+  {
+    "step": 462,
+    "loss": 0.5670949220657349,
+    "diagonal_ce": 0.5427309274673462,
+    "finite": 0.024364007636904716
+  },
+  {
+    "step": 463,
+    "loss": 0.6896452903747559,
+    "diagonal_ce": 0.6652330160140991,
+    "finite": 0.024412287399172783
+  },
+  {
+    "step": 464,
+    "loss": 0.5720633864402771,
+    "diagonal_ce": 0.5465102195739746,
+    "finite": 0.025553176179528236
+  },
+  {
+    "step": 465,
+    "loss": 0.7719159126281738,
+    "diagonal_ce": 0.7488067150115967,
+    "finite": 0.023109227418899536
+  },
+  {
+    "step": 466,
+    "loss": 0.5385965704917908,
+    "diagonal_ce": 0.5094056129455566,
+    "finite": 0.02919095568358898
+  },
+  {
+    "step": 467,
+    "loss": 0.7052253484725952,
+    "diagonal_ce": 0.6804426312446594,
+    "finite": 0.024782689288258553
+  },
+  {
+    "step": 468,
+    "loss": 0.7127165794372559,
+    "diagonal_ce": 0.6875558495521545,
+    "finite": 0.025160718709230423
+  },
+  {
+    "step": 469,
+    "loss": 0.6748542189598083,
+    "diagonal_ce": 0.6510235071182251,
+    "finite": 0.023830730468034744
+  },
+  {
+    "step": 470,
+    "loss": 0.5340477228164673,
+    "diagonal_ce": 0.5085214376449585,
+    "finite": 0.02552630379796028
+  },
+  {
+    "step": 471,
+    "loss": 0.5464648008346558,
+    "diagonal_ce": 0.5235516428947449,
+    "finite": 0.022913144901394844
+  },
+  {
+    "step": 472,
+    "loss": 0.6779913306236267,
+    "diagonal_ce": 0.653566300868988,
+    "finite": 0.024425044655799866
+  },
+  {
+    "step": 473,
+    "loss": 0.5915822982788086,
+    "diagonal_ce": 0.5656195282936096,
+    "finite": 0.025962769985198975
+  },
+  {
+    "step": 474,
+    "loss": 0.4729839563369751,
+    "diagonal_ce": 0.4471020996570587,
+    "finite": 0.025881851091980934
+  },
+  {
+    "step": 475,
+    "loss": 0.5250015258789062,
+    "diagonal_ce": 0.49867475032806396,
+    "finite": 0.026326758787035942
+  },
+  {
+    "step": 476,
+    "loss": 0.6641748547554016,
+    "diagonal_ce": 0.6384852528572083,
+    "finite": 0.025689618661999702
+  },
+  {
+    "step": 477,
+    "loss": 0.7873574495315552,
+    "diagonal_ce": 0.7627418041229248,
+    "finite": 0.024615664035081863
+  },
+  {
+    "step": 478,
+    "loss": 0.6079263687133789,
+    "diagonal_ce": 0.5856708288192749,
+    "finite": 0.02225552313029766
+  },
+  {
+    "step": 479,
+    "loss": 0.627137303352356,
+    "diagonal_ce": 0.6030399203300476,
+    "finite": 0.024097397923469543
+  },
+  {
+    "step": 480,
+    "loss": 0.5578932762145996,
+    "diagonal_ce": 0.5339488387107849,
+    "finite": 0.023944467306137085
+  },
+  {
+    "step": 481,
+    "loss": 0.5738693475723267,
+    "diagonal_ce": 0.5480617880821228,
+    "finite": 0.025807589292526245
+  },
+  {
+    "step": 482,
+    "loss": 0.6501283645629883,
+    "diagonal_ce": 0.6268218159675598,
+    "finite": 0.02330651879310608
+  },
+  {
+    "step": 483,
+    "loss": 0.49481332302093506,
+    "diagonal_ce": 0.46781840920448303,
+    "finite": 0.02699490822851658
+  },
+  {
+    "step": 484,
+    "loss": 0.719619631767273,
+    "diagonal_ce": 0.6973953247070312,
+    "finite": 0.022224320098757744
+  },
+  {
+    "step": 485,
+    "loss": 0.5616010427474976,
+    "diagonal_ce": 0.5344623923301697,
+    "finite": 0.027138669043779373
+  },
+  {
+    "step": 486,
+    "loss": 0.6396487951278687,
+    "diagonal_ce": 0.6163973808288574,
+    "finite": 0.02325143851339817
+  },
+  {
+    "step": 487,
+    "loss": 0.5036343932151794,
+    "diagonal_ce": 0.4781807065010071,
+    "finite": 0.025453703477978706
+  },
+  {
+    "step": 488,
+    "loss": 0.6649404764175415,
+    "diagonal_ce": 0.6437399387359619,
+    "finite": 0.021200556308031082
+  },
+  {
+    "step": 489,
+    "loss": 0.6842339634895325,
+    "diagonal_ce": 0.6624777317047119,
+    "finite": 0.021756215021014214
+  },
+  {
+    "step": 490,
+    "loss": 0.5685184001922607,
+    "diagonal_ce": 0.5481815934181213,
+    "finite": 0.020336806774139404
+  },
+  {
+    "step": 491,
+    "loss": 0.5762979984283447,
+    "diagonal_ce": 0.5548508763313293,
+    "finite": 0.02144709788262844
+  },
+  {
+    "step": 492,
+    "loss": 0.5739290118217468,
+    "diagonal_ce": 0.5513470768928528,
+    "finite": 0.022581925615668297
+  },
+  {
+    "step": 493,
+    "loss": 0.5890681147575378,
+    "diagonal_ce": 0.5683080554008484,
+    "finite": 0.020760085433721542
+  },
+  {
+    "step": 494,
+    "loss": 0.6791799068450928,
+    "diagonal_ce": 0.6614835858345032,
+    "finite": 0.017696313560009003
+  },
+  {
+    "step": 495,
+    "loss": 0.7521281242370605,
+    "diagonal_ce": 0.7301639318466187,
+    "finite": 0.02196419984102249
+  },
+  {
+    "step": 496,
+    "loss": 0.7223774194717407,
+    "diagonal_ce": 0.7009652256965637,
+    "finite": 0.02141222357749939
+  },
+  {
+    "step": 497,
+    "loss": 0.6080324053764343,
+    "diagonal_ce": 0.5871167182922363,
+    "finite": 0.020915677770972252
+  },
+  {
+    "step": 498,
+    "loss": 0.612114429473877,
+    "diagonal_ce": 0.5935178995132446,
+    "finite": 0.01859651692211628
+  },
+  {
+    "step": 499,
+    "loss": 0.5998920798301697,
+    "diagonal_ce": 0.5781015753746033,
+    "finite": 0.021790487691760063
+  },
+  {
+    "step": 500,
+    "loss": 0.6033853888511658,
+    "diagonal_ce": 0.58417809009552,
+    "finite": 0.019207321107387543
+  },
+  {
+    "step": 501,
+    "loss": 0.7076112031936646,
+    "diagonal_ce": 0.688702404499054,
+    "finite": 0.01890878565609455
+  },
+  {
+    "step": 502,
+    "loss": 0.5542879104614258,
+    "diagonal_ce": 0.5348690748214722,
+    "finite": 0.019418824464082718
+  },
+  {
+    "step": 503,
+    "loss": 0.5598881244659424,
+    "diagonal_ce": 0.54149329662323,
+    "finite": 0.01839483343064785
+  },
+  {
+    "step": 504,
+    "loss": 0.5188685655593872,
+    "diagonal_ce": 0.5016193389892578,
+    "finite": 0.017249248921871185
+  },
+  {
+    "step": 505,
+    "loss": 0.517875075340271,
+    "diagonal_ce": 0.5009437799453735,
+    "finite": 0.016931306570768356
+  },
+  {
+    "step": 506,
+    "loss": 0.6399552822113037,
+    "diagonal_ce": 0.6223956942558289,
+    "finite": 0.017559580504894257
+  },
+  {
+    "step": 507,
+    "loss": 0.6173456311225891,
+    "diagonal_ce": 0.599518895149231,
+    "finite": 0.017826756462454796
+  },
+  {
+    "step": 508,
+    "loss": 0.7861790657043457,
+    "diagonal_ce": 0.768033504486084,
+    "finite": 0.01814558357000351
+  },
+  {
+    "step": 509,
+    "loss": 0.5581689476966858,
+    "diagonal_ce": 0.540847897529602,
+    "finite": 0.01732107251882553
+  },
+  {
+    "step": 510,
+    "loss": 0.5602397322654724,
+    "diagonal_ce": 0.542681872844696,
+    "finite": 0.017557859420776367
+  },
+  {
+    "step": 511,
+    "loss": 0.5773794651031494,
+    "diagonal_ce": 0.5602262616157532,
+    "finite": 0.017153188586235046
+  },
+  {
+    "step": 512,
+    "loss": 0.5726405382156372,
+    "diagonal_ce": 0.5549761056900024,
+    "finite": 0.017664453014731407
+  },
+  {
+    "step": 513,
+    "loss": 0.6590368747711182,
+    "diagonal_ce": 0.6404289603233337,
+    "finite": 0.01860789582133293
+  },
+  {
+    "step": 514,
+    "loss": 0.5811850428581238,
+    "diagonal_ce": 0.564784824848175,
+    "finite": 0.016400208696722984
+  },
+  {
+    "step": 515,
+    "loss": 0.5810234546661377,
+    "diagonal_ce": 0.5631639361381531,
+    "finite": 0.01785953901708126
+  },
+  {
+    "step": 516,
+    "loss": 0.6360840797424316,
+    "diagonal_ce": 0.6202245950698853,
+    "finite": 0.01585947722196579
+  },
+  {
+    "step": 517,
+    "loss": 0.5278414487838745,
+    "diagonal_ce": 0.5090739727020264,
+    "finite": 0.018767468631267548
+  },
+  {
+    "step": 518,
+    "loss": 0.7315653562545776,
+    "diagonal_ce": 0.7156126499176025,
+    "finite": 0.015952715650200844
+  },
+  {
+    "step": 519,
+    "loss": 0.53978431224823,
+    "diagonal_ce": 0.5246244072914124,
+    "finite": 0.015159893780946732
+  },
+  {
+    "step": 520,
+    "loss": 0.7599347233772278,
+    "diagonal_ce": 0.7433483004570007,
+    "finite": 0.01658644713461399
+  },
+  {
+    "step": 521,
+    "loss": 0.7152586579322815,
+    "diagonal_ce": 0.699381947517395,
+    "finite": 0.015876736491918564
+  },
+  {
+    "step": 522,
+    "loss": 0.49597740173339844,
+    "diagonal_ce": 0.4791649281978607,
+    "finite": 0.016812479123473167
+  },
+  {
+    "step": 523,
+    "loss": 0.6056505441665649,
+    "diagonal_ce": 0.590013325214386,
+    "finite": 0.015637222677469254
+  },
+  {
+    "step": 524,
+    "loss": 0.7084140777587891,
+    "diagonal_ce": 0.6941840052604675,
+    "finite": 0.014230080880224705
+  },
+  {
+    "step": 525,
+    "loss": 0.5548017621040344,
+    "diagonal_ce": 0.5384860038757324,
+    "finite": 0.016315745189785957
+  },
+  {
+    "step": 526,
+    "loss": 0.6274300813674927,
+    "diagonal_ce": 0.6139661073684692,
+    "finite": 0.013464001938700676
+  },
+  {
+    "step": 527,
+    "loss": 0.5303192734718323,
+    "diagonal_ce": 0.5162627696990967,
+    "finite": 0.01405650470405817
+  },
+  {
+    "step": 528,
+    "loss": 0.5296198129653931,
+    "diagonal_ce": 0.515244722366333,
+    "finite": 0.014375079423189163
+  },
+  {
+    "step": 529,
+    "loss": 0.5076814293861389,
+    "diagonal_ce": 0.4927476644515991,
+    "finite": 0.01493377611041069
+  },
+  {
+    "step": 530,
+    "loss": 0.7415550351142883,
+    "diagonal_ce": 0.7300055623054504,
+    "finite": 0.011549467220902443
+  },
+  {
+    "step": 531,
+    "loss": 0.6412598490715027,
+    "diagonal_ce": 0.628994345664978,
+    "finite": 0.012265483848750591
+  },
+  {
+    "step": 532,
+    "loss": 0.6048527956008911,
+    "diagonal_ce": 0.5927634239196777,
+    "finite": 0.012089353054761887
+  },
+  {
+    "step": 533,
+    "loss": 0.6628618240356445,
+    "diagonal_ce": 0.6503257751464844,
+    "finite": 0.012536078691482544
+  },
+  {
+    "step": 534,
+    "loss": 0.5760167837142944,
+    "diagonal_ce": 0.5628811120986938,
+    "finite": 0.013135699555277824
+  },
+  {
+    "step": 535,
+    "loss": 0.7610065340995789,
+    "diagonal_ce": 0.7468565702438354,
+    "finite": 0.014149949885904789
+  },
+  {
+    "step": 536,
+    "loss": 0.4704042375087738,
+    "diagonal_ce": 0.45732805132865906,
+    "finite": 0.013076182454824448
+  },
+  {
+    "step": 537,
+    "loss": 0.6139885187149048,
+    "diagonal_ce": 0.5995436906814575,
+    "finite": 0.014444840140640736
+  },
+  {
+    "step": 538,
+    "loss": 0.6135460734367371,
+    "diagonal_ce": 0.5999271869659424,
+    "finite": 0.01361887902021408
+  },
+  {
+    "step": 539,
+    "loss": 0.6803240180015564,
+    "diagonal_ce": 0.6668809056282043,
+    "finite": 0.013443130068480968
+  },
+  {
+    "step": 540,
+    "loss": 0.6340398192405701,
+    "diagonal_ce": 0.6188169717788696,
+    "finite": 0.01522284559905529
+  },
+  {
+    "step": 541,
+    "loss": 0.5667649507522583,
+    "diagonal_ce": 0.5534724593162537,
+    "finite": 0.013292484916746616
+  },
+  {
+    "step": 542,
+    "loss": 0.7985026240348816,
+    "diagonal_ce": 0.7856451272964478,
+    "finite": 0.012857483699917793
+  },
+  {
+    "step": 543,
+    "loss": 0.5806745290756226,
+    "diagonal_ce": 0.5685871839523315,
+    "finite": 0.012087320908904076
+  },
+  {
+    "step": 544,
+    "loss": 0.7091639637947083,
+    "diagonal_ce": 0.6959852576255798,
+    "finite": 0.01317872665822506
+  },
+  {
+    "step": 545,
+    "loss": 0.5338013768196106,
+    "diagonal_ce": 0.5212488174438477,
+    "finite": 0.01255258172750473
+  },
+  {
+    "step": 546,
+    "loss": 0.5190669298171997,
+    "diagonal_ce": 0.5059664249420166,
+    "finite": 0.01310049183666706
+  },
+  {
+    "step": 547,
+    "loss": 0.6644720435142517,
+    "diagonal_ce": 0.6509345173835754,
+    "finite": 0.013537527993321419
+  },
+  {
+    "step": 548,
+    "loss": 0.547581672668457,
+    "diagonal_ce": 0.5341612100601196,
+    "finite": 0.013420463539659977
+  },
+  {
+    "step": 549,
+    "loss": 0.5193966627120972,
+    "diagonal_ce": 0.505327045917511,
+    "finite": 0.01406964659690857
+  },
+  {
+    "step": 550,
+    "loss": 0.5833470821380615,
+    "diagonal_ce": 0.5690364837646484,
+    "finite": 0.01431062538176775
+  },
+  {
+    "step": 551,
+    "loss": 0.6378686428070068,
+    "diagonal_ce": 0.6222700476646423,
+    "finite": 0.015598570927977562
+  },
+  {
+    "step": 552,
+    "loss": 0.6200816631317139,
+    "diagonal_ce": 0.6055365800857544,
+    "finite": 0.014545065350830555
+  },
+  {
+    "step": 553,
+    "loss": 0.6897873878479004,
+    "diagonal_ce": 0.6771617531776428,
+    "finite": 0.01262564305216074
+  },
+  {
+    "step": 554,
+    "loss": 0.6735296845436096,
+    "diagonal_ce": 0.661151647567749,
+    "finite": 0.012378061190247536
+  },
+  {
+    "step": 555,
+    "loss": 0.7414872050285339,
+    "diagonal_ce": 0.7288562059402466,
+    "finite": 0.012630971148610115
+  },
+  {
+    "step": 556,
+    "loss": 0.5208889842033386,
+    "diagonal_ce": 0.5077910423278809,
+    "finite": 0.013097941875457764
+  },
+  {
+    "step": 557,
+    "loss": 0.5659867525100708,
+    "diagonal_ce": 0.5542166829109192,
+    "finite": 0.011770090088248253
+  },
+  {
+    "step": 558,
+    "loss": 0.5354190468788147,
+    "diagonal_ce": 0.5241384506225586,
+    "finite": 0.011280592530965805
+  },
+  {
+    "step": 559,
+    "loss": 0.5630550980567932,
+    "diagonal_ce": 0.5504519939422607,
+    "finite": 0.012603129260241985
+  },
+  {
+    "step": 560,
+    "loss": 0.6015219688415527,
+    "diagonal_ce": 0.5895912647247314,
+    "finite": 0.011930684559047222
+  },
+  {
+    "step": 561,
+    "loss": 0.6449968814849854,
+    "diagonal_ce": 0.6333378553390503,
+    "finite": 0.011659014970064163
+  },
+  {
+    "step": 562,
+    "loss": 0.5366808772087097,
+    "diagonal_ce": 0.5235621333122253,
+    "finite": 0.0131187429651618
+  },
+  {
+    "step": 563,
+    "loss": 0.5985135436058044,
+    "diagonal_ce": 0.5866466164588928,
+    "finite": 0.011866910383105278
+  },
+  {
+    "step": 564,
+    "loss": 0.6113549470901489,
+    "diagonal_ce": 0.6023383140563965,
+    "finite": 0.009016655385494232
+  },
+  {
+    "step": 565,
+    "loss": 0.681954562664032,
+    "diagonal_ce": 0.6691780090332031,
+    "finite": 0.012776533141732216
+  },
+  {
+    "step": 566,
+    "loss": 0.660499632358551,
+    "diagonal_ce": 0.6503116488456726,
+    "finite": 0.010187970474362373
+  },
+  {
+    "step": 567,
+    "loss": 0.576196014881134,
+    "diagonal_ce": 0.5648506879806519,
+    "finite": 0.011345339007675648
+  },
+  {
+    "step": 568,
+    "loss": 0.7642431855201721,
+    "diagonal_ce": 0.7549864649772644,
+    "finite": 0.009256714954972267
+  },
+  {
+    "step": 569,
+    "loss": 0.5490034222602844,
+    "diagonal_ce": 0.5375719666481018,
+    "finite": 0.01143146213144064
+  },
+  {
+    "step": 570,
+    "loss": 0.4444205164909363,
+    "diagonal_ce": 0.4328019917011261,
+    "finite": 0.011618513613939285
+  },
+  {
+    "step": 571,
+    "loss": 0.45974281430244446,
+    "diagonal_ce": 0.44865137338638306,
+    "finite": 0.0110914446413517
+  },
+  {
+    "step": 572,
+    "loss": 0.5016133785247803,
+    "diagonal_ce": 0.49131977558135986,
+    "finite": 0.010293579660356045
+  },
+  {
+    "step": 573,
+    "loss": 0.5639081001281738,
+    "diagonal_ce": 0.5528910160064697,
+    "finite": 0.011017058975994587
+  },
+  {
+    "step": 574,
+    "loss": 0.6455353498458862,
+    "diagonal_ce": 0.6344016790390015,
+    "finite": 0.011133654043078423
+  },
+  {
+    "step": 575,
+    "loss": 0.7573328018188477,
+    "diagonal_ce": 0.7473885416984558,
+    "finite": 0.009944232180714607
+  },
+  {
+    "step": 576,
+    "loss": 0.6538306474685669,
+    "diagonal_ce": 0.6445888876914978,
+    "finite": 0.00924178957939148
+  },
+  {
+    "step": 577,
+    "loss": 0.62111896276474,
+    "diagonal_ce": 0.6105225086212158,
+    "finite": 0.010596426203846931
+  },
+  {
+    "step": 578,
+    "loss": 0.5678182244300842,
+    "diagonal_ce": 0.5572113394737244,
+    "finite": 0.010606861673295498
+  },
+  {
+    "step": 579,
+    "loss": 0.6762785911560059,
+    "diagonal_ce": 0.6669816970825195,
+    "finite": 0.00929686427116394
+  },
+  {
+    "step": 580,
+    "loss": 0.6740212440490723,
+    "diagonal_ce": 0.6650465130805969,
+    "finite": 0.008974702097475529
+  },
+  {
+    "step": 581,
+    "loss": 0.586179256439209,
+    "diagonal_ce": 0.5758432745933533,
+    "finite": 0.010335966013371944
+  },
+  {
+    "step": 582,
+    "loss": 0.7514495253562927,
+    "diagonal_ce": 0.7412011623382568,
+    "finite": 0.010248370468616486
+  },
+  {
+    "step": 583,
+    "loss": 0.5808308124542236,
+    "diagonal_ce": 0.5708470344543457,
+    "finite": 0.009983775205910206
+  },
+  {
+    "step": 584,
+    "loss": 0.6078039407730103,
+    "diagonal_ce": 0.5965970158576965,
+    "finite": 0.011206944473087788
+  },
+  {
+    "step": 585,
+    "loss": 0.5899645686149597,
+    "diagonal_ce": 0.5794322490692139,
+    "finite": 0.01053230557590723
+  },
+  {
+    "step": 586,
+    "loss": 0.5305208563804626,
+    "diagonal_ce": 0.5196015238761902,
+    "finite": 0.0109193604439497
+  },
+  {
+    "step": 587,
+    "loss": 0.5652779340744019,
+    "diagonal_ce": 0.5529776811599731,
+    "finite": 0.012300249189138412
+  },
+  {
+    "step": 588,
+    "loss": 0.506768524646759,
+    "diagonal_ce": 0.49620160460472107,
+    "finite": 0.010566944256424904
+  },
+  {
+    "step": 589,
+    "loss": 0.627805233001709,
+    "diagonal_ce": 0.6176616549491882,
+    "finite": 0.010143603198230267
+  },
+  {
+    "step": 590,
+    "loss": 0.48885416984558105,
+    "diagonal_ce": 0.4781586825847626,
+    "finite": 0.010695502161979675
+  },
+  {
+    "step": 591,
+    "loss": 0.9091668128967285,
+    "diagonal_ce": 0.9000929594039917,
+    "finite": 0.00907385814934969
+  },
+  {
+    "step": 592,
+    "loss": 0.7165020108222961,
+    "diagonal_ce": 0.7066841721534729,
+    "finite": 0.00981783214956522
+  },
+  {
+    "step": 593,
+    "loss": 0.6546058654785156,
+    "diagonal_ce": 0.6448461413383484,
+    "finite": 0.009759734384715557
+  },
+  {
+    "step": 594,
+    "loss": 0.5009477138519287,
+    "diagonal_ce": 0.4923471510410309,
+    "finite": 0.00860055722296238
+  },
+  {
+    "step": 595,
+    "loss": 0.6083723306655884,
+    "diagonal_ce": 0.5988593697547913,
+    "finite": 0.009512954391539097
+  },
+  {
+    "step": 596,
+    "loss": 0.625207781791687,
+    "diagonal_ce": 0.6161245107650757,
+    "finite": 0.009083294309675694
+  },
+  {
+    "step": 597,
+    "loss": 0.5921409130096436,
+    "diagonal_ce": 0.5831272602081299,
+    "finite": 0.009013623930513859
+  },
+  {
+    "step": 598,
+    "loss": 0.6450151801109314,
+    "diagonal_ce": 0.6354700326919556,
+    "finite": 0.009545163251459599
+  },
+  {
+    "step": 599,
+    "loss": 0.6760583519935608,
+    "diagonal_ce": 0.6685917377471924,
+    "finite": 0.007466590031981468
+  },
+  {
+    "step": 600,
+    "loss": 0.5542839169502258,
+    "diagonal_ce": 0.5450844168663025,
+    "finite": 0.009199507534503937
+  },
+  {
+    "step": 601,
+    "loss": 0.6526274681091309,
+    "diagonal_ce": 0.6443899869918823,
+    "finite": 0.00823749229311943
+  },
+  {
+    "step": 602,
+    "loss": 0.6360390186309814,
+    "diagonal_ce": 0.6269316673278809,
+    "finite": 0.009107330814003944
+  },
+  {
+    "step": 603,
+    "loss": 0.5427088737487793,
+    "diagonal_ce": 0.5333842039108276,
+    "finite": 0.009324691258370876
+  },
+  {
+    "step": 604,
+    "loss": 0.49397140741348267,
+    "diagonal_ce": 0.4847239553928375,
+    "finite": 0.009247461333870888
+  },
+  {
+    "step": 605,
+    "loss": 0.6055186986923218,
+    "diagonal_ce": 0.5973075032234192,
+    "finite": 0.008211210370063782
+  },
+  {
+    "step": 606,
+    "loss": 0.5984644889831543,
+    "diagonal_ce": 0.5890367031097412,
+    "finite": 0.009427808225154877
+  },
+  {
+    "step": 607,
+    "loss": 0.7941700220108032,
+    "diagonal_ce": 0.7864430546760559,
+    "finite": 0.007726971060037613
+  },
+  {
+    "step": 608,
+    "loss": 0.45789140462875366,
+    "diagonal_ce": 0.44939905405044556,
+    "finite": 0.008492336608469486
+  },
+  {
+    "step": 609,
+    "loss": 0.488839328289032,
+    "diagonal_ce": 0.4794740676879883,
+    "finite": 0.009365271776914597
+  },
+  {
+    "step": 610,
+    "loss": 0.7345083951950073,
+    "diagonal_ce": 0.7257528901100159,
+    "finite": 0.008755533024668694
+  },
+  {
+    "step": 611,
+    "loss": 0.5679032206535339,
+    "diagonal_ce": 0.5591764450073242,
+    "finite": 0.008726794272661209
+  },
+  {
+    "step": 612,
+    "loss": 0.5382773876190186,
+    "diagonal_ce": 0.530031144618988,
+    "finite": 0.008246243931353092
+  },
+  {
+    "step": 613,
+    "loss": 0.610262393951416,
+    "diagonal_ce": 0.6017552018165588,
+    "finite": 0.008507221937179565
+  },
+  {
+    "step": 614,
+    "loss": 0.5962731838226318,
+    "diagonal_ce": 0.5873728394508362,
+    "finite": 0.008900368586182594
+  },
+  {
+    "step": 615,
+    "loss": 0.5216548442840576,
+    "diagonal_ce": 0.512294590473175,
+    "finite": 0.009360277093946934
+  },
+  {
+    "step": 616,
+    "loss": 0.4880463778972626,
+    "diagonal_ce": 0.47946038842201233,
+    "finite": 0.008585987612605095
+  },
+  {
+    "step": 617,
+    "loss": 0.6029796004295349,
+    "diagonal_ce": 0.5941395163536072,
+    "finite": 0.008840077556669712
+  },
+  {
+    "step": 618,
+    "loss": 0.6285315155982971,
+    "diagonal_ce": 0.6183344125747681,
+    "finite": 0.01019708625972271
+  },
+  {
+    "step": 619,
+    "loss": 0.7600879669189453,
+    "diagonal_ce": 0.7507343292236328,
+    "finite": 0.009353607892990112
+  },
+  {
+    "step": 620,
+    "loss": 0.6678269505500793,
+    "diagonal_ce": 0.6592119336128235,
+    "finite": 0.008615014143288136
+  },
+  {
+    "step": 621,
+    "loss": 0.6846848130226135,
+    "diagonal_ce": 0.675724446773529,
+    "finite": 0.008960378356277943
+  },
+  {
+    "step": 622,
+    "loss": 0.5158474445343018,
+    "diagonal_ce": 0.5068970918655396,
+    "finite": 0.008950368501245975
+  },
+  {
+    "step": 623,
+    "loss": 0.5375926494598389,
+    "diagonal_ce": 0.5284068584442139,
+    "finite": 0.009185763075947762
+  },
+  {
+    "step": 624,
+    "loss": 0.5273405313491821,
+    "diagonal_ce": 0.5186746120452881,
+    "finite": 0.008665921166539192
+  },
+  {
+    "step": 625,
+    "loss": 0.5578222274780273,
+    "diagonal_ce": 0.5504429936408997,
+    "finite": 0.007379255723208189
+  },
+  {
+    "step": 626,
+    "loss": 0.6113649606704712,
+    "diagonal_ce": 0.6035026907920837,
+    "finite": 0.007862241938710213
+  },
+  {
+    "step": 627,
+    "loss": 0.8237854242324829,
+    "diagonal_ce": 0.8150591850280762,
+    "finite": 0.00872625783085823
+  },
+  {
+    "step": 628,
+    "loss": 0.6186004877090454,
+    "diagonal_ce": 0.6108815670013428,
+    "finite": 0.007718926761299372
+  },
+  {
+    "step": 629,
+    "loss": 0.5242176651954651,
+    "diagonal_ce": 0.5160440802574158,
+    "finite": 0.008173586800694466
+  },
+  {
+    "step": 630,
+    "loss": 0.6157702803611755,
+    "diagonal_ce": 0.6094775795936584,
+    "finite": 0.0062926774844527245
+  },
+  {
+    "step": 631,
+    "loss": 0.3922213912010193,
+    "diagonal_ce": 0.3844887614250183,
+    "finite": 0.007732621394097805
+  },
+  {
+    "step": 632,
+    "loss": 0.7448252439498901,
+    "diagonal_ce": 0.7380409836769104,
+    "finite": 0.006784238386899233
+  },
+  {
+    "step": 633,
+    "loss": 0.5072969198226929,
+    "diagonal_ce": 0.49985963106155396,
+    "finite": 0.00743728457018733
+  },
+  {
+    "step": 634,
+    "loss": 0.6143150329589844,
+    "diagonal_ce": 0.607174813747406,
+    "finite": 0.007140240631997585
+  },
+  {
+    "step": 635,
+    "loss": 0.5706548094749451,
+    "diagonal_ce": 0.5631608963012695,
+    "finite": 0.00749391270801425
+  },
+  {
+    "step": 636,
+    "loss": 0.7058072686195374,
+    "diagonal_ce": 0.6982460618019104,
+    "finite": 0.00756122637540102
+  },
+  {
+    "step": 637,
+    "loss": 0.4642515778541565,
+    "diagonal_ce": 0.4564647674560547,
+    "finite": 0.007786818314343691
+  },
+  {
+    "step": 638,
+    "loss": 0.6139107346534729,
+    "diagonal_ce": 0.6062588691711426,
+    "finite": 0.007651836611330509
+  },
+  {
+    "step": 639,
+    "loss": 0.44293123483657837,
+    "diagonal_ce": 0.43502989411354065,
+    "finite": 0.007901329547166824
+  },
+  {
+    "step": 640,
+    "loss": 0.5400351881980896,
+    "diagonal_ce": 0.5327825546264648,
+    "finite": 0.007252609357237816
+  },
+  {
+    "step": 641,
+    "loss": 0.545167088508606,
+    "diagonal_ce": 0.5366486310958862,
+    "finite": 0.008518485352396965
+  },
+  {
+    "step": 642,
+    "loss": 0.6781913638114929,
+    "diagonal_ce": 0.6707649230957031,
+    "finite": 0.007426436059176922
+  },
+  {
+    "step": 643,
+    "loss": 0.8031893968582153,
+    "diagonal_ce": 0.7953951954841614,
+    "finite": 0.007794179953634739
+  },
+  {
+    "step": 644,
+    "loss": 0.6727279424667358,
+    "diagonal_ce": 0.6649649143218994,
+    "finite": 0.007763057015836239
+  },
+  {
+    "step": 645,
+    "loss": 0.5248768925666809,
+    "diagonal_ce": 0.5177189111709595,
+    "finite": 0.007157960440963507
+  },
+  {
+    "step": 646,
+    "loss": 0.5839208960533142,
+    "diagonal_ce": 0.5767126083374023,
+    "finite": 0.007208259776234627
+  },
+  {
+    "step": 647,
+    "loss": 0.6007469296455383,
+    "diagonal_ce": 0.5949084162712097,
+    "finite": 0.005838489159941673
+  },
+  {
+    "step": 648,
+    "loss": 0.5155071020126343,
+    "diagonal_ce": 0.5092006325721741,
+    "finite": 0.006306466180831194
+  },
+  {
+    "step": 649,
+    "loss": 0.5334141850471497,
+    "diagonal_ce": 0.526692271232605,
+    "finite": 0.0067219240590929985
+  },
+  {
+    "step": 650,
+    "loss": 0.5896737575531006,
+    "diagonal_ce": 0.5831220149993896,
+    "finite": 0.006551723461598158
+  },
+  {
+    "step": 651,
+    "loss": 0.613231897354126,
+    "diagonal_ce": 0.606483519077301,
+    "finite": 0.006748350802809
+  },
+  {
+    "step": 652,
+    "loss": 0.4505710303783417,
+    "diagonal_ce": 0.44296225905418396,
+    "finite": 0.007608759216964245
+  },
+  {
+    "step": 653,
+    "loss": 0.6358756422996521,
+    "diagonal_ce": 0.6281623840332031,
+    "finite": 0.007713256869465113
+  },
+  {
+    "step": 654,
+    "loss": 0.6003149747848511,
+    "diagonal_ce": 0.5937052965164185,
+    "finite": 0.006609688512980938
+  },
+  {
+    "step": 655,
+    "loss": 0.45950791239738464,
+    "diagonal_ce": 0.4530925750732422,
+    "finite": 0.006415334530174732
+  },
+  {
+    "step": 656,
+    "loss": 0.5173730254173279,
+    "diagonal_ce": 0.5100931525230408,
+    "finite": 0.007279899436980486
+  },
+  {
+    "step": 657,
+    "loss": 0.8011082410812378,
+    "diagonal_ce": 0.794485330581665,
+    "finite": 0.006622889079153538
+  },
+  {
+    "step": 658,
+    "loss": 0.6189275979995728,
+    "diagonal_ce": 0.6111246943473816,
+    "finite": 0.007802893407642841
+  },
+  {
+    "step": 659,
+    "loss": 0.696629524230957,
+    "diagonal_ce": 0.6892421841621399,
+    "finite": 0.0073873247019946575
+  },
+  {
+    "step": 660,
+    "loss": 0.7404506206512451,
+    "diagonal_ce": 0.7336127161979675,
+    "finite": 0.006837929133325815
+  },
+  {
+    "step": 661,
+    "loss": 0.6779540777206421,
+    "diagonal_ce": 0.6700553894042969,
+    "finite": 0.007898671552538872
+  },
+  {
+    "step": 662,
+    "loss": 0.5210431218147278,
+    "diagonal_ce": 0.5139685273170471,
+    "finite": 0.007074597291648388
+  },
+  {
+    "step": 663,
+    "loss": 0.5762674808502197,
+    "diagonal_ce": 0.5695520639419556,
+    "finite": 0.0067154099233448505
+  },
+  {
+    "step": 664,
+    "loss": 0.7188443541526794,
+    "diagonal_ce": 0.7121296525001526,
+    "finite": 0.006714712828397751
+  },
+  {
+    "step": 665,
+    "loss": 0.6481420397758484,
+    "diagonal_ce": 0.6408611536026001,
+    "finite": 0.007280863355845213
+  },
+  {
+    "step": 666,
+    "loss": 0.5416592359542847,
+    "diagonal_ce": 0.5341827869415283,
+    "finite": 0.007476474158465862
+  },
+  {
+    "step": 667,
+    "loss": 0.49641337990760803,
+    "diagonal_ce": 0.48997458815574646,
+    "finite": 0.006438779644668102
+  },
+  {
+    "step": 668,
+    "loss": 0.43142563104629517,
+    "diagonal_ce": 0.4262906610965729,
+    "finite": 0.005134966690093279
+  },
+  {
+    "step": 669,
+    "loss": 0.5968174934387207,
+    "diagonal_ce": 0.5898759365081787,
+    "finite": 0.006941537372767925
+  },
+  {
+    "step": 670,
+    "loss": 0.6415351033210754,
+    "diagonal_ce": 0.635242223739624,
+    "finite": 0.006292854435741901
+  },
+  {
+    "step": 671,
+    "loss": 0.5168834328651428,
+    "diagonal_ce": 0.5112046599388123,
+    "finite": 0.005678746849298477
+  },
+  {
+    "step": 672,
+    "loss": 0.7543843388557434,
+    "diagonal_ce": 0.7493520379066467,
+    "finite": 0.0050323037430644035
+  },
+  {
+    "step": 673,
+    "loss": 0.5158107876777649,
+    "diagonal_ce": 0.5107355117797852,
+    "finite": 0.005075264256447554
+  },
+  {
+    "step": 674,
+    "loss": 0.49751952290534973,
+    "diagonal_ce": 0.49096864461898804,
+    "finite": 0.006550880149006844
+  },
+  {
+    "step": 675,
+    "loss": 0.6997663378715515,
+    "diagonal_ce": 0.6929422616958618,
+    "finite": 0.006824077572673559
+  },
+  {
+    "step": 676,
+    "loss": 0.5643689036369324,
+    "diagonal_ce": 0.5572367310523987,
+    "finite": 0.007132188882678747
+  },
+  {
+    "step": 677,
+    "loss": 0.6782681345939636,
+    "diagonal_ce": 0.6715731620788574,
+    "finite": 0.00669497437775135
+  },
+  {
+    "step": 678,
+    "loss": 0.8131963610649109,
+    "diagonal_ce": 0.8069635629653931,
+    "finite": 0.006232797168195248
+  },
+  {
+    "step": 679,
+    "loss": 0.5459738373756409,
+    "diagonal_ce": 0.5387207865715027,
+    "finite": 0.007253075018525124
+  },
+  {
+    "step": 680,
+    "loss": 0.5775579810142517,
+    "diagonal_ce": 0.570279061794281,
+    "finite": 0.007278905715793371
+  },
+  {
+    "step": 681,
+    "loss": 0.6005566716194153,
+    "diagonal_ce": 0.5939784049987793,
+    "finite": 0.006578290835022926
+  },
+  {
+    "step": 682,
+    "loss": 0.7647868990898132,
+    "diagonal_ce": 0.758032500743866,
+    "finite": 0.006754414644092321
+  },
+  {
+    "step": 683,
+    "loss": 0.6147888898849487,
+    "diagonal_ce": 0.6085519790649414,
+    "finite": 0.00623688381165266
+  },
+  {
+    "step": 684,
+    "loss": 0.5772717595100403,
+    "diagonal_ce": 0.5697056651115417,
+    "finite": 0.0075660883449018
+  },
+  {
+    "step": 685,
+    "loss": 0.6615219116210938,
+    "diagonal_ce": 0.6550208330154419,
+    "finite": 0.006501056253910065
+  },
+  {
+    "step": 686,
+    "loss": 0.596802830696106,
+    "diagonal_ce": 0.5911896824836731,
+    "finite": 0.005613167304545641
+  },
+  {
+    "step": 687,
+    "loss": 0.644104540348053,
+    "diagonal_ce": 0.6383756399154663,
+    "finite": 0.0057289088144898415
+  },
+  {
+    "step": 688,
+    "loss": 0.5189314484596252,
+    "diagonal_ce": 0.5140480399131775,
+    "finite": 0.004883406218141317
+  },
+  {
+    "step": 689,
+    "loss": 0.7056902050971985,
+    "diagonal_ce": 0.7009792923927307,
+    "finite": 0.004710919689387083
+  },
+  {
+    "step": 690,
+    "loss": 0.7412758469581604,
+    "diagonal_ce": 0.7357228398323059,
+    "finite": 0.00555300060659647
+  },
+  {
+    "step": 691,
+    "loss": 0.7019264101982117,
+    "diagonal_ce": 0.6971114277839661,
+    "finite": 0.00481495913118124
+  },
+  {
+    "step": 692,
+    "loss": 0.6282881498336792,
+    "diagonal_ce": 0.6228893995285034,
+    "finite": 0.005398725159466267
+  },
+  {
+    "step": 693,
+    "loss": 0.594719648361206,
+    "diagonal_ce": 0.5902184844017029,
+    "finite": 0.004501177463680506
+  },
+  {
+    "step": 694,
+    "loss": 0.49776822328567505,
+    "diagonal_ce": 0.4927792251110077,
+    "finite": 0.004988985601812601
+  },
+  {
+    "step": 695,
+    "loss": 0.6355772018432617,
+    "diagonal_ce": 0.6299434304237366,
+    "finite": 0.005633780267089605
+  },
+  {
+    "step": 696,
+    "loss": 0.5338720679283142,
+    "diagonal_ce": 0.5281214118003845,
+    "finite": 0.005750659387558699
+  },
+  {
+    "step": 697,
+    "loss": 0.49844348430633545,
+    "diagonal_ce": 0.4922831654548645,
+    "finite": 0.0061603086069226265
+  },
+  {
+    "step": 698,
+    "loss": 0.5841370224952698,
+    "diagonal_ce": 0.5779232978820801,
+    "finite": 0.006213699467480183
+  },
+  {
+    "step": 699,
+    "loss": 0.47318148612976074,
+    "diagonal_ce": 0.46806055307388306,
+    "finite": 0.005120929330587387
+  },
+  {
+    "step": 700,
+    "loss": 0.603259801864624,
+    "diagonal_ce": 0.598147451877594,
+    "finite": 0.005112321116030216
+  },
+  {
+    "step": 701,
+    "loss": 0.6957112550735474,
+    "diagonal_ce": 0.6897942423820496,
+    "finite": 0.005916985217481852
+  },
+  {
+    "step": 702,
+    "loss": 0.5301991701126099,
+    "diagonal_ce": 0.5255879759788513,
+    "finite": 0.004611176438629627
+  },
+  {
+    "step": 703,
+    "loss": 0.5246089100837708,
+    "diagonal_ce": 0.5198834538459778,
+    "finite": 0.004725470673292875
+  },
+  {
+    "step": 704,
+    "loss": 0.6339170932769775,
+    "diagonal_ce": 0.6292961835861206,
+    "finite": 0.00462093111127615
+  },
+  {
+    "step": 705,
+    "loss": 0.7081480026245117,
+    "diagonal_ce": 0.7031137943267822,
+    "finite": 0.005034191068261862
+  },
+  {
+    "step": 706,
+    "loss": 0.5846548080444336,
+    "diagonal_ce": 0.580084502696991,
+    "finite": 0.00457029091194272
+  },
+  {
+    "step": 707,
+    "loss": 0.651593804359436,
+    "diagonal_ce": 0.6471475958824158,
+    "finite": 0.004446196369826794
+  },
+  {
+    "step": 708,
+    "loss": 0.550935685634613,
+    "diagonal_ce": 0.5457582473754883,
+    "finite": 0.005177465733140707
+  },
+  {
+    "step": 709,
+    "loss": 0.5585367679595947,
+    "diagonal_ce": 0.5536871552467346,
+    "finite": 0.004849642049521208
+  },
+  {
+    "step": 710,
+    "loss": 0.5966452956199646,
+    "diagonal_ce": 0.5914989709854126,
+    "finite": 0.005146332550793886
+  },
+  {
+    "step": 711,
+    "loss": 0.5047361254692078,
+    "diagonal_ce": 0.4995652139186859,
+    "finite": 0.005170921329408884
+  },
+  {
+    "step": 712,
+    "loss": 0.6372012495994568,
+    "diagonal_ce": 0.6318872570991516,
+    "finite": 0.005313990171998739
+  },
+  {
+    "step": 713,
+    "loss": 0.5417037606239319,
+    "diagonal_ce": 0.5365387201309204,
+    "finite": 0.005165066570043564
+  },
+  {
+    "step": 714,
+    "loss": 0.4322260022163391,
+    "diagonal_ce": 0.4271342158317566,
+    "finite": 0.00509179150685668
+  },
+  {
+    "step": 715,
+    "loss": 0.6081584692001343,
+    "diagonal_ce": 0.6022542715072632,
+    "finite": 0.005904208868741989
+  },
+  {
+    "step": 716,
+    "loss": 0.6529801487922668,
+    "diagonal_ce": 0.646382749080658,
+    "finite": 0.0065974025055766106
+  },
+  {
+    "step": 717,
+    "loss": 0.6029770374298096,
+    "diagonal_ce": 0.59701007604599,
+    "finite": 0.00596698559820652
+  },
+  {
+    "step": 718,
+    "loss": 0.6179527640342712,
+    "diagonal_ce": 0.6128685474395752,
+    "finite": 0.005084211006760597
+  },
+  {
+    "step": 719,
+    "loss": 0.6095542311668396,
+    "diagonal_ce": 0.6038524508476257,
+    "finite": 0.005701808724552393
+  },
+  {
+    "step": 720,
+    "loss": 0.5259003639221191,
+    "diagonal_ce": 0.5213944315910339,
+    "finite": 0.004505926743149757
+  },
+  {
+    "step": 721,
+    "loss": 0.5203016996383667,
+    "diagonal_ce": 0.5162729024887085,
+    "finite": 0.004028795287013054
+  },
+  {
+    "step": 722,
+    "loss": 0.5026533603668213,
+    "diagonal_ce": 0.49796605110168457,
+    "finite": 0.004687321372330189
+  },
+  {
+    "step": 723,
+    "loss": 0.5067877769470215,
+    "diagonal_ce": 0.5012431740760803,
+    "finite": 0.005544593092054129
+  },
+  {
+    "step": 724,
+    "loss": 0.5946764945983887,
+    "diagonal_ce": 0.5901917219161987,
+    "finite": 0.004484759643673897
+  },
+  {
+    "step": 725,
+    "loss": 0.666881263256073,
+    "diagonal_ce": 0.6613634824752808,
+    "finite": 0.005517785903066397
+  },
+  {
+    "step": 726,
+    "loss": 0.5779431462287903,
+    "diagonal_ce": 0.5736463069915771,
+    "finite": 0.004296854138374329
+  },
+  {
+    "step": 727,
+    "loss": 0.39657488465309143,
+    "diagonal_ce": 0.3917466700077057,
+    "finite": 0.0048282272182404995
+  },
+  {
+    "step": 728,
+    "loss": 0.588543176651001,
+    "diagonal_ce": 0.5836647748947144,
+    "finite": 0.004878415260463953
+  },
+  {
+    "step": 729,
+    "loss": 0.606036901473999,
+    "diagonal_ce": 0.6011916399002075,
+    "finite": 0.004845259711146355
+  },
+  {
+    "step": 730,
+    "loss": 0.6018134355545044,
+    "diagonal_ce": 0.5964864492416382,
+    "finite": 0.0053269886411726475
+  },
+  {
+    "step": 731,
+    "loss": 0.5528103113174438,
+    "diagonal_ce": 0.5483360886573792,
+    "finite": 0.004474241752177477
+  },
+  {
+    "step": 732,
+    "loss": 0.5703103542327881,
+    "diagonal_ce": 0.5657076835632324,
+    "finite": 0.0046026697382330894
+  },
+  {
+    "step": 733,
+    "loss": 0.48108214139938354,
+    "diagonal_ce": 0.47644153237342834,
+    "finite": 0.004640600644052029
+  },
+  {
+    "step": 734,
+    "loss": 0.655825674533844,
+    "diagonal_ce": 0.650985598564148,
+    "finite": 0.004840068519115448
+  },
+  {
+    "step": 735,
+    "loss": 0.5952638983726501,
+    "diagonal_ce": 0.5901941061019897,
+    "finite": 0.005069774575531483
+  },
+  {
+    "step": 736,
+    "loss": 0.743880569934845,
+    "diagonal_ce": 0.7393494844436646,
+    "finite": 0.004531096201390028
+  },
+  {
+    "step": 737,
+    "loss": 0.4088784456253052,
+    "diagonal_ce": 0.4026680886745453,
+    "finite": 0.006210365332663059
+  },
+  {
+    "step": 738,
+    "loss": 0.46949681639671326,
+    "diagonal_ce": 0.46352317929267883,
+    "finite": 0.005973645020276308
+  },
+  {
+    "step": 739,
+    "loss": 0.39137035608291626,
+    "diagonal_ce": 0.38555750250816345,
+    "finite": 0.005812845192849636
+  },
+  {
+    "step": 740,
+    "loss": 0.49648550152778625,
+    "diagonal_ce": 0.49045470356941223,
+    "finite": 0.006030798889696598
+  },
+  {
+    "step": 741,
+    "loss": 0.6909202337265015,
+    "diagonal_ce": 0.6854631304740906,
+    "finite": 0.005457122810184956
+  },
+  {
+    "step": 742,
+    "loss": 0.5821558833122253,
+    "diagonal_ce": 0.5758398175239563,
+    "finite": 0.006316088605672121
+  },
+  {
+    "step": 743,
+    "loss": 0.583372175693512,
+    "diagonal_ce": 0.5770205855369568,
+    "finite": 0.006351590622216463
+  },
+  {
+    "step": 744,
+    "loss": 0.6647293567657471,
+    "diagonal_ce": 0.6571593284606934,
+    "finite": 0.007570039946585894
+  },
+  {
+    "step": 745,
+    "loss": 0.46977323293685913,
+    "diagonal_ce": 0.46459779143333435,
+    "finite": 0.00517545361071825
+  },
+  {
+    "step": 746,
+    "loss": 0.7219622731208801,
+    "diagonal_ce": 0.7164204716682434,
+    "finite": 0.00554177351295948
+  },
+  {
+    "step": 747,
+    "loss": 0.4656011760234833,
+    "diagonal_ce": 0.4601951539516449,
+    "finite": 0.005406034644693136
+  },
+  {
+    "step": 748,
+    "loss": 0.4586905241012573,
+    "diagonal_ce": 0.45429569482803345,
+    "finite": 0.0043948255479335785
+  },
+  {
+    "step": 749,
+    "loss": 0.6031593680381775,
+    "diagonal_ce": 0.5984617471694946,
+    "finite": 0.004697606898844242
+  },
+  {
+    "step": 750,
+    "loss": 0.5983100533485413,
+    "diagonal_ce": 0.5939266681671143,
+    "finite": 0.0043833632953464985
+  },
+  {
+    "step": 751,
+    "loss": 0.6308960318565369,
+    "diagonal_ce": 0.6264097690582275,
+    "finite": 0.004486233927309513
+  },
+  {
+    "step": 752,
+    "loss": 0.6163740158081055,
+    "diagonal_ce": 0.6118582487106323,
+    "finite": 0.004515775945037603
+  },
+  {
+    "step": 753,
+    "loss": 0.5240486860275269,
+    "diagonal_ce": 0.5196775197982788,
+    "finite": 0.004371163435280323
+  },
+  {
+    "step": 754,
+    "loss": 0.6197978258132935,
+    "diagonal_ce": 0.6142354011535645,
+    "finite": 0.0055624330416321754
+  },
+  {
+    "step": 755,
+    "loss": 0.5531762838363647,
+    "diagonal_ce": 0.5495253801345825,
+    "finite": 0.0036509246565401554
+  },
+  {
+    "step": 756,
+    "loss": 0.5359057784080505,
+    "diagonal_ce": 0.5317333936691284,
+    "finite": 0.004172398243099451
+  },
+  {
+    "step": 757,
+    "loss": 0.5587162971496582,
+    "diagonal_ce": 0.5543877482414246,
+    "finite": 0.004328543320298195
+  },
+  {
+    "step": 758,
+    "loss": 0.603954553604126,
+    "diagonal_ce": 0.6003129482269287,
+    "finite": 0.003641603048890829
+  },
+  {
+    "step": 759,
+    "loss": 0.6233282089233398,
+    "diagonal_ce": 0.6194018721580505,
+    "finite": 0.003926315810531378
+  },
+  {
+    "step": 760,
+    "loss": 0.6590350270271301,
+    "diagonal_ce": 0.6548672914505005,
+    "finite": 0.004167723935097456
+  },
+  {
+    "step": 761,
+    "loss": 0.6791284084320068,
+    "diagonal_ce": 0.6756821274757385,
+    "finite": 0.0034462884068489075
+  },
+  {
+    "step": 762,
+    "loss": 0.5534005761146545,
+    "diagonal_ce": 0.5493608117103577,
+    "finite": 0.004039753694087267
+  },
+  {
+    "step": 763,
+    "loss": 0.5981799364089966,
+    "diagonal_ce": 0.5927493572235107,
+    "finite": 0.00543059129267931
+  },
+  {
+    "step": 764,
+    "loss": 0.5386589169502258,
+    "diagonal_ce": 0.5333455801010132,
+    "finite": 0.00531335873529315
+  },
+  {
+    "step": 765,
+    "loss": 0.5268120765686035,
+    "diagonal_ce": 0.522212028503418,
+    "finite": 0.004600051790475845
+  },
+  {
+    "step": 766,
+    "loss": 0.5448147058486938,
+    "diagonal_ce": 0.5389114022254944,
+    "finite": 0.005903332494199276
+  },
+  {
+    "step": 767,
+    "loss": 0.6718729138374329,
+    "diagonal_ce": 0.6673212647438049,
+    "finite": 0.004551625344902277
+  },
+  {
+    "step": 768,
+    "loss": 0.530113697052002,
+    "diagonal_ce": 0.5253068208694458,
+    "finite": 0.0048068673349916935
+  },
+  {
+    "step": 769,
+    "loss": 0.571299135684967,
+    "diagonal_ce": 0.5646328926086426,
+    "finite": 0.006666222121566534
+  },
+  {
+    "step": 770,
+    "loss": 0.5822795033454895,
+    "diagonal_ce": 0.5767070651054382,
+    "finite": 0.005572427064180374
+  },
+  {
+    "step": 771,
+    "loss": 0.5672985911369324,
+    "diagonal_ce": 0.560481071472168,
+    "finite": 0.0068175336346030235
+  },
+  {
+    "step": 772,
+    "loss": 0.49879804253578186,
+    "diagonal_ce": 0.4940308928489685,
+    "finite": 0.004767152015119791
+  },
+  {
+    "step": 773,
+    "loss": 0.5122788548469543,
+    "diagonal_ce": 0.5080760717391968,
+    "finite": 0.004202754702419043
+  },
+  {
+    "step": 774,
+    "loss": 0.5077646970748901,
+    "diagonal_ce": 0.5030757784843445,
+    "finite": 0.004688917193561792
+  },
+  {
+    "step": 775,
+    "loss": 0.5721680521965027,
+    "diagonal_ce": 0.5677628517150879,
+    "finite": 0.0044052028097212315
+  },
+  {
+    "step": 776,
+    "loss": 0.5689389705657959,
+    "diagonal_ce": 0.5648477673530579,
+    "finite": 0.004091218113899231
+  },
+  {
+    "step": 777,
+    "loss": 0.5226620435714722,
+    "diagonal_ce": 0.5189504623413086,
+    "finite": 0.003711555153131485
+  },
+  {
+    "step": 778,
+    "loss": 0.5366437435150146,
+    "diagonal_ce": 0.5325090289115906,
+    "finite": 0.004134741146117449
+  },
+  {
+    "step": 779,
+    "loss": 0.46721166372299194,
+    "diagonal_ce": 0.4637056589126587,
+    "finite": 0.0035060036461800337
+  },
+  {
+    "step": 780,
+    "loss": 0.4677630662918091,
+    "diagonal_ce": 0.46368885040283203,
+    "finite": 0.004074219614267349
+  },
+  {
+    "step": 781,
+    "loss": 0.4889649748802185,
+    "diagonal_ce": 0.48544570803642273,
+    "finite": 0.003519275691360235
+  },
+  {
+    "step": 782,
+    "loss": 0.5703349709510803,
+    "diagonal_ce": 0.5663831830024719,
+    "finite": 0.00395176513120532
+  },
+  {
+    "step": 783,
+    "loss": 0.49202579259872437,
+    "diagonal_ce": 0.48774874210357666,
+    "finite": 0.0042770542204380035
+  },
+  {
+    "step": 784,
+    "loss": 0.502260684967041,
+    "diagonal_ce": 0.49892479181289673,
+    "finite": 0.0033358875662088394
+  },
+  {
+    "step": 785,
+    "loss": 0.5161355137825012,
+    "diagonal_ce": 0.5118049383163452,
+    "finite": 0.004330582916736603
+  },
+  {
+    "step": 786,
+    "loss": 0.49555477499961853,
+    "diagonal_ce": 0.4908113479614258,
+    "finite": 0.004743440076708794
+  },
+  {
+    "step": 787,
+    "loss": 0.6754187941551208,
+    "diagonal_ce": 0.6708735823631287,
+    "finite": 0.004545228555798531
+  },
+  {
+    "step": 788,
+    "loss": 0.6351370215415955,
+    "diagonal_ce": 0.6304804086685181,
+    "finite": 0.0046565840020775795
+  },
+  {
+    "step": 789,
+    "loss": 0.5075686573982239,
+    "diagonal_ce": 0.5032550692558289,
+    "finite": 0.004313610959798098
+  },
+  {
+    "step": 790,
+    "loss": 0.570289134979248,
+    "diagonal_ce": 0.5668367147445679,
+    "finite": 0.0034524002112448215
+  },
+  {
+    "step": 791,
+    "loss": 0.6292264461517334,
+    "diagonal_ce": 0.6255064606666565,
+    "finite": 0.003719960805028677
+  },
+  {
+    "step": 792,
+    "loss": 0.5007327795028687,
+    "diagonal_ce": 0.49723154306411743,
+    "finite": 0.003501239698380232
+  },
+  {
+    "step": 793,
+    "loss": 0.47494280338287354,
+    "diagonal_ce": 0.47114098072052,
+    "finite": 0.0038018287159502506
+  },
+  {
+    "step": 794,
+    "loss": 0.685469388961792,
+    "diagonal_ce": 0.6812890768051147,
+    "finite": 0.004180325195193291
+  },
+  {
+    "step": 795,
+    "loss": 0.6584805846214294,
+    "diagonal_ce": 0.6548232436180115,
+    "finite": 0.0036573661491274834
+  },
+  {
+    "step": 796,
+    "loss": 0.5268928408622742,
+    "diagonal_ce": 0.5229201912879944,
+    "finite": 0.003972622100263834
+  },
+  {
+    "step": 797,
+    "loss": 0.46794217824935913,
+    "diagonal_ce": 0.463325560092926,
+    "finite": 0.0046166302636265755
+  },
+  {
+    "step": 798,
+    "loss": 0.4503968060016632,
+    "diagonal_ce": 0.4439602494239807,
+    "finite": 0.006436551455408335
+  },
+  {
+    "step": 799,
+    "loss": 0.5249513983726501,
+    "diagonal_ce": 0.5173287391662598,
+    "finite": 0.0076226298697292805
+  },
+  {
+    "step": 800,
+    "loss": 0.5500431060791016,
+    "diagonal_ce": 0.542218804359436,
+    "finite": 0.00782428402453661
+  },
+  {
+    "step": 801,
+    "loss": 0.698009192943573,
+    "diagonal_ce": 0.6904586553573608,
+    "finite": 0.007550555281341076
+  },
+  {
+    "step": 802,
+    "loss": 0.5973454713821411,
+    "diagonal_ce": 0.5901409983634949,
+    "finite": 0.007204459980130196
+  },
+  {
+    "step": 803,
+    "loss": 0.6582561731338501,
+    "diagonal_ce": 0.6521139740943909,
+    "finite": 0.006142213940620422
+  },
+  {
+    "step": 804,
+    "loss": 0.40014052391052246,
+    "diagonal_ce": 0.39417821168899536,
+    "finite": 0.0059623029083013535
+  },
+  {
+    "step": 805,
+    "loss": 0.5787753462791443,
+    "diagonal_ce": 0.573826014995575,
+    "finite": 0.004949336871504784
+  },
+  {
+    "step": 806,
+    "loss": 0.5054090619087219,
+    "diagonal_ce": 0.5009154677391052,
+    "finite": 0.004493584856390953
+  },
+  {
+    "step": 807,
+    "loss": 0.4889625012874603,
+    "diagonal_ce": 0.48488226532936096,
+    "finite": 0.004080222919583321
+  },
+  {
+    "step": 808,
+    "loss": 0.6352515816688538,
+    "diagonal_ce": 0.6318339705467224,
+    "finite": 0.0034176399931311607
+  },
+  {
+    "step": 809,
+    "loss": 0.6638475060462952,
+    "diagonal_ce": 0.6594347357749939,
+    "finite": 0.004412790760397911
+  },
+  {
+    "step": 810,
+    "loss": 0.4450359642505646,
+    "diagonal_ce": 0.4412562847137451,
+    "finite": 0.0037796692922711372
+  },
+  {
+    "step": 811,
+    "loss": 0.6072982549667358,
+    "diagonal_ce": 0.6045611500740051,
+    "finite": 0.0027370909228920937
+  },
+  {
+    "step": 812,
+    "loss": 0.5009413361549377,
+    "diagonal_ce": 0.4971737563610077,
+    "finite": 0.0037675928324460983
+  },
+  {
+    "step": 813,
+    "loss": 0.48026543855667114,
+    "diagonal_ce": 0.476474791765213,
+    "finite": 0.003790642600506544
+  },
+  {
+    "step": 814,
+    "loss": 0.6381534337997437,
+    "diagonal_ce": 0.6353270411491394,
+    "finite": 0.0028263828717172146
+  },
+  {
+    "step": 815,
+    "loss": 0.8567183613777161,
+    "diagonal_ce": 0.8521620631217957,
+    "finite": 0.004556271247565746
+  },
+  {
+    "step": 816,
+    "loss": 0.717623770236969,
+    "diagonal_ce": 0.714122474193573,
+    "finite": 0.0035012848675251007
+  },
+  {
+    "step": 817,
+    "loss": 0.46164679527282715,
+    "diagonal_ce": 0.4583970010280609,
+    "finite": 0.0032497826032340527
+  },
+  {
+    "step": 818,
+    "loss": 0.4728119671344757,
+    "diagonal_ce": 0.46889621019363403,
+    "finite": 0.003915770445019007
+  },
+  {
+    "step": 819,
+    "loss": 0.49728748202323914,
+    "diagonal_ce": 0.49294665455818176,
+    "finite": 0.004340813960880041
+  },
+  {
+    "step": 820,
+    "loss": 0.5117376446723938,
+    "diagonal_ce": 0.5068953037261963,
+    "finite": 0.004842327442020178
+  },
+  {
+    "step": 821,
+    "loss": 0.4475236237049103,
+    "diagonal_ce": 0.4434264004230499,
+    "finite": 0.004097234457731247
+  },
+  {
+    "step": 822,
+    "loss": 0.5729285478591919,
+    "diagonal_ce": 0.5680031180381775,
+    "finite": 0.004925423301756382
+  },
+  {
+    "step": 823,
+    "loss": 0.49950364232063293,
+    "diagonal_ce": 0.4950144588947296,
+    "finite": 0.004489181563258171
+  },
+  {
+    "step": 824,
+    "loss": 0.486385703086853,
+    "diagonal_ce": 0.48241955041885376,
+    "finite": 0.003966160584241152
+  },
+  {
+    "step": 825,
+    "loss": 0.5184385776519775,
+    "diagonal_ce": 0.514198362827301,
+    "finite": 0.004240213893353939
+  },
+  {
+    "step": 826,
+    "loss": 0.5924751162528992,
+    "diagonal_ce": 0.5888528823852539,
+    "finite": 0.0036222320050001144
+  },
+  {
+    "step": 827,
+    "loss": 0.5797164440155029,
+    "diagonal_ce": 0.5764918923377991,
+    "finite": 0.0032245584297925234
+  },
+  {
+    "step": 828,
+    "loss": 0.3784073293209076,
+    "diagonal_ce": 0.3750728666782379,
+    "finite": 0.0033344679977744818
+  },
+  {
+    "step": 829,
+    "loss": 0.5306930541992188,
+    "diagonal_ce": 0.5269445776939392,
+    "finite": 0.003748471848666668
+  },
+  {
+    "step": 830,
+    "loss": 0.630351722240448,
+    "diagonal_ce": 0.6271427273750305,
+    "finite": 0.0032090048771351576
+  },
+  {
+    "step": 831,
+    "loss": 0.5225967168807983,
+    "diagonal_ce": 0.519164502620697,
+    "finite": 0.0034322193823754787
+  },
+  {
+    "step": 832,
+    "loss": 0.8100642561912537,
+    "diagonal_ce": 0.8072777986526489,
+    "finite": 0.0027864500880241394
+  },
+  {
+    "step": 833,
+    "loss": 0.6178168058395386,
+    "diagonal_ce": 0.6138117909431458,
+    "finite": 0.004004993475973606
+  },
+  {
+    "step": 834,
+    "loss": 0.7068409323692322,
+    "diagonal_ce": 0.7030551433563232,
+    "finite": 0.0037857680581510067
+  },
+  {
+    "step": 835,
+    "loss": 0.62491774559021,
+    "diagonal_ce": 0.6212788820266724,
+    "finite": 0.003638878697529435
+  },
+  {
+    "step": 836,
+    "loss": 0.5419495701789856,
+    "diagonal_ce": 0.5383257269859314,
+    "finite": 0.0036238168831914663
+  },
+  {
+    "step": 837,
+    "loss": 0.46474382281303406,
+    "diagonal_ce": 0.460878849029541,
+    "finite": 0.0038649854250252247
+  },
+  {
+    "step": 838,
+    "loss": 0.539521336555481,
+    "diagonal_ce": 0.5355631113052368,
+    "finite": 0.0039582084864377975
+  },
+  {
+    "step": 839,
+    "loss": 0.6013337969779968,
+    "diagonal_ce": 0.5976172089576721,
+    "finite": 0.003716590814292431
+  },
+  {
+    "step": 840,
+    "loss": 0.7890433669090271,
+    "diagonal_ce": 0.7854938507080078,
+    "finite": 0.0035495287738740444
+  },
+  {
+    "step": 841,
+    "loss": 0.4763188362121582,
+    "diagonal_ce": 0.47305700182914734,
+    "finite": 0.00326183601282537
+  },
+  {
+    "step": 842,
+    "loss": 0.5599875450134277,
+    "diagonal_ce": 0.5566599369049072,
+    "finite": 0.0033276136964559555
+  },
+  {
+    "step": 843,
+    "loss": 0.7071164846420288,
+    "diagonal_ce": 0.7026862502098083,
+    "finite": 0.004430236294865608
+  },
+  {
+    "step": 844,
+    "loss": 0.4947485029697418,
+    "diagonal_ce": 0.4917665421962738,
+    "finite": 0.0029819547198712826
+  },
+  {
+    "step": 845,
+    "loss": 0.5523186922073364,
+    "diagonal_ce": 0.5488631725311279,
+    "finite": 0.0034555019810795784
+  },
+  {
+    "step": 846,
+    "loss": 0.4682115316390991,
+    "diagonal_ce": 0.4651360511779785,
+    "finite": 0.0030754932668060064
+  },
+  {
+    "step": 847,
+    "loss": 0.5585440993309021,
+    "diagonal_ce": 0.5544446706771851,
+    "finite": 0.004099420737475157
+  },
+  {
+    "step": 848,
+    "loss": 0.5087375640869141,
+    "diagonal_ce": 0.5049504637718201,
+    "finite": 0.003787115216255188
+  },
+  {
+    "step": 849,
+    "loss": 0.6291584372520447,
+    "diagonal_ce": 0.6255134344100952,
+    "finite": 0.003645013552159071
+  },
+  {
+    "step": 850,
+    "loss": 0.4300156533718109,
+    "diagonal_ce": 0.42636820673942566,
+    "finite": 0.003647451288998127
+  },
+  {
+    "step": 851,
+    "loss": 0.5690669417381287,
+    "diagonal_ce": 0.5648688673973083,
+    "finite": 0.004198085051029921
+  },
+  {
+    "step": 852,
+    "loss": 0.5476593971252441,
+    "diagonal_ce": 0.5445277094841003,
+    "finite": 0.003131690202280879
+  },
+  {
+    "step": 853,
+    "loss": 0.45317453145980835,
+    "diagonal_ce": 0.4495466351509094,
+    "finite": 0.0036278970073908567
+  },
+  {
+    "step": 854,
+    "loss": 0.6773505806922913,
+    "diagonal_ce": 0.6730654239654541,
+    "finite": 0.004285174421966076
+  },
+  {
+    "step": 855,
+    "loss": 0.6381462812423706,
+    "diagonal_ce": 0.6342753767967224,
+    "finite": 0.0038708869833499193
+  },
+  {
+    "step": 856,
+    "loss": 0.4482114613056183,
+    "diagonal_ce": 0.4455317258834839,
+    "finite": 0.0026797307655215263
+  },
+  {
+    "step": 857,
+    "loss": 0.4476117193698883,
+    "diagonal_ce": 0.44443362951278687,
+    "finite": 0.003178092185407877
+  },
+  {
+    "step": 858,
+    "loss": 0.4613008201122284,
+    "diagonal_ce": 0.4584876298904419,
+    "finite": 0.0028132046572864056
+  },
+  {
+    "step": 859,
+    "loss": 0.5037294626235962,
+    "diagonal_ce": 0.5005248188972473,
+    "finite": 0.0032046660780906677
+  },
+  {
+    "step": 860,
+    "loss": 0.5726386904716492,
+    "diagonal_ce": 0.569751501083374,
+    "finite": 0.002887197770178318
+  },
+  {
+    "step": 861,
+    "loss": 0.625615119934082,
+    "diagonal_ce": 0.6225172281265259,
+    "finite": 0.0030979113653302193
+  },
+  {
+    "step": 862,
+    "loss": 0.6073644757270813,
+    "diagonal_ce": 0.6041004061698914,
+    "finite": 0.003264063037931919
+  },
+  {
+    "step": 863,
+    "loss": 0.7384153008460999,
+    "diagonal_ce": 0.7351627945899963,
+    "finite": 0.003252483904361725
+  },
+  {
+    "step": 864,
+    "loss": 0.5629833936691284,
+    "diagonal_ce": 0.5592917203903198,
+    "finite": 0.003691672347486019
+  },
+  {
+    "step": 865,
+    "loss": 0.5910834074020386,
+    "diagonal_ce": 0.5870003700256348,
+    "finite": 0.004083007574081421
+  },
+  {
+    "step": 866,
+    "loss": 0.5454128980636597,
+    "diagonal_ce": 0.5417311787605286,
+    "finite": 0.00368169485591352
+  },
+  {
+    "step": 867,
+    "loss": 0.4872065782546997,
+    "diagonal_ce": 0.48324817419052124,
+    "finite": 0.003958395682275295
+  },
+  {
+    "step": 868,
+    "loss": 0.4833017885684967,
+    "diagonal_ce": 0.4800204336643219,
+    "finite": 0.0032813488505780697
+  },
+  {
+    "step": 869,
+    "loss": 0.6614941358566284,
+    "diagonal_ce": 0.6568182110786438,
+    "finite": 0.0046759070828557014
+  },
+  {
+    "step": 870,
+    "loss": 0.5166497230529785,
+    "diagonal_ce": 0.5128386616706848,
+    "finite": 0.0038110767491161823
+  },
+  {
+    "step": 871,
+    "loss": 0.6243757009506226,
+    "diagonal_ce": 0.6192765235900879,
+    "finite": 0.005099163390696049
+  },
+  {
+    "step": 872,
+    "loss": 0.5189993977546692,
+    "diagonal_ce": 0.5146785974502563,
+    "finite": 0.004320795182138681
+  },
+  {
+    "step": 873,
+    "loss": 0.49180662631988525,
+    "diagonal_ce": 0.4865935146808624,
+    "finite": 0.005213125143200159
+  },
+  {
+    "step": 874,
+    "loss": 0.6378704309463501,
+    "diagonal_ce": 0.6340993642807007,
+    "finite": 0.0037710650358349085
+  },
+  {
+    "step": 875,
+    "loss": 0.5411806702613831,
+    "diagonal_ce": 0.5369082093238831,
+    "finite": 0.0042724767699837685
+  },
+  {
+    "step": 876,
+    "loss": 0.6098605394363403,
+    "diagonal_ce": 0.6058181524276733,
+    "finite": 0.004042372107505798
+  },
+  {
+    "step": 877,
+    "loss": 0.5379173159599304,
+    "diagonal_ce": 0.5334478616714478,
+    "finite": 0.004469436593353748
+  },
+  {
+    "step": 878,
+    "loss": 0.539909839630127,
+    "diagonal_ce": 0.5352656245231628,
+    "finite": 0.004644217900931835
+  },
+  {
+    "step": 879,
+    "loss": 0.43177106976509094,
+    "diagonal_ce": 0.42669886350631714,
+    "finite": 0.005072209518402815
+  },
+  {
+    "step": 880,
+    "loss": 0.5136967301368713,
+    "diagonal_ce": 0.5083963871002197,
+    "finite": 0.005300331395119429
+  },
+  {
+    "step": 881,
+    "loss": 0.692652702331543,
+    "diagonal_ce": 0.6862545609474182,
+    "finite": 0.006398137658834457
+  },
+  {
+    "step": 882,
+    "loss": 0.5094146132469177,
+    "diagonal_ce": 0.5048314929008484,
+    "finite": 0.004583111498504877
+  },
+  {
+    "step": 883,
+    "loss": 0.45769357681274414,
+    "diagonal_ce": 0.45104730129241943,
+    "finite": 0.006646276451647282
+  },
+  {
+    "step": 884,
+    "loss": 0.44596198201179504,
+    "diagonal_ce": 0.43797609210014343,
+    "finite": 0.007985898293554783
+  },
+  {
+    "step": 885,
+    "loss": 0.4182949364185333,
+    "diagonal_ce": 0.41156628727912903,
+    "finite": 0.006728646345436573
+  },
+  {
+    "step": 886,
+    "loss": 0.7114892601966858,
+    "diagonal_ce": 0.7027834057807922,
+    "finite": 0.008705845102667809
+  },
+  {
+    "step": 887,
+    "loss": 0.44823965430259705,
+    "diagonal_ce": 0.44151586294174194,
+    "finite": 0.006723778322339058
+  },
+  {
+    "step": 888,
+    "loss": 0.40094709396362305,
+    "diagonal_ce": 0.39181822538375854,
+    "finite": 0.009128877893090248
+  },
+  {
+    "step": 889,
+    "loss": 0.5106422305107117,
+    "diagonal_ce": 0.5047585964202881,
+    "finite": 0.005883605219423771
+  },
+  {
+    "step": 890,
+    "loss": 0.46070361137390137,
+    "diagonal_ce": 0.45265376567840576,
+    "finite": 0.008049853146076202
+  },
+  {
+    "step": 891,
+    "loss": 0.4713806211948395,
+    "diagonal_ce": 0.46347901225090027,
+    "finite": 0.007901612669229507
+  },
+  {
+    "step": 892,
+    "loss": 0.5447262525558472,
+    "diagonal_ce": 0.5393043160438538,
+    "finite": 0.005421945825219154
+  },
+  {
+    "step": 893,
+    "loss": 0.48563244938850403,
+    "diagonal_ce": 0.4792804419994354,
+    "finite": 0.0063520087860524654
+  },
+  {
+    "step": 894,
+    "loss": 0.5573554635047913,
+    "diagonal_ce": 0.552362859249115,
+    "finite": 0.00499260239303112
+  },
+  {
+    "step": 895,
+    "loss": 0.570785403251648,
+    "diagonal_ce": 0.5656155943870544,
+    "finite": 0.005169784650206566
+  },
+  {
+    "step": 896,
+    "loss": 0.41566702723503113,
+    "diagonal_ce": 0.41215983033180237,
+    "finite": 0.003507194109261036
+  },
+  {
+    "step": 897,
+    "loss": 0.4787142276763916,
+    "diagonal_ce": 0.47428855299949646,
+    "finite": 0.0044256653636693954
+  },
+  {
+    "step": 898,
+    "loss": 0.4262753427028656,
+    "diagonal_ce": 0.4216143488883972,
+    "finite": 0.004660982172936201
+  },
+  {
+    "step": 899,
+    "loss": 0.5484545826911926,
+    "diagonal_ce": 0.544021725654602,
+    "finite": 0.0044328635558485985
+  },
+  {
+    "step": 900,
+    "loss": 0.5059124231338501,
+    "diagonal_ce": 0.5012983679771423,
+    "finite": 0.004614063538610935
+  },
+  {
+    "step": 901,
+    "loss": 0.5828641653060913,
+    "diagonal_ce": 0.5788304805755615,
+    "finite": 0.004033700563013554
+  },
+  {
+    "step": 902,
+    "loss": 0.5975155234336853,
+    "diagonal_ce": 0.5930662751197815,
+    "finite": 0.004449225962162018
+  },
+  {
+    "step": 903,
+    "loss": 0.5643181204795837,
+    "diagonal_ce": 0.5596216320991516,
+    "finite": 0.004696469753980637
+  },
+  {
+    "step": 904,
+    "loss": 0.6480434536933899,
+    "diagonal_ce": 0.644657552242279,
+    "finite": 0.0033859198447316885
+  },
+  {
+    "step": 905,
+    "loss": 0.7880831360816956,
+    "diagonal_ce": 0.7843323349952698,
+    "finite": 0.003750820178538561
+  },
+  {
+    "step": 906,
+    "loss": 0.5760073065757751,
+    "diagonal_ce": 0.5720105767250061,
+    "finite": 0.003996731247752905
+  },
+  {
+    "step": 907,
+    "loss": 0.3753420114517212,
+    "diagonal_ce": 0.37165552377700806,
+    "finite": 0.0036864751018583775
+  },
+  {
+    "step": 908,
+    "loss": 0.42606979608535767,
+    "diagonal_ce": 0.42273327708244324,
+    "finite": 0.003336505964398384
+  },
+  {
+    "step": 909,
+    "loss": 0.679672360420227,
+    "diagonal_ce": 0.675387442111969,
+    "finite": 0.0042849150486290455
+  },
+  {
+    "step": 910,
+    "loss": 0.45496007800102234,
+    "diagonal_ce": 0.45057594776153564,
+    "finite": 0.004384119063615799
+  },
+  {
+    "step": 911,
+    "loss": 0.6079655289649963,
+    "diagonal_ce": 0.6030254364013672,
+    "finite": 0.004940066486597061
+  },
+  {
+    "step": 912,
+    "loss": 0.6477872729301453,
+    "diagonal_ce": 0.6428656578063965,
+    "finite": 0.004921597894281149
+  },
+  {
+    "step": 913,
+    "loss": 0.6126897931098938,
+    "diagonal_ce": 0.6089476943016052,
+    "finite": 0.003742100205272436
+  },
+  {
+    "step": 914,
+    "loss": 0.48422420024871826,
+    "diagonal_ce": 0.48051562905311584,
+    "finite": 0.0037085600197315216
+  },
+  {
+    "step": 915,
+    "loss": 0.7439048290252686,
+    "diagonal_ce": 0.7397618889808655,
+    "finite": 0.004142929799854755
+  },
+  {
+    "step": 916,
+    "loss": 0.5023785829544067,
+    "diagonal_ce": 0.4987446069717407,
+    "finite": 0.003633954795077443
+  },
+  {
+    "step": 917,
+    "loss": 0.3842562437057495,
+    "diagonal_ce": 0.3819939196109772,
+    "finite": 0.002262325258925557
+  },
+  {
+    "step": 918,
+    "loss": 0.5015442967414856,
+    "diagonal_ce": 0.49837785959243774,
+    "finite": 0.0031664296984672546
+  },
+  {
+    "step": 919,
+    "loss": 0.49492284655570984,
+    "diagonal_ce": 0.4924617409706116,
+    "finite": 0.0024611109402030706
+  },
+  {
+    "step": 920,
+    "loss": 0.48437029123306274,
+    "diagonal_ce": 0.4812111258506775,
+    "finite": 0.0031591581646353006
+  },
+  {
+    "step": 921,
+    "loss": 0.5247294902801514,
+    "diagonal_ce": 0.5215007066726685,
+    "finite": 0.003228766843676567
+  },
+  {
+    "step": 922,
+    "loss": 0.5873245000839233,
+    "diagonal_ce": 0.5842853784561157,
+    "finite": 0.003039101604372263
+  },
+  {
+    "step": 923,
+    "loss": 0.5516030788421631,
+    "diagonal_ce": 0.5491046905517578,
+    "finite": 0.0024983990006148815
+  },
+  {
+    "step": 924,
+    "loss": 0.7073882222175598,
+    "diagonal_ce": 0.7038664817810059,
+    "finite": 0.003521768609061837
+  },
+  {
+    "step": 925,
+    "loss": 0.6439495086669922,
+    "diagonal_ce": 0.6413642764091492,
+    "finite": 0.0025852303951978683
+  },
+  {
+    "step": 926,
+    "loss": 0.40680599212646484,
+    "diagonal_ce": 0.40349429845809937,
+    "finite": 0.003311679931357503
+  },
+  {
+    "step": 927,
+    "loss": 0.5753782391548157,
+    "diagonal_ce": 0.5705164670944214,
+    "finite": 0.004861772526055574
+  },
+  {
+    "step": 928,
+    "loss": 0.6433727741241455,
+    "diagonal_ce": 0.6396015882492065,
+    "finite": 0.003771215444430709
+  },
+  {
+    "step": 929,
+    "loss": 0.5480020046234131,
+    "diagonal_ce": 0.5447999238967896,
+    "finite": 0.0032020590733736753
+  },
+  {
+    "step": 930,
+    "loss": 0.6031910181045532,
+    "diagonal_ce": 0.599784791469574,
+    "finite": 0.003406255505979061
+  },
+  {
+    "step": 931,
+    "loss": 0.621393084526062,
+    "diagonal_ce": 0.6186804175376892,
+    "finite": 0.0027126967906951904
+  },
+  {
+    "step": 932,
+    "loss": 0.5697624087333679,
+    "diagonal_ce": 0.5675013065338135,
+    "finite": 0.0022611012682318687
+  },
+  {
+    "step": 933,
+    "loss": 0.5710735321044922,
+    "diagonal_ce": 0.5688780546188354,
+    "finite": 0.0021954833064228296
+  },
+  {
+    "step": 934,
+    "loss": 0.5160906910896301,
+    "diagonal_ce": 0.5144093632698059,
+    "finite": 0.0016813382972031832
+  },
+  {
+    "step": 935,
+    "loss": 0.4869002103805542,
+    "diagonal_ce": 0.4847727119922638,
+    "finite": 0.0021274967584758997
+  },
+  {
+    "step": 936,
+    "loss": 0.5147373676300049,
+    "diagonal_ce": 0.5124499797821045,
+    "finite": 0.002287378069013357
+  },
+  {
+    "step": 937,
+    "loss": 0.5160837769508362,
+    "diagonal_ce": 0.513744592666626,
+    "finite": 0.0023391868453472853
+  },
+  {
+    "step": 938,
+    "loss": 0.44854170083999634,
+    "diagonal_ce": 0.4459768235683441,
+    "finite": 0.0025648653972893953
+  },
+  {
+    "step": 939,
+    "loss": 0.5510655045509338,
+    "diagonal_ce": 0.5486761331558228,
+    "finite": 0.0023893886245787144
+  },
+  {
+    "step": 940,
+    "loss": 0.6332167387008667,
+    "diagonal_ce": 0.6306184530258179,
+    "finite": 0.002598277060315013
+  },
+  {
+    "step": 941,
+    "loss": 0.6701738238334656,
+    "diagonal_ce": 0.6675467491149902,
+    "finite": 0.0026270870584994555
+  },
+  {
+    "step": 942,
+    "loss": 0.5824322700500488,
+    "diagonal_ce": 0.5792373418807983,
+    "finite": 0.0031949342228472233
+  },
+  {
+    "step": 943,
+    "loss": 0.5866038799285889,
+    "diagonal_ce": 0.5831772685050964,
+    "finite": 0.003426586277782917
+  },
+  {
+    "step": 944,
+    "loss": 0.5021541118621826,
+    "diagonal_ce": 0.4992513060569763,
+    "finite": 0.0029028207063674927
+  },
+  {
+    "step": 945,
+    "loss": 0.6540706753730774,
+    "diagonal_ce": 0.6510882377624512,
+    "finite": 0.002982412464916706
+  },
+  {
+    "step": 946,
+    "loss": 0.48252570629119873,
+    "diagonal_ce": 0.4803318381309509,
+    "finite": 0.0021938802674412727
+  },
+  {
+    "step": 947,
+    "loss": 0.457314133644104,
+    "diagonal_ce": 0.4546470642089844,
+    "finite": 0.002667064545676112
+  },
+  {
+    "step": 948,
+    "loss": 0.6291408538818359,
+    "diagonal_ce": 0.6257522702217102,
+    "finite": 0.003388580633327365
+  },
+  {
+    "step": 949,
+    "loss": 0.3269832134246826,
+    "diagonal_ce": 0.32402557134628296,
+    "finite": 0.002957649063318968
+  },
+  {
+    "step": 950,
+    "loss": 0.6238109469413757,
+    "diagonal_ce": 0.6210740804672241,
+    "finite": 0.0027368476148694754
+  },
+  {
+    "step": 951,
+    "loss": 0.6300718188285828,
+    "diagonal_ce": 0.6271900534629822,
+    "finite": 0.0028817758429795504
+  },
+  {
+    "step": 952,
+    "loss": 0.4378781318664551,
+    "diagonal_ce": 0.4345068335533142,
+    "finite": 0.0033713069278746843
+  },
+  {
+    "step": 953,
+    "loss": 0.5753219723701477,
+    "diagonal_ce": 0.5720837712287903,
+    "finite": 0.0032382069621235132
+  },
+  {
+    "step": 954,
+    "loss": 0.640872061252594,
+    "diagonal_ce": 0.6370421051979065,
+    "finite": 0.0038299784064292908
+  },
+  {
+    "step": 955,
+    "loss": 0.4973379075527191,
+    "diagonal_ce": 0.4940907657146454,
+    "finite": 0.0032471504528075457
+  },
+  {
+    "step": 956,
+    "loss": 0.5449872016906738,
+    "diagonal_ce": 0.5413095355033875,
+    "finite": 0.0036776417400687933
+  },
+  {
+    "step": 957,
+    "loss": 0.45965516567230225,
+    "diagonal_ce": 0.4568237364292145,
+    "finite": 0.0028314238879829645
+  },
+  {
+    "step": 958,
+    "loss": 0.610690176486969,
+    "diagonal_ce": 0.6065998673439026,
+    "finite": 0.004090333357453346
+  },
+  {
+    "step": 959,
+    "loss": 0.6087328195571899,
+    "diagonal_ce": 0.6055081486701965,
+    "finite": 0.0032246913760900497
+  },
+  {
+    "step": 960,
+    "loss": 0.6380369067192078,
+    "diagonal_ce": 0.6347561478614807,
+    "finite": 0.003280753269791603
+  },
+  {
+    "step": 961,
+    "loss": 0.6628494262695312,
+    "diagonal_ce": 0.6596139669418335,
+    "finite": 0.0032354826107621193
+  },
+  {
+    "step": 962,
+    "loss": 0.46100541949272156,
+    "diagonal_ce": 0.4575258791446686,
+    "finite": 0.003479534760117531
+  },
+  {
+    "step": 963,
+    "loss": 0.5797938704490662,
+    "diagonal_ce": 0.5763225555419922,
+    "finite": 0.003471286967396736
+  },
+  {
+    "step": 964,
+    "loss": 0.5442314743995667,
+    "diagonal_ce": 0.5409137606620789,
+    "finite": 0.003317728638648987
+  },
+  {
+    "step": 965,
+    "loss": 0.45873239636421204,
+    "diagonal_ce": 0.4560967981815338,
+    "finite": 0.0026355949230492115
+  },
+  {
+    "step": 966,
+    "loss": 0.595138430595398,
+    "diagonal_ce": 0.5923383831977844,
+    "finite": 0.0028000178281217813
+  },
+  {
+    "step": 967,
+    "loss": 0.49117517471313477,
+    "diagonal_ce": 0.487878680229187,
+    "finite": 0.0032965000718832016
+  },
+  {
+    "step": 968,
+    "loss": 0.4667631685733795,
+    "diagonal_ce": 0.46374189853668213,
+    "finite": 0.0030212646815925837
+  },
+  {
+    "step": 969,
+    "loss": 0.5281832218170166,
+    "diagonal_ce": 0.52499920129776,
+    "finite": 0.003184047294780612
+  },
+  {
+    "step": 970,
+    "loss": 0.4402717351913452,
+    "diagonal_ce": 0.43649375438690186,
+    "finite": 0.0037779926788061857
+  },
+  {
+    "step": 971,
+    "loss": 0.6194961071014404,
+    "diagonal_ce": 0.6149075031280518,
+    "finite": 0.004588603973388672
+  },
+  {
+    "step": 972,
+    "loss": 0.6312559843063354,
+    "diagonal_ce": 0.6273046135902405,
+    "finite": 0.003951383754611015
+  },
+  {
+    "step": 973,
+    "loss": 0.599398136138916,
+    "diagonal_ce": 0.5958361625671387,
+    "finite": 0.003561947727575898
+  },
+  {
+    "step": 974,
+    "loss": 0.5641623139381409,
+    "diagonal_ce": 0.5596944689750671,
+    "finite": 0.004467852879315615
+  },
+  {
+    "step": 975,
+    "loss": 0.5826582908630371,
+    "diagonal_ce": 0.578733503818512,
+    "finite": 0.003924773074686527
+  },
+  {
+    "step": 976,
+    "loss": 0.7646809220314026,
+    "diagonal_ce": 0.7591348886489868,
+    "finite": 0.005546007305383682
+  },
+  {
+    "step": 977,
+    "loss": 0.4801630973815918,
+    "diagonal_ce": 0.47752007842063904,
+    "finite": 0.0026430264115333557
+  },
+  {
+    "step": 978,
+    "loss": 0.5943462252616882,
+    "diagonal_ce": 0.5906046628952026,
+    "finite": 0.003741565393283963
+  },
+  {
+    "step": 979,
+    "loss": 0.6593164205551147,
+    "diagonal_ce": 0.6555070281028748,
+    "finite": 0.0038093996699899435
+  },
+  {
+    "step": 980,
+    "loss": 0.3159507215023041,
+    "diagonal_ce": 0.31130239367485046,
+    "finite": 0.00464833527803421
+  },
+  {
+    "step": 981,
+    "loss": 0.4438691735267639,
+    "diagonal_ce": 0.4399127960205078,
+    "finite": 0.003956388216465712
+  },
+  {
+    "step": 982,
+    "loss": 0.40784093737602234,
+    "diagonal_ce": 0.40401825308799744,
+    "finite": 0.0038226856850087643
+  },
+  {
+    "step": 983,
+    "loss": 0.6616212725639343,
+    "diagonal_ce": 0.6568710803985596,
+    "finite": 0.004750163294374943
+  },
+  {
+    "step": 984,
+    "loss": 0.4669138789176941,
+    "diagonal_ce": 0.46394553780555725,
+    "finite": 0.0029683327302336693
+  },
+  {
+    "step": 985,
+    "loss": 0.5203327536582947,
+    "diagonal_ce": 0.5164812803268433,
+    "finite": 0.0038514991756528616
+  },
+  {
+    "step": 986,
+    "loss": 0.4463059604167938,
+    "diagonal_ce": 0.4428664445877075,
+    "finite": 0.0034395267721265554
+  },
+  {
+    "step": 987,
+    "loss": 0.6252568364143372,
+    "diagonal_ce": 0.622022807598114,
+    "finite": 0.00323400367051363
+  },
+  {
+    "step": 988,
+    "loss": 0.5706421136856079,
+    "diagonal_ce": 0.5663276314735413,
+    "finite": 0.004314456135034561
+  },
+  {
+    "step": 989,
+    "loss": 0.46939533948898315,
+    "diagonal_ce": 0.4664304852485657,
+    "finite": 0.0029648623894900084
+  },
+  {
+    "step": 990,
+    "loss": 0.4589976370334625,
+    "diagonal_ce": 0.45618778467178345,
+    "finite": 0.0028098453767597675
+  },
+  {
+    "step": 991,
+    "loss": 0.6163942813873291,
+    "diagonal_ce": 0.6122784614562988,
+    "finite": 0.0041158138774335384
+  },
+  {
+    "step": 992,
+    "loss": 0.4608435332775116,
+    "diagonal_ce": 0.4580662250518799,
+    "finite": 0.0027773226611316204
+  },
+  {
+    "step": 993,
+    "loss": 0.7425450086593628,
+    "diagonal_ce": 0.737916111946106,
+    "finite": 0.004628906957805157
+  },
+  {
+    "step": 994,
+    "loss": 0.5754553079605103,
+    "diagonal_ce": 0.5715600252151489,
+    "finite": 0.003895302303135395
+  },
+  {
+    "step": 995,
+    "loss": 0.5447061061859131,
+    "diagonal_ce": 0.5411496162414551,
+    "finite": 0.0035565043799579144
+  },
+  {
+    "step": 996,
+    "loss": 0.5327812433242798,
+    "diagonal_ce": 0.5279574990272522,
+    "finite": 0.004823741037398577
+  },
+  {
+    "step": 997,
+    "loss": 0.426437109708786,
+    "diagonal_ce": 0.4218222200870514,
+    "finite": 0.004614895209670067
+  },
+  {
+    "step": 998,
+    "loss": 0.6249658465385437,
+    "diagonal_ce": 0.6201153993606567,
+    "finite": 0.004850437398999929
+  },
+  {
+    "step": 999,
+    "loss": 0.5093243718147278,
+    "diagonal_ce": 0.5045209527015686,
+    "finite": 0.004803406074643135
+  }
+]
diff --git a/lecture_6/verified_examples/fmlm/report.json b/lecture_6/verified_examples/fmlm/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..d75f84a8ac7865be04eb87e48d10886f19403ac9
--- /dev/null
+++ b/lecture_6/verified_examples/fmlm/report.json
@@ -0,0 +1,19 @@
+{
+  "method": "fmlm",
+  "data_kind": "synthetic-text",
+  "train_loss_first_20_mean": 2.472592842578888,
+  "train_loss_last_20_mean": 0.5210289716720581,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "heldout_diagonal_ce_at_half_time": 0.4668397903442383,
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "unique_fraction": 0.03125,
+  "token_entropy": 2.41172456741333,
+  "mean_length": 4.0,
+  "empty_fraction": 0.0,
+  "training_support_fraction": 1.0,
+  "elapsed_seconds": 3.229403880999598
+}
diff --git a/lecture_6/verified_examples/fmlm/samples.txt b/lecture_6/verified_examples/fmlm/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..d9483d35f1340d583b1cf02eac645349983b2372
--- /dev/null
+++ b/lecture_6/verified_examples/fmlm/samples.txt
@@ -0,0 +1,128 @@
+gold star moves down
+blue square moves right
+gold star moves down
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+gold star moves down
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+green triangle moves up
+green triangle moves up
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+blue square moves right
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+blue square moves right
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+blue square moves right
+green triangle moves up
+red circle moves left
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+blue square moves right
+gold star moves down
+red circle moves left
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+blue square moves right
+green triangle moves up
+blue square moves right
+blue square moves right
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+red circle moves left
+gold star moves down
+blue square moves right
+gold star moves down
+red circle moves left
+blue square moves right
+gold star moves down
+gold star moves down
+red circle moves left
+blue square moves right
+red circle moves left
+green triangle moves up
+green triangle moves up
+gold star moves down
+gold star moves down
+green triangle moves up
+red circle moves left
+blue square moves right
+blue square moves right
+red circle moves left
+blue square moves right
+red circle moves left
+red circle moves left
+red circle moves left
+gold star moves down
+green triangle moves up
+blue square moves right
+gold star moves down
+green triangle moves up
+red circle moves left
+gold star moves down
+red circle moves left
+green triangle moves up
+red circle moves left
+red circle moves left
+blue square moves right
+gold star moves down
+green triangle moves up
+blue square moves right
+green triangle moves up
+gold star moves down
+gold star moves down
+gold star moves down
+gold star moves down
+red circle moves left
+green triangle moves up
+gold star moves down
+gold star moves down
diff --git a/lecture_6/verified_examples/fmm-eulerian/config.json b/lecture_6/verified_examples/fmm-eulerian/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..28b5fd733a1b884869cc82965e8d8a048fa7bb31
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-eulerian/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "fmm-eulerian",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/fmm-eulerian"
+}
diff --git a/lecture_6/verified_examples/fmm-eulerian/losses.json b/lecture_6/verified_examples/fmm-eulerian/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..ff4f41b48ec5aa975563e427c89b120368797f75
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-eulerian/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 1.8851450681686401,
+    "diagonal": 1.8811585903167725,
+    "finite": 0.7972910404205322
+  },
+  {
+    "step": 1,
+    "loss": 2.4123687744140625,
+    "diagonal": 2.407409191131592,
+    "finite": 0.49596816301345825
+  },
+  {
+    "step": 2,
+    "loss": 1.7745871543884277,
+    "diagonal": 1.7719451189041138,
+    "finite": 0.17613756656646729
+  },
+  {
+    "step": 3,
+    "loss": 2.064462900161743,
+    "diagonal": 2.0577735900878906,
+    "finite": 0.33446183800697327
+  },
+  {
+    "step": 4,
+    "loss": 1.9669859409332275,
+    "diagonal": 1.963293194770813,
+    "finite": 0.14771118760108948
+  },
+  {
+    "step": 5,
+    "loss": 2.6184937953948975,
+    "diagonal": 2.6154119968414307,
+    "finite": 0.102728471159935
+  },
+  {
+    "step": 6,
+    "loss": 2.1369833946228027,
+    "diagonal": 2.125288963317871,
+    "finite": 0.3341261148452759
+  },
+  {
+    "step": 7,
+    "loss": 1.7759703397750854,
+    "diagonal": 1.7675647735595703,
+    "finite": 0.21014048159122467
+  },
+  {
+    "step": 8,
+    "loss": 1.4605733156204224,
+    "diagonal": 1.453401803970337,
+    "finite": 0.15936769545078278
+  },
+  {
+    "step": 9,
+    "loss": 1.7408868074417114,
+    "diagonal": 1.7258234024047852,
+    "finite": 0.30126816034317017
+  },
+  {
+    "step": 10,
+    "loss": 1.9775495529174805,
+    "diagonal": 1.9567675590515137,
+    "finite": 0.3778534233570099
+  },
+  {
+    "step": 11,
+    "loss": 2.572100877761841,
+    "diagonal": 2.529325246810913,
+    "finite": 0.7129275798797607
+  },
+  {
+    "step": 12,
+    "loss": 1.781679391860962,
+    "diagonal": 1.7689157724380493,
+    "finite": 0.19636285305023193
+  },
+  {
+    "step": 13,
+    "loss": 2.145137071609497,
+    "diagonal": 2.120647430419922,
+    "finite": 0.34985071420669556
+  },
+  {
+    "step": 14,
+    "loss": 1.9896999597549438,
+    "diagonal": 1.96797513961792,
+    "finite": 0.28966349363327026
+  },
+  {
+    "step": 15,
+    "loss": 2.048140287399292,
+    "diagonal": 2.0138955116271973,
+    "finite": 0.4280584752559662
+  },
+  {
+    "step": 16,
+    "loss": 1.7574210166931152,
+    "diagonal": 1.7172507047653198,
+    "finite": 0.47259148955345154
+  },
+  {
+    "step": 17,
+    "loss": 1.7252227067947388,
+    "diagonal": 1.7068558931350708,
+    "finite": 0.204075887799263
+  },
+  {
+    "step": 18,
+    "loss": 1.844403862953186,
+    "diagonal": 1.7891982793807983,
+    "finite": 0.581110954284668
+  },
+  {
+    "step": 19,
+    "loss": 2.1837215423583984,
+    "diagonal": 2.1317873001098633,
+    "finite": 0.5193430185317993
+  },
+  {
+    "step": 20,
+    "loss": 2.492769479751587,
+    "diagonal": 2.4728097915649414,
+    "finite": 0.19009308516979218
+  },
+  {
+    "step": 21,
+    "loss": 2.0020813941955566,
+    "diagonal": 1.9400842189788818,
+    "finite": 0.5636115074157715
+  },
+  {
+    "step": 22,
+    "loss": 1.8953193426132202,
+    "diagonal": 1.8368538618087769,
+    "finite": 0.5083959698677063
+  },
+  {
+    "step": 23,
+    "loss": 2.116718053817749,
+    "diagonal": 2.09841251373291,
+    "finite": 0.15254659950733185
+  },
+  {
+    "step": 24,
+    "loss": 1.8157283067703247,
+    "diagonal": 1.7925410270690918,
+    "finite": 0.18549782037734985
+  },
+  {
+    "step": 25,
+    "loss": 2.4266953468322754,
+    "diagonal": 2.3681445121765137,
+    "finite": 0.45039090514183044
+  },
+  {
+    "step": 26,
+    "loss": 2.0457589626312256,
+    "diagonal": 1.964432716369629,
+    "finite": 0.6024169325828552
+  },
+  {
+    "step": 27,
+    "loss": 1.8212648630142212,
+    "diagonal": 1.7814708948135376,
+    "finite": 0.2842426896095276
+  },
+  {
+    "step": 28,
+    "loss": 2.324819803237915,
+    "diagonal": 2.291670083999634,
+    "finite": 0.22861860692501068
+  },
+  {
+    "step": 29,
+    "loss": 1.752659559249878,
+    "diagonal": 1.7098357677459717,
+    "finite": 0.28549158573150635
+  },
+  {
+    "step": 30,
+    "loss": 1.691908597946167,
+    "diagonal": 1.6644366979599,
+    "finite": 0.17723779380321503
+  },
+  {
+    "step": 31,
+    "loss": 2.236377239227295,
+    "diagonal": 2.1720499992370605,
+    "finite": 0.40204551815986633
+  },
+  {
+    "step": 32,
+    "loss": 1.743231177330017,
+    "diagonal": 1.7150616645812988,
+    "finite": 0.17072449624538422
+  },
+  {
+    "step": 33,
+    "loss": 2.576856851577759,
+    "diagonal": 2.485278844833374,
+    "finite": 0.5386938452720642
+  },
+  {
+    "step": 34,
+    "loss": 2.045956611633301,
+    "diagonal": 2.033207416534424,
+    "finite": 0.07285307347774506
+  },
+  {
+    "step": 35,
+    "loss": 2.312368869781494,
+    "diagonal": 2.2646830081939697,
+    "finite": 0.26492202281951904
+  },
+  {
+    "step": 36,
+    "loss": 2.6024222373962402,
+    "diagonal": 2.565500020980835,
+    "finite": 0.19957932829856873
+  },
+  {
+    "step": 37,
+    "loss": 2.3717775344848633,
+    "diagonal": 2.313718318939209,
+    "finite": 0.3055746853351593
+  },
+  {
+    "step": 38,
+    "loss": 2.095287322998047,
+    "diagonal": 2.0591557025909424,
+    "finite": 0.18528977036476135
+  },
+  {
+    "step": 39,
+    "loss": 2.1895804405212402,
+    "diagonal": 2.136322259902954,
+    "finite": 0.26629042625427246
+  },
+  {
+    "step": 40,
+    "loss": 1.9123165607452393,
+    "diagonal": 1.6237313747406006,
+    "finite": 1.4077329635620117
+  },
+  {
+    "step": 41,
+    "loss": 2.6113948822021484,
+    "diagonal": 2.4868698120117188,
+    "finite": 0.5929762125015259
+  },
+  {
+    "step": 42,
+    "loss": 2.439178943634033,
+    "diagonal": 2.3603339195251465,
+    "finite": 0.3667212724685669
+  },
+  {
+    "step": 43,
+    "loss": 2.7870545387268066,
+    "diagonal": 2.713590383529663,
+    "finite": 0.33392810821533203
+  },
+  {
+    "step": 44,
+    "loss": 1.97141695022583,
+    "diagonal": 1.9297550916671753,
+    "finite": 0.18516384065151215
+  },
+  {
+    "step": 45,
+    "loss": 2.1803317070007324,
+    "diagonal": 2.129014730453491,
+    "finite": 0.22311724722385406
+  },
+  {
+    "step": 46,
+    "loss": 2.0225701332092285,
+    "diagonal": 2.002802848815918,
+    "finite": 0.08411603420972824
+  },
+  {
+    "step": 47,
+    "loss": 2.4525911808013916,
+    "diagonal": 2.388152837753296,
+    "finite": 0.26849350333213806
+  },
+  {
+    "step": 48,
+    "loss": 2.2632884979248047,
+    "diagonal": 2.1774466037750244,
+    "finite": 0.3503747582435608
+  },
+  {
+    "step": 49,
+    "loss": 2.264843225479126,
+    "diagonal": 2.2051053047180176,
+    "finite": 0.2389514148235321
+  },
+  {
+    "step": 50,
+    "loss": 1.8055723905563354,
+    "diagonal": 1.6882648468017578,
+    "finite": 0.46002957224845886
+  },
+  {
+    "step": 51,
+    "loss": 1.9417386054992676,
+    "diagonal": 1.9035398960113525,
+    "finite": 0.14691804349422455
+  },
+  {
+    "step": 52,
+    "loss": 2.0682754516601562,
+    "diagonal": 2.0265092849731445,
+    "finite": 0.15760846436023712
+  },
+  {
+    "step": 53,
+    "loss": 2.455221652984619,
+    "diagonal": 2.394160509109497,
+    "finite": 0.2261519581079483
+  },
+  {
+    "step": 54,
+    "loss": 2.2112724781036377,
+    "diagonal": 1.8680411577224731,
+    "finite": 1.2481142282485962
+  },
+  {
+    "step": 55,
+    "loss": 2.146388292312622,
+    "diagonal": 2.097426652908325,
+    "finite": 0.1748625934123993
+  },
+  {
+    "step": 56,
+    "loss": 2.649595022201538,
+    "diagonal": 2.5182714462280273,
+    "finite": 0.4607847332954407
+  },
+  {
+    "step": 57,
+    "loss": 2.2191340923309326,
+    "diagonal": 2.0741262435913086,
+    "finite": 0.5000267028808594
+  },
+  {
+    "step": 58,
+    "loss": 1.936187744140625,
+    "diagonal": 1.8796602487564087,
+    "finite": 0.19161847233772278
+  },
+  {
+    "step": 59,
+    "loss": 1.793357491493225,
+    "diagonal": 1.6516389846801758,
+    "finite": 0.4723949730396271
+  },
+  {
+    "step": 60,
+    "loss": 2.0849406719207764,
+    "diagonal": 1.975042700767517,
+    "finite": 0.360321044921875
+  },
+  {
+    "step": 61,
+    "loss": 2.4185385704040527,
+    "diagonal": 2.3137564659118652,
+    "finite": 0.338006854057312
+  },
+  {
+    "step": 62,
+    "loss": 1.8469171524047852,
+    "diagonal": 1.797967553138733,
+    "finite": 0.15539540350437164
+  },
+  {
+    "step": 63,
+    "loss": 2.17857027053833,
+    "diagonal": 2.145934820175171,
+    "finite": 0.10198547691106796
+  },
+  {
+    "step": 64,
+    "loss": 2.716092824935913,
+    "diagonal": 2.68790864944458,
+    "finite": 0.08672034740447998
+  },
+  {
+    "step": 65,
+    "loss": 2.115117311477661,
+    "diagonal": 1.9456126689910889,
+    "finite": 0.5136505961418152
+  },
+  {
+    "step": 66,
+    "loss": 2.1523773670196533,
+    "diagonal": 2.0701494216918945,
+    "finite": 0.2454567700624466
+  },
+  {
+    "step": 67,
+    "loss": 2.1177868843078613,
+    "diagonal": 2.0785136222839355,
+    "finite": 0.1155092790722847
+  },
+  {
+    "step": 68,
+    "loss": 2.0627200603485107,
+    "diagonal": 2.032066822052002,
+    "finite": 0.08884979784488678
+  },
+  {
+    "step": 69,
+    "loss": 2.9705147743225098,
+    "diagonal": 2.9001224040985107,
+    "finite": 0.20112089812755585
+  },
+  {
+    "step": 70,
+    "loss": 2.223268985748291,
+    "diagonal": 2.1714425086975098,
+    "finite": 0.14599011838436127
+  },
+  {
+    "step": 71,
+    "loss": 2.2144432067871094,
+    "diagonal": 2.087340831756592,
+    "finite": 0.35306212306022644
+  },
+  {
+    "step": 72,
+    "loss": 2.0031185150146484,
+    "diagonal": 1.9656156301498413,
+    "finite": 0.1027476117014885
+  },
+  {
+    "step": 73,
+    "loss": 2.206787347793579,
+    "diagonal": 1.9642033576965332,
+    "finite": 0.6556321978569031
+  },
+  {
+    "step": 74,
+    "loss": 1.9762165546417236,
+    "diagonal": 1.8920516967773438,
+    "finite": 0.22443945705890656
+  },
+  {
+    "step": 75,
+    "loss": 1.7558475732803345,
+    "diagonal": 1.7103534936904907,
+    "finite": 0.11972135305404663
+  },
+  {
+    "step": 76,
+    "loss": 1.7808513641357422,
+    "diagonal": 1.714521050453186,
+    "finite": 0.17228642106056213
+  },
+  {
+    "step": 77,
+    "loss": 2.0328280925750732,
+    "diagonal": 1.9958058595657349,
+    "finite": 0.09492906928062439
+  },
+  {
+    "step": 78,
+    "loss": 2.34035587310791,
+    "diagonal": 2.281186103820801,
+    "finite": 0.14979662001132965
+  },
+  {
+    "step": 79,
+    "loss": 2.9555628299713135,
+    "diagonal": 2.8266968727111816,
+    "finite": 0.3221646845340729
+  },
+  {
+    "step": 80,
+    "loss": 1.7315716743469238,
+    "diagonal": 1.6897284984588623,
+    "finite": 0.10331657528877258
+  },
+  {
+    "step": 81,
+    "loss": 2.5396127700805664,
+    "diagonal": 2.494640350341797,
+    "finite": 0.10968871414661407
+  },
+  {
+    "step": 82,
+    "loss": 2.2953178882598877,
+    "diagonal": 2.011742115020752,
+    "finite": 0.6833152174949646
+  },
+  {
+    "step": 83,
+    "loss": 2.330864191055298,
+    "diagonal": 2.0465848445892334,
+    "finite": 0.6768555641174316
+  },
+  {
+    "step": 84,
+    "loss": 2.025646209716797,
+    "diagonal": 1.8837151527404785,
+    "finite": 0.3339552879333496
+  },
+  {
+    "step": 85,
+    "loss": 1.7368786334991455,
+    "diagonal": 1.7037625312805176,
+    "finite": 0.07701428234577179
+  },
+  {
+    "step": 86,
+    "loss": 1.9561611413955688,
+    "diagonal": 1.8272219896316528,
+    "finite": 0.2964117228984833
+  },
+  {
+    "step": 87,
+    "loss": 1.898510217666626,
+    "diagonal": 1.791881799697876,
+    "finite": 0.24233722686767578
+  },
+  {
+    "step": 88,
+    "loss": 1.8810174465179443,
+    "diagonal": 1.8243772983551025,
+    "finite": 0.1272810995578766
+  },
+  {
+    "step": 89,
+    "loss": 2.2742295265197754,
+    "diagonal": 2.2409026622772217,
+    "finite": 0.0740598663687706
+  },
+  {
+    "step": 90,
+    "loss": 1.9783998727798462,
+    "diagonal": 1.8982667922973633,
+    "finite": 0.17611661553382874
+  },
+  {
+    "step": 91,
+    "loss": 1.6754482984542847,
+    "diagonal": 1.6196781396865845,
+    "finite": 0.12123946845531464
+  },
+  {
+    "step": 92,
+    "loss": 1.805088996887207,
+    "diagonal": 1.7587188482284546,
+    "finite": 0.09972076117992401
+  },
+  {
+    "step": 93,
+    "loss": 1.8799824714660645,
+    "diagonal": 1.7920236587524414,
+    "finite": 0.1871463656425476
+  },
+  {
+    "step": 94,
+    "loss": 1.858134388923645,
+    "diagonal": 1.8164503574371338,
+    "finite": 0.08775590360164642
+  },
+  {
+    "step": 95,
+    "loss": 2.0869598388671875,
+    "diagonal": 2.0535478591918945,
+    "finite": 0.06960810720920563
+  },
+  {
+    "step": 96,
+    "loss": 1.9227222204208374,
+    "diagonal": 1.868521809577942,
+    "finite": 0.11175353825092316
+  },
+  {
+    "step": 97,
+    "loss": 2.0621845722198486,
+    "diagonal": 1.9731086492538452,
+    "finite": 0.18178755044937134
+  },
+  {
+    "step": 98,
+    "loss": 1.9885677099227905,
+    "diagonal": 1.9423612356185913,
+    "finite": 0.09334646910429001
+  },
+  {
+    "step": 99,
+    "loss": 2.3673274517059326,
+    "diagonal": 2.2542409896850586,
+    "finite": 0.22617298364639282
+  },
+  {
+    "step": 100,
+    "loss": 1.9705393314361572,
+    "diagonal": 1.9299486875534058,
+    "finite": 0.08037745207548141
+  },
+  {
+    "step": 101,
+    "loss": 1.874773383140564,
+    "diagonal": 1.785679578781128,
+    "finite": 0.17469362914562225
+  },
+  {
+    "step": 102,
+    "loss": 2.4108595848083496,
+    "diagonal": 2.3683724403381348,
+    "finite": 0.08249916881322861
+  },
+  {
+    "step": 103,
+    "loss": 1.6727136373519897,
+    "diagonal": 1.6378450393676758,
+    "finite": 0.06705497205257416
+  },
+  {
+    "step": 104,
+    "loss": 2.226807117462158,
+    "diagonal": 2.115949869155884,
+    "finite": 0.21115681529045105
+  },
+  {
+    "step": 105,
+    "loss": 1.6518330574035645,
+    "diagonal": 1.6148829460144043,
+    "finite": 0.06971728801727295
+  },
+  {
+    "step": 106,
+    "loss": 2.063668966293335,
+    "diagonal": 2.032504081726074,
+    "finite": 0.05825197324156761
+  },
+  {
+    "step": 107,
+    "loss": 1.7883135080337524,
+    "diagonal": 1.7595936059951782,
+    "finite": 0.05318494886159897
+  },
+  {
+    "step": 108,
+    "loss": 2.0890073776245117,
+    "diagonal": 2.030832052230835,
+    "finite": 0.10674352943897247
+  },
+  {
+    "step": 109,
+    "loss": 2.2117371559143066,
+    "diagonal": 2.1677587032318115,
+    "finite": 0.07996085286140442
+  },
+  {
+    "step": 110,
+    "loss": 2.479243278503418,
+    "diagonal": 2.414785623550415,
+    "finite": 0.11614013463258743
+  },
+  {
+    "step": 111,
+    "loss": 2.374904155731201,
+    "diagonal": 2.2962324619293213,
+    "finite": 0.1404850035905838
+  },
+  {
+    "step": 112,
+    "loss": 2.8389132022857666,
+    "diagonal": 2.7943499088287354,
+    "finite": 0.07887323200702667
+  },
+  {
+    "step": 113,
+    "loss": 2.0634727478027344,
+    "diagonal": 2.034184217453003,
+    "finite": 0.05138332024216652
+  },
+  {
+    "step": 114,
+    "loss": 1.8765870332717896,
+    "diagonal": 1.8363934755325317,
+    "finite": 0.06990183889865875
+  },
+  {
+    "step": 115,
+    "loss": 2.0627095699310303,
+    "diagonal": 2.0196104049682617,
+    "finite": 0.07430879771709442
+  },
+  {
+    "step": 116,
+    "loss": 2.209726333618164,
+    "diagonal": 2.0402326583862305,
+    "finite": 0.289732962846756
+  },
+  {
+    "step": 117,
+    "loss": 2.2920188903808594,
+    "diagonal": 2.2172045707702637,
+    "finite": 0.1268039494752884
+  },
+  {
+    "step": 118,
+    "loss": 1.9673620462417603,
+    "diagonal": 1.9187464714050293,
+    "finite": 0.08170679956674576
+  },
+  {
+    "step": 119,
+    "loss": 2.074495315551758,
+    "diagonal": 1.9899487495422363,
+    "finite": 0.14091074466705322
+  },
+  {
+    "step": 120,
+    "loss": 2.248427629470825,
+    "diagonal": 2.221168279647827,
+    "finite": 0.04505687952041626
+  },
+  {
+    "step": 121,
+    "loss": 2.140430212020874,
+    "diagonal": 2.0998644828796387,
+    "finite": 0.066501185297966
+  },
+  {
+    "step": 122,
+    "loss": 1.6774470806121826,
+    "diagonal": 1.6306020021438599,
+    "finite": 0.07617081701755524
+  },
+  {
+    "step": 123,
+    "loss": 1.7237340211868286,
+    "diagonal": 1.6979401111602783,
+    "finite": 0.041603099554777145
+  },
+  {
+    "step": 124,
+    "loss": 2.2946152687072754,
+    "diagonal": 2.2492778301239014,
+    "finite": 0.07254006713628769
+  },
+  {
+    "step": 125,
+    "loss": 2.257685661315918,
+    "diagonal": 2.1600358486175537,
+    "finite": 0.15499958395957947
+  },
+  {
+    "step": 126,
+    "loss": 2.0531280040740967,
+    "diagonal": 2.0201613903045654,
+    "finite": 0.05191579833626747
+  },
+  {
+    "step": 127,
+    "loss": 2.0894410610198975,
+    "diagonal": 2.0164787769317627,
+    "finite": 0.11400357633829117
+  },
+  {
+    "step": 128,
+    "loss": 2.0637059211730957,
+    "diagonal": 2.017709732055664,
+    "finite": 0.07131194323301315
+  },
+  {
+    "step": 129,
+    "loss": 2.4167633056640625,
+    "diagonal": 2.3773245811462402,
+    "finite": 0.0606750063598156
+  },
+  {
+    "step": 130,
+    "loss": 2.1956136226654053,
+    "diagonal": 2.1626625061035156,
+    "finite": 0.05030709132552147
+  },
+  {
+    "step": 131,
+    "loss": 2.058537483215332,
+    "diagonal": 2.016228437423706,
+    "finite": 0.06410478055477142
+  },
+  {
+    "step": 132,
+    "loss": 1.7426633834838867,
+    "diagonal": 1.6826152801513672,
+    "finite": 0.09029794484376907
+  },
+  {
+    "step": 133,
+    "loss": 2.2409613132476807,
+    "diagonal": 2.211834669113159,
+    "finite": 0.04347242787480354
+  },
+  {
+    "step": 134,
+    "loss": 1.9809826612472534,
+    "diagonal": 1.938563585281372,
+    "finite": 0.06284300982952118
+  },
+  {
+    "step": 135,
+    "loss": 1.9875173568725586,
+    "diagonal": 1.8911817073822021,
+    "finite": 0.14166998863220215
+  },
+  {
+    "step": 136,
+    "loss": 1.7977781295776367,
+    "diagonal": 1.6980479955673218,
+    "finite": 0.14559142291545868
+  },
+  {
+    "step": 137,
+    "loss": 1.8240532875061035,
+    "diagonal": 1.7766464948654175,
+    "finite": 0.0687054693698883
+  },
+  {
+    "step": 138,
+    "loss": 2.22578501701355,
+    "diagonal": 2.194512367248535,
+    "finite": 0.044996608048677444
+  },
+  {
+    "step": 139,
+    "loss": 2.485283851623535,
+    "diagonal": 2.4476122856140137,
+    "finite": 0.053816474974155426
+  },
+  {
+    "step": 140,
+    "loss": 2.6139070987701416,
+    "diagonal": 2.540245532989502,
+    "finite": 0.10448447614908218
+  },
+  {
+    "step": 141,
+    "loss": 1.9150270223617554,
+    "diagonal": 1.8369345664978027,
+    "finite": 0.10998939722776413
+  },
+  {
+    "step": 142,
+    "loss": 2.318816661834717,
+    "diagonal": 2.1702024936676025,
+    "finite": 0.20785187184810638
+  },
+  {
+    "step": 143,
+    "loss": 2.733524799346924,
+    "diagonal": 2.5684518814086914,
+    "finite": 0.22926810383796692
+  },
+  {
+    "step": 144,
+    "loss": 1.966233730316162,
+    "diagonal": 1.889599084854126,
+    "finite": 0.10570286959409714
+  },
+  {
+    "step": 145,
+    "loss": 2.0811026096343994,
+    "diagonal": 1.9797632694244385,
+    "finite": 0.13882088661193848
+  },
+  {
+    "step": 146,
+    "loss": 2.2280867099761963,
+    "diagonal": 2.173529624938965,
+    "finite": 0.07422734797000885
+  },
+  {
+    "step": 147,
+    "loss": 2.0551705360412598,
+    "diagonal": 2.02325701713562,
+    "finite": 0.04312624782323837
+  },
+  {
+    "step": 148,
+    "loss": 2.040166139602661,
+    "diagonal": 1.857139229774475,
+    "finite": 0.24567364156246185
+  },
+  {
+    "step": 149,
+    "loss": 2.179833173751831,
+    "diagonal": 2.1362733840942383,
+    "finite": 0.05807963386178017
+  },
+  {
+    "step": 150,
+    "loss": 2.471109628677368,
+    "diagonal": 2.38566255569458,
+    "finite": 0.11317481845617294
+  },
+  {
+    "step": 151,
+    "loss": 2.7952919006347656,
+    "diagonal": 2.7409961223602295,
+    "finite": 0.07144175469875336
+  },
+  {
+    "step": 152,
+    "loss": 2.647190809249878,
+    "diagonal": 2.566828727722168,
+    "finite": 0.10504844784736633
+  },
+  {
+    "step": 153,
+    "loss": 2.4048006534576416,
+    "diagonal": 2.3143460750579834,
+    "finite": 0.11747346818447113
+  },
+  {
+    "step": 154,
+    "loss": 2.333508014678955,
+    "diagonal": 2.2213473320007324,
+    "finite": 0.14472348988056183
+  },
+  {
+    "step": 155,
+    "loss": 2.006390333175659,
+    "diagonal": 1.9443359375,
+    "finite": 0.07955706119537354
+  },
+  {
+    "step": 156,
+    "loss": 1.882079005241394,
+    "diagonal": 1.8117785453796387,
+    "finite": 0.08955477178096771
+  },
+  {
+    "step": 157,
+    "loss": 1.9105206727981567,
+    "diagonal": 1.8466980457305908,
+    "finite": 0.08078809827566147
+  },
+  {
+    "step": 158,
+    "loss": 1.719708800315857,
+    "diagonal": 1.6643445491790771,
+    "finite": 0.06964053958654404
+  },
+  {
+    "step": 159,
+    "loss": 2.161367654800415,
+    "diagonal": 2.095475912094116,
+    "finite": 0.08236468583345413
+  },
+  {
+    "step": 160,
+    "loss": 2.4548721313476562,
+    "diagonal": 2.351574659347534,
+    "finite": 0.12831979990005493
+  },
+  {
+    "step": 161,
+    "loss": 1.9098693132400513,
+    "diagonal": 1.836309552192688,
+    "finite": 0.09081456810235977
+  },
+  {
+    "step": 162,
+    "loss": 2.2384719848632812,
+    "diagonal": 2.120227813720703,
+    "finite": 0.1450849324464798
+  },
+  {
+    "step": 163,
+    "loss": 1.6785871982574463,
+    "diagonal": 1.5719804763793945,
+    "finite": 0.13000813126564026
+  },
+  {
+    "step": 164,
+    "loss": 1.9440217018127441,
+    "diagonal": 1.8744536638259888,
+    "finite": 0.08432493358850479
+  },
+  {
+    "step": 165,
+    "loss": 2.242711067199707,
+    "diagonal": 2.1782352924346924,
+    "finite": 0.07768169790506363
+  },
+  {
+    "step": 166,
+    "loss": 1.934696078300476,
+    "diagonal": 1.8865127563476562,
+    "finite": 0.05770452693104744
+  },
+  {
+    "step": 167,
+    "loss": 1.7807708978652954,
+    "diagonal": 1.69062077999115,
+    "finite": 0.10732152312994003
+  },
+  {
+    "step": 168,
+    "loss": 1.9411685466766357,
+    "diagonal": 1.8795082569122314,
+    "finite": 0.07297074794769287
+  },
+  {
+    "step": 169,
+    "loss": 2.199573278427124,
+    "diagonal": 2.162601947784424,
+    "finite": 0.04349581152200699
+  },
+  {
+    "step": 170,
+    "loss": 2.0172512531280518,
+    "diagonal": 1.9772167205810547,
+    "finite": 0.04682411625981331
+  },
+  {
+    "step": 171,
+    "loss": 2.598140001296997,
+    "diagonal": 2.5203254222869873,
+    "finite": 0.09048208594322205
+  },
+  {
+    "step": 172,
+    "loss": 2.6863560676574707,
+    "diagonal": 2.6298558712005615,
+    "finite": 0.0653180405497551
+  },
+  {
+    "step": 173,
+    "loss": 1.989398717880249,
+    "diagonal": 1.8552213907241821,
+    "finite": 0.15422682464122772
+  },
+  {
+    "step": 174,
+    "loss": 2.13316011428833,
+    "diagonal": 2.049790620803833,
+    "finite": 0.09527941793203354
+  },
+  {
+    "step": 175,
+    "loss": 2.109398126602173,
+    "diagonal": 2.0715034008026123,
+    "finite": 0.04306206479668617
+  },
+  {
+    "step": 176,
+    "loss": 2.0014939308166504,
+    "diagonal": 1.9240961074829102,
+    "finite": 0.08745504915714264
+  },
+  {
+    "step": 177,
+    "loss": 2.1759634017944336,
+    "diagonal": 2.1194119453430176,
+    "finite": 0.06354109197854996
+  },
+  {
+    "step": 178,
+    "loss": 1.917771577835083,
+    "diagonal": 1.7469384670257568,
+    "finite": 0.19087494909763336
+  },
+  {
+    "step": 179,
+    "loss": 1.9465885162353516,
+    "diagonal": 1.8692822456359863,
+    "finite": 0.08589590340852737
+  },
+  {
+    "step": 180,
+    "loss": 1.6254737377166748,
+    "diagonal": 1.5813863277435303,
+    "finite": 0.04871537536382675
+  },
+  {
+    "step": 181,
+    "loss": 2.2297122478485107,
+    "diagonal": 2.170903444290161,
+    "finite": 0.06462493538856506
+  },
+  {
+    "step": 182,
+    "loss": 2.505864143371582,
+    "diagonal": 2.3993988037109375,
+    "finite": 0.11635557562112808
+  },
+  {
+    "step": 183,
+    "loss": 2.0092623233795166,
+    "diagonal": 1.9397789239883423,
+    "finite": 0.07552547752857208
+  },
+  {
+    "step": 184,
+    "loss": 2.455789566040039,
+    "diagonal": 2.3788294792175293,
+    "finite": 0.08320020884275436
+  },
+  {
+    "step": 185,
+    "loss": 1.9511767625808716,
+    "diagonal": 1.8825201988220215,
+    "finite": 0.07382430881261826
+  },
+  {
+    "step": 186,
+    "loss": 2.0360097885131836,
+    "diagonal": 1.9539639949798584,
+    "finite": 0.08774938434362411
+  },
+  {
+    "step": 187,
+    "loss": 2.5745723247528076,
+    "diagonal": 2.4569895267486572,
+    "finite": 0.12508800625801086
+  },
+  {
+    "step": 188,
+    "loss": 2.450510263442993,
+    "diagonal": 2.3897407054901123,
+    "finite": 0.0643063634634018
+  },
+  {
+    "step": 189,
+    "loss": 2.7812860012054443,
+    "diagonal": 2.6923515796661377,
+    "finite": 0.09361530095338821
+  },
+  {
+    "step": 190,
+    "loss": 1.7011399269104004,
+    "diagonal": 1.6531105041503906,
+    "finite": 0.050292640924453735
+  },
+  {
+    "step": 191,
+    "loss": 2.180083751678467,
+    "diagonal": 2.1279077529907227,
+    "finite": 0.05435003340244293
+  },
+  {
+    "step": 192,
+    "loss": 2.3000099658966064,
+    "diagonal": 2.2452468872070312,
+    "finite": 0.056749384850263596
+  },
+  {
+    "step": 193,
+    "loss": 2.7678287029266357,
+    "diagonal": 2.7272579669952393,
+    "finite": 0.04182557016611099
+  },
+  {
+    "step": 194,
+    "loss": 2.2743725776672363,
+    "diagonal": 2.1935675144195557,
+    "finite": 0.08287696540355682
+  },
+  {
+    "step": 195,
+    "loss": 1.5081596374511719,
+    "diagonal": 1.4356040954589844,
+    "finite": 0.07403622567653656
+  },
+  {
+    "step": 196,
+    "loss": 2.6030561923980713,
+    "diagonal": 2.5662002563476562,
+    "finite": 0.03741718828678131
+  },
+  {
+    "step": 197,
+    "loss": 1.7821451425552368,
+    "diagonal": 1.7122118473052979,
+    "finite": 0.07063964754343033
+  },
+  {
+    "step": 198,
+    "loss": 1.9647338390350342,
+    "diagonal": 1.9170448780059814,
+    "finite": 0.047928646206855774
+  },
+  {
+    "step": 199,
+    "loss": 1.9516788721084595,
+    "diagonal": 1.852750301361084,
+    "finite": 0.09892857819795609
+  },
+  {
+    "step": 200,
+    "loss": 2.4458770751953125,
+    "diagonal": 2.382870674133301,
+    "finite": 0.06300634145736694
+  },
+  {
+    "step": 201,
+    "loss": 2.2566709518432617,
+    "diagonal": 2.2177913188934326,
+    "finite": 0.0388796404004097
+  },
+  {
+    "step": 202,
+    "loss": 2.88733172416687,
+    "diagonal": 2.8184945583343506,
+    "finite": 0.06883709132671356
+  },
+  {
+    "step": 203,
+    "loss": 2.1797492504119873,
+    "diagonal": 2.1132545471191406,
+    "finite": 0.06649462878704071
+  },
+  {
+    "step": 204,
+    "loss": 2.5625476837158203,
+    "diagonal": 2.5159881114959717,
+    "finite": 0.0465596467256546
+  },
+  {
+    "step": 205,
+    "loss": 2.237426996231079,
+    "diagonal": 2.136387586593628,
+    "finite": 0.10103942453861237
+  },
+  {
+    "step": 206,
+    "loss": 2.429953098297119,
+    "diagonal": 2.2334160804748535,
+    "finite": 0.1965370774269104
+  },
+  {
+    "step": 207,
+    "loss": 1.777446985244751,
+    "diagonal": 1.7162542343139648,
+    "finite": 0.06119275838136673
+  },
+  {
+    "step": 208,
+    "loss": 1.7398762702941895,
+    "diagonal": 1.6848561763763428,
+    "finite": 0.055020153522491455
+  },
+  {
+    "step": 209,
+    "loss": 1.9582713842391968,
+    "diagonal": 1.9050945043563843,
+    "finite": 0.05317683145403862
+  },
+  {
+    "step": 210,
+    "loss": 1.8476579189300537,
+    "diagonal": 1.775113821029663,
+    "finite": 0.07254412770271301
+  },
+  {
+    "step": 211,
+    "loss": 2.047032594680786,
+    "diagonal": 1.9125186204910278,
+    "finite": 0.1345139890909195
+  },
+  {
+    "step": 212,
+    "loss": 1.9907516241073608,
+    "diagonal": 1.9171208143234253,
+    "finite": 0.07363084703683853
+  },
+  {
+    "step": 213,
+    "loss": 2.4767749309539795,
+    "diagonal": 2.401872158050537,
+    "finite": 0.07490267604589462
+  },
+  {
+    "step": 214,
+    "loss": 2.5927438735961914,
+    "diagonal": 2.540238857269287,
+    "finite": 0.052505020052194595
+  },
+  {
+    "step": 215,
+    "loss": 2.002032518386841,
+    "diagonal": 1.9068419933319092,
+    "finite": 0.09519062936306
+  },
+  {
+    "step": 216,
+    "loss": 1.715471863746643,
+    "diagonal": 1.669180154800415,
+    "finite": 0.046291690319776535
+  },
+  {
+    "step": 217,
+    "loss": 1.9750655889511108,
+    "diagonal": 1.9094264507293701,
+    "finite": 0.06563917547464371
+  },
+  {
+    "step": 218,
+    "loss": 2.456482410430908,
+    "diagonal": 2.396481990814209,
+    "finite": 0.060000479221343994
+  },
+  {
+    "step": 219,
+    "loss": 2.2770590782165527,
+    "diagonal": 2.1837213039398193,
+    "finite": 0.09333768486976624
+  },
+  {
+    "step": 220,
+    "loss": 2.1247081756591797,
+    "diagonal": 2.073481321334839,
+    "finite": 0.05122683197259903
+  },
+  {
+    "step": 221,
+    "loss": 1.8224626779556274,
+    "diagonal": 1.7694993019104004,
+    "finite": 0.05296334624290466
+  },
+  {
+    "step": 222,
+    "loss": 1.9390199184417725,
+    "diagonal": 1.875324010848999,
+    "finite": 0.06369595229625702
+  },
+  {
+    "step": 223,
+    "loss": 1.6005985736846924,
+    "diagonal": 1.5629477500915527,
+    "finite": 0.037650857120752335
+  },
+  {
+    "step": 224,
+    "loss": 2.391329526901245,
+    "diagonal": 2.3382515907287598,
+    "finite": 0.05307786539196968
+  },
+  {
+    "step": 225,
+    "loss": 2.4281392097473145,
+    "diagonal": 2.3748178482055664,
+    "finite": 0.05332128703594208
+  },
+  {
+    "step": 226,
+    "loss": 2.0988683700561523,
+    "diagonal": 1.9940745830535889,
+    "finite": 0.1047937348484993
+  },
+  {
+    "step": 227,
+    "loss": 2.313316583633423,
+    "diagonal": 2.2659802436828613,
+    "finite": 0.047336407005786896
+  },
+  {
+    "step": 228,
+    "loss": 2.256181478500366,
+    "diagonal": 2.1110377311706543,
+    "finite": 0.14514374732971191
+  },
+  {
+    "step": 229,
+    "loss": 2.3769309520721436,
+    "diagonal": 2.307929277420044,
+    "finite": 0.06900174915790558
+  },
+  {
+    "step": 230,
+    "loss": 2.2441325187683105,
+    "diagonal": 2.183260440826416,
+    "finite": 0.060872018337249756
+  },
+  {
+    "step": 231,
+    "loss": 1.9056087732315063,
+    "diagonal": 1.8658511638641357,
+    "finite": 0.03975759446620941
+  },
+  {
+    "step": 232,
+    "loss": 1.8622159957885742,
+    "diagonal": 1.7910500764846802,
+    "finite": 0.07116586714982986
+  },
+  {
+    "step": 233,
+    "loss": 2.349994421005249,
+    "diagonal": 2.3099026679992676,
+    "finite": 0.04009169340133667
+  },
+  {
+    "step": 234,
+    "loss": 2.514611005783081,
+    "diagonal": 2.465597629547119,
+    "finite": 0.04901336878538132
+  },
+  {
+    "step": 235,
+    "loss": 1.585490107536316,
+    "diagonal": 1.5315364599227905,
+    "finite": 0.05395366623997688
+  },
+  {
+    "step": 236,
+    "loss": 2.497001886367798,
+    "diagonal": 2.4344863891601562,
+    "finite": 0.06251544505357742
+  },
+  {
+    "step": 237,
+    "loss": 2.3332741260528564,
+    "diagonal": 2.2754647731781006,
+    "finite": 0.05780927836894989
+  },
+  {
+    "step": 238,
+    "loss": 2.3358142375946045,
+    "diagonal": 2.2817835807800293,
+    "finite": 0.05403060466051102
+  },
+  {
+    "step": 239,
+    "loss": 1.8101130723953247,
+    "diagonal": 1.7612786293029785,
+    "finite": 0.048834428191185
+  },
+  {
+    "step": 240,
+    "loss": 2.0471811294555664,
+    "diagonal": 2.012044906616211,
+    "finite": 0.035136282444000244
+  },
+  {
+    "step": 241,
+    "loss": 1.5670793056488037,
+    "diagonal": 1.5181422233581543,
+    "finite": 0.04893708974123001
+  },
+  {
+    "step": 242,
+    "loss": 1.7560515403747559,
+    "diagonal": 1.7053028345108032,
+    "finite": 0.05074867233633995
+  },
+  {
+    "step": 243,
+    "loss": 2.932405710220337,
+    "diagonal": 2.8723387718200684,
+    "finite": 0.06006704643368721
+  },
+  {
+    "step": 244,
+    "loss": 2.751332998275757,
+    "diagonal": 2.631166934967041,
+    "finite": 0.1201661229133606
+  },
+  {
+    "step": 245,
+    "loss": 2.3120999336242676,
+    "diagonal": 2.229841947555542,
+    "finite": 0.08225801587104797
+  },
+  {
+    "step": 246,
+    "loss": 2.3286402225494385,
+    "diagonal": 2.2099664211273193,
+    "finite": 0.11867369711399078
+  },
+  {
+    "step": 247,
+    "loss": 2.1627845764160156,
+    "diagonal": 2.104337692260742,
+    "finite": 0.05844699218869209
+  },
+  {
+    "step": 248,
+    "loss": 2.490495204925537,
+    "diagonal": 2.435791015625,
+    "finite": 0.054704293608665466
+  },
+  {
+    "step": 249,
+    "loss": 1.7862588167190552,
+    "diagonal": 1.6927663087844849,
+    "finite": 0.09349249303340912
+  },
+  {
+    "step": 250,
+    "loss": 2.4900870323181152,
+    "diagonal": 2.413785219192505,
+    "finite": 0.07630182802677155
+  },
+  {
+    "step": 251,
+    "loss": 1.50507390499115,
+    "diagonal": 1.4561409950256348,
+    "finite": 0.048932865262031555
+  },
+  {
+    "step": 252,
+    "loss": 2.7557079792022705,
+    "diagonal": 2.693305492401123,
+    "finite": 0.06240248680114746
+  },
+  {
+    "step": 253,
+    "loss": 1.551608681678772,
+    "diagonal": 1.5097600221633911,
+    "finite": 0.04184866324067116
+  },
+  {
+    "step": 254,
+    "loss": 1.6484159231185913,
+    "diagonal": 1.6187479496002197,
+    "finite": 0.029667958617210388
+  },
+  {
+    "step": 255,
+    "loss": 2.1061134338378906,
+    "diagonal": 1.9409323930740356,
+    "finite": 0.16518105566501617
+  },
+  {
+    "step": 256,
+    "loss": 1.8772073984146118,
+    "diagonal": 1.821485996246338,
+    "finite": 0.05572137236595154
+  },
+  {
+    "step": 257,
+    "loss": 2.085909128189087,
+    "diagonal": 2.037451982498169,
+    "finite": 0.04845710098743439
+  },
+  {
+    "step": 258,
+    "loss": 2.5839033126831055,
+    "diagonal": 2.5228514671325684,
+    "finite": 0.0610518679022789
+  },
+  {
+    "step": 259,
+    "loss": 2.1679584980010986,
+    "diagonal": 2.1179163455963135,
+    "finite": 0.050042152404785156
+  },
+  {
+    "step": 260,
+    "loss": 2.0763700008392334,
+    "diagonal": 2.04750657081604,
+    "finite": 0.028863467276096344
+  },
+  {
+    "step": 261,
+    "loss": 1.4747259616851807,
+    "diagonal": 1.4190000295639038,
+    "finite": 0.05572596937417984
+  },
+  {
+    "step": 262,
+    "loss": 2.420869827270508,
+    "diagonal": 2.3337254524230957,
+    "finite": 0.0871443971991539
+  },
+  {
+    "step": 263,
+    "loss": 2.387234687805176,
+    "diagonal": 2.3485167026519775,
+    "finite": 0.038717884570360184
+  },
+  {
+    "step": 264,
+    "loss": 1.9217047691345215,
+    "diagonal": 1.8741741180419922,
+    "finite": 0.047530632466077805
+  },
+  {
+    "step": 265,
+    "loss": 1.9398603439331055,
+    "diagonal": 1.8623193502426147,
+    "finite": 0.07754099369049072
+  },
+  {
+    "step": 266,
+    "loss": 2.1477737426757812,
+    "diagonal": 2.10005784034729,
+    "finite": 0.047715865075588226
+  },
+  {
+    "step": 267,
+    "loss": 2.359290599822998,
+    "diagonal": 2.293668508529663,
+    "finite": 0.06562203168869019
+  },
+  {
+    "step": 268,
+    "loss": 1.6386518478393555,
+    "diagonal": 1.5980501174926758,
+    "finite": 0.04060175642371178
+  },
+  {
+    "step": 269,
+    "loss": 1.744682788848877,
+    "diagonal": 1.6971094608306885,
+    "finite": 0.04757332056760788
+  },
+  {
+    "step": 270,
+    "loss": 2.0335090160369873,
+    "diagonal": 1.9644818305969238,
+    "finite": 0.06902727484703064
+  },
+  {
+    "step": 271,
+    "loss": 1.9420095682144165,
+    "diagonal": 1.892000436782837,
+    "finite": 0.05000915378332138
+  },
+  {
+    "step": 272,
+    "loss": 1.8583016395568848,
+    "diagonal": 1.7988568544387817,
+    "finite": 0.059444792568683624
+  },
+  {
+    "step": 273,
+    "loss": 2.5418224334716797,
+    "diagonal": 2.432990789413452,
+    "finite": 0.10883155465126038
+  },
+  {
+    "step": 274,
+    "loss": 2.336538553237915,
+    "diagonal": 2.299562931060791,
+    "finite": 0.03697572648525238
+  },
+  {
+    "step": 275,
+    "loss": 2.0060012340545654,
+    "diagonal": 1.9495248794555664,
+    "finite": 0.0564764067530632
+  },
+  {
+    "step": 276,
+    "loss": 1.9577646255493164,
+    "diagonal": 1.9127310514450073,
+    "finite": 0.0450335331261158
+  },
+  {
+    "step": 277,
+    "loss": 2.6458823680877686,
+    "diagonal": 2.571033000946045,
+    "finite": 0.07484931498765945
+  },
+  {
+    "step": 278,
+    "loss": 2.156716823577881,
+    "diagonal": 2.08876371383667,
+    "finite": 0.06795302033424377
+  },
+  {
+    "step": 279,
+    "loss": 2.208580732345581,
+    "diagonal": 2.1469995975494385,
+    "finite": 0.06158110499382019
+  },
+  {
+    "step": 280,
+    "loss": 2.3028409481048584,
+    "diagonal": 2.263766288757324,
+    "finite": 0.039074692875146866
+  },
+  {
+    "step": 281,
+    "loss": 2.646965980529785,
+    "diagonal": 2.5624213218688965,
+    "finite": 0.0845445841550827
+  },
+  {
+    "step": 282,
+    "loss": 1.9955863952636719,
+    "diagonal": 1.9463245868682861,
+    "finite": 0.04926183819770813
+  },
+  {
+    "step": 283,
+    "loss": 2.094601631164551,
+    "diagonal": 2.0409233570098877,
+    "finite": 0.053678274154663086
+  },
+  {
+    "step": 284,
+    "loss": 2.275592803955078,
+    "diagonal": 2.2226829528808594,
+    "finite": 0.052909739315509796
+  },
+  {
+    "step": 285,
+    "loss": 1.6905378103256226,
+    "diagonal": 1.6073886156082153,
+    "finite": 0.08314917981624603
+  },
+  {
+    "step": 286,
+    "loss": 2.0814900398254395,
+    "diagonal": 2.013070583343506,
+    "finite": 0.06841936707496643
+  },
+  {
+    "step": 287,
+    "loss": 2.073519229888916,
+    "diagonal": 2.0110771656036377,
+    "finite": 0.06244201958179474
+  },
+  {
+    "step": 288,
+    "loss": 2.0005264282226562,
+    "diagonal": 1.9497520923614502,
+    "finite": 0.050774380564689636
+  },
+  {
+    "step": 289,
+    "loss": 1.9025154113769531,
+    "diagonal": 1.822249412536621,
+    "finite": 0.08026601374149323
+  },
+  {
+    "step": 290,
+    "loss": 1.5784201622009277,
+    "diagonal": 1.5483983755111694,
+    "finite": 0.03002178855240345
+  },
+  {
+    "step": 291,
+    "loss": 2.0599164962768555,
+    "diagonal": 2.013603925704956,
+    "finite": 0.04631251469254494
+  },
+  {
+    "step": 292,
+    "loss": 2.0023903846740723,
+    "diagonal": 1.9463534355163574,
+    "finite": 0.05603700876235962
+  },
+  {
+    "step": 293,
+    "loss": 2.0978972911834717,
+    "diagonal": 2.054250717163086,
+    "finite": 0.04364655911922455
+  },
+  {
+    "step": 294,
+    "loss": 2.17411470413208,
+    "diagonal": 2.0777769088745117,
+    "finite": 0.09633776545524597
+  },
+  {
+    "step": 295,
+    "loss": 2.338627815246582,
+    "diagonal": 2.271479845046997,
+    "finite": 0.06714799255132675
+  },
+  {
+    "step": 296,
+    "loss": 2.3031814098358154,
+    "diagonal": 2.233920097351074,
+    "finite": 0.06926138699054718
+  },
+  {
+    "step": 297,
+    "loss": 2.2970898151397705,
+    "diagonal": 2.24627685546875,
+    "finite": 0.050813011825084686
+  },
+  {
+    "step": 298,
+    "loss": 1.9849398136138916,
+    "diagonal": 1.9480987787246704,
+    "finite": 0.03684106469154358
+  },
+  {
+    "step": 299,
+    "loss": 2.070164680480957,
+    "diagonal": 1.994541883468628,
+    "finite": 0.07562276721000671
+  },
+  {
+    "step": 300,
+    "loss": 2.1055469512939453,
+    "diagonal": 2.059967041015625,
+    "finite": 0.045579902827739716
+  },
+  {
+    "step": 301,
+    "loss": 2.412926435470581,
+    "diagonal": 2.3601763248443604,
+    "finite": 0.05275009199976921
+  },
+  {
+    "step": 302,
+    "loss": 2.02013897895813,
+    "diagonal": 1.968860149383545,
+    "finite": 0.05127883329987526
+  },
+  {
+    "step": 303,
+    "loss": 1.518522024154663,
+    "diagonal": 1.4783804416656494,
+    "finite": 0.04014160484075546
+  },
+  {
+    "step": 304,
+    "loss": 2.4886107444763184,
+    "diagonal": 2.4116079807281494,
+    "finite": 0.07700282335281372
+  },
+  {
+    "step": 305,
+    "loss": 2.7014684677124023,
+    "diagonal": 2.649658441543579,
+    "finite": 0.051809996366500854
+  },
+  {
+    "step": 306,
+    "loss": 2.2119383811950684,
+    "diagonal": 2.1766176223754883,
+    "finite": 0.0353206992149353
+  },
+  {
+    "step": 307,
+    "loss": 2.01792573928833,
+    "diagonal": 1.9865086078643799,
+    "finite": 0.03141719475388527
+  },
+  {
+    "step": 308,
+    "loss": 1.953110694885254,
+    "diagonal": 1.9016940593719482,
+    "finite": 0.05141669511795044
+  },
+  {
+    "step": 309,
+    "loss": 2.23808217048645,
+    "diagonal": 2.1869871616363525,
+    "finite": 0.051095012575387955
+  },
+  {
+    "step": 310,
+    "loss": 1.8773797750473022,
+    "diagonal": 1.8111025094985962,
+    "finite": 0.06627725064754486
+  },
+  {
+    "step": 311,
+    "loss": 2.517703056335449,
+    "diagonal": 2.4582252502441406,
+    "finite": 0.05947781354188919
+  },
+  {
+    "step": 312,
+    "loss": 2.2646613121032715,
+    "diagonal": 2.2307796478271484,
+    "finite": 0.03388170897960663
+  },
+  {
+    "step": 313,
+    "loss": 2.2908527851104736,
+    "diagonal": 2.242297410964966,
+    "finite": 0.04855548217892647
+  },
+  {
+    "step": 314,
+    "loss": 1.7288817167282104,
+    "diagonal": 1.6712652444839478,
+    "finite": 0.05761651694774628
+  },
+  {
+    "step": 315,
+    "loss": 1.6653414964675903,
+    "diagonal": 1.6125373840332031,
+    "finite": 0.05280405655503273
+  },
+  {
+    "step": 316,
+    "loss": 1.9096355438232422,
+    "diagonal": 1.8695347309112549,
+    "finite": 0.04010075703263283
+  },
+  {
+    "step": 317,
+    "loss": 1.8502670526504517,
+    "diagonal": 1.7804410457611084,
+    "finite": 0.06982602179050446
+  },
+  {
+    "step": 318,
+    "loss": 1.7424298524856567,
+    "diagonal": 1.662243127822876,
+    "finite": 0.08018667250871658
+  },
+  {
+    "step": 319,
+    "loss": 1.9533835649490356,
+    "diagonal": 1.9164408445358276,
+    "finite": 0.036942705512046814
+  },
+  {
+    "step": 320,
+    "loss": 2.063347101211548,
+    "diagonal": 2.0269551277160645,
+    "finite": 0.03639192506670952
+  },
+  {
+    "step": 321,
+    "loss": 2.473884344100952,
+    "diagonal": 2.446202516555786,
+    "finite": 0.02768176980316639
+  },
+  {
+    "step": 322,
+    "loss": 2.0432140827178955,
+    "diagonal": 1.9814563989639282,
+    "finite": 0.06175773963332176
+  },
+  {
+    "step": 323,
+    "loss": 1.9715209007263184,
+    "diagonal": 1.9325082302093506,
+    "finite": 0.03901267796754837
+  },
+  {
+    "step": 324,
+    "loss": 1.9663342237472534,
+    "diagonal": 1.9285564422607422,
+    "finite": 0.03777776658535004
+  },
+  {
+    "step": 325,
+    "loss": 1.9277307987213135,
+    "diagonal": 1.8635268211364746,
+    "finite": 0.06420399993658066
+  },
+  {
+    "step": 326,
+    "loss": 1.6471617221832275,
+    "diagonal": 1.6064600944519043,
+    "finite": 0.04070167988538742
+  },
+  {
+    "step": 327,
+    "loss": 2.019534111022949,
+    "diagonal": 1.9790325164794922,
+    "finite": 0.040501538664102554
+  },
+  {
+    "step": 328,
+    "loss": 1.95591402053833,
+    "diagonal": 1.9103564023971558,
+    "finite": 0.04555761069059372
+  },
+  {
+    "step": 329,
+    "loss": 2.3830299377441406,
+    "diagonal": 2.352609634399414,
+    "finite": 0.03042031079530716
+  },
+  {
+    "step": 330,
+    "loss": 2.341399669647217,
+    "diagonal": 2.2970352172851562,
+    "finite": 0.04436440393328667
+  },
+  {
+    "step": 331,
+    "loss": 2.0453455448150635,
+    "diagonal": 1.9980642795562744,
+    "finite": 0.04728115350008011
+  },
+  {
+    "step": 332,
+    "loss": 2.0553975105285645,
+    "diagonal": 1.9384949207305908,
+    "finite": 0.11690261960029602
+  },
+  {
+    "step": 333,
+    "loss": 2.5375280380249023,
+    "diagonal": 2.465559482574463,
+    "finite": 0.07196857035160065
+  },
+  {
+    "step": 334,
+    "loss": 2.3570773601531982,
+    "diagonal": 2.320967674255371,
+    "finite": 0.036109697073698044
+  },
+  {
+    "step": 335,
+    "loss": 2.072828531265259,
+    "diagonal": 2.00734281539917,
+    "finite": 0.06548561155796051
+  },
+  {
+    "step": 336,
+    "loss": 1.9284087419509888,
+    "diagonal": 1.8596816062927246,
+    "finite": 0.06872709095478058
+  },
+  {
+    "step": 337,
+    "loss": 1.9039483070373535,
+    "diagonal": 1.8483062982559204,
+    "finite": 0.05564195290207863
+  },
+  {
+    "step": 338,
+    "loss": 2.200961112976074,
+    "diagonal": 2.145503282546997,
+    "finite": 0.05545788258314133
+  },
+  {
+    "step": 339,
+    "loss": 2.19095778465271,
+    "diagonal": 2.1176555156707764,
+    "finite": 0.07330227643251419
+  },
+  {
+    "step": 340,
+    "loss": 1.8655273914337158,
+    "diagonal": 1.8009283542633057,
+    "finite": 0.06459903717041016
+  },
+  {
+    "step": 341,
+    "loss": 2.1951169967651367,
+    "diagonal": 2.149683952331543,
+    "finite": 0.045433010905981064
+  },
+  {
+    "step": 342,
+    "loss": 2.0574088096618652,
+    "diagonal": 2.006713390350342,
+    "finite": 0.05069543421268463
+  },
+  {
+    "step": 343,
+    "loss": 2.062502861022949,
+    "diagonal": 1.9881900548934937,
+    "finite": 0.07431288808584213
+  },
+  {
+    "step": 344,
+    "loss": 1.908603310585022,
+    "diagonal": 1.8544055223464966,
+    "finite": 0.05419773980975151
+  },
+  {
+    "step": 345,
+    "loss": 2.7487926483154297,
+    "diagonal": 2.6981430053710938,
+    "finite": 0.05064968392252922
+  },
+  {
+    "step": 346,
+    "loss": 2.0548183917999268,
+    "diagonal": 1.992727279663086,
+    "finite": 0.06209118291735649
+  },
+  {
+    "step": 347,
+    "loss": 1.883617639541626,
+    "diagonal": 1.8473520278930664,
+    "finite": 0.03626560792326927
+  },
+  {
+    "step": 348,
+    "loss": 2.280996561050415,
+    "diagonal": 2.2080254554748535,
+    "finite": 0.07297118008136749
+  },
+  {
+    "step": 349,
+    "loss": 2.0003488063812256,
+    "diagonal": 1.9546822309494019,
+    "finite": 0.045666519552469254
+  },
+  {
+    "step": 350,
+    "loss": 2.43709659576416,
+    "diagonal": 2.323798179626465,
+    "finite": 0.11329834163188934
+  },
+  {
+    "step": 351,
+    "loss": 1.8925392627716064,
+    "diagonal": 1.8323085308074951,
+    "finite": 0.06023069843649864
+  },
+  {
+    "step": 352,
+    "loss": 1.8994805812835693,
+    "diagonal": 1.8422019481658936,
+    "finite": 0.05727862939238548
+  },
+  {
+    "step": 353,
+    "loss": 1.739173173904419,
+    "diagonal": 1.6861661672592163,
+    "finite": 0.05300695821642876
+  },
+  {
+    "step": 354,
+    "loss": 2.419835329055786,
+    "diagonal": 2.3694112300872803,
+    "finite": 0.05042398348450661
+  },
+  {
+    "step": 355,
+    "loss": 1.8257397413253784,
+    "diagonal": 1.7741036415100098,
+    "finite": 0.05163609981536865
+  },
+  {
+    "step": 356,
+    "loss": 2.0904934406280518,
+    "diagonal": 2.008157730102539,
+    "finite": 0.08233579993247986
+  },
+  {
+    "step": 357,
+    "loss": 2.128877639770508,
+    "diagonal": 2.0533525943756104,
+    "finite": 0.07552505284547806
+  },
+  {
+    "step": 358,
+    "loss": 2.1149911880493164,
+    "diagonal": 2.065457820892334,
+    "finite": 0.04953331872820854
+  },
+  {
+    "step": 359,
+    "loss": 2.1389498710632324,
+    "diagonal": 2.076789379119873,
+    "finite": 0.06216041371226311
+  },
+  {
+    "step": 360,
+    "loss": 2.010056495666504,
+    "diagonal": 1.9604711532592773,
+    "finite": 0.04958537966012955
+  },
+  {
+    "step": 361,
+    "loss": 1.8961589336395264,
+    "diagonal": 1.8655040264129639,
+    "finite": 0.030654918402433395
+  },
+  {
+    "step": 362,
+    "loss": 2.36862850189209,
+    "diagonal": 2.2826457023620605,
+    "finite": 0.08598291873931885
+  },
+  {
+    "step": 363,
+    "loss": 2.4297971725463867,
+    "diagonal": 2.378140449523926,
+    "finite": 0.05165663734078407
+  },
+  {
+    "step": 364,
+    "loss": 1.9513952732086182,
+    "diagonal": 1.9164055585861206,
+    "finite": 0.03498966619372368
+  },
+  {
+    "step": 365,
+    "loss": 1.9815385341644287,
+    "diagonal": 1.9373774528503418,
+    "finite": 0.044161077588796616
+  },
+  {
+    "step": 366,
+    "loss": 2.1837337017059326,
+    "diagonal": 2.0606346130371094,
+    "finite": 0.12309911102056503
+  },
+  {
+    "step": 367,
+    "loss": 1.7925580739974976,
+    "diagonal": 1.7491319179534912,
+    "finite": 0.043426111340522766
+  },
+  {
+    "step": 368,
+    "loss": 2.456122398376465,
+    "diagonal": 2.413235664367676,
+    "finite": 0.042886801064014435
+  },
+  {
+    "step": 369,
+    "loss": 1.8854765892028809,
+    "diagonal": 1.8411641120910645,
+    "finite": 0.044312477111816406
+  },
+  {
+    "step": 370,
+    "loss": 1.8342723846435547,
+    "diagonal": 1.7877066135406494,
+    "finite": 0.04656573385000229
+  },
+  {
+    "step": 371,
+    "loss": 2.034209728240967,
+    "diagonal": 1.9756799936294556,
+    "finite": 0.058529749512672424
+  },
+  {
+    "step": 372,
+    "loss": 2.244381904602051,
+    "diagonal": 2.18397855758667,
+    "finite": 0.060403261333703995
+  },
+  {
+    "step": 373,
+    "loss": 2.132286548614502,
+    "diagonal": 2.034219741821289,
+    "finite": 0.09806692600250244
+  },
+  {
+    "step": 374,
+    "loss": 2.011972188949585,
+    "diagonal": 1.9450342655181885,
+    "finite": 0.06693793088197708
+  },
+  {
+    "step": 375,
+    "loss": 2.1434485912323,
+    "diagonal": 2.0974924564361572,
+    "finite": 0.04595612362027168
+  },
+  {
+    "step": 376,
+    "loss": 2.158651113510132,
+    "diagonal": 2.1275384426116943,
+    "finite": 0.03111260011792183
+  },
+  {
+    "step": 377,
+    "loss": 1.7909542322158813,
+    "diagonal": 1.74570631980896,
+    "finite": 0.04524793475866318
+  },
+  {
+    "step": 378,
+    "loss": 2.1552939414978027,
+    "diagonal": 2.079251766204834,
+    "finite": 0.0760420560836792
+  },
+  {
+    "step": 379,
+    "loss": 1.8501721620559692,
+    "diagonal": 1.8017455339431763,
+    "finite": 0.04842660203576088
+  },
+  {
+    "step": 380,
+    "loss": 1.9014582633972168,
+    "diagonal": 1.8431099653244019,
+    "finite": 0.058348339051008224
+  },
+  {
+    "step": 381,
+    "loss": 2.4111318588256836,
+    "diagonal": 2.3742659091949463,
+    "finite": 0.036865975707769394
+  },
+  {
+    "step": 382,
+    "loss": 2.346184015274048,
+    "diagonal": 2.2916057109832764,
+    "finite": 0.05457841604948044
+  },
+  {
+    "step": 383,
+    "loss": 2.142983913421631,
+    "diagonal": 2.0859522819519043,
+    "finite": 0.05703158304095268
+  },
+  {
+    "step": 384,
+    "loss": 1.9060051441192627,
+    "diagonal": 1.836920976638794,
+    "finite": 0.06908414512872696
+  },
+  {
+    "step": 385,
+    "loss": 2.0670526027679443,
+    "diagonal": 1.9945635795593262,
+    "finite": 0.0724889412522316
+  },
+  {
+    "step": 386,
+    "loss": 3.051068067550659,
+    "diagonal": 2.996305227279663,
+    "finite": 0.05476292222738266
+  },
+  {
+    "step": 387,
+    "loss": 1.7131373882293701,
+    "diagonal": 1.6692341566085815,
+    "finite": 0.04390327259898186
+  },
+  {
+    "step": 388,
+    "loss": 2.2875940799713135,
+    "diagonal": 2.248753070831299,
+    "finite": 0.038840968161821365
+  },
+  {
+    "step": 389,
+    "loss": 2.045327663421631,
+    "diagonal": 2.0053579807281494,
+    "finite": 0.03996971994638443
+  },
+  {
+    "step": 390,
+    "loss": 2.1584057807922363,
+    "diagonal": 2.119523286819458,
+    "finite": 0.03888237848877907
+  },
+  {
+    "step": 391,
+    "loss": 2.6588149070739746,
+    "diagonal": 2.6056127548217773,
+    "finite": 0.05320214480161667
+  },
+  {
+    "step": 392,
+    "loss": 2.0465195178985596,
+    "diagonal": 1.994224190711975,
+    "finite": 0.05229539796710014
+  },
+  {
+    "step": 393,
+    "loss": 2.389838695526123,
+    "diagonal": 2.209852457046509,
+    "finite": 0.1799861341714859
+  },
+  {
+    "step": 394,
+    "loss": 1.8390384912490845,
+    "diagonal": 1.781468391418457,
+    "finite": 0.05757008492946625
+  },
+  {
+    "step": 395,
+    "loss": 2.5369198322296143,
+    "diagonal": 2.479625940322876,
+    "finite": 0.05729393661022186
+  },
+  {
+    "step": 396,
+    "loss": 2.4599149227142334,
+    "diagonal": 2.4277942180633545,
+    "finite": 0.03212061896920204
+  },
+  {
+    "step": 397,
+    "loss": 2.741741418838501,
+    "diagonal": 2.703477144241333,
+    "finite": 0.038264159113168716
+  },
+  {
+    "step": 398,
+    "loss": 2.1490132808685303,
+    "diagonal": 2.038403272628784,
+    "finite": 0.11060996353626251
+  },
+  {
+    "step": 399,
+    "loss": 2.3511970043182373,
+    "diagonal": 2.2762598991394043,
+    "finite": 0.07493717968463898
+  },
+  {
+    "step": 400,
+    "loss": 2.265422821044922,
+    "diagonal": 2.2175257205963135,
+    "finite": 0.04789718613028526
+  },
+  {
+    "step": 401,
+    "loss": 1.771941065788269,
+    "diagonal": 1.7407727241516113,
+    "finite": 0.0311683788895607
+  },
+  {
+    "step": 402,
+    "loss": 2.332322835922241,
+    "diagonal": 2.289879560470581,
+    "finite": 0.04244336858391762
+  },
+  {
+    "step": 403,
+    "loss": 2.06062650680542,
+    "diagonal": 1.9970148801803589,
+    "finite": 0.06361153721809387
+  },
+  {
+    "step": 404,
+    "loss": 1.898809790611267,
+    "diagonal": 1.8521217107772827,
+    "finite": 0.04668813198804855
+  },
+  {
+    "step": 405,
+    "loss": 2.0054445266723633,
+    "diagonal": 1.9618957042694092,
+    "finite": 0.043548766523599625
+  },
+  {
+    "step": 406,
+    "loss": 2.0251383781433105,
+    "diagonal": 1.9597364664077759,
+    "finite": 0.06540203094482422
+  },
+  {
+    "step": 407,
+    "loss": 2.2648098468780518,
+    "diagonal": 2.205378770828247,
+    "finite": 0.05943107604980469
+  },
+  {
+    "step": 408,
+    "loss": 1.924837350845337,
+    "diagonal": 1.8723082542419434,
+    "finite": 0.05252914875745773
+  },
+  {
+    "step": 409,
+    "loss": 1.936991572380066,
+    "diagonal": 1.882542610168457,
+    "finite": 0.05444901064038277
+  },
+  {
+    "step": 410,
+    "loss": 2.03556752204895,
+    "diagonal": 2.0060625076293945,
+    "finite": 0.029505087062716484
+  },
+  {
+    "step": 411,
+    "loss": 2.0123658180236816,
+    "diagonal": 1.974965214729309,
+    "finite": 0.03740072250366211
+  },
+  {
+    "step": 412,
+    "loss": 2.214789628982544,
+    "diagonal": 2.154245376586914,
+    "finite": 0.060544248670339584
+  },
+  {
+    "step": 413,
+    "loss": 2.462491989135742,
+    "diagonal": 2.4034903049468994,
+    "finite": 0.05900175869464874
+  },
+  {
+    "step": 414,
+    "loss": 2.08306884765625,
+    "diagonal": 2.0379116535186768,
+    "finite": 0.04515718296170235
+  },
+  {
+    "step": 415,
+    "loss": 2.036412000656128,
+    "diagonal": 1.9860377311706543,
+    "finite": 0.05037422478199005
+  },
+  {
+    "step": 416,
+    "loss": 2.070814371109009,
+    "diagonal": 2.032641887664795,
+    "finite": 0.038172587752342224
+  },
+  {
+    "step": 417,
+    "loss": 2.4833765029907227,
+    "diagonal": 2.4348318576812744,
+    "finite": 0.048544637858867645
+  },
+  {
+    "step": 418,
+    "loss": 2.2361998558044434,
+    "diagonal": 2.1977100372314453,
+    "finite": 0.03848983719944954
+  },
+  {
+    "step": 419,
+    "loss": 2.0838875770568848,
+    "diagonal": 2.0311672687530518,
+    "finite": 0.05272035673260689
+  },
+  {
+    "step": 420,
+    "loss": 2.2422919273376465,
+    "diagonal": 2.1377158164978027,
+    "finite": 0.10457614064216614
+  },
+  {
+    "step": 421,
+    "loss": 2.213090419769287,
+    "diagonal": 2.168497085571289,
+    "finite": 0.04459341987967491
+  },
+  {
+    "step": 422,
+    "loss": 1.9760985374450684,
+    "diagonal": 1.921058177947998,
+    "finite": 0.0550403892993927
+  },
+  {
+    "step": 423,
+    "loss": 2.400360584259033,
+    "diagonal": 2.343813180923462,
+    "finite": 0.05654751509428024
+  },
+  {
+    "step": 424,
+    "loss": 2.1326911449432373,
+    "diagonal": 2.0901172161102295,
+    "finite": 0.042574018239974976
+  },
+  {
+    "step": 425,
+    "loss": 1.595279335975647,
+    "diagonal": 1.5514475107192993,
+    "finite": 0.04383185878396034
+  },
+  {
+    "step": 426,
+    "loss": 1.7065739631652832,
+    "diagonal": 1.6658498048782349,
+    "finite": 0.040724169462919235
+  },
+  {
+    "step": 427,
+    "loss": 2.5059287548065186,
+    "diagonal": 2.4229977130889893,
+    "finite": 0.08293113857507706
+  },
+  {
+    "step": 428,
+    "loss": 1.8253449201583862,
+    "diagonal": 1.7741143703460693,
+    "finite": 0.0512305349111557
+  },
+  {
+    "step": 429,
+    "loss": 1.9700101613998413,
+    "diagonal": 1.9192196130752563,
+    "finite": 0.05079055577516556
+  },
+  {
+    "step": 430,
+    "loss": 2.191250801086426,
+    "diagonal": 2.154390335083008,
+    "finite": 0.036860544234514236
+  },
+  {
+    "step": 431,
+    "loss": 2.0604476928710938,
+    "diagonal": 2.0224359035491943,
+    "finite": 0.0380118265748024
+  },
+  {
+    "step": 432,
+    "loss": 2.0840530395507812,
+    "diagonal": 2.0315916538238525,
+    "finite": 0.052461475133895874
+  },
+  {
+    "step": 433,
+    "loss": 2.0358798503875732,
+    "diagonal": 1.9811915159225464,
+    "finite": 0.05468833073973656
+  },
+  {
+    "step": 434,
+    "loss": 2.3387701511383057,
+    "diagonal": 2.3039915561676025,
+    "finite": 0.03477858006954193
+  },
+  {
+    "step": 435,
+    "loss": 2.3799421787261963,
+    "diagonal": 2.3300342559814453,
+    "finite": 0.04990788549184799
+  },
+  {
+    "step": 436,
+    "loss": 1.7809481620788574,
+    "diagonal": 1.7352616786956787,
+    "finite": 0.04568646103143692
+  },
+  {
+    "step": 437,
+    "loss": 1.7449924945831299,
+    "diagonal": 1.6920762062072754,
+    "finite": 0.052916329354047775
+  },
+  {
+    "step": 438,
+    "loss": 1.8911025524139404,
+    "diagonal": 1.8366363048553467,
+    "finite": 0.05446629971265793
+  },
+  {
+    "step": 439,
+    "loss": 1.7401454448699951,
+    "diagonal": 1.6909431219100952,
+    "finite": 0.049202267080545425
+  },
+  {
+    "step": 440,
+    "loss": 1.4664204120635986,
+    "diagonal": 1.433203101158142,
+    "finite": 0.03321734443306923
+  },
+  {
+    "step": 441,
+    "loss": 2.0741591453552246,
+    "diagonal": 2.00429105758667,
+    "finite": 0.06986800581216812
+  },
+  {
+    "step": 442,
+    "loss": 2.3779475688934326,
+    "diagonal": 2.310331106185913,
+    "finite": 0.0676165372133255
+  },
+  {
+    "step": 443,
+    "loss": 2.307786464691162,
+    "diagonal": 2.2608859539031982,
+    "finite": 0.046900466084480286
+  },
+  {
+    "step": 444,
+    "loss": 2.4371166229248047,
+    "diagonal": 2.3748843669891357,
+    "finite": 0.062232159078121185
+  },
+  {
+    "step": 445,
+    "loss": 1.5896799564361572,
+    "diagonal": 1.547715663909912,
+    "finite": 0.04196426272392273
+  },
+  {
+    "step": 446,
+    "loss": 1.8052432537078857,
+    "diagonal": 1.7459452152252197,
+    "finite": 0.05929797887802124
+  },
+  {
+    "step": 447,
+    "loss": 1.6486529111862183,
+    "diagonal": 1.6126517057418823,
+    "finite": 0.036001235246658325
+  },
+  {
+    "step": 448,
+    "loss": 2.1371872425079346,
+    "diagonal": 2.0692758560180664,
+    "finite": 0.06791134178638458
+  },
+  {
+    "step": 449,
+    "loss": 2.524564743041992,
+    "diagonal": 2.476256847381592,
+    "finite": 0.048307932913303375
+  },
+  {
+    "step": 450,
+    "loss": 2.3027186393737793,
+    "diagonal": 2.2526907920837402,
+    "finite": 0.05002782866358757
+  },
+  {
+    "step": 451,
+    "loss": 2.066429615020752,
+    "diagonal": 1.9980459213256836,
+    "finite": 0.06838378310203552
+  },
+  {
+    "step": 452,
+    "loss": 2.482042074203491,
+    "diagonal": 2.441486358642578,
+    "finite": 0.040555667132139206
+  },
+  {
+    "step": 453,
+    "loss": 1.7127623558044434,
+    "diagonal": 1.6427345275878906,
+    "finite": 0.07002777606248856
+  },
+  {
+    "step": 454,
+    "loss": 2.2271876335144043,
+    "diagonal": 2.1829721927642822,
+    "finite": 0.0442153699696064
+  },
+  {
+    "step": 455,
+    "loss": 1.7061030864715576,
+    "diagonal": 1.6577755212783813,
+    "finite": 0.04832755774259567
+  },
+  {
+    "step": 456,
+    "loss": 2.1237854957580566,
+    "diagonal": 2.064793109893799,
+    "finite": 0.058992378413677216
+  },
+  {
+    "step": 457,
+    "loss": 2.3102362155914307,
+    "diagonal": 2.2781124114990234,
+    "finite": 0.03212374448776245
+  },
+  {
+    "step": 458,
+    "loss": 1.6146315336227417,
+    "diagonal": 1.540696144104004,
+    "finite": 0.07393541187047958
+  },
+  {
+    "step": 459,
+    "loss": 2.3535990715026855,
+    "diagonal": 2.2918550968170166,
+    "finite": 0.06174389272928238
+  },
+  {
+    "step": 460,
+    "loss": 2.1330983638763428,
+    "diagonal": 2.0772690773010254,
+    "finite": 0.05582931265234947
+  },
+  {
+    "step": 461,
+    "loss": 2.434296131134033,
+    "diagonal": 2.334855079650879,
+    "finite": 0.09944098442792892
+  },
+  {
+    "step": 462,
+    "loss": 2.1246182918548584,
+    "diagonal": 2.044804334640503,
+    "finite": 0.07981385290622711
+  },
+  {
+    "step": 463,
+    "loss": 1.7623615264892578,
+    "diagonal": 1.6893298625946045,
+    "finite": 0.07303166389465332
+  },
+  {
+    "step": 464,
+    "loss": 2.0723516941070557,
+    "diagonal": 2.0253348350524902,
+    "finite": 0.04701688140630722
+  },
+  {
+    "step": 465,
+    "loss": 2.7418577671051025,
+    "diagonal": 2.6979074478149414,
+    "finite": 0.04395033046603203
+  },
+  {
+    "step": 466,
+    "loss": 2.7288506031036377,
+    "diagonal": 2.668684720993042,
+    "finite": 0.0601658970117569
+  },
+  {
+    "step": 467,
+    "loss": 2.493542194366455,
+    "diagonal": 2.44452166557312,
+    "finite": 0.04902045801281929
+  },
+  {
+    "step": 468,
+    "loss": 2.2579421997070312,
+    "diagonal": 2.1948673725128174,
+    "finite": 0.06307470798492432
+  },
+  {
+    "step": 469,
+    "loss": 1.9771687984466553,
+    "diagonal": 1.9406324625015259,
+    "finite": 0.036536313593387604
+  },
+  {
+    "step": 470,
+    "loss": 2.077887535095215,
+    "diagonal": 2.021526336669922,
+    "finite": 0.056361135095357895
+  },
+  {
+    "step": 471,
+    "loss": 2.219568967819214,
+    "diagonal": 2.1641547679901123,
+    "finite": 0.05541416257619858
+  },
+  {
+    "step": 472,
+    "loss": 2.353529691696167,
+    "diagonal": 2.3091375827789307,
+    "finite": 0.04439210146665573
+  },
+  {
+    "step": 473,
+    "loss": 2.2320878505706787,
+    "diagonal": 2.1850991249084473,
+    "finite": 0.04698870703577995
+  },
+  {
+    "step": 474,
+    "loss": 2.146135091781616,
+    "diagonal": 2.0852909088134766,
+    "finite": 0.060844067484140396
+  },
+  {
+    "step": 475,
+    "loss": 2.358499526977539,
+    "diagonal": 2.241262435913086,
+    "finite": 0.11723703145980835
+  },
+  {
+    "step": 476,
+    "loss": 2.173138380050659,
+    "diagonal": 2.1313767433166504,
+    "finite": 0.04176165536046028
+  },
+  {
+    "step": 477,
+    "loss": 1.6057333946228027,
+    "diagonal": 1.5509332418441772,
+    "finite": 0.05480014160275459
+  },
+  {
+    "step": 478,
+    "loss": 2.2249374389648438,
+    "diagonal": 2.168447732925415,
+    "finite": 0.056489601731300354
+  },
+  {
+    "step": 479,
+    "loss": 1.8875867128372192,
+    "diagonal": 1.829280138015747,
+    "finite": 0.05830657109618187
+  },
+  {
+    "step": 480,
+    "loss": 2.1051111221313477,
+    "diagonal": 2.067190647125244,
+    "finite": 0.03792041540145874
+  },
+  {
+    "step": 481,
+    "loss": 2.382256031036377,
+    "diagonal": 2.2923691272735596,
+    "finite": 0.08988688886165619
+  },
+  {
+    "step": 482,
+    "loss": 2.0638861656188965,
+    "diagonal": 1.988439917564392,
+    "finite": 0.07544629275798798
+  },
+  {
+    "step": 483,
+    "loss": 2.5147228240966797,
+    "diagonal": 2.4339592456817627,
+    "finite": 0.08076360076665878
+  },
+  {
+    "step": 484,
+    "loss": 1.776971459388733,
+    "diagonal": 1.7234554290771484,
+    "finite": 0.05351606756448746
+  },
+  {
+    "step": 485,
+    "loss": 1.8058440685272217,
+    "diagonal": 1.7601221799850464,
+    "finite": 0.04572190344333649
+  },
+  {
+    "step": 486,
+    "loss": 1.8735026121139526,
+    "diagonal": 1.8351109027862549,
+    "finite": 0.038391757756471634
+  },
+  {
+    "step": 487,
+    "loss": 2.5028982162475586,
+    "diagonal": 2.4386544227600098,
+    "finite": 0.06424374133348465
+  },
+  {
+    "step": 488,
+    "loss": 2.337684154510498,
+    "diagonal": 2.2819366455078125,
+    "finite": 0.05574752390384674
+  },
+  {
+    "step": 489,
+    "loss": 1.8061457872390747,
+    "diagonal": 1.7401795387268066,
+    "finite": 0.06596621870994568
+  },
+  {
+    "step": 490,
+    "loss": 2.4397358894348145,
+    "diagonal": 2.397488832473755,
+    "finite": 0.04224703460931778
+  },
+  {
+    "step": 491,
+    "loss": 2.1220662593841553,
+    "diagonal": 2.0689685344696045,
+    "finite": 0.053097620606422424
+  },
+  {
+    "step": 492,
+    "loss": 1.877900242805481,
+    "diagonal": 1.827936053276062,
+    "finite": 0.04996418580412865
+  },
+  {
+    "step": 493,
+    "loss": 1.8047505617141724,
+    "diagonal": 1.7440574169158936,
+    "finite": 0.06069318950176239
+  },
+  {
+    "step": 494,
+    "loss": 1.8692119121551514,
+    "diagonal": 1.8166677951812744,
+    "finite": 0.05254414305090904
+  },
+  {
+    "step": 495,
+    "loss": 2.471600294113159,
+    "diagonal": 2.4083523750305176,
+    "finite": 0.06324785202741623
+  },
+  {
+    "step": 496,
+    "loss": 2.1563057899475098,
+    "diagonal": 2.068105697631836,
+    "finite": 0.08820018172264099
+  },
+  {
+    "step": 497,
+    "loss": 2.264554023742676,
+    "diagonal": 2.242567300796509,
+    "finite": 0.02198670245707035
+  },
+  {
+    "step": 498,
+    "loss": 1.9161708354949951,
+    "diagonal": 1.8462870121002197,
+    "finite": 0.06988376379013062
+  },
+  {
+    "step": 499,
+    "loss": 2.100534439086914,
+    "diagonal": 2.024583339691162,
+    "finite": 0.0759509950876236
+  },
+  {
+    "step": 500,
+    "loss": 2.592087984085083,
+    "diagonal": 2.543260097503662,
+    "finite": 0.048827894032001495
+  },
+  {
+    "step": 501,
+    "loss": 2.0277087688446045,
+    "diagonal": 1.969927191734314,
+    "finite": 0.05778149887919426
+  },
+  {
+    "step": 502,
+    "loss": 1.6877776384353638,
+    "diagonal": 1.6426411867141724,
+    "finite": 0.045136500149965286
+  },
+  {
+    "step": 503,
+    "loss": 2.2594902515411377,
+    "diagonal": 2.208350658416748,
+    "finite": 0.051139604300260544
+  },
+  {
+    "step": 504,
+    "loss": 2.4583373069763184,
+    "diagonal": 2.4238290786743164,
+    "finite": 0.03450813889503479
+  },
+  {
+    "step": 505,
+    "loss": 1.7295271158218384,
+    "diagonal": 1.6747066974639893,
+    "finite": 0.05482039973139763
+  },
+  {
+    "step": 506,
+    "loss": 1.7747670412063599,
+    "diagonal": 1.7022286653518677,
+    "finite": 0.07253837585449219
+  },
+  {
+    "step": 507,
+    "loss": 2.1096012592315674,
+    "diagonal": 2.0332553386688232,
+    "finite": 0.07634598016738892
+  },
+  {
+    "step": 508,
+    "loss": 2.049438953399658,
+    "diagonal": 1.9854270219802856,
+    "finite": 0.06401203572750092
+  },
+  {
+    "step": 509,
+    "loss": 2.361701250076294,
+    "diagonal": 2.30100417137146,
+    "finite": 0.06069701164960861
+  },
+  {
+    "step": 510,
+    "loss": 1.4674562215805054,
+    "diagonal": 1.4223021268844604,
+    "finite": 0.0451541468501091
+  },
+  {
+    "step": 511,
+    "loss": 2.2538163661956787,
+    "diagonal": 2.2122268676757812,
+    "finite": 0.041589558124542236
+  },
+  {
+    "step": 512,
+    "loss": 2.4994144439697266,
+    "diagonal": 2.427976131439209,
+    "finite": 0.07143843173980713
+  },
+  {
+    "step": 513,
+    "loss": 2.2760889530181885,
+    "diagonal": 2.2375645637512207,
+    "finite": 0.03852441906929016
+  },
+  {
+    "step": 514,
+    "loss": 2.2450971603393555,
+    "diagonal": 2.190737009048462,
+    "finite": 0.054360050708055496
+  },
+  {
+    "step": 515,
+    "loss": 1.5959978103637695,
+    "diagonal": 1.532618522644043,
+    "finite": 0.06337924301624298
+  },
+  {
+    "step": 516,
+    "loss": 2.1547346115112305,
+    "diagonal": 2.1179094314575195,
+    "finite": 0.03682520240545273
+  },
+  {
+    "step": 517,
+    "loss": 1.5479892492294312,
+    "diagonal": 1.485545039176941,
+    "finite": 0.06244422495365143
+  },
+  {
+    "step": 518,
+    "loss": 1.9813103675842285,
+    "diagonal": 1.9288430213928223,
+    "finite": 0.05246740207076073
+  },
+  {
+    "step": 519,
+    "loss": 2.6794817447662354,
+    "diagonal": 2.6166059970855713,
+    "finite": 0.06287579983472824
+  },
+  {
+    "step": 520,
+    "loss": 1.7629046440124512,
+    "diagonal": 1.7190378904342651,
+    "finite": 0.04386673495173454
+  },
+  {
+    "step": 521,
+    "loss": 2.263920307159424,
+    "diagonal": 2.1958439350128174,
+    "finite": 0.06807637214660645
+  },
+  {
+    "step": 522,
+    "loss": 2.0349230766296387,
+    "diagonal": 2.003523826599121,
+    "finite": 0.031399305909872055
+  },
+  {
+    "step": 523,
+    "loss": 1.9231314659118652,
+    "diagonal": 1.8785266876220703,
+    "finite": 0.0446048378944397
+  },
+  {
+    "step": 524,
+    "loss": 2.1696066856384277,
+    "diagonal": 2.1204519271850586,
+    "finite": 0.04915469139814377
+  },
+  {
+    "step": 525,
+    "loss": 1.6993684768676758,
+    "diagonal": 1.6397132873535156,
+    "finite": 0.05965517461299896
+  },
+  {
+    "step": 526,
+    "loss": 2.7310731410980225,
+    "diagonal": 2.648742914199829,
+    "finite": 0.08233028650283813
+  },
+  {
+    "step": 527,
+    "loss": 2.6217703819274902,
+    "diagonal": 2.5255346298217773,
+    "finite": 0.09623566269874573
+  },
+  {
+    "step": 528,
+    "loss": 1.763013243675232,
+    "diagonal": 1.7329397201538086,
+    "finite": 0.0300735030323267
+  },
+  {
+    "step": 529,
+    "loss": 1.8659723997116089,
+    "diagonal": 1.8074768781661987,
+    "finite": 0.05849548056721687
+  },
+  {
+    "step": 530,
+    "loss": 2.2563347816467285,
+    "diagonal": 2.1974358558654785,
+    "finite": 0.05889899656176567
+  },
+  {
+    "step": 531,
+    "loss": 2.365679979324341,
+    "diagonal": 2.32659912109375,
+    "finite": 0.0390809029340744
+  },
+  {
+    "step": 532,
+    "loss": 1.8858894109725952,
+    "diagonal": 1.7909353971481323,
+    "finite": 0.09495402127504349
+  },
+  {
+    "step": 533,
+    "loss": 1.955912709236145,
+    "diagonal": 1.9038079977035522,
+    "finite": 0.05210466682910919
+  },
+  {
+    "step": 534,
+    "loss": 2.7348828315734863,
+    "diagonal": 2.685035467147827,
+    "finite": 0.04984745755791664
+  },
+  {
+    "step": 535,
+    "loss": 2.102055311203003,
+    "diagonal": 2.045437812805176,
+    "finite": 0.056617431342601776
+  },
+  {
+    "step": 536,
+    "loss": 1.9162448644638062,
+    "diagonal": 1.870438575744629,
+    "finite": 0.04580633342266083
+  },
+  {
+    "step": 537,
+    "loss": 2.26922345161438,
+    "diagonal": 2.2150895595550537,
+    "finite": 0.054133784025907516
+  },
+  {
+    "step": 538,
+    "loss": 1.8527461290359497,
+    "diagonal": 1.7902474403381348,
+    "finite": 0.06249864399433136
+  },
+  {
+    "step": 539,
+    "loss": 2.3788416385650635,
+    "diagonal": 2.329343795776367,
+    "finite": 0.0494978092610836
+  },
+  {
+    "step": 540,
+    "loss": 1.9764333963394165,
+    "diagonal": 1.9302504062652588,
+    "finite": 0.04618298262357712
+  },
+  {
+    "step": 541,
+    "loss": 1.9420640468597412,
+    "diagonal": 1.8707075119018555,
+    "finite": 0.07135659456253052
+  },
+  {
+    "step": 542,
+    "loss": 2.454054355621338,
+    "diagonal": 2.410451650619507,
+    "finite": 0.0436025969684124
+  },
+  {
+    "step": 543,
+    "loss": 1.801430106163025,
+    "diagonal": 1.771620750427246,
+    "finite": 0.029809316620230675
+  },
+  {
+    "step": 544,
+    "loss": 2.055891990661621,
+    "diagonal": 2.0068161487579346,
+    "finite": 0.04907587170600891
+  },
+  {
+    "step": 545,
+    "loss": 2.268456220626831,
+    "diagonal": 2.2313406467437744,
+    "finite": 0.037115491926670074
+  },
+  {
+    "step": 546,
+    "loss": 1.9179991483688354,
+    "diagonal": 1.8626642227172852,
+    "finite": 0.05533495545387268
+  },
+  {
+    "step": 547,
+    "loss": 2.305217742919922,
+    "diagonal": 2.25563907623291,
+    "finite": 0.04957873001694679
+  },
+  {
+    "step": 548,
+    "loss": 1.746330976486206,
+    "diagonal": 1.7134130001068115,
+    "finite": 0.03291802853345871
+  },
+  {
+    "step": 549,
+    "loss": 1.7709840536117554,
+    "diagonal": 1.7258872985839844,
+    "finite": 0.045096706598997116
+  },
+  {
+    "step": 550,
+    "loss": 1.7500145435333252,
+    "diagonal": 1.7077709436416626,
+    "finite": 0.042243652045726776
+  },
+  {
+    "step": 551,
+    "loss": 2.5504417419433594,
+    "diagonal": 2.4956982135772705,
+    "finite": 0.054743535816669464
+  },
+  {
+    "step": 552,
+    "loss": 2.2163941860198975,
+    "diagonal": 2.173649549484253,
+    "finite": 0.04274454712867737
+  },
+  {
+    "step": 553,
+    "loss": 2.2944488525390625,
+    "diagonal": 2.2175941467285156,
+    "finite": 0.07685459405183792
+  },
+  {
+    "step": 554,
+    "loss": 1.9185888767242432,
+    "diagonal": 1.8557558059692383,
+    "finite": 0.06283307075500488
+  },
+  {
+    "step": 555,
+    "loss": 1.796047329902649,
+    "diagonal": 1.7454583644866943,
+    "finite": 0.050588998943567276
+  },
+  {
+    "step": 556,
+    "loss": 1.7342746257781982,
+    "diagonal": 1.671398639678955,
+    "finite": 0.06287596374750137
+  },
+  {
+    "step": 557,
+    "loss": 2.191549777984619,
+    "diagonal": 2.1241092681884766,
+    "finite": 0.06744056940078735
+  },
+  {
+    "step": 558,
+    "loss": 2.044105291366577,
+    "diagonal": 1.9918256998062134,
+    "finite": 0.052279602736234665
+  },
+  {
+    "step": 559,
+    "loss": 2.4636752605438232,
+    "diagonal": 2.402491331100464,
+    "finite": 0.06118394434452057
+  },
+  {
+    "step": 560,
+    "loss": 2.2233357429504395,
+    "diagonal": 2.18523907661438,
+    "finite": 0.03809657692909241
+  },
+  {
+    "step": 561,
+    "loss": 1.9540010690689087,
+    "diagonal": 1.9043807983398438,
+    "finite": 0.04962029308080673
+  },
+  {
+    "step": 562,
+    "loss": 1.830573320388794,
+    "diagonal": 1.783285140991211,
+    "finite": 0.04728821665048599
+  },
+  {
+    "step": 563,
+    "loss": 1.3358341455459595,
+    "diagonal": 1.2942559719085693,
+    "finite": 0.04157811775803566
+  },
+  {
+    "step": 564,
+    "loss": 2.0535669326782227,
+    "diagonal": 2.010395050048828,
+    "finite": 0.04317184165120125
+  },
+  {
+    "step": 565,
+    "loss": 1.6227164268493652,
+    "diagonal": 1.5829662084579468,
+    "finite": 0.03975021839141846
+  },
+  {
+    "step": 566,
+    "loss": 2.179565906524658,
+    "diagonal": 2.133735179901123,
+    "finite": 0.045830752700567245
+  },
+  {
+    "step": 567,
+    "loss": 2.0299181938171387,
+    "diagonal": 1.9871282577514648,
+    "finite": 0.042789895087480545
+  },
+  {
+    "step": 568,
+    "loss": 2.4120371341705322,
+    "diagonal": 2.3666017055511475,
+    "finite": 0.0454353503882885
+  },
+  {
+    "step": 569,
+    "loss": 1.9042203426361084,
+    "diagonal": 1.8612829446792603,
+    "finite": 0.04293745383620262
+  },
+  {
+    "step": 570,
+    "loss": 2.2097256183624268,
+    "diagonal": 2.141950845718384,
+    "finite": 0.06777475774288177
+  },
+  {
+    "step": 571,
+    "loss": 2.3800225257873535,
+    "diagonal": 2.2991182804107666,
+    "finite": 0.0809042826294899
+  },
+  {
+    "step": 572,
+    "loss": 2.8532073497772217,
+    "diagonal": 2.805405616760254,
+    "finite": 0.04780180752277374
+  },
+  {
+    "step": 573,
+    "loss": 2.2553839683532715,
+    "diagonal": 2.2072949409484863,
+    "finite": 0.04808898642659187
+  },
+  {
+    "step": 574,
+    "loss": 2.1957814693450928,
+    "diagonal": 2.1158785820007324,
+    "finite": 0.07990290224552155
+  },
+  {
+    "step": 575,
+    "loss": 1.9622124433517456,
+    "diagonal": 1.8897541761398315,
+    "finite": 0.07245825231075287
+  },
+  {
+    "step": 576,
+    "loss": 1.9082218408584595,
+    "diagonal": 1.8725730180740356,
+    "finite": 0.03564881905913353
+  },
+  {
+    "step": 577,
+    "loss": 1.8917925357818604,
+    "diagonal": 1.8654768466949463,
+    "finite": 0.026315737515687943
+  },
+  {
+    "step": 578,
+    "loss": 2.476921319961548,
+    "diagonal": 2.4386560916900635,
+    "finite": 0.03826534003019333
+  },
+  {
+    "step": 579,
+    "loss": 2.0693652629852295,
+    "diagonal": 2.037748098373413,
+    "finite": 0.03161722421646118
+  },
+  {
+    "step": 580,
+    "loss": 1.9523767232894897,
+    "diagonal": 1.9143623113632202,
+    "finite": 0.03801438584923744
+  },
+  {
+    "step": 581,
+    "loss": 2.4047935009002686,
+    "diagonal": 2.3662807941436768,
+    "finite": 0.03851277008652687
+  },
+  {
+    "step": 582,
+    "loss": 1.4116196632385254,
+    "diagonal": 1.361877679824829,
+    "finite": 0.0497419536113739
+  },
+  {
+    "step": 583,
+    "loss": 1.7688108682632446,
+    "diagonal": 1.721123218536377,
+    "finite": 0.047687605023384094
+  },
+  {
+    "step": 584,
+    "loss": 1.9972102642059326,
+    "diagonal": 1.9532740116119385,
+    "finite": 0.04393628612160683
+  },
+  {
+    "step": 585,
+    "loss": 2.160149574279785,
+    "diagonal": 2.1109611988067627,
+    "finite": 0.04918849095702171
+  },
+  {
+    "step": 586,
+    "loss": 1.7821321487426758,
+    "diagonal": 1.7327890396118164,
+    "finite": 0.04934310168027878
+  },
+  {
+    "step": 587,
+    "loss": 2.124828815460205,
+    "diagonal": 2.073901891708374,
+    "finite": 0.050926897674798965
+  },
+  {
+    "step": 588,
+    "loss": 1.8933932781219482,
+    "diagonal": 1.8478574752807617,
+    "finite": 0.045535795390605927
+  },
+  {
+    "step": 589,
+    "loss": 2.1026382446289062,
+    "diagonal": 2.0385730266571045,
+    "finite": 0.06406527012586594
+  },
+  {
+    "step": 590,
+    "loss": 2.201444625854492,
+    "diagonal": 2.1520915031433105,
+    "finite": 0.04935318976640701
+  },
+  {
+    "step": 591,
+    "loss": 2.2428996562957764,
+    "diagonal": 2.2042999267578125,
+    "finite": 0.03859972953796387
+  },
+  {
+    "step": 592,
+    "loss": 1.8656227588653564,
+    "diagonal": 1.8221046924591064,
+    "finite": 0.043518029153347015
+  },
+  {
+    "step": 593,
+    "loss": 2.4190123081207275,
+    "diagonal": 2.3603975772857666,
+    "finite": 0.05861468240618706
+  },
+  {
+    "step": 594,
+    "loss": 2.22510027885437,
+    "diagonal": 2.1932129859924316,
+    "finite": 0.03188737854361534
+  },
+  {
+    "step": 595,
+    "loss": 1.8039230108261108,
+    "diagonal": 1.7647289037704468,
+    "finite": 0.03919416293501854
+  },
+  {
+    "step": 596,
+    "loss": 2.630293607711792,
+    "diagonal": 2.5767295360565186,
+    "finite": 0.05356408655643463
+  },
+  {
+    "step": 597,
+    "loss": 2.293809652328491,
+    "diagonal": 2.208648204803467,
+    "finite": 0.08516141027212143
+  },
+  {
+    "step": 598,
+    "loss": 1.9193730354309082,
+    "diagonal": 1.8142054080963135,
+    "finite": 0.10516756772994995
+  },
+  {
+    "step": 599,
+    "loss": 2.095757007598877,
+    "diagonal": 2.0535900592803955,
+    "finite": 0.042166851460933685
+  },
+  {
+    "step": 600,
+    "loss": 2.0465269088745117,
+    "diagonal": 2.0039219856262207,
+    "finite": 0.042604949325323105
+  },
+  {
+    "step": 601,
+    "loss": 2.0400230884552,
+    "diagonal": 1.989534616470337,
+    "finite": 0.05048857629299164
+  },
+  {
+    "step": 602,
+    "loss": 2.208446741104126,
+    "diagonal": 2.1568825244903564,
+    "finite": 0.05156414583325386
+  },
+  {
+    "step": 603,
+    "loss": 2.23516583442688,
+    "diagonal": 2.193129062652588,
+    "finite": 0.042036667466163635
+  },
+  {
+    "step": 604,
+    "loss": 1.7211875915527344,
+    "diagonal": 1.683068871498108,
+    "finite": 0.03811870515346527
+  },
+  {
+    "step": 605,
+    "loss": 1.9299792051315308,
+    "diagonal": 1.8912538290023804,
+    "finite": 0.03872538357973099
+  },
+  {
+    "step": 606,
+    "loss": 2.168463706970215,
+    "diagonal": 2.1138947010040283,
+    "finite": 0.054569121450185776
+  },
+  {
+    "step": 607,
+    "loss": 2.2337687015533447,
+    "diagonal": 2.1873512268066406,
+    "finite": 0.04641743376851082
+  },
+  {
+    "step": 608,
+    "loss": 2.1449382305145264,
+    "diagonal": 2.107443332672119,
+    "finite": 0.037494927644729614
+  },
+  {
+    "step": 609,
+    "loss": 1.9367640018463135,
+    "diagonal": 1.8997998237609863,
+    "finite": 0.036964137107133865
+  },
+  {
+    "step": 610,
+    "loss": 2.045149803161621,
+    "diagonal": 1.9972673654556274,
+    "finite": 0.047882355749607086
+  },
+  {
+    "step": 611,
+    "loss": 2.1869213581085205,
+    "diagonal": 2.148555278778076,
+    "finite": 0.03836613893508911
+  },
+  {
+    "step": 612,
+    "loss": 1.7809056043624878,
+    "diagonal": 1.732648253440857,
+    "finite": 0.04825739189982414
+  },
+  {
+    "step": 613,
+    "loss": 2.2718286514282227,
+    "diagonal": 2.2274820804595947,
+    "finite": 0.044346608221530914
+  },
+  {
+    "step": 614,
+    "loss": 2.2883312702178955,
+    "diagonal": 2.237710475921631,
+    "finite": 0.05062084645032883
+  },
+  {
+    "step": 615,
+    "loss": 1.779363751411438,
+    "diagonal": 1.746122121810913,
+    "finite": 0.033241625875234604
+  },
+  {
+    "step": 616,
+    "loss": 2.039773464202881,
+    "diagonal": 1.99568510055542,
+    "finite": 0.044088274240493774
+  },
+  {
+    "step": 617,
+    "loss": 1.9731895923614502,
+    "diagonal": 1.912409782409668,
+    "finite": 0.060779765248298645
+  },
+  {
+    "step": 618,
+    "loss": 2.0406484603881836,
+    "diagonal": 1.9706597328186035,
+    "finite": 0.06998877227306366
+  },
+  {
+    "step": 619,
+    "loss": 1.7480502128601074,
+    "diagonal": 1.6985881328582764,
+    "finite": 0.04946209490299225
+  },
+  {
+    "step": 620,
+    "loss": 2.051290512084961,
+    "diagonal": 2.0166327953338623,
+    "finite": 0.03465760871767998
+  },
+  {
+    "step": 621,
+    "loss": 2.2739181518554688,
+    "diagonal": 2.2177748680114746,
+    "finite": 0.05614335089921951
+  },
+  {
+    "step": 622,
+    "loss": 1.8284542560577393,
+    "diagonal": 1.7748712301254272,
+    "finite": 0.05358303338289261
+  },
+  {
+    "step": 623,
+    "loss": 2.0346100330352783,
+    "diagonal": 1.9634454250335693,
+    "finite": 0.07116453349590302
+  },
+  {
+    "step": 624,
+    "loss": 1.5157883167266846,
+    "diagonal": 1.461100459098816,
+    "finite": 0.05468783900141716
+  },
+  {
+    "step": 625,
+    "loss": 2.1669833660125732,
+    "diagonal": 2.1272315979003906,
+    "finite": 0.03975183516740799
+  },
+  {
+    "step": 626,
+    "loss": 2.1595141887664795,
+    "diagonal": 2.107790231704712,
+    "finite": 0.051723871380090714
+  },
+  {
+    "step": 627,
+    "loss": 2.1049644947052,
+    "diagonal": 2.0605807304382324,
+    "finite": 0.04438379779458046
+  },
+  {
+    "step": 628,
+    "loss": 2.2054710388183594,
+    "diagonal": 2.0346972942352295,
+    "finite": 0.17077375948429108
+  },
+  {
+    "step": 629,
+    "loss": 2.250293016433716,
+    "diagonal": 2.1910738945007324,
+    "finite": 0.05921907722949982
+  },
+  {
+    "step": 630,
+    "loss": 1.706879734992981,
+    "diagonal": 1.6570364236831665,
+    "finite": 0.04984327033162117
+  },
+  {
+    "step": 631,
+    "loss": 2.0480523109436035,
+    "diagonal": 1.9920480251312256,
+    "finite": 0.0560043603181839
+  },
+  {
+    "step": 632,
+    "loss": 1.853085994720459,
+    "diagonal": 1.8042654991149902,
+    "finite": 0.048820532858371735
+  },
+  {
+    "step": 633,
+    "loss": 1.7557971477508545,
+    "diagonal": 1.7164652347564697,
+    "finite": 0.03933187201619148
+  },
+  {
+    "step": 634,
+    "loss": 1.8684399127960205,
+    "diagonal": 1.8067102432250977,
+    "finite": 0.06172966957092285
+  },
+  {
+    "step": 635,
+    "loss": 1.8712875843048096,
+    "diagonal": 1.8289201259613037,
+    "finite": 0.04236742854118347
+  },
+  {
+    "step": 636,
+    "loss": 2.6841349601745605,
+    "diagonal": 2.634594678878784,
+    "finite": 0.049540165811777115
+  },
+  {
+    "step": 637,
+    "loss": 1.9360363483428955,
+    "diagonal": 1.874434232711792,
+    "finite": 0.06160207837820053
+  },
+  {
+    "step": 638,
+    "loss": 2.0398151874542236,
+    "diagonal": 1.98499596118927,
+    "finite": 0.05481915548443794
+  },
+  {
+    "step": 639,
+    "loss": 1.4814871549606323,
+    "diagonal": 1.4259417057037354,
+    "finite": 0.05554545670747757
+  },
+  {
+    "step": 640,
+    "loss": 1.821216344833374,
+    "diagonal": 1.7884266376495361,
+    "finite": 0.03278970345854759
+  },
+  {
+    "step": 641,
+    "loss": 2.1589581966400146,
+    "diagonal": 2.120148181915283,
+    "finite": 0.03880999609827995
+  },
+  {
+    "step": 642,
+    "loss": 2.4431095123291016,
+    "diagonal": 2.399225950241089,
+    "finite": 0.04388345405459404
+  },
+  {
+    "step": 643,
+    "loss": 2.1103515625,
+    "diagonal": 2.0709805488586426,
+    "finite": 0.039371006190776825
+  },
+  {
+    "step": 644,
+    "loss": 2.145414352416992,
+    "diagonal": 2.1088201999664307,
+    "finite": 0.03659418225288391
+  },
+  {
+    "step": 645,
+    "loss": 2.062145233154297,
+    "diagonal": 2.023336887359619,
+    "finite": 0.03880836069583893
+  },
+  {
+    "step": 646,
+    "loss": 2.4237425327301025,
+    "diagonal": 2.374965190887451,
+    "finite": 0.04877745732665062
+  },
+  {
+    "step": 647,
+    "loss": 1.7666947841644287,
+    "diagonal": 1.7169126272201538,
+    "finite": 0.04978213086724281
+  },
+  {
+    "step": 648,
+    "loss": 2.332392692565918,
+    "diagonal": 2.2784979343414307,
+    "finite": 0.05389475077390671
+  },
+  {
+    "step": 649,
+    "loss": 2.0731706619262695,
+    "diagonal": 2.0334105491638184,
+    "finite": 0.039760179817676544
+  },
+  {
+    "step": 650,
+    "loss": 1.8428263664245605,
+    "diagonal": 1.776084065437317,
+    "finite": 0.06674227863550186
+  },
+  {
+    "step": 651,
+    "loss": 2.0456349849700928,
+    "diagonal": 2.0094990730285645,
+    "finite": 0.03613598272204399
+  },
+  {
+    "step": 652,
+    "loss": 1.860009789466858,
+    "diagonal": 1.801603078842163,
+    "finite": 0.05840672552585602
+  },
+  {
+    "step": 653,
+    "loss": 2.025381326675415,
+    "diagonal": 1.9349563121795654,
+    "finite": 0.09042498469352722
+  },
+  {
+    "step": 654,
+    "loss": 2.181480884552002,
+    "diagonal": 2.1270432472229004,
+    "finite": 0.05443757027387619
+  },
+  {
+    "step": 655,
+    "loss": 2.22174072265625,
+    "diagonal": 2.1810789108276367,
+    "finite": 0.04066191613674164
+  },
+  {
+    "step": 656,
+    "loss": 2.077213764190674,
+    "diagonal": 1.9965846538543701,
+    "finite": 0.08062920719385147
+  },
+  {
+    "step": 657,
+    "loss": 2.1963467597961426,
+    "diagonal": 2.146357536315918,
+    "finite": 0.04998914524912834
+  },
+  {
+    "step": 658,
+    "loss": 1.9620459079742432,
+    "diagonal": 1.8598599433898926,
+    "finite": 0.10218597948551178
+  },
+  {
+    "step": 659,
+    "loss": 2.6532809734344482,
+    "diagonal": 2.6024110317230225,
+    "finite": 0.05086991935968399
+  },
+  {
+    "step": 660,
+    "loss": 1.9093910455703735,
+    "diagonal": 1.853665828704834,
+    "finite": 0.05572516471147537
+  },
+  {
+    "step": 661,
+    "loss": 1.801368236541748,
+    "diagonal": 1.7592452764511108,
+    "finite": 0.042123012244701385
+  },
+  {
+    "step": 662,
+    "loss": 1.7751399278640747,
+    "diagonal": 1.7314987182617188,
+    "finite": 0.04364115744829178
+  },
+  {
+    "step": 663,
+    "loss": 2.134467840194702,
+    "diagonal": 2.0899505615234375,
+    "finite": 0.04451724886894226
+  },
+  {
+    "step": 664,
+    "loss": 1.816095232963562,
+    "diagonal": 1.7641055583953857,
+    "finite": 0.051989708095788956
+  },
+  {
+    "step": 665,
+    "loss": 1.933160662651062,
+    "diagonal": 1.8686351776123047,
+    "finite": 0.06452549993991852
+  },
+  {
+    "step": 666,
+    "loss": 2.0698492527008057,
+    "diagonal": 2.0156476497650146,
+    "finite": 0.054201602935791016
+  },
+  {
+    "step": 667,
+    "loss": 2.232187509536743,
+    "diagonal": 2.180370569229126,
+    "finite": 0.05181698873639107
+  },
+  {
+    "step": 668,
+    "loss": 2.4273509979248047,
+    "diagonal": 2.374993324279785,
+    "finite": 0.05235763639211655
+  },
+  {
+    "step": 669,
+    "loss": 2.3730127811431885,
+    "diagonal": 2.2818939685821533,
+    "finite": 0.09111873060464859
+  },
+  {
+    "step": 670,
+    "loss": 1.3636270761489868,
+    "diagonal": 1.3043015003204346,
+    "finite": 0.059325531125068665
+  },
+  {
+    "step": 671,
+    "loss": 1.9309253692626953,
+    "diagonal": 1.8812328577041626,
+    "finite": 0.04969248175621033
+  },
+  {
+    "step": 672,
+    "loss": 2.1905581951141357,
+    "diagonal": 2.1454341411590576,
+    "finite": 0.04512406513094902
+  },
+  {
+    "step": 673,
+    "loss": 2.329274892807007,
+    "diagonal": 2.2773334980010986,
+    "finite": 0.05194137617945671
+  },
+  {
+    "step": 674,
+    "loss": 1.6442372798919678,
+    "diagonal": 1.6099598407745361,
+    "finite": 0.03427744656801224
+  },
+  {
+    "step": 675,
+    "loss": 1.805022954940796,
+    "diagonal": 1.7580337524414062,
+    "finite": 0.046989232301712036
+  },
+  {
+    "step": 676,
+    "loss": 1.8074952363967896,
+    "diagonal": 1.770687222480774,
+    "finite": 0.03680801764130592
+  },
+  {
+    "step": 677,
+    "loss": 2.0559263229370117,
+    "diagonal": 2.0178189277648926,
+    "finite": 0.03810739144682884
+  },
+  {
+    "step": 678,
+    "loss": 2.337594985961914,
+    "diagonal": 2.2968637943267822,
+    "finite": 0.04073110967874527
+  },
+  {
+    "step": 679,
+    "loss": 1.8889493942260742,
+    "diagonal": 1.8278871774673462,
+    "finite": 0.06106216460466385
+  },
+  {
+    "step": 680,
+    "loss": 2.844979763031006,
+    "diagonal": 2.805450677871704,
+    "finite": 0.03952905908226967
+  },
+  {
+    "step": 681,
+    "loss": 2.6824991703033447,
+    "diagonal": 2.6205716133117676,
+    "finite": 0.06192748248577118
+  },
+  {
+    "step": 682,
+    "loss": 1.7253282070159912,
+    "diagonal": 1.694298505783081,
+    "finite": 0.031029650941491127
+  },
+  {
+    "step": 683,
+    "loss": 1.9593149423599243,
+    "diagonal": 1.896437168121338,
+    "finite": 0.06287774443626404
+  },
+  {
+    "step": 684,
+    "loss": 2.171983003616333,
+    "diagonal": 2.134274482727051,
+    "finite": 0.03770855814218521
+  },
+  {
+    "step": 685,
+    "loss": 2.395632743835449,
+    "diagonal": 2.3332672119140625,
+    "finite": 0.0623655691742897
+  },
+  {
+    "step": 686,
+    "loss": 1.7869025468826294,
+    "diagonal": 1.749193549156189,
+    "finite": 0.037708982825279236
+  },
+  {
+    "step": 687,
+    "loss": 1.8823972940444946,
+    "diagonal": 1.8280351161956787,
+    "finite": 0.05436214804649353
+  },
+  {
+    "step": 688,
+    "loss": 1.7388743162155151,
+    "diagonal": 1.6895071268081665,
+    "finite": 0.04936714097857475
+  },
+  {
+    "step": 689,
+    "loss": 1.4978688955307007,
+    "diagonal": 1.4650311470031738,
+    "finite": 0.032837770879268646
+  },
+  {
+    "step": 690,
+    "loss": 2.024845600128174,
+    "diagonal": 1.946767807006836,
+    "finite": 0.07807783782482147
+  },
+  {
+    "step": 691,
+    "loss": 2.177811861038208,
+    "diagonal": 2.142181396484375,
+    "finite": 0.03563039377331734
+  },
+  {
+    "step": 692,
+    "loss": 1.6021043062210083,
+    "diagonal": 1.5388758182525635,
+    "finite": 0.06322845816612244
+  },
+  {
+    "step": 693,
+    "loss": 1.8579939603805542,
+    "diagonal": 1.720252513885498,
+    "finite": 0.13774140179157257
+  },
+  {
+    "step": 694,
+    "loss": 2.711784839630127,
+    "diagonal": 2.671987771987915,
+    "finite": 0.03979698196053505
+  },
+  {
+    "step": 695,
+    "loss": 2.102972984313965,
+    "diagonal": 2.0491676330566406,
+    "finite": 0.05380535125732422
+  },
+  {
+    "step": 696,
+    "loss": 1.8034837245941162,
+    "diagonal": 1.7517551183700562,
+    "finite": 0.05172862857580185
+  },
+  {
+    "step": 697,
+    "loss": 1.7466990947723389,
+    "diagonal": 1.6907968521118164,
+    "finite": 0.05590222030878067
+  },
+  {
+    "step": 698,
+    "loss": 2.2007699012756348,
+    "diagonal": 2.150609254837036,
+    "finite": 0.050160542130470276
+  },
+  {
+    "step": 699,
+    "loss": 2.2098653316497803,
+    "diagonal": 2.148233413696289,
+    "finite": 0.06163201108574867
+  },
+  {
+    "step": 700,
+    "loss": 2.1338601112365723,
+    "diagonal": 2.088050127029419,
+    "finite": 0.045809872448444366
+  },
+  {
+    "step": 701,
+    "loss": 1.671091914176941,
+    "diagonal": 1.6324701309204102,
+    "finite": 0.03862175717949867
+  },
+  {
+    "step": 702,
+    "loss": 1.9350130558013916,
+    "diagonal": 1.8752521276474,
+    "finite": 0.0597609281539917
+  },
+  {
+    "step": 703,
+    "loss": 1.8316713571548462,
+    "diagonal": 1.7817267179489136,
+    "finite": 0.0499446839094162
+  },
+  {
+    "step": 704,
+    "loss": 1.7349032163619995,
+    "diagonal": 1.6911805868148804,
+    "finite": 0.04372265934944153
+  },
+  {
+    "step": 705,
+    "loss": 2.500401735305786,
+    "diagonal": 2.433701276779175,
+    "finite": 0.0667005330324173
+  },
+  {
+    "step": 706,
+    "loss": 1.8489325046539307,
+    "diagonal": 1.7967747449874878,
+    "finite": 0.052157703787088394
+  },
+  {
+    "step": 707,
+    "loss": 2.0481839179992676,
+    "diagonal": 2.0079030990600586,
+    "finite": 0.040280863642692566
+  },
+  {
+    "step": 708,
+    "loss": 1.8092292547225952,
+    "diagonal": 1.7680376768112183,
+    "finite": 0.04119153693318367
+  },
+  {
+    "step": 709,
+    "loss": 1.363411545753479,
+    "diagonal": 1.3197678327560425,
+    "finite": 0.04364374279975891
+  },
+  {
+    "step": 710,
+    "loss": 1.8286073207855225,
+    "diagonal": 1.7622706890106201,
+    "finite": 0.06633661687374115
+  },
+  {
+    "step": 711,
+    "loss": 1.962175726890564,
+    "diagonal": 1.8774738311767578,
+    "finite": 0.08470192551612854
+  },
+  {
+    "step": 712,
+    "loss": 1.6697965860366821,
+    "diagonal": 1.6259825229644775,
+    "finite": 0.043814029544591904
+  },
+  {
+    "step": 713,
+    "loss": 1.7582473754882812,
+    "diagonal": 1.711090326309204,
+    "finite": 0.047157030552625656
+  },
+  {
+    "step": 714,
+    "loss": 2.3731582164764404,
+    "diagonal": 2.3241193294525146,
+    "finite": 0.049039002507925034
+  },
+  {
+    "step": 715,
+    "loss": 2.0430588722229004,
+    "diagonal": 1.9790834188461304,
+    "finite": 0.06397533416748047
+  },
+  {
+    "step": 716,
+    "loss": 2.1832454204559326,
+    "diagonal": 2.131361484527588,
+    "finite": 0.051883965730667114
+  },
+  {
+    "step": 717,
+    "loss": 2.21681809425354,
+    "diagonal": 2.148451089859009,
+    "finite": 0.06836693733930588
+  },
+  {
+    "step": 718,
+    "loss": 1.8947054147720337,
+    "diagonal": 1.8343110084533691,
+    "finite": 0.060394398868083954
+  },
+  {
+    "step": 719,
+    "loss": 1.335547924041748,
+    "diagonal": 1.2856847047805786,
+    "finite": 0.04986322671175003
+  },
+  {
+    "step": 720,
+    "loss": 1.7048633098602295,
+    "diagonal": 1.6708259582519531,
+    "finite": 0.03403737396001816
+  },
+  {
+    "step": 721,
+    "loss": 2.2910687923431396,
+    "diagonal": 2.234623908996582,
+    "finite": 0.05644480139017105
+  },
+  {
+    "step": 722,
+    "loss": 1.9373780488967896,
+    "diagonal": 1.891240119934082,
+    "finite": 0.04613793268799782
+  },
+  {
+    "step": 723,
+    "loss": 1.8435558080673218,
+    "diagonal": 1.7735223770141602,
+    "finite": 0.07003341615200043
+  },
+  {
+    "step": 724,
+    "loss": 1.8589519262313843,
+    "diagonal": 1.7971651554107666,
+    "finite": 0.06178680807352066
+  },
+  {
+    "step": 725,
+    "loss": 1.8825347423553467,
+    "diagonal": 1.8286799192428589,
+    "finite": 0.0538548119366169
+  },
+  {
+    "step": 726,
+    "loss": 2.1747918128967285,
+    "diagonal": 2.1085915565490723,
+    "finite": 0.06620017439126968
+  },
+  {
+    "step": 727,
+    "loss": 2.1650896072387695,
+    "diagonal": 2.1166582107543945,
+    "finite": 0.04843141511082649
+  },
+  {
+    "step": 728,
+    "loss": 2.0035197734832764,
+    "diagonal": 1.93564772605896,
+    "finite": 0.06787214428186417
+  },
+  {
+    "step": 729,
+    "loss": 2.105045795440674,
+    "diagonal": 2.0523226261138916,
+    "finite": 0.05272315442562103
+  },
+  {
+    "step": 730,
+    "loss": 1.6264649629592896,
+    "diagonal": 1.5797637701034546,
+    "finite": 0.04670121893286705
+  },
+  {
+    "step": 731,
+    "loss": 1.9583232402801514,
+    "diagonal": 1.9011670351028442,
+    "finite": 0.057156194001436234
+  },
+  {
+    "step": 732,
+    "loss": 2.1606533527374268,
+    "diagonal": 2.1159722805023193,
+    "finite": 0.044680994004011154
+  },
+  {
+    "step": 733,
+    "loss": 2.57364821434021,
+    "diagonal": 2.4773802757263184,
+    "finite": 0.09626797586679459
+  },
+  {
+    "step": 734,
+    "loss": 2.2800369262695312,
+    "diagonal": 2.2196195125579834,
+    "finite": 0.06041736155748367
+  },
+  {
+    "step": 735,
+    "loss": 2.7528581619262695,
+    "diagonal": 2.697922706604004,
+    "finite": 0.05493542179465294
+  },
+  {
+    "step": 736,
+    "loss": 1.8170108795166016,
+    "diagonal": 1.7709873914718628,
+    "finite": 0.04602352902293205
+  },
+  {
+    "step": 737,
+    "loss": 1.3991527557373047,
+    "diagonal": 1.3466625213623047,
+    "finite": 0.052490219473838806
+  },
+  {
+    "step": 738,
+    "loss": 2.2793710231781006,
+    "diagonal": 2.2329020500183105,
+    "finite": 0.04646893963217735
+  },
+  {
+    "step": 739,
+    "loss": 1.8924167156219482,
+    "diagonal": 1.8532555103302002,
+    "finite": 0.039161209017038345
+  },
+  {
+    "step": 740,
+    "loss": 2.0037403106689453,
+    "diagonal": 1.9646964073181152,
+    "finite": 0.03904401510953903
+  },
+  {
+    "step": 741,
+    "loss": 1.691406488418579,
+    "diagonal": 1.622672200202942,
+    "finite": 0.06873428821563721
+  },
+  {
+    "step": 742,
+    "loss": 2.0354583263397217,
+    "diagonal": 1.995877981185913,
+    "finite": 0.039580460637807846
+  },
+  {
+    "step": 743,
+    "loss": 2.4516243934631348,
+    "diagonal": 2.4143574237823486,
+    "finite": 0.03726695105433464
+  },
+  {
+    "step": 744,
+    "loss": 1.9958744049072266,
+    "diagonal": 1.9655147790908813,
+    "finite": 0.030359668657183647
+  },
+  {
+    "step": 745,
+    "loss": 2.16792631149292,
+    "diagonal": 2.1198763847351074,
+    "finite": 0.048049990087747574
+  },
+  {
+    "step": 746,
+    "loss": 1.8241628408432007,
+    "diagonal": 1.785797357559204,
+    "finite": 0.0383654423058033
+  },
+  {
+    "step": 747,
+    "loss": 1.883897304534912,
+    "diagonal": 1.8402258157730103,
+    "finite": 0.04367144778370857
+  },
+  {
+    "step": 748,
+    "loss": 2.1546454429626465,
+    "diagonal": 2.106935739517212,
+    "finite": 0.04770958423614502
+  },
+  {
+    "step": 749,
+    "loss": 1.798659086227417,
+    "diagonal": 1.7491052150726318,
+    "finite": 0.04955391585826874
+  },
+  {
+    "step": 750,
+    "loss": 1.3224741220474243,
+    "diagonal": 1.2769989967346191,
+    "finite": 0.04547514021396637
+  },
+  {
+    "step": 751,
+    "loss": 1.6296025514602661,
+    "diagonal": 1.600376009941101,
+    "finite": 0.029226532205939293
+  },
+  {
+    "step": 752,
+    "loss": 2.1736581325531006,
+    "diagonal": 2.1208395957946777,
+    "finite": 0.0528184249997139
+  },
+  {
+    "step": 753,
+    "loss": 1.8687894344329834,
+    "diagonal": 1.8193001747131348,
+    "finite": 0.049489207565784454
+  },
+  {
+    "step": 754,
+    "loss": 2.6163439750671387,
+    "diagonal": 2.5727920532226562,
+    "finite": 0.043551862239837646
+  },
+  {
+    "step": 755,
+    "loss": 2.3059933185577393,
+    "diagonal": 2.2524142265319824,
+    "finite": 0.053579166531562805
+  },
+  {
+    "step": 756,
+    "loss": 2.2391598224639893,
+    "diagonal": 2.1752216815948486,
+    "finite": 0.06393812596797943
+  },
+  {
+    "step": 757,
+    "loss": 1.791189193725586,
+    "diagonal": 1.735856294631958,
+    "finite": 0.05533287301659584
+  },
+  {
+    "step": 758,
+    "loss": 2.3792428970336914,
+    "diagonal": 2.3198251724243164,
+    "finite": 0.05941776558756828
+  },
+  {
+    "step": 759,
+    "loss": 2.3385910987854004,
+    "diagonal": 2.3040359020233154,
+    "finite": 0.034555114805698395
+  },
+  {
+    "step": 760,
+    "loss": 2.499819278717041,
+    "diagonal": 2.4493305683135986,
+    "finite": 0.05048864707350731
+  },
+  {
+    "step": 761,
+    "loss": 2.314065456390381,
+    "diagonal": 2.261997699737549,
+    "finite": 0.05206771939992905
+  },
+  {
+    "step": 762,
+    "loss": 2.6647486686706543,
+    "diagonal": 2.6125576496124268,
+    "finite": 0.05219089984893799
+  },
+  {
+    "step": 763,
+    "loss": 1.816014289855957,
+    "diagonal": 1.7549517154693604,
+    "finite": 0.06106255203485489
+  },
+  {
+    "step": 764,
+    "loss": 1.7116202116012573,
+    "diagonal": 1.6681550741195679,
+    "finite": 0.04346516355872154
+  },
+  {
+    "step": 765,
+    "loss": 1.5615999698638916,
+    "diagonal": 1.515561819076538,
+    "finite": 0.046038154512643814
+  },
+  {
+    "step": 766,
+    "loss": 2.4562151432037354,
+    "diagonal": 2.4078969955444336,
+    "finite": 0.04831819236278534
+  },
+  {
+    "step": 767,
+    "loss": 2.023097276687622,
+    "diagonal": 1.9750099182128906,
+    "finite": 0.04808737337589264
+  },
+  {
+    "step": 768,
+    "loss": 2.495251178741455,
+    "diagonal": 2.45955753326416,
+    "finite": 0.03569353371858597
+  },
+  {
+    "step": 769,
+    "loss": 1.9822142124176025,
+    "diagonal": 1.9424775838851929,
+    "finite": 0.03973662480711937
+  },
+  {
+    "step": 770,
+    "loss": 1.8259090185165405,
+    "diagonal": 1.7719473838806152,
+    "finite": 0.053961656987667084
+  },
+  {
+    "step": 771,
+    "loss": 1.6445438861846924,
+    "diagonal": 1.6084764003753662,
+    "finite": 0.03606754541397095
+  },
+  {
+    "step": 772,
+    "loss": 1.5849934816360474,
+    "diagonal": 1.5537666082382202,
+    "finite": 0.031226860359311104
+  },
+  {
+    "step": 773,
+    "loss": 1.96365225315094,
+    "diagonal": 1.89603853225708,
+    "finite": 0.06761372089385986
+  },
+  {
+    "step": 774,
+    "loss": 1.5620503425598145,
+    "diagonal": 1.4963407516479492,
+    "finite": 0.06570953130722046
+  },
+  {
+    "step": 775,
+    "loss": 2.1987106800079346,
+    "diagonal": 2.1461853981018066,
+    "finite": 0.05252533406019211
+  },
+  {
+    "step": 776,
+    "loss": 1.790446400642395,
+    "diagonal": 1.7431682348251343,
+    "finite": 0.047278113663196564
+  },
+  {
+    "step": 777,
+    "loss": 2.159797191619873,
+    "diagonal": 2.096283435821533,
+    "finite": 0.06351379305124283
+  },
+  {
+    "step": 778,
+    "loss": 2.10683274269104,
+    "diagonal": 2.0375359058380127,
+    "finite": 0.06929673254489899
+  },
+  {
+    "step": 779,
+    "loss": 1.572411298751831,
+    "diagonal": 1.5270534753799438,
+    "finite": 0.045357804745435715
+  },
+  {
+    "step": 780,
+    "loss": 2.395235061645508,
+    "diagonal": 2.3390166759490967,
+    "finite": 0.05621843412518501
+  },
+  {
+    "step": 781,
+    "loss": 1.4961572885513306,
+    "diagonal": 1.4330193996429443,
+    "finite": 0.06313791126012802
+  },
+  {
+    "step": 782,
+    "loss": 2.056626319885254,
+    "diagonal": 2.000075578689575,
+    "finite": 0.05655064061284065
+  },
+  {
+    "step": 783,
+    "loss": 1.9785822629928589,
+    "diagonal": 1.9290359020233154,
+    "finite": 0.04954640567302704
+  },
+  {
+    "step": 784,
+    "loss": 1.5162094831466675,
+    "diagonal": 1.45274817943573,
+    "finite": 0.06346134096384048
+  },
+  {
+    "step": 785,
+    "loss": 2.193033218383789,
+    "diagonal": 2.1521835327148438,
+    "finite": 0.040849730372428894
+  },
+  {
+    "step": 786,
+    "loss": 2.5580344200134277,
+    "diagonal": 2.5037784576416016,
+    "finite": 0.0542558915913105
+  },
+  {
+    "step": 787,
+    "loss": 2.569559097290039,
+    "diagonal": 2.5380892753601074,
+    "finite": 0.03146990388631821
+  },
+  {
+    "step": 788,
+    "loss": 1.92840576171875,
+    "diagonal": 1.8860032558441162,
+    "finite": 0.04240255430340767
+  },
+  {
+    "step": 789,
+    "loss": 1.7638217210769653,
+    "diagonal": 1.715071201324463,
+    "finite": 0.04875052720308304
+  },
+  {
+    "step": 790,
+    "loss": 2.4036781787872314,
+    "diagonal": 2.364942789077759,
+    "finite": 0.03873547166585922
+  },
+  {
+    "step": 791,
+    "loss": 2.5134963989257812,
+    "diagonal": 2.47769832611084,
+    "finite": 0.03579803183674812
+  },
+  {
+    "step": 792,
+    "loss": 2.2977170944213867,
+    "diagonal": 2.245880603790283,
+    "finite": 0.05183650180697441
+  },
+  {
+    "step": 793,
+    "loss": 1.7576402425765991,
+    "diagonal": 1.7246218919754028,
+    "finite": 0.033018339425325394
+  },
+  {
+    "step": 794,
+    "loss": 2.1633169651031494,
+    "diagonal": 2.1367928981781006,
+    "finite": 0.026523975655436516
+  },
+  {
+    "step": 795,
+    "loss": 2.1260178089141846,
+    "diagonal": 2.0806174278259277,
+    "finite": 0.04540042206645012
+  },
+  {
+    "step": 796,
+    "loss": 2.3186240196228027,
+    "diagonal": 2.2879605293273926,
+    "finite": 0.030663587152957916
+  },
+  {
+    "step": 797,
+    "loss": 2.3946726322174072,
+    "diagonal": 2.360192060470581,
+    "finite": 0.03448051959276199
+  },
+  {
+    "step": 798,
+    "loss": 2.021979808807373,
+    "diagonal": 1.9854304790496826,
+    "finite": 0.03654929995536804
+  },
+  {
+    "step": 799,
+    "loss": 2.067072629928589,
+    "diagonal": 2.033816337585449,
+    "finite": 0.03325621411204338
+  },
+  {
+    "step": 800,
+    "loss": 1.7639278173446655,
+    "diagonal": 1.72216796875,
+    "finite": 0.04175988584756851
+  },
+  {
+    "step": 801,
+    "loss": 1.6283445358276367,
+    "diagonal": 1.5950826406478882,
+    "finite": 0.03326188027858734
+  },
+  {
+    "step": 802,
+    "loss": 2.2056939601898193,
+    "diagonal": 2.1701722145080566,
+    "finite": 0.035521648824214935
+  },
+  {
+    "step": 803,
+    "loss": 1.9867664575576782,
+    "diagonal": 1.936828374862671,
+    "finite": 0.049938034266233444
+  },
+  {
+    "step": 804,
+    "loss": 2.296811819076538,
+    "diagonal": 2.2444233894348145,
+    "finite": 0.052388329058885574
+  },
+  {
+    "step": 805,
+    "loss": 2.333390235900879,
+    "diagonal": 2.2843215465545654,
+    "finite": 0.04906872659921646
+  },
+  {
+    "step": 806,
+    "loss": 2.403637170791626,
+    "diagonal": 2.3233730792999268,
+    "finite": 0.08026402443647385
+  },
+  {
+    "step": 807,
+    "loss": 2.0993850231170654,
+    "diagonal": 2.0425918102264404,
+    "finite": 0.05679325759410858
+  },
+  {
+    "step": 808,
+    "loss": 1.823809266090393,
+    "diagonal": 1.775665044784546,
+    "finite": 0.04814426600933075
+  },
+  {
+    "step": 809,
+    "loss": 2.568601131439209,
+    "diagonal": 2.510359048843384,
+    "finite": 0.05824219435453415
+  },
+  {
+    "step": 810,
+    "loss": 2.369368076324463,
+    "diagonal": 2.2966389656066895,
+    "finite": 0.07272904366254807
+  },
+  {
+    "step": 811,
+    "loss": 1.7585842609405518,
+    "diagonal": 1.7173641920089722,
+    "finite": 0.04122012108564377
+  },
+  {
+    "step": 812,
+    "loss": 1.6316289901733398,
+    "diagonal": 1.5317409038543701,
+    "finite": 0.0998881459236145
+  },
+  {
+    "step": 813,
+    "loss": 2.1256492137908936,
+    "diagonal": 2.0588512420654297,
+    "finite": 0.06679806113243103
+  },
+  {
+    "step": 814,
+    "loss": 2.2211015224456787,
+    "diagonal": 2.165048599243164,
+    "finite": 0.056052833795547485
+  },
+  {
+    "step": 815,
+    "loss": 2.533519744873047,
+    "diagonal": 2.4845240116119385,
+    "finite": 0.04899575561285019
+  },
+  {
+    "step": 816,
+    "loss": 1.9657962322235107,
+    "diagonal": 1.914450764656067,
+    "finite": 0.05134541541337967
+  },
+  {
+    "step": 817,
+    "loss": 2.115186929702759,
+    "diagonal": 2.0522148609161377,
+    "finite": 0.06297196447849274
+  },
+  {
+    "step": 818,
+    "loss": 1.6615643501281738,
+    "diagonal": 1.602018117904663,
+    "finite": 0.059546273201704025
+  },
+  {
+    "step": 819,
+    "loss": 2.087967872619629,
+    "diagonal": 2.0043044090270996,
+    "finite": 0.08366337418556213
+  },
+  {
+    "step": 820,
+    "loss": 1.7274675369262695,
+    "diagonal": 1.6591222286224365,
+    "finite": 0.06834529340267181
+  },
+  {
+    "step": 821,
+    "loss": 1.8611596822738647,
+    "diagonal": 1.7784340381622314,
+    "finite": 0.08272566646337509
+  },
+  {
+    "step": 822,
+    "loss": 2.1739306449890137,
+    "diagonal": 2.103410482406616,
+    "finite": 0.07052010297775269
+  },
+  {
+    "step": 823,
+    "loss": 2.0891976356506348,
+    "diagonal": 2.0190963745117188,
+    "finite": 0.07010118663311005
+  },
+  {
+    "step": 824,
+    "loss": 2.056467056274414,
+    "diagonal": 2.002284049987793,
+    "finite": 0.05418308824300766
+  },
+  {
+    "step": 825,
+    "loss": 2.236690044403076,
+    "diagonal": 2.195993661880493,
+    "finite": 0.040696315467357635
+  },
+  {
+    "step": 826,
+    "loss": 2.2527291774749756,
+    "diagonal": 2.19553279876709,
+    "finite": 0.05719633400440216
+  },
+  {
+    "step": 827,
+    "loss": 2.314230442047119,
+    "diagonal": 2.267073392868042,
+    "finite": 0.04715697839856148
+  },
+  {
+    "step": 828,
+    "loss": 2.3331925868988037,
+    "diagonal": 2.284895896911621,
+    "finite": 0.048296719789505005
+  },
+  {
+    "step": 829,
+    "loss": 1.8327240943908691,
+    "diagonal": 1.7771358489990234,
+    "finite": 0.05558820068836212
+  },
+  {
+    "step": 830,
+    "loss": 2.183393955230713,
+    "diagonal": 2.1120400428771973,
+    "finite": 0.07135381549596786
+  },
+  {
+    "step": 831,
+    "loss": 1.7880961894989014,
+    "diagonal": 1.7403548955917358,
+    "finite": 0.04774124175310135
+  },
+  {
+    "step": 832,
+    "loss": 1.9284638166427612,
+    "diagonal": 1.8706920146942139,
+    "finite": 0.057771746069192886
+  },
+  {
+    "step": 833,
+    "loss": 2.104895830154419,
+    "diagonal": 2.015113353729248,
+    "finite": 0.0897824615240097
+  },
+  {
+    "step": 834,
+    "loss": 1.6601474285125732,
+    "diagonal": 1.5923492908477783,
+    "finite": 0.06779810786247253
+  },
+  {
+    "step": 835,
+    "loss": 2.5744705200195312,
+    "diagonal": 2.5037221908569336,
+    "finite": 0.07074841111898422
+  },
+  {
+    "step": 836,
+    "loss": 1.2254160642623901,
+    "diagonal": 1.1753121614456177,
+    "finite": 0.05010392516851425
+  },
+  {
+    "step": 837,
+    "loss": 2.2417330741882324,
+    "diagonal": 2.1863608360290527,
+    "finite": 0.055372126400470734
+  },
+  {
+    "step": 838,
+    "loss": 1.991715669631958,
+    "diagonal": 1.9519741535186768,
+    "finite": 0.039741575717926025
+  },
+  {
+    "step": 839,
+    "loss": 2.1758978366851807,
+    "diagonal": 2.11296010017395,
+    "finite": 0.06293770670890808
+  },
+  {
+    "step": 840,
+    "loss": 1.556110143661499,
+    "diagonal": 1.5023653507232666,
+    "finite": 0.053744837641716
+  },
+  {
+    "step": 841,
+    "loss": 2.103342294692993,
+    "diagonal": 2.051632881164551,
+    "finite": 0.051709480583667755
+  },
+  {
+    "step": 842,
+    "loss": 1.6103078126907349,
+    "diagonal": 1.5634808540344238,
+    "finite": 0.04682699590921402
+  },
+  {
+    "step": 843,
+    "loss": 2.1554055213928223,
+    "diagonal": 2.1026556491851807,
+    "finite": 0.05274979770183563
+  },
+  {
+    "step": 844,
+    "loss": 2.41693377494812,
+    "diagonal": 2.3657078742980957,
+    "finite": 0.051225967705249786
+  },
+  {
+    "step": 845,
+    "loss": 1.995084285736084,
+    "diagonal": 1.953226089477539,
+    "finite": 0.0418582446873188
+  },
+  {
+    "step": 846,
+    "loss": 1.6667633056640625,
+    "diagonal": 1.6219651699066162,
+    "finite": 0.0447981134057045
+  },
+  {
+    "step": 847,
+    "loss": 2.084743022918701,
+    "diagonal": 2.0058705806732178,
+    "finite": 0.07887254655361176
+  },
+  {
+    "step": 848,
+    "loss": 2.518460988998413,
+    "diagonal": 2.476752996444702,
+    "finite": 0.041708096861839294
+  },
+  {
+    "step": 849,
+    "loss": 2.1768364906311035,
+    "diagonal": 2.1208786964416504,
+    "finite": 0.05595780536532402
+  },
+  {
+    "step": 850,
+    "loss": 1.9975439310073853,
+    "diagonal": 1.9602071046829224,
+    "finite": 0.03733685240149498
+  },
+  {
+    "step": 851,
+    "loss": 2.1355020999908447,
+    "diagonal": 2.067836046218872,
+    "finite": 0.06766609102487564
+  },
+  {
+    "step": 852,
+    "loss": 2.2585525512695312,
+    "diagonal": 2.215183973312378,
+    "finite": 0.043368540704250336
+  },
+  {
+    "step": 853,
+    "loss": 2.3395092487335205,
+    "diagonal": 2.2927308082580566,
+    "finite": 0.04677853360772133
+  },
+  {
+    "step": 854,
+    "loss": 2.2419211864471436,
+    "diagonal": 2.2110135555267334,
+    "finite": 0.030907541513442993
+  },
+  {
+    "step": 855,
+    "loss": 2.2199151515960693,
+    "diagonal": 2.152456760406494,
+    "finite": 0.06745840609073639
+  },
+  {
+    "step": 856,
+    "loss": 2.141004800796509,
+    "diagonal": 2.103973865509033,
+    "finite": 0.03703096881508827
+  },
+  {
+    "step": 857,
+    "loss": 2.237532377243042,
+    "diagonal": 2.2096364498138428,
+    "finite": 0.02789590321481228
+  },
+  {
+    "step": 858,
+    "loss": 2.4186348915100098,
+    "diagonal": 2.3880248069763184,
+    "finite": 0.030610140413045883
+  },
+  {
+    "step": 859,
+    "loss": 2.281348466873169,
+    "diagonal": 2.2084426879882812,
+    "finite": 0.07290583848953247
+  },
+  {
+    "step": 860,
+    "loss": 1.533408522605896,
+    "diagonal": 1.4787794351577759,
+    "finite": 0.05462906137108803
+  },
+  {
+    "step": 861,
+    "loss": 1.8395110368728638,
+    "diagonal": 1.8136193752288818,
+    "finite": 0.025891626253724098
+  },
+  {
+    "step": 862,
+    "loss": 1.7037376165390015,
+    "diagonal": 1.6560180187225342,
+    "finite": 0.047719646245241165
+  },
+  {
+    "step": 863,
+    "loss": 1.973183512687683,
+    "diagonal": 1.9137475490570068,
+    "finite": 0.059435997158288956
+  },
+  {
+    "step": 864,
+    "loss": 2.5979228019714355,
+    "diagonal": 2.5414931774139404,
+    "finite": 0.056429676711559296
+  },
+  {
+    "step": 865,
+    "loss": 2.071446418762207,
+    "diagonal": 2.011157989501953,
+    "finite": 0.06028846278786659
+  },
+  {
+    "step": 866,
+    "loss": 1.6318223476409912,
+    "diagonal": 1.5557360649108887,
+    "finite": 0.07608625292778015
+  },
+  {
+    "step": 867,
+    "loss": 2.0365188121795654,
+    "diagonal": 1.9516099691390991,
+    "finite": 0.08490881323814392
+  },
+  {
+    "step": 868,
+    "loss": 2.3958847522735596,
+    "diagonal": 2.3351213932037354,
+    "finite": 0.06076332926750183
+  },
+  {
+    "step": 869,
+    "loss": 2.148425340652466,
+    "diagonal": 2.079322338104248,
+    "finite": 0.06910296529531479
+  },
+  {
+    "step": 870,
+    "loss": 2.1131365299224854,
+    "diagonal": 2.056199073791504,
+    "finite": 0.05693738907575607
+  },
+  {
+    "step": 871,
+    "loss": 1.5813747644424438,
+    "diagonal": 1.5282018184661865,
+    "finite": 0.053172964602708817
+  },
+  {
+    "step": 872,
+    "loss": 1.5193061828613281,
+    "diagonal": 1.4576528072357178,
+    "finite": 0.06165338307619095
+  },
+  {
+    "step": 873,
+    "loss": 2.13855242729187,
+    "diagonal": 2.0842342376708984,
+    "finite": 0.054318275302648544
+  },
+  {
+    "step": 874,
+    "loss": 2.167640209197998,
+    "diagonal": 2.1121859550476074,
+    "finite": 0.055454153567552567
+  },
+  {
+    "step": 875,
+    "loss": 2.390652656555176,
+    "diagonal": 2.2960243225097656,
+    "finite": 0.094628244638443
+  },
+  {
+    "step": 876,
+    "loss": 1.8139512538909912,
+    "diagonal": 1.7613273859024048,
+    "finite": 0.05262380838394165
+  },
+  {
+    "step": 877,
+    "loss": 2.3712594509124756,
+    "diagonal": 2.307163715362549,
+    "finite": 0.06409582495689392
+  },
+  {
+    "step": 878,
+    "loss": 2.001734495162964,
+    "diagonal": 1.9534659385681152,
+    "finite": 0.0482686311006546
+  },
+  {
+    "step": 879,
+    "loss": 1.8908835649490356,
+    "diagonal": 1.8307067155838013,
+    "finite": 0.06017681956291199
+  },
+  {
+    "step": 880,
+    "loss": 2.165896415710449,
+    "diagonal": 2.12570858001709,
+    "finite": 0.04018792510032654
+  },
+  {
+    "step": 881,
+    "loss": 2.330148458480835,
+    "diagonal": 2.2867660522460938,
+    "finite": 0.04338231682777405
+  },
+  {
+    "step": 882,
+    "loss": 1.7441306114196777,
+    "diagonal": 1.7029248476028442,
+    "finite": 0.04120581969618797
+  },
+  {
+    "step": 883,
+    "loss": 2.614267110824585,
+    "diagonal": 2.571608304977417,
+    "finite": 0.04265889525413513
+  },
+  {
+    "step": 884,
+    "loss": 2.51762056350708,
+    "diagonal": 2.471360445022583,
+    "finite": 0.04626002907752991
+  },
+  {
+    "step": 885,
+    "loss": 2.077270269393921,
+    "diagonal": 1.996449589729309,
+    "finite": 0.08082060515880585
+  },
+  {
+    "step": 886,
+    "loss": 2.3320679664611816,
+    "diagonal": 2.2911770343780518,
+    "finite": 0.040890831500291824
+  },
+  {
+    "step": 887,
+    "loss": 2.1241445541381836,
+    "diagonal": 2.0718636512756348,
+    "finite": 0.052280932664871216
+  },
+  {
+    "step": 888,
+    "loss": 2.881351947784424,
+    "diagonal": 2.8362882137298584,
+    "finite": 0.04506383836269379
+  },
+  {
+    "step": 889,
+    "loss": 1.9386804103851318,
+    "diagonal": 1.8902267217636108,
+    "finite": 0.04845370352268219
+  },
+  {
+    "step": 890,
+    "loss": 1.6985012292861938,
+    "diagonal": 1.6431190967559814,
+    "finite": 0.055382125079631805
+  },
+  {
+    "step": 891,
+    "loss": 1.9838731288909912,
+    "diagonal": 1.9364068508148193,
+    "finite": 0.047466255724430084
+  },
+  {
+    "step": 892,
+    "loss": 2.009268045425415,
+    "diagonal": 1.9632909297943115,
+    "finite": 0.04597700759768486
+  },
+  {
+    "step": 893,
+    "loss": 1.9568157196044922,
+    "diagonal": 1.8979384899139404,
+    "finite": 0.05887720733880997
+  },
+  {
+    "step": 894,
+    "loss": 2.1238455772399902,
+    "diagonal": 2.079897403717041,
+    "finite": 0.04394828528165817
+  },
+  {
+    "step": 895,
+    "loss": 1.7922004461288452,
+    "diagonal": 1.7518317699432373,
+    "finite": 0.040368642657995224
+  },
+  {
+    "step": 896,
+    "loss": 1.7507073879241943,
+    "diagonal": 1.7060810327529907,
+    "finite": 0.04462632164359093
+  },
+  {
+    "step": 897,
+    "loss": 2.239956855773926,
+    "diagonal": 2.1663625240325928,
+    "finite": 0.07359431684017181
+  },
+  {
+    "step": 898,
+    "loss": 2.0284483432769775,
+    "diagonal": 1.9947900772094727,
+    "finite": 0.03365827724337578
+  },
+  {
+    "step": 899,
+    "loss": 1.961297869682312,
+    "diagonal": 1.9328598976135254,
+    "finite": 0.028437916189432144
+  },
+  {
+    "step": 900,
+    "loss": 1.985425591468811,
+    "diagonal": 1.9453667402267456,
+    "finite": 0.04005889222025871
+  },
+  {
+    "step": 901,
+    "loss": 2.3426945209503174,
+    "diagonal": 2.2965822219848633,
+    "finite": 0.0461122952401638
+  },
+  {
+    "step": 902,
+    "loss": 2.2284035682678223,
+    "diagonal": 2.1851272583007812,
+    "finite": 0.043276406824588776
+  },
+  {
+    "step": 903,
+    "loss": 2.0432074069976807,
+    "diagonal": 2.0009734630584717,
+    "finite": 0.04223383218050003
+  },
+  {
+    "step": 904,
+    "loss": 1.4831547737121582,
+    "diagonal": 1.4359146356582642,
+    "finite": 0.04724010452628136
+  },
+  {
+    "step": 905,
+    "loss": 1.5357306003570557,
+    "diagonal": 1.482252597808838,
+    "finite": 0.05347798764705658
+  },
+  {
+    "step": 906,
+    "loss": 1.9687179327011108,
+    "diagonal": 1.9216458797454834,
+    "finite": 0.047072071582078934
+  },
+  {
+    "step": 907,
+    "loss": 1.4817208051681519,
+    "diagonal": 1.4239546060562134,
+    "finite": 0.05776619538664818
+  },
+  {
+    "step": 908,
+    "loss": 1.8322944641113281,
+    "diagonal": 1.7722939252853394,
+    "finite": 0.060000523924827576
+  },
+  {
+    "step": 909,
+    "loss": 1.8961821794509888,
+    "diagonal": 1.8319727182388306,
+    "finite": 0.06420949101448059
+  },
+  {
+    "step": 910,
+    "loss": 1.4364880323410034,
+    "diagonal": 1.3898054361343384,
+    "finite": 0.04668261110782623
+  },
+  {
+    "step": 911,
+    "loss": 1.8939545154571533,
+    "diagonal": 1.8367465734481812,
+    "finite": 0.05720791220664978
+  },
+  {
+    "step": 912,
+    "loss": 2.5309505462646484,
+    "diagonal": 2.444819211959839,
+    "finite": 0.08613137900829315
+  },
+  {
+    "step": 913,
+    "loss": 2.076979160308838,
+    "diagonal": 1.9989862442016602,
+    "finite": 0.07799295336008072
+  },
+  {
+    "step": 914,
+    "loss": 1.914280891418457,
+    "diagonal": 1.872096061706543,
+    "finite": 0.04218478128314018
+  },
+  {
+    "step": 915,
+    "loss": 1.598608374595642,
+    "diagonal": 1.555818796157837,
+    "finite": 0.04278960078954697
+  },
+  {
+    "step": 916,
+    "loss": 2.6360085010528564,
+    "diagonal": 2.5933709144592285,
+    "finite": 0.042637646198272705
+  },
+  {
+    "step": 917,
+    "loss": 2.3041021823883057,
+    "diagonal": 2.2531847953796387,
+    "finite": 0.05091738700866699
+  },
+  {
+    "step": 918,
+    "loss": 2.143184185028076,
+    "diagonal": 2.1028542518615723,
+    "finite": 0.040329985320568085
+  },
+  {
+    "step": 919,
+    "loss": 1.9853991270065308,
+    "diagonal": 1.9490090608596802,
+    "finite": 0.03639006242156029
+  },
+  {
+    "step": 920,
+    "loss": 2.005388021469116,
+    "diagonal": 1.9689841270446777,
+    "finite": 0.03640388324856758
+  },
+  {
+    "step": 921,
+    "loss": 2.4116923809051514,
+    "diagonal": 2.359614133834839,
+    "finite": 0.05207829177379608
+  },
+  {
+    "step": 922,
+    "loss": 2.0051474571228027,
+    "diagonal": 1.9644185304641724,
+    "finite": 0.040728967636823654
+  },
+  {
+    "step": 923,
+    "loss": 2.1185555458068848,
+    "diagonal": 2.074949264526367,
+    "finite": 0.04360640048980713
+  },
+  {
+    "step": 924,
+    "loss": 2.104220151901245,
+    "diagonal": 2.056058645248413,
+    "finite": 0.0481615774333477
+  },
+  {
+    "step": 925,
+    "loss": 2.0186543464660645,
+    "diagonal": 1.9686203002929688,
+    "finite": 0.05003412067890167
+  },
+  {
+    "step": 926,
+    "loss": 2.13066029548645,
+    "diagonal": 2.073607921600342,
+    "finite": 0.05705247074365616
+  },
+  {
+    "step": 927,
+    "loss": 1.6839812994003296,
+    "diagonal": 1.625462293624878,
+    "finite": 0.058518994599580765
+  },
+  {
+    "step": 928,
+    "loss": 1.7048689126968384,
+    "diagonal": 1.6620597839355469,
+    "finite": 0.04280909150838852
+  },
+  {
+    "step": 929,
+    "loss": 1.7665808200836182,
+    "diagonal": 1.693415880203247,
+    "finite": 0.0731649100780487
+  },
+  {
+    "step": 930,
+    "loss": 1.7615021467208862,
+    "diagonal": 1.7040038108825684,
+    "finite": 0.057498324662446976
+  },
+  {
+    "step": 931,
+    "loss": 2.2764041423797607,
+    "diagonal": 2.2268104553222656,
+    "finite": 0.04959360510110855
+  },
+  {
+    "step": 932,
+    "loss": 2.3506405353546143,
+    "diagonal": 2.3224196434020996,
+    "finite": 0.028220899403095245
+  },
+  {
+    "step": 933,
+    "loss": 2.035766839981079,
+    "diagonal": 1.97406005859375,
+    "finite": 0.06170685589313507
+  },
+  {
+    "step": 934,
+    "loss": 2.5750787258148193,
+    "diagonal": 2.523759365081787,
+    "finite": 0.05131933465600014
+  },
+  {
+    "step": 935,
+    "loss": 2.5212290287017822,
+    "diagonal": 2.4710307121276855,
+    "finite": 0.05019843205809593
+  },
+  {
+    "step": 936,
+    "loss": 1.8732658624649048,
+    "diagonal": 1.7966725826263428,
+    "finite": 0.07659328728914261
+  },
+  {
+    "step": 937,
+    "loss": 1.964648962020874,
+    "diagonal": 1.9159798622131348,
+    "finite": 0.048669084906578064
+  },
+  {
+    "step": 938,
+    "loss": 2.3258585929870605,
+    "diagonal": 2.2906904220581055,
+    "finite": 0.03516819328069687
+  },
+  {
+    "step": 939,
+    "loss": 1.4931163787841797,
+    "diagonal": 1.4539703130722046,
+    "finite": 0.03914602845907211
+  },
+  {
+    "step": 940,
+    "loss": 2.2279105186462402,
+    "diagonal": 2.16933536529541,
+    "finite": 0.0585751011967659
+  },
+  {
+    "step": 941,
+    "loss": 1.8641899824142456,
+    "diagonal": 1.807294249534607,
+    "finite": 0.05689571052789688
+  },
+  {
+    "step": 942,
+    "loss": 2.1472835540771484,
+    "diagonal": 2.0670223236083984,
+    "finite": 0.08026126772165298
+  },
+  {
+    "step": 943,
+    "loss": 2.7535386085510254,
+    "diagonal": 2.702892541885376,
+    "finite": 0.05064603313803673
+  },
+  {
+    "step": 944,
+    "loss": 2.0212368965148926,
+    "diagonal": 1.9644675254821777,
+    "finite": 0.056769464164972305
+  },
+  {
+    "step": 945,
+    "loss": 1.7912795543670654,
+    "diagonal": 1.7395697832107544,
+    "finite": 0.051709771156311035
+  },
+  {
+    "step": 946,
+    "loss": 1.419940710067749,
+    "diagonal": 1.3660889863967896,
+    "finite": 0.053851742297410965
+  },
+  {
+    "step": 947,
+    "loss": 2.2687299251556396,
+    "diagonal": 2.2057597637176514,
+    "finite": 0.06297014653682709
+  },
+  {
+    "step": 948,
+    "loss": 1.9063587188720703,
+    "diagonal": 1.8268704414367676,
+    "finite": 0.07948829978704453
+  },
+  {
+    "step": 949,
+    "loss": 1.7419480085372925,
+    "diagonal": 1.6941381692886353,
+    "finite": 0.04780981317162514
+  },
+  {
+    "step": 950,
+    "loss": 1.8472212553024292,
+    "diagonal": 1.8022736310958862,
+    "finite": 0.04494762048125267
+  },
+  {
+    "step": 951,
+    "loss": 2.042048454284668,
+    "diagonal": 1.9987711906433105,
+    "finite": 0.04327728599309921
+  },
+  {
+    "step": 952,
+    "loss": 1.8484002351760864,
+    "diagonal": 1.7985408306121826,
+    "finite": 0.04985935986042023
+  },
+  {
+    "step": 953,
+    "loss": 2.471714973449707,
+    "diagonal": 2.4242489337921143,
+    "finite": 0.047466062009334564
+  },
+  {
+    "step": 954,
+    "loss": 2.286228895187378,
+    "diagonal": 2.23089861869812,
+    "finite": 0.055330321192741394
+  },
+  {
+    "step": 955,
+    "loss": 2.4327290058135986,
+    "diagonal": 2.394334316253662,
+    "finite": 0.038394585251808167
+  },
+  {
+    "step": 956,
+    "loss": 1.5948901176452637,
+    "diagonal": 1.5517630577087402,
+    "finite": 0.04312705993652344
+  },
+  {
+    "step": 957,
+    "loss": 2.6337907314300537,
+    "diagonal": 2.58539080619812,
+    "finite": 0.048399921506643295
+  },
+  {
+    "step": 958,
+    "loss": 2.04270076751709,
+    "diagonal": 1.996824026107788,
+    "finite": 0.04587680473923683
+  },
+  {
+    "step": 959,
+    "loss": 2.0994303226470947,
+    "diagonal": 2.0354580879211426,
+    "finite": 0.06397213041782379
+  },
+  {
+    "step": 960,
+    "loss": 2.1316769123077393,
+    "diagonal": 2.0900769233703613,
+    "finite": 0.04159997031092644
+  },
+  {
+    "step": 961,
+    "loss": 1.766005516052246,
+    "diagonal": 1.7166340351104736,
+    "finite": 0.04937151446938515
+  },
+  {
+    "step": 962,
+    "loss": 2.296044111251831,
+    "diagonal": 2.2510039806365967,
+    "finite": 0.04504024609923363
+  },
+  {
+    "step": 963,
+    "loss": 2.0556492805480957,
+    "diagonal": 1.998319149017334,
+    "finite": 0.05733012408018112
+  },
+  {
+    "step": 964,
+    "loss": 2.350226402282715,
+    "diagonal": 2.313349723815918,
+    "finite": 0.03687656670808792
+  },
+  {
+    "step": 965,
+    "loss": 1.6123497486114502,
+    "diagonal": 1.572828769683838,
+    "finite": 0.0395209938287735
+  },
+  {
+    "step": 966,
+    "loss": 1.9917035102844238,
+    "diagonal": 1.9602328538894653,
+    "finite": 0.031470634043216705
+  },
+  {
+    "step": 967,
+    "loss": 1.7086231708526611,
+    "diagonal": 1.6643332242965698,
+    "finite": 0.04428999125957489
+  },
+  {
+    "step": 968,
+    "loss": 2.369121551513672,
+    "diagonal": 2.3164265155792236,
+    "finite": 0.052694980055093765
+  },
+  {
+    "step": 969,
+    "loss": 2.3115739822387695,
+    "diagonal": 2.260310649871826,
+    "finite": 0.05126337334513664
+  },
+  {
+    "step": 970,
+    "loss": 2.367105722427368,
+    "diagonal": 2.328659772872925,
+    "finite": 0.038445886224508286
+  },
+  {
+    "step": 971,
+    "loss": 2.3628578186035156,
+    "diagonal": 2.31585431098938,
+    "finite": 0.04700344055891037
+  },
+  {
+    "step": 972,
+    "loss": 1.6768020391464233,
+    "diagonal": 1.6079872846603394,
+    "finite": 0.06881476193666458
+  },
+  {
+    "step": 973,
+    "loss": 1.6087744235992432,
+    "diagonal": 1.545899510383606,
+    "finite": 0.06287488341331482
+  },
+  {
+    "step": 974,
+    "loss": 1.850475788116455,
+    "diagonal": 1.805955410003662,
+    "finite": 0.04452035576105118
+  },
+  {
+    "step": 975,
+    "loss": 2.0410358905792236,
+    "diagonal": 1.9949700832366943,
+    "finite": 0.04606587067246437
+  },
+  {
+    "step": 976,
+    "loss": 2.099738597869873,
+    "diagonal": 2.0572071075439453,
+    "finite": 0.042531609535217285
+  },
+  {
+    "step": 977,
+    "loss": 2.0440804958343506,
+    "diagonal": 1.9935078620910645,
+    "finite": 0.05057262256741524
+  },
+  {
+    "step": 978,
+    "loss": 2.0720913410186768,
+    "diagonal": 2.017136573791504,
+    "finite": 0.054954882711172104
+  },
+  {
+    "step": 979,
+    "loss": 1.687121868133545,
+    "diagonal": 1.6168817281723022,
+    "finite": 0.07024016976356506
+  },
+  {
+    "step": 980,
+    "loss": 2.625727891921997,
+    "diagonal": 2.585383892059326,
+    "finite": 0.04034395515918732
+  },
+  {
+    "step": 981,
+    "loss": 2.273581027984619,
+    "diagonal": 2.220079183578491,
+    "finite": 0.05350177362561226
+  },
+  {
+    "step": 982,
+    "loss": 1.8602280616760254,
+    "diagonal": 1.7776107788085938,
+    "finite": 0.08261723816394806
+  },
+  {
+    "step": 983,
+    "loss": 1.9588569402694702,
+    "diagonal": 1.894892930984497,
+    "finite": 0.06396402418613434
+  },
+  {
+    "step": 984,
+    "loss": 2.3223695755004883,
+    "diagonal": 2.2756195068359375,
+    "finite": 0.04675016179680824
+  },
+  {
+    "step": 985,
+    "loss": 1.794877529144287,
+    "diagonal": 1.745927333831787,
+    "finite": 0.04895017296075821
+  },
+  {
+    "step": 986,
+    "loss": 1.8006892204284668,
+    "diagonal": 1.7436615228652954,
+    "finite": 0.057027656584978104
+  },
+  {
+    "step": 987,
+    "loss": 2.4946401119232178,
+    "diagonal": 2.448683500289917,
+    "finite": 0.04595668986439705
+  },
+  {
+    "step": 988,
+    "loss": 1.9358128309249878,
+    "diagonal": 1.8923882246017456,
+    "finite": 0.043424613773822784
+  },
+  {
+    "step": 989,
+    "loss": 2.0033960342407227,
+    "diagonal": 1.9541559219360352,
+    "finite": 0.04924002289772034
+  },
+  {
+    "step": 990,
+    "loss": 1.9277958869934082,
+    "diagonal": 1.873894214630127,
+    "finite": 0.05390161648392677
+  },
+  {
+    "step": 991,
+    "loss": 2.572530508041382,
+    "diagonal": 2.5374176502227783,
+    "finite": 0.03511296212673187
+  },
+  {
+    "step": 992,
+    "loss": 1.9156194925308228,
+    "diagonal": 1.8694241046905518,
+    "finite": 0.04619535058736801
+  },
+  {
+    "step": 993,
+    "loss": 1.794857382774353,
+    "diagonal": 1.7525004148483276,
+    "finite": 0.04235702380537987
+  },
+  {
+    "step": 994,
+    "loss": 1.393859624862671,
+    "diagonal": 1.3244857788085938,
+    "finite": 0.06937378644943237
+  },
+  {
+    "step": 995,
+    "loss": 1.723821997642517,
+    "diagonal": 1.6677685976028442,
+    "finite": 0.05605340749025345
+  },
+  {
+    "step": 996,
+    "loss": 2.3262064456939697,
+    "diagonal": 2.259247303009033,
+    "finite": 0.06695904582738876
+  },
+  {
+    "step": 997,
+    "loss": 1.936899185180664,
+    "diagonal": 1.8921095132827759,
+    "finite": 0.044789671897888184
+  },
+  {
+    "step": 998,
+    "loss": 1.8149305582046509,
+    "diagonal": 1.759136438369751,
+    "finite": 0.05579417198896408
+  },
+  {
+    "step": 999,
+    "loss": 2.2656426429748535,
+    "diagonal": 2.2178876399993896,
+    "finite": 0.047755107283592224
+  }
+]
diff --git a/lecture_6/verified_examples/fmm-eulerian/report.json b/lecture_6/verified_examples/fmm-eulerian/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..eca8590311822b53f0db40e91ebb648dc1e410e9
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-eulerian/report.json
@@ -0,0 +1,24 @@
+{
+  "method": "fmm-eulerian",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 1.9930766880512238,
+  "train_loss_last_20_mean": 2.0371171474456786,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "composition_rmse": 0.11971178650856018,
+  "finite_samples": true,
+  "mean_distance_to_center": 0.47431039810180664,
+  "mode_fractions": [
+    0.265625,
+    0.2421875,
+    0.25,
+    0.2421875
+  ],
+  "mode_entropy": 1.3855692148208618,
+  "mean_target_log_density": -3.866715431213379,
+  "elapsed_seconds": 5.261868300003698
+}
diff --git a/lecture_6/verified_examples/fmm-eulerian/samples.txt b/lecture_6/verified_examples/fmm-eulerian/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..f61e7a0b32464a65af30b10588909786e652234d
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-eulerian/samples.txt
@@ -0,0 +1,128 @@
+-1.3646473 1.6453974
+-1.5693790 1.5408229
+-1.7755380 -1.6750557
+-1.5442705 0.1581783
+0.9031482 -1.4994699
+-1.5114495 1.5690646
+1.5419362 -1.8791335
+-1.6483958 -1.8381560
+-1.5814039 -1.5625736
+1.3231920 1.6464790
+0.6416752 1.2941431
+1.6866206 -1.2349126
+1.6302056 0.8196216
+1.1080496 -0.3472358
+-1.4744625 -1.6230266
+1.6574860 -1.7633461
+1.4229062 1.4147508
+1.3074654 -1.8424792
+0.9750477 0.9899102
+1.4942000 -1.6654099
+-1.6138248 1.5833250
+-1.5436732 -1.2602286
+-1.6319299 -1.7706332
+-1.5348338 -1.7987690
+0.0793941 -1.7007062
+-1.6194069 0.8645565
+1.3131762 0.2603287
+-1.0464109 -1.7231753
+-1.6091341 1.3718840
+-1.0579611 -1.7676178
+-1.3414220 -1.4697986
+-1.9181337 -1.6353692
+-0.9619865 -1.9413916
+-1.5727093 -1.6535547
+1.6865449 1.5957866
+-0.2817801 -1.6002156
+1.6291937 1.3157988
+-0.3076163 1.6236393
+1.6511092 1.9830004
+1.5125484 -0.7508596
+0.6585701 1.4903327
+-1.6257954 -1.1032746
+-0.2987745 -1.4882758
+1.7598397 1.1561856
+-1.6172929 -1.6292634
+-0.9791926 1.4823478
+-1.4620528 -1.5237187
+1.5175856 -1.7444814
+1.5009094 1.7973523
+-1.5978416 1.2931747
+0.9554361 1.5272835
+0.3184995 -0.8509107
+1.2582620 -1.3479902
+1.2129036 1.4347801
+-0.7325113 1.6866194
+-1.7939012 1.3678670
+1.3418256 -1.3816297
+-0.6535361 1.2371116
+-1.6103957 -1.4422774
+-1.6452838 2.0740452
+-1.5870665 -0.8329399
+1.3722661 1.5796741
+0.8869680 1.4736264
+1.6347647 0.8394658
+1.7507353 -1.8137639
+1.5145504 -1.9956174
+0.2852065 -1.3524165
+1.6583719 -1.7156267
+-1.5586655 -1.6048220
+-1.6395468 -1.2137021
+1.5488628 1.2559700
+1.4972963 0.3866100
+0.3576303 -0.5640550
+-0.8460145 1.3126423
+1.5940022 1.5347216
+-0.2014559 -1.7491794
+1.4892846 -1.8308296
+1.6895657 -1.6619539
+1.5640463 1.4181544
+1.7459830 -1.5848701
+-1.2786781 1.6775494
+1.5429933 1.2238773
+1.4911745 1.7707536
+-1.4073923 2.2746661
+-1.3804253 -1.1747379
+-1.7003272 -1.2601312
+2.2419872 1.6564522
+-0.5599626 1.3396268
+-1.7416121 1.5881122
+-0.0948579 -0.6033155
+1.7913065 1.2623889
+-1.8286905 1.4723135
+1.9151443 -1.8043537
+1.4501076 1.4324769
+-1.6193360 0.9282537
+-1.2265301 1.3568572
+-0.7555472 1.2390883
+1.3785323 -1.6783662
+-1.5904689 -0.0887662
+1.2454959 -1.6618708
+-1.6759342 -1.6023284
+-1.5502696 1.0923321
+-1.1429182 1.6304214
+-1.7556082 -1.4059281
+-1.6146060 -1.7412596
+-1.6517823 1.5198083
+1.0503173 -1.7340689
+1.3351530 -1.7321110
+-1.9237195 -1.6726735
+-1.2976274 1.3926231
+-1.1611691 -1.6577489
+1.8068870 1.2053680
+1.1585534 1.0644622
+1.3228498 -1.7040849
+1.6651856 -1.6485567
+-1.4592652 -1.3309952
+1.5291314 1.7798661
+1.7755847 1.4726206
+1.3119552 -1.1620274
+-1.7161754 -1.6292337
+1.9272953 -1.7684478
+-1.7362442 0.5248759
+-1.6084423 1.4464617
+1.5940139 1.7340913
+1.3600054 -1.7130959
+-1.8942559 1.6082097
+-1.3783884 1.2418989
+1.6956950 -1.7509544
diff --git a/lecture_6/verified_examples/fmm-eulerian/teacher_losses.json b/lecture_6/verified_examples/fmm-eulerian/teacher_losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..3ff375a40b898f709a65c41934258725cfb7ef43
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-eulerian/teacher_losses.json
@@ -0,0 +1,4002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.901901960372925
+  },
+  {
+    "step": 1,
+    "loss": 4.030956745147705
+  },
+  {
+    "step": 2,
+    "loss": 3.7361669540405273
+  },
+  {
+    "step": 3,
+    "loss": 3.1736671924591064
+  },
+  {
+    "step": 4,
+    "loss": 3.2819948196411133
+  },
+  {
+    "step": 5,
+    "loss": 2.6870734691619873
+  },
+  {
+    "step": 6,
+    "loss": 3.2287180423736572
+  },
+  {
+    "step": 7,
+    "loss": 3.540705919265747
+  },
+  {
+    "step": 8,
+    "loss": 2.320319652557373
+  },
+  {
+    "step": 9,
+    "loss": 3.2631494998931885
+  },
+  {
+    "step": 10,
+    "loss": 3.2428276538848877
+  },
+  {
+    "step": 11,
+    "loss": 3.1067261695861816
+  },
+  {
+    "step": 12,
+    "loss": 2.9945061206817627
+  },
+  {
+    "step": 13,
+    "loss": 3.429009199142456
+  },
+  {
+    "step": 14,
+    "loss": 3.202871084213257
+  },
+  {
+    "step": 15,
+    "loss": 3.343949317932129
+  },
+  {
+    "step": 16,
+    "loss": 3.338503837585449
+  },
+  {
+    "step": 17,
+    "loss": 2.27468204498291
+  },
+  {
+    "step": 18,
+    "loss": 3.2059783935546875
+  },
+  {
+    "step": 19,
+    "loss": 3.2105021476745605
+  },
+  {
+    "step": 20,
+    "loss": 3.607123374938965
+  },
+  {
+    "step": 21,
+    "loss": 2.5147407054901123
+  },
+  {
+    "step": 22,
+    "loss": 2.4429540634155273
+  },
+  {
+    "step": 23,
+    "loss": 2.693626880645752
+  },
+  {
+    "step": 24,
+    "loss": 2.922039031982422
+  },
+  {
+    "step": 25,
+    "loss": 3.412623405456543
+  },
+  {
+    "step": 26,
+    "loss": 3.049421548843384
+  },
+  {
+    "step": 27,
+    "loss": 3.4507718086242676
+  },
+  {
+    "step": 28,
+    "loss": 3.2085723876953125
+  },
+  {
+    "step": 29,
+    "loss": 3.431762933731079
+  },
+  {
+    "step": 30,
+    "loss": 3.186777114868164
+  },
+  {
+    "step": 31,
+    "loss": 2.358400821685791
+  },
+  {
+    "step": 32,
+    "loss": 2.739171028137207
+  },
+  {
+    "step": 33,
+    "loss": 3.3288445472717285
+  },
+  {
+    "step": 34,
+    "loss": 2.9850246906280518
+  },
+  {
+    "step": 35,
+    "loss": 2.979214906692505
+  },
+  {
+    "step": 36,
+    "loss": 3.4282126426696777
+  },
+  {
+    "step": 37,
+    "loss": 2.3601138591766357
+  },
+  {
+    "step": 38,
+    "loss": 2.754340410232544
+  },
+  {
+    "step": 39,
+    "loss": 2.772657871246338
+  },
+  {
+    "step": 40,
+    "loss": 3.816230535507202
+  },
+  {
+    "step": 41,
+    "loss": 2.872300624847412
+  },
+  {
+    "step": 42,
+    "loss": 3.0081868171691895
+  },
+  {
+    "step": 43,
+    "loss": 2.6166443824768066
+  },
+  {
+    "step": 44,
+    "loss": 2.4548749923706055
+  },
+  {
+    "step": 45,
+    "loss": 2.7366158962249756
+  },
+  {
+    "step": 46,
+    "loss": 2.7148921489715576
+  },
+  {
+    "step": 47,
+    "loss": 2.800400972366333
+  },
+  {
+    "step": 48,
+    "loss": 2.9447460174560547
+  },
+  {
+    "step": 49,
+    "loss": 2.708866834640503
+  },
+  {
+    "step": 50,
+    "loss": 2.883293628692627
+  },
+  {
+    "step": 51,
+    "loss": 2.8611910343170166
+  },
+  {
+    "step": 52,
+    "loss": 2.477092742919922
+  },
+  {
+    "step": 53,
+    "loss": 2.551604986190796
+  },
+  {
+    "step": 54,
+    "loss": 2.338512897491455
+  },
+  {
+    "step": 55,
+    "loss": 3.476226329803467
+  },
+  {
+    "step": 56,
+    "loss": 2.717756509780884
+  },
+  {
+    "step": 57,
+    "loss": 2.5666332244873047
+  },
+  {
+    "step": 58,
+    "loss": 2.3942244052886963
+  },
+  {
+    "step": 59,
+    "loss": 2.3049826622009277
+  },
+  {
+    "step": 60,
+    "loss": 2.817511796951294
+  },
+  {
+    "step": 61,
+    "loss": 2.9381887912750244
+  },
+  {
+    "step": 62,
+    "loss": 3.0970544815063477
+  },
+  {
+    "step": 63,
+    "loss": 2.7542073726654053
+  },
+  {
+    "step": 64,
+    "loss": 2.95668625831604
+  },
+  {
+    "step": 65,
+    "loss": 3.3345565795898438
+  },
+  {
+    "step": 66,
+    "loss": 3.0203516483306885
+  },
+  {
+    "step": 67,
+    "loss": 3.0535619258880615
+  },
+  {
+    "step": 68,
+    "loss": 2.2485365867614746
+  },
+  {
+    "step": 69,
+    "loss": 3.313269853591919
+  },
+  {
+    "step": 70,
+    "loss": 3.151857614517212
+  },
+  {
+    "step": 71,
+    "loss": 3.3004636764526367
+  },
+  {
+    "step": 72,
+    "loss": 3.13859224319458
+  },
+  {
+    "step": 73,
+    "loss": 2.831691026687622
+  },
+  {
+    "step": 74,
+    "loss": 2.824505090713501
+  },
+  {
+    "step": 75,
+    "loss": 3.2724480628967285
+  },
+  {
+    "step": 76,
+    "loss": 3.3112194538116455
+  },
+  {
+    "step": 77,
+    "loss": 3.5525429248809814
+  },
+  {
+    "step": 78,
+    "loss": 3.02317214012146
+  },
+  {
+    "step": 79,
+    "loss": 2.3117425441741943
+  },
+  {
+    "step": 80,
+    "loss": 2.52921986579895
+  },
+  {
+    "step": 81,
+    "loss": 3.346832752227783
+  },
+  {
+    "step": 82,
+    "loss": 2.557271957397461
+  },
+  {
+    "step": 83,
+    "loss": 2.8063182830810547
+  },
+  {
+    "step": 84,
+    "loss": 3.1693220138549805
+  },
+  {
+    "step": 85,
+    "loss": 2.1511852741241455
+  },
+  {
+    "step": 86,
+    "loss": 2.3931725025177
+  },
+  {
+    "step": 87,
+    "loss": 2.7104268074035645
+  },
+  {
+    "step": 88,
+    "loss": 3.144993305206299
+  },
+  {
+    "step": 89,
+    "loss": 2.5371882915496826
+  },
+  {
+    "step": 90,
+    "loss": 2.635395050048828
+  },
+  {
+    "step": 91,
+    "loss": 2.9128007888793945
+  },
+  {
+    "step": 92,
+    "loss": 2.091165781021118
+  },
+  {
+    "step": 93,
+    "loss": 2.678255081176758
+  },
+  {
+    "step": 94,
+    "loss": 3.1458537578582764
+  },
+  {
+    "step": 95,
+    "loss": 3.0256667137145996
+  },
+  {
+    "step": 96,
+    "loss": 3.504319906234741
+  },
+  {
+    "step": 97,
+    "loss": 2.4840328693389893
+  },
+  {
+    "step": 98,
+    "loss": 3.156357765197754
+  },
+  {
+    "step": 99,
+    "loss": 2.409656047821045
+  },
+  {
+    "step": 100,
+    "loss": 2.607604503631592
+  },
+  {
+    "step": 101,
+    "loss": 3.1481847763061523
+  },
+  {
+    "step": 102,
+    "loss": 2.3221395015716553
+  },
+  {
+    "step": 103,
+    "loss": 2.7403645515441895
+  },
+  {
+    "step": 104,
+    "loss": 2.9177207946777344
+  },
+  {
+    "step": 105,
+    "loss": 3.1296420097351074
+  },
+  {
+    "step": 106,
+    "loss": 2.714864492416382
+  },
+  {
+    "step": 107,
+    "loss": 2.2136282920837402
+  },
+  {
+    "step": 108,
+    "loss": 3.0324344635009766
+  },
+  {
+    "step": 109,
+    "loss": 2.8028464317321777
+  },
+  {
+    "step": 110,
+    "loss": 3.500157356262207
+  },
+  {
+    "step": 111,
+    "loss": 3.659149646759033
+  },
+  {
+    "step": 112,
+    "loss": 2.6796770095825195
+  },
+  {
+    "step": 113,
+    "loss": 4.001369476318359
+  },
+  {
+    "step": 114,
+    "loss": 3.12492299079895
+  },
+  {
+    "step": 115,
+    "loss": 2.186939239501953
+  },
+  {
+    "step": 116,
+    "loss": 3.0609922409057617
+  },
+  {
+    "step": 117,
+    "loss": 2.7359426021575928
+  },
+  {
+    "step": 118,
+    "loss": 2.8246054649353027
+  },
+  {
+    "step": 119,
+    "loss": 2.0663673877716064
+  },
+  {
+    "step": 120,
+    "loss": 2.82535719871521
+  },
+  {
+    "step": 121,
+    "loss": 2.7651166915893555
+  },
+  {
+    "step": 122,
+    "loss": 2.3627724647521973
+  },
+  {
+    "step": 123,
+    "loss": 3.1746630668640137
+  },
+  {
+    "step": 124,
+    "loss": 2.2432596683502197
+  },
+  {
+    "step": 125,
+    "loss": 2.632728338241577
+  },
+  {
+    "step": 126,
+    "loss": 3.509660005569458
+  },
+  {
+    "step": 127,
+    "loss": 2.6030969619750977
+  },
+  {
+    "step": 128,
+    "loss": 2.819704532623291
+  },
+  {
+    "step": 129,
+    "loss": 2.7884159088134766
+  },
+  {
+    "step": 130,
+    "loss": 3.066481590270996
+  },
+  {
+    "step": 131,
+    "loss": 2.5375585556030273
+  },
+  {
+    "step": 132,
+    "loss": 2.6820192337036133
+  },
+  {
+    "step": 133,
+    "loss": 2.8677313327789307
+  },
+  {
+    "step": 134,
+    "loss": 3.295163631439209
+  },
+  {
+    "step": 135,
+    "loss": 3.008159637451172
+  },
+  {
+    "step": 136,
+    "loss": 2.6790380477905273
+  },
+  {
+    "step": 137,
+    "loss": 3.2993409633636475
+  },
+  {
+    "step": 138,
+    "loss": 2.3291473388671875
+  },
+  {
+    "step": 139,
+    "loss": 3.2662582397460938
+  },
+  {
+    "step": 140,
+    "loss": 3.1028847694396973
+  },
+  {
+    "step": 141,
+    "loss": 3.5241870880126953
+  },
+  {
+    "step": 142,
+    "loss": 2.6248207092285156
+  },
+  {
+    "step": 143,
+    "loss": 3.289806365966797
+  },
+  {
+    "step": 144,
+    "loss": 2.761228322982788
+  },
+  {
+    "step": 145,
+    "loss": 2.6195461750030518
+  },
+  {
+    "step": 146,
+    "loss": 3.2968337535858154
+  },
+  {
+    "step": 147,
+    "loss": 2.2302370071411133
+  },
+  {
+    "step": 148,
+    "loss": 2.7895140647888184
+  },
+  {
+    "step": 149,
+    "loss": 3.0598552227020264
+  },
+  {
+    "step": 150,
+    "loss": 2.991975784301758
+  },
+  {
+    "step": 151,
+    "loss": 2.758124589920044
+  },
+  {
+    "step": 152,
+    "loss": 2.8041367530822754
+  },
+  {
+    "step": 153,
+    "loss": 2.7885689735412598
+  },
+  {
+    "step": 154,
+    "loss": 2.642705202102661
+  },
+  {
+    "step": 155,
+    "loss": 3.208401679992676
+  },
+  {
+    "step": 156,
+    "loss": 2.890425205230713
+  },
+  {
+    "step": 157,
+    "loss": 3.0730347633361816
+  },
+  {
+    "step": 158,
+    "loss": 2.9297609329223633
+  },
+  {
+    "step": 159,
+    "loss": 3.1628060340881348
+  },
+  {
+    "step": 160,
+    "loss": 2.235241174697876
+  },
+  {
+    "step": 161,
+    "loss": 3.431405544281006
+  },
+  {
+    "step": 162,
+    "loss": 3.1083548069000244
+  },
+  {
+    "step": 163,
+    "loss": 2.592428207397461
+  },
+  {
+    "step": 164,
+    "loss": 2.538461923599243
+  },
+  {
+    "step": 165,
+    "loss": 2.8032314777374268
+  },
+  {
+    "step": 166,
+    "loss": 2.8171889781951904
+  },
+  {
+    "step": 167,
+    "loss": 2.857837677001953
+  },
+  {
+    "step": 168,
+    "loss": 2.95976185798645
+  },
+  {
+    "step": 169,
+    "loss": 2.500030994415283
+  },
+  {
+    "step": 170,
+    "loss": 2.632225513458252
+  },
+  {
+    "step": 171,
+    "loss": 2.696317672729492
+  },
+  {
+    "step": 172,
+    "loss": 2.671130657196045
+  },
+  {
+    "step": 173,
+    "loss": 3.2583823204040527
+  },
+  {
+    "step": 174,
+    "loss": 2.750561237335205
+  },
+  {
+    "step": 175,
+    "loss": 2.7291007041931152
+  },
+  {
+    "step": 176,
+    "loss": 2.5894086360931396
+  },
+  {
+    "step": 177,
+    "loss": 2.551658868789673
+  },
+  {
+    "step": 178,
+    "loss": 2.7688674926757812
+  },
+  {
+    "step": 179,
+    "loss": 2.5460314750671387
+  },
+  {
+    "step": 180,
+    "loss": 2.573371648788452
+  },
+  {
+    "step": 181,
+    "loss": 2.5819363594055176
+  },
+  {
+    "step": 182,
+    "loss": 2.7828993797302246
+  },
+  {
+    "step": 183,
+    "loss": 2.3213307857513428
+  },
+  {
+    "step": 184,
+    "loss": 2.626124382019043
+  },
+  {
+    "step": 185,
+    "loss": 2.0648884773254395
+  },
+  {
+    "step": 186,
+    "loss": 2.6399617195129395
+  },
+  {
+    "step": 187,
+    "loss": 2.4929964542388916
+  },
+  {
+    "step": 188,
+    "loss": 2.738865613937378
+  },
+  {
+    "step": 189,
+    "loss": 2.869166851043701
+  },
+  {
+    "step": 190,
+    "loss": 2.6773924827575684
+  },
+  {
+    "step": 191,
+    "loss": 3.207840919494629
+  },
+  {
+    "step": 192,
+    "loss": 2.593851327896118
+  },
+  {
+    "step": 193,
+    "loss": 3.145773410797119
+  },
+  {
+    "step": 194,
+    "loss": 2.6272592544555664
+  },
+  {
+    "step": 195,
+    "loss": 3.2182958126068115
+  },
+  {
+    "step": 196,
+    "loss": 2.6175713539123535
+  },
+  {
+    "step": 197,
+    "loss": 2.102283000946045
+  },
+  {
+    "step": 198,
+    "loss": 2.3725454807281494
+  },
+  {
+    "step": 199,
+    "loss": 2.310814142227173
+  },
+  {
+    "step": 200,
+    "loss": 2.554727077484131
+  },
+  {
+    "step": 201,
+    "loss": 2.290694236755371
+  },
+  {
+    "step": 202,
+    "loss": 2.0614757537841797
+  },
+  {
+    "step": 203,
+    "loss": 2.4946200847625732
+  },
+  {
+    "step": 204,
+    "loss": 3.1302361488342285
+  },
+  {
+    "step": 205,
+    "loss": 2.4278793334960938
+  },
+  {
+    "step": 206,
+    "loss": 2.7277281284332275
+  },
+  {
+    "step": 207,
+    "loss": 1.6022748947143555
+  },
+  {
+    "step": 208,
+    "loss": 2.2651426792144775
+  },
+  {
+    "step": 209,
+    "loss": 2.446990489959717
+  },
+  {
+    "step": 210,
+    "loss": 2.829681634902954
+  },
+  {
+    "step": 211,
+    "loss": 2.8909616470336914
+  },
+  {
+    "step": 212,
+    "loss": 2.6464128494262695
+  },
+  {
+    "step": 213,
+    "loss": 3.0840983390808105
+  },
+  {
+    "step": 214,
+    "loss": 2.442357063293457
+  },
+  {
+    "step": 215,
+    "loss": 3.077253580093384
+  },
+  {
+    "step": 216,
+    "loss": 3.0163815021514893
+  },
+  {
+    "step": 217,
+    "loss": 3.3182713985443115
+  },
+  {
+    "step": 218,
+    "loss": 2.6422321796417236
+  },
+  {
+    "step": 219,
+    "loss": 2.7757790088653564
+  },
+  {
+    "step": 220,
+    "loss": 2.817136287689209
+  },
+  {
+    "step": 221,
+    "loss": 2.7244391441345215
+  },
+  {
+    "step": 222,
+    "loss": 3.3463165760040283
+  },
+  {
+    "step": 223,
+    "loss": 2.5178160667419434
+  },
+  {
+    "step": 224,
+    "loss": 2.3083720207214355
+  },
+  {
+    "step": 225,
+    "loss": 2.6672210693359375
+  },
+  {
+    "step": 226,
+    "loss": 2.953312635421753
+  },
+  {
+    "step": 227,
+    "loss": 2.245347023010254
+  },
+  {
+    "step": 228,
+    "loss": 2.6127264499664307
+  },
+  {
+    "step": 229,
+    "loss": 2.3829171657562256
+  },
+  {
+    "step": 230,
+    "loss": 1.9589905738830566
+  },
+  {
+    "step": 231,
+    "loss": 2.7865824699401855
+  },
+  {
+    "step": 232,
+    "loss": 2.784212589263916
+  },
+  {
+    "step": 233,
+    "loss": 2.638892412185669
+  },
+  {
+    "step": 234,
+    "loss": 2.2629337310791016
+  },
+  {
+    "step": 235,
+    "loss": 2.3170275688171387
+  },
+  {
+    "step": 236,
+    "loss": 2.3931238651275635
+  },
+  {
+    "step": 237,
+    "loss": 2.5577549934387207
+  },
+  {
+    "step": 238,
+    "loss": 2.67926025390625
+  },
+  {
+    "step": 239,
+    "loss": 2.399914026260376
+  },
+  {
+    "step": 240,
+    "loss": 2.719255208969116
+  },
+  {
+    "step": 241,
+    "loss": 2.645662784576416
+  },
+  {
+    "step": 242,
+    "loss": 2.1666066646575928
+  },
+  {
+    "step": 243,
+    "loss": 2.710801839828491
+  },
+  {
+    "step": 244,
+    "loss": 2.2600297927856445
+  },
+  {
+    "step": 245,
+    "loss": 2.4880356788635254
+  },
+  {
+    "step": 246,
+    "loss": 2.333265542984009
+  },
+  {
+    "step": 247,
+    "loss": 2.3228213787078857
+  },
+  {
+    "step": 248,
+    "loss": 2.98348331451416
+  },
+  {
+    "step": 249,
+    "loss": 2.44199538230896
+  },
+  {
+    "step": 250,
+    "loss": 2.6789755821228027
+  },
+  {
+    "step": 251,
+    "loss": 2.432734489440918
+  },
+  {
+    "step": 252,
+    "loss": 2.3950858116149902
+  },
+  {
+    "step": 253,
+    "loss": 3.024618148803711
+  },
+  {
+    "step": 254,
+    "loss": 2.7950377464294434
+  },
+  {
+    "step": 255,
+    "loss": 2.6282715797424316
+  },
+  {
+    "step": 256,
+    "loss": 2.5368154048919678
+  },
+  {
+    "step": 257,
+    "loss": 2.5300967693328857
+  },
+  {
+    "step": 258,
+    "loss": 2.71651029586792
+  },
+  {
+    "step": 259,
+    "loss": 2.345527172088623
+  },
+  {
+    "step": 260,
+    "loss": 1.991959571838379
+  },
+  {
+    "step": 261,
+    "loss": 2.2183401584625244
+  },
+  {
+    "step": 262,
+    "loss": 2.7822048664093018
+  },
+  {
+    "step": 263,
+    "loss": 2.955565929412842
+  },
+  {
+    "step": 264,
+    "loss": 2.171292781829834
+  },
+  {
+    "step": 265,
+    "loss": 3.007766008377075
+  },
+  {
+    "step": 266,
+    "loss": 2.5466020107269287
+  },
+  {
+    "step": 267,
+    "loss": 2.4173848628997803
+  },
+  {
+    "step": 268,
+    "loss": 2.6756205558776855
+  },
+  {
+    "step": 269,
+    "loss": 2.4434726238250732
+  },
+  {
+    "step": 270,
+    "loss": 2.3825483322143555
+  },
+  {
+    "step": 271,
+    "loss": 2.5813300609588623
+  },
+  {
+    "step": 272,
+    "loss": 2.342559814453125
+  },
+  {
+    "step": 273,
+    "loss": 2.664748191833496
+  },
+  {
+    "step": 274,
+    "loss": 2.8664631843566895
+  },
+  {
+    "step": 275,
+    "loss": 2.8220643997192383
+  },
+  {
+    "step": 276,
+    "loss": 2.6016016006469727
+  },
+  {
+    "step": 277,
+    "loss": 2.292630672454834
+  },
+  {
+    "step": 278,
+    "loss": 2.3435916900634766
+  },
+  {
+    "step": 279,
+    "loss": 2.225806474685669
+  },
+  {
+    "step": 280,
+    "loss": 2.861757755279541
+  },
+  {
+    "step": 281,
+    "loss": 2.4925742149353027
+  },
+  {
+    "step": 282,
+    "loss": 2.3195114135742188
+  },
+  {
+    "step": 283,
+    "loss": 2.723316192626953
+  },
+  {
+    "step": 284,
+    "loss": 2.3318111896514893
+  },
+  {
+    "step": 285,
+    "loss": 2.3740956783294678
+  },
+  {
+    "step": 286,
+    "loss": 2.7161083221435547
+  },
+  {
+    "step": 287,
+    "loss": 1.8623343706130981
+  },
+  {
+    "step": 288,
+    "loss": 3.0774383544921875
+  },
+  {
+    "step": 289,
+    "loss": 2.684474468231201
+  },
+  {
+    "step": 290,
+    "loss": 2.1260976791381836
+  },
+  {
+    "step": 291,
+    "loss": 2.633331775665283
+  },
+  {
+    "step": 292,
+    "loss": 3.048750400543213
+  },
+  {
+    "step": 293,
+    "loss": 2.1517202854156494
+  },
+  {
+    "step": 294,
+    "loss": 2.703066349029541
+  },
+  {
+    "step": 295,
+    "loss": 2.2772347927093506
+  },
+  {
+    "step": 296,
+    "loss": 2.532550573348999
+  },
+  {
+    "step": 297,
+    "loss": 2.5133583545684814
+  },
+  {
+    "step": 298,
+    "loss": 2.2637734413146973
+  },
+  {
+    "step": 299,
+    "loss": 2.8052215576171875
+  },
+  {
+    "step": 300,
+    "loss": 2.3975658416748047
+  },
+  {
+    "step": 301,
+    "loss": 2.142946720123291
+  },
+  {
+    "step": 302,
+    "loss": 2.3383138179779053
+  },
+  {
+    "step": 303,
+    "loss": 2.956615924835205
+  },
+  {
+    "step": 304,
+    "loss": 2.268173933029175
+  },
+  {
+    "step": 305,
+    "loss": 2.2826666831970215
+  },
+  {
+    "step": 306,
+    "loss": 2.504539728164673
+  },
+  {
+    "step": 307,
+    "loss": 2.5966529846191406
+  },
+  {
+    "step": 308,
+    "loss": 1.9715884923934937
+  },
+  {
+    "step": 309,
+    "loss": 2.8570797443389893
+  },
+  {
+    "step": 310,
+    "loss": 2.3709073066711426
+  },
+  {
+    "step": 311,
+    "loss": 2.3691515922546387
+  },
+  {
+    "step": 312,
+    "loss": 2.5264945030212402
+  },
+  {
+    "step": 313,
+    "loss": 2.853039503097534
+  },
+  {
+    "step": 314,
+    "loss": 2.6715211868286133
+  },
+  {
+    "step": 315,
+    "loss": 2.4609460830688477
+  },
+  {
+    "step": 316,
+    "loss": 2.3723304271698
+  },
+  {
+    "step": 317,
+    "loss": 2.623749017715454
+  },
+  {
+    "step": 318,
+    "loss": 2.3588414192199707
+  },
+  {
+    "step": 319,
+    "loss": 2.2384724617004395
+  },
+  {
+    "step": 320,
+    "loss": 2.6265077590942383
+  },
+  {
+    "step": 321,
+    "loss": 2.3127033710479736
+  },
+  {
+    "step": 322,
+    "loss": 2.5432920455932617
+  },
+  {
+    "step": 323,
+    "loss": 2.902012348175049
+  },
+  {
+    "step": 324,
+    "loss": 2.2379114627838135
+  },
+  {
+    "step": 325,
+    "loss": 2.8483102321624756
+  },
+  {
+    "step": 326,
+    "loss": 3.0475165843963623
+  },
+  {
+    "step": 327,
+    "loss": 2.2012202739715576
+  },
+  {
+    "step": 328,
+    "loss": 3.10513973236084
+  },
+  {
+    "step": 329,
+    "loss": 2.7302069664001465
+  },
+  {
+    "step": 330,
+    "loss": 2.05947208404541
+  },
+  {
+    "step": 331,
+    "loss": 2.0735864639282227
+  },
+  {
+    "step": 332,
+    "loss": 2.351263999938965
+  },
+  {
+    "step": 333,
+    "loss": 2.1889426708221436
+  },
+  {
+    "step": 334,
+    "loss": 1.893702745437622
+  },
+  {
+    "step": 335,
+    "loss": 2.886248826980591
+  },
+  {
+    "step": 336,
+    "loss": 2.281409502029419
+  },
+  {
+    "step": 337,
+    "loss": 2.278639793395996
+  },
+  {
+    "step": 338,
+    "loss": 2.7411670684814453
+  },
+  {
+    "step": 339,
+    "loss": 2.242872714996338
+  },
+  {
+    "step": 340,
+    "loss": 2.567128896713257
+  },
+  {
+    "step": 341,
+    "loss": 2.1635279655456543
+  },
+  {
+    "step": 342,
+    "loss": 2.7505345344543457
+  },
+  {
+    "step": 343,
+    "loss": 2.4954588413238525
+  },
+  {
+    "step": 344,
+    "loss": 2.4626471996307373
+  },
+  {
+    "step": 345,
+    "loss": 2.457416296005249
+  },
+  {
+    "step": 346,
+    "loss": 2.4571924209594727
+  },
+  {
+    "step": 347,
+    "loss": 2.3100287914276123
+  },
+  {
+    "step": 348,
+    "loss": 2.4437308311462402
+  },
+  {
+    "step": 349,
+    "loss": 2.0501744747161865
+  },
+  {
+    "step": 350,
+    "loss": 2.1469335556030273
+  },
+  {
+    "step": 351,
+    "loss": 2.464240550994873
+  },
+  {
+    "step": 352,
+    "loss": 1.8512563705444336
+  },
+  {
+    "step": 353,
+    "loss": 2.4845597743988037
+  },
+  {
+    "step": 354,
+    "loss": 2.224407434463501
+  },
+  {
+    "step": 355,
+    "loss": 2.5380733013153076
+  },
+  {
+    "step": 356,
+    "loss": 2.51659893989563
+  },
+  {
+    "step": 357,
+    "loss": 2.0740654468536377
+  },
+  {
+    "step": 358,
+    "loss": 2.069371461868286
+  },
+  {
+    "step": 359,
+    "loss": 2.823765516281128
+  },
+  {
+    "step": 360,
+    "loss": 2.5208475589752197
+  },
+  {
+    "step": 361,
+    "loss": 2.116133213043213
+  },
+  {
+    "step": 362,
+    "loss": 2.556251049041748
+  },
+  {
+    "step": 363,
+    "loss": 2.223443031311035
+  },
+  {
+    "step": 364,
+    "loss": 2.6511716842651367
+  },
+  {
+    "step": 365,
+    "loss": 1.691718339920044
+  },
+  {
+    "step": 366,
+    "loss": 2.411846160888672
+  },
+  {
+    "step": 367,
+    "loss": 2.582014799118042
+  },
+  {
+    "step": 368,
+    "loss": 2.2078142166137695
+  },
+  {
+    "step": 369,
+    "loss": 2.609196662902832
+  },
+  {
+    "step": 370,
+    "loss": 2.444159984588623
+  },
+  {
+    "step": 371,
+    "loss": 2.0085737705230713
+  },
+  {
+    "step": 372,
+    "loss": 2.4077141284942627
+  },
+  {
+    "step": 373,
+    "loss": 2.8086421489715576
+  },
+  {
+    "step": 374,
+    "loss": 2.359715700149536
+  },
+  {
+    "step": 375,
+    "loss": 2.343597888946533
+  },
+  {
+    "step": 376,
+    "loss": 1.948641061782837
+  },
+  {
+    "step": 377,
+    "loss": 2.3641631603240967
+  },
+  {
+    "step": 378,
+    "loss": 2.0386908054351807
+  },
+  {
+    "step": 379,
+    "loss": 2.9259984493255615
+  },
+  {
+    "step": 380,
+    "loss": 2.6643362045288086
+  },
+  {
+    "step": 381,
+    "loss": 2.8584165573120117
+  },
+  {
+    "step": 382,
+    "loss": 2.6431076526641846
+  },
+  {
+    "step": 383,
+    "loss": 2.8262100219726562
+  },
+  {
+    "step": 384,
+    "loss": 2.1087937355041504
+  },
+  {
+    "step": 385,
+    "loss": 2.412994861602783
+  },
+  {
+    "step": 386,
+    "loss": 2.452765703201294
+  },
+  {
+    "step": 387,
+    "loss": 2.2612946033477783
+  },
+  {
+    "step": 388,
+    "loss": 2.9486331939697266
+  },
+  {
+    "step": 389,
+    "loss": 2.2730305194854736
+  },
+  {
+    "step": 390,
+    "loss": 2.526773691177368
+  },
+  {
+    "step": 391,
+    "loss": 2.397615909576416
+  },
+  {
+    "step": 392,
+    "loss": 2.3714022636413574
+  },
+  {
+    "step": 393,
+    "loss": 2.501068353652954
+  },
+  {
+    "step": 394,
+    "loss": 2.101055860519409
+  },
+  {
+    "step": 395,
+    "loss": 1.8332078456878662
+  },
+  {
+    "step": 396,
+    "loss": 2.620009183883667
+  },
+  {
+    "step": 397,
+    "loss": 2.6437087059020996
+  },
+  {
+    "step": 398,
+    "loss": 2.1969316005706787
+  },
+  {
+    "step": 399,
+    "loss": 2.578944444656372
+  },
+  {
+    "step": 400,
+    "loss": 2.8199615478515625
+  },
+  {
+    "step": 401,
+    "loss": 1.9555848836898804
+  },
+  {
+    "step": 402,
+    "loss": 2.3566293716430664
+  },
+  {
+    "step": 403,
+    "loss": 1.9274892807006836
+  },
+  {
+    "step": 404,
+    "loss": 2.3533687591552734
+  },
+  {
+    "step": 405,
+    "loss": 2.3114140033721924
+  },
+  {
+    "step": 406,
+    "loss": 2.3387277126312256
+  },
+  {
+    "step": 407,
+    "loss": 2.3504040241241455
+  },
+  {
+    "step": 408,
+    "loss": 2.694427490234375
+  },
+  {
+    "step": 409,
+    "loss": 2.370358467102051
+  },
+  {
+    "step": 410,
+    "loss": 1.8371087312698364
+  },
+  {
+    "step": 411,
+    "loss": 2.34598970413208
+  },
+  {
+    "step": 412,
+    "loss": 2.001140832901001
+  },
+  {
+    "step": 413,
+    "loss": 2.0652122497558594
+  },
+  {
+    "step": 414,
+    "loss": 2.631736993789673
+  },
+  {
+    "step": 415,
+    "loss": 2.3046376705169678
+  },
+  {
+    "step": 416,
+    "loss": 2.365978240966797
+  },
+  {
+    "step": 417,
+    "loss": 2.047502040863037
+  },
+  {
+    "step": 418,
+    "loss": 2.6210899353027344
+  },
+  {
+    "step": 419,
+    "loss": 2.1412880420684814
+  },
+  {
+    "step": 420,
+    "loss": 2.2439045906066895
+  },
+  {
+    "step": 421,
+    "loss": 2.1576952934265137
+  },
+  {
+    "step": 422,
+    "loss": 2.051438331604004
+  },
+  {
+    "step": 423,
+    "loss": 2.0313544273376465
+  },
+  {
+    "step": 424,
+    "loss": 3.118997573852539
+  },
+  {
+    "step": 425,
+    "loss": 2.471263885498047
+  },
+  {
+    "step": 426,
+    "loss": 1.698156714439392
+  },
+  {
+    "step": 427,
+    "loss": 2.799497365951538
+  },
+  {
+    "step": 428,
+    "loss": 2.1427876949310303
+  },
+  {
+    "step": 429,
+    "loss": 2.820594549179077
+  },
+  {
+    "step": 430,
+    "loss": 1.9575327634811401
+  },
+  {
+    "step": 431,
+    "loss": 2.6089365482330322
+  },
+  {
+    "step": 432,
+    "loss": 2.0574324131011963
+  },
+  {
+    "step": 433,
+    "loss": 2.868596315383911
+  },
+  {
+    "step": 434,
+    "loss": 2.1540873050689697
+  },
+  {
+    "step": 435,
+    "loss": 2.039017677307129
+  },
+  {
+    "step": 436,
+    "loss": 2.4460833072662354
+  },
+  {
+    "step": 437,
+    "loss": 2.5863380432128906
+  },
+  {
+    "step": 438,
+    "loss": 2.5211329460144043
+  },
+  {
+    "step": 439,
+    "loss": 2.0439255237579346
+  },
+  {
+    "step": 440,
+    "loss": 2.083531141281128
+  },
+  {
+    "step": 441,
+    "loss": 2.2036032676696777
+  },
+  {
+    "step": 442,
+    "loss": 2.1617541313171387
+  },
+  {
+    "step": 443,
+    "loss": 2.2706785202026367
+  },
+  {
+    "step": 444,
+    "loss": 2.3687477111816406
+  },
+  {
+    "step": 445,
+    "loss": 2.1419553756713867
+  },
+  {
+    "step": 446,
+    "loss": 2.3326170444488525
+  },
+  {
+    "step": 447,
+    "loss": 2.0808708667755127
+  },
+  {
+    "step": 448,
+    "loss": 2.309194803237915
+  },
+  {
+    "step": 449,
+    "loss": 2.8360342979431152
+  },
+  {
+    "step": 450,
+    "loss": 2.3126049041748047
+  },
+  {
+    "step": 451,
+    "loss": 2.2485318183898926
+  },
+  {
+    "step": 452,
+    "loss": 2.6139726638793945
+  },
+  {
+    "step": 453,
+    "loss": 2.174654483795166
+  },
+  {
+    "step": 454,
+    "loss": 2.4408035278320312
+  },
+  {
+    "step": 455,
+    "loss": 2.3054635524749756
+  },
+  {
+    "step": 456,
+    "loss": 2.500479221343994
+  },
+  {
+    "step": 457,
+    "loss": 2.712820053100586
+  },
+  {
+    "step": 458,
+    "loss": 2.3475780487060547
+  },
+  {
+    "step": 459,
+    "loss": 2.476759910583496
+  },
+  {
+    "step": 460,
+    "loss": 2.163086175918579
+  },
+  {
+    "step": 461,
+    "loss": 2.1306872367858887
+  },
+  {
+    "step": 462,
+    "loss": 2.569213390350342
+  },
+  {
+    "step": 463,
+    "loss": 1.9032127857208252
+  },
+  {
+    "step": 464,
+    "loss": 2.670799493789673
+  },
+  {
+    "step": 465,
+    "loss": 2.116924285888672
+  },
+  {
+    "step": 466,
+    "loss": 2.200054883956909
+  },
+  {
+    "step": 467,
+    "loss": 2.726794719696045
+  },
+  {
+    "step": 468,
+    "loss": 2.4743218421936035
+  },
+  {
+    "step": 469,
+    "loss": 2.1093218326568604
+  },
+  {
+    "step": 470,
+    "loss": 1.994795322418213
+  },
+  {
+    "step": 471,
+    "loss": 2.4643502235412598
+  },
+  {
+    "step": 472,
+    "loss": 2.4895074367523193
+  },
+  {
+    "step": 473,
+    "loss": 2.212019920349121
+  },
+  {
+    "step": 474,
+    "loss": 1.9118317365646362
+  },
+  {
+    "step": 475,
+    "loss": 1.9181571006774902
+  },
+  {
+    "step": 476,
+    "loss": 2.6781809329986572
+  },
+  {
+    "step": 477,
+    "loss": 1.9821468591690063
+  },
+  {
+    "step": 478,
+    "loss": 2.641598701477051
+  },
+  {
+    "step": 479,
+    "loss": 2.110565185546875
+  },
+  {
+    "step": 480,
+    "loss": 2.528163194656372
+  },
+  {
+    "step": 481,
+    "loss": 2.2186732292175293
+  },
+  {
+    "step": 482,
+    "loss": 1.94599187374115
+  },
+  {
+    "step": 483,
+    "loss": 2.3718581199645996
+  },
+  {
+    "step": 484,
+    "loss": 2.222639560699463
+  },
+  {
+    "step": 485,
+    "loss": 2.4093661308288574
+  },
+  {
+    "step": 486,
+    "loss": 2.54209041595459
+  },
+  {
+    "step": 487,
+    "loss": 2.024200201034546
+  },
+  {
+    "step": 488,
+    "loss": 2.5153119564056396
+  },
+  {
+    "step": 489,
+    "loss": 1.658121943473816
+  },
+  {
+    "step": 490,
+    "loss": 2.2563576698303223
+  },
+  {
+    "step": 491,
+    "loss": 2.3844380378723145
+  },
+  {
+    "step": 492,
+    "loss": 2.1449241638183594
+  },
+  {
+    "step": 493,
+    "loss": 2.2108402252197266
+  },
+  {
+    "step": 494,
+    "loss": 2.344649314880371
+  },
+  {
+    "step": 495,
+    "loss": 2.548719644546509
+  },
+  {
+    "step": 496,
+    "loss": 1.7746530771255493
+  },
+  {
+    "step": 497,
+    "loss": 2.309767246246338
+  },
+  {
+    "step": 498,
+    "loss": 2.0731115341186523
+  },
+  {
+    "step": 499,
+    "loss": 2.5398313999176025
+  },
+  {
+    "step": 500,
+    "loss": 2.091824769973755
+  },
+  {
+    "step": 501,
+    "loss": 1.9239593744277954
+  },
+  {
+    "step": 502,
+    "loss": 1.9768168926239014
+  },
+  {
+    "step": 503,
+    "loss": 2.260188341140747
+  },
+  {
+    "step": 504,
+    "loss": 2.553421974182129
+  },
+  {
+    "step": 505,
+    "loss": 2.4699223041534424
+  },
+  {
+    "step": 506,
+    "loss": 2.630557060241699
+  },
+  {
+    "step": 507,
+    "loss": 2.0340492725372314
+  },
+  {
+    "step": 508,
+    "loss": 2.028682231903076
+  },
+  {
+    "step": 509,
+    "loss": 2.45908260345459
+  },
+  {
+    "step": 510,
+    "loss": 2.2142536640167236
+  },
+  {
+    "step": 511,
+    "loss": 2.4662668704986572
+  },
+  {
+    "step": 512,
+    "loss": 2.27579927444458
+  },
+  {
+    "step": 513,
+    "loss": 2.2575185298919678
+  },
+  {
+    "step": 514,
+    "loss": 2.6080620288848877
+  },
+  {
+    "step": 515,
+    "loss": 2.5972297191619873
+  },
+  {
+    "step": 516,
+    "loss": 2.1600301265716553
+  },
+  {
+    "step": 517,
+    "loss": 1.9268064498901367
+  },
+  {
+    "step": 518,
+    "loss": 2.278988838195801
+  },
+  {
+    "step": 519,
+    "loss": 2.4084134101867676
+  },
+  {
+    "step": 520,
+    "loss": 2.7133266925811768
+  },
+  {
+    "step": 521,
+    "loss": 2.123317003250122
+  },
+  {
+    "step": 522,
+    "loss": 2.0050742626190186
+  },
+  {
+    "step": 523,
+    "loss": 2.311730146408081
+  },
+  {
+    "step": 524,
+    "loss": 2.100144624710083
+  },
+  {
+    "step": 525,
+    "loss": 2.182567834854126
+  },
+  {
+    "step": 526,
+    "loss": 2.6850223541259766
+  },
+  {
+    "step": 527,
+    "loss": 2.64558482170105
+  },
+  {
+    "step": 528,
+    "loss": 2.065207004547119
+  },
+  {
+    "step": 529,
+    "loss": 2.57641339302063
+  },
+  {
+    "step": 530,
+    "loss": 2.37033748626709
+  },
+  {
+    "step": 531,
+    "loss": 2.3202273845672607
+  },
+  {
+    "step": 532,
+    "loss": 2.5949063301086426
+  },
+  {
+    "step": 533,
+    "loss": 2.621664047241211
+  },
+  {
+    "step": 534,
+    "loss": 2.4353041648864746
+  },
+  {
+    "step": 535,
+    "loss": 2.0931382179260254
+  },
+  {
+    "step": 536,
+    "loss": 2.1506476402282715
+  },
+  {
+    "step": 537,
+    "loss": 2.0098910331726074
+  },
+  {
+    "step": 538,
+    "loss": 1.8340765237808228
+  },
+  {
+    "step": 539,
+    "loss": 2.3008437156677246
+  },
+  {
+    "step": 540,
+    "loss": 2.4273364543914795
+  },
+  {
+    "step": 541,
+    "loss": 2.4804060459136963
+  },
+  {
+    "step": 542,
+    "loss": 2.25795841217041
+  },
+  {
+    "step": 543,
+    "loss": 2.357149600982666
+  },
+  {
+    "step": 544,
+    "loss": 2.1500396728515625
+  },
+  {
+    "step": 545,
+    "loss": 2.459463596343994
+  },
+  {
+    "step": 546,
+    "loss": 2.2286086082458496
+  },
+  {
+    "step": 547,
+    "loss": 2.4219624996185303
+  },
+  {
+    "step": 548,
+    "loss": 2.686821222305298
+  },
+  {
+    "step": 549,
+    "loss": 2.2649004459381104
+  },
+  {
+    "step": 550,
+    "loss": 2.307349920272827
+  },
+  {
+    "step": 551,
+    "loss": 1.8991062641143799
+  },
+  {
+    "step": 552,
+    "loss": 1.9229987859725952
+  },
+  {
+    "step": 553,
+    "loss": 2.5056543350219727
+  },
+  {
+    "step": 554,
+    "loss": 2.1609060764312744
+  },
+  {
+    "step": 555,
+    "loss": 1.9778512716293335
+  },
+  {
+    "step": 556,
+    "loss": 2.471957206726074
+  },
+  {
+    "step": 557,
+    "loss": 1.8614418506622314
+  },
+  {
+    "step": 558,
+    "loss": 2.335939884185791
+  },
+  {
+    "step": 559,
+    "loss": 1.712602972984314
+  },
+  {
+    "step": 560,
+    "loss": 2.4900341033935547
+  },
+  {
+    "step": 561,
+    "loss": 2.3448946475982666
+  },
+  {
+    "step": 562,
+    "loss": 2.333690643310547
+  },
+  {
+    "step": 563,
+    "loss": 2.3033447265625
+  },
+  {
+    "step": 564,
+    "loss": 1.985489010810852
+  },
+  {
+    "step": 565,
+    "loss": 2.1400845050811768
+  },
+  {
+    "step": 566,
+    "loss": 2.6713786125183105
+  },
+  {
+    "step": 567,
+    "loss": 2.2288951873779297
+  },
+  {
+    "step": 568,
+    "loss": 1.8685835599899292
+  },
+  {
+    "step": 569,
+    "loss": 1.8806357383728027
+  },
+  {
+    "step": 570,
+    "loss": 2.147825241088867
+  },
+  {
+    "step": 571,
+    "loss": 1.928283452987671
+  },
+  {
+    "step": 572,
+    "loss": 1.8230233192443848
+  },
+  {
+    "step": 573,
+    "loss": 1.8360440731048584
+  },
+  {
+    "step": 574,
+    "loss": 2.6959915161132812
+  },
+  {
+    "step": 575,
+    "loss": 1.9693267345428467
+  },
+  {
+    "step": 576,
+    "loss": 2.7600269317626953
+  },
+  {
+    "step": 577,
+    "loss": 2.2720563411712646
+  },
+  {
+    "step": 578,
+    "loss": 2.299776077270508
+  },
+  {
+    "step": 579,
+    "loss": 2.212860584259033
+  },
+  {
+    "step": 580,
+    "loss": 2.3061680793762207
+  },
+  {
+    "step": 581,
+    "loss": 2.2603089809417725
+  },
+  {
+    "step": 582,
+    "loss": 2.0869574546813965
+  },
+  {
+    "step": 583,
+    "loss": 2.23502254486084
+  },
+  {
+    "step": 584,
+    "loss": 2.2090988159179688
+  },
+  {
+    "step": 585,
+    "loss": 2.244767427444458
+  },
+  {
+    "step": 586,
+    "loss": 2.256420135498047
+  },
+  {
+    "step": 587,
+    "loss": 1.9098711013793945
+  },
+  {
+    "step": 588,
+    "loss": 2.3755404949188232
+  },
+  {
+    "step": 589,
+    "loss": 2.6855807304382324
+  },
+  {
+    "step": 590,
+    "loss": 2.460073471069336
+  },
+  {
+    "step": 591,
+    "loss": 1.8837049007415771
+  },
+  {
+    "step": 592,
+    "loss": 2.081373929977417
+  },
+  {
+    "step": 593,
+    "loss": 2.1925439834594727
+  },
+  {
+    "step": 594,
+    "loss": 1.9564194679260254
+  },
+  {
+    "step": 595,
+    "loss": 2.205615758895874
+  },
+  {
+    "step": 596,
+    "loss": 2.478692054748535
+  },
+  {
+    "step": 597,
+    "loss": 2.0080032348632812
+  },
+  {
+    "step": 598,
+    "loss": 2.469820976257324
+  },
+  {
+    "step": 599,
+    "loss": 1.8856621980667114
+  },
+  {
+    "step": 600,
+    "loss": 1.6023671627044678
+  },
+  {
+    "step": 601,
+    "loss": 2.1479015350341797
+  },
+  {
+    "step": 602,
+    "loss": 2.306637763977051
+  },
+  {
+    "step": 603,
+    "loss": 2.2650392055511475
+  },
+  {
+    "step": 604,
+    "loss": 2.517967939376831
+  },
+  {
+    "step": 605,
+    "loss": 2.248115062713623
+  },
+  {
+    "step": 606,
+    "loss": 2.1899242401123047
+  },
+  {
+    "step": 607,
+    "loss": 2.3952863216400146
+  },
+  {
+    "step": 608,
+    "loss": 2.0763449668884277
+  },
+  {
+    "step": 609,
+    "loss": 2.3016607761383057
+  },
+  {
+    "step": 610,
+    "loss": 2.283357858657837
+  },
+  {
+    "step": 611,
+    "loss": 1.9581166505813599
+  },
+  {
+    "step": 612,
+    "loss": 2.4603822231292725
+  },
+  {
+    "step": 613,
+    "loss": 2.20369553565979
+  },
+  {
+    "step": 614,
+    "loss": 2.3975698947906494
+  },
+  {
+    "step": 615,
+    "loss": 2.3169641494750977
+  },
+  {
+    "step": 616,
+    "loss": 2.176382303237915
+  },
+  {
+    "step": 617,
+    "loss": 2.343982219696045
+  },
+  {
+    "step": 618,
+    "loss": 1.8763999938964844
+  },
+  {
+    "step": 619,
+    "loss": 2.083078384399414
+  },
+  {
+    "step": 620,
+    "loss": 1.902529239654541
+  },
+  {
+    "step": 621,
+    "loss": 2.0607450008392334
+  },
+  {
+    "step": 622,
+    "loss": 2.078382730484009
+  },
+  {
+    "step": 623,
+    "loss": 2.4523744583129883
+  },
+  {
+    "step": 624,
+    "loss": 2.1366493701934814
+  },
+  {
+    "step": 625,
+    "loss": 2.0985474586486816
+  },
+  {
+    "step": 626,
+    "loss": 2.5543007850646973
+  },
+  {
+    "step": 627,
+    "loss": 2.5027101039886475
+  },
+  {
+    "step": 628,
+    "loss": 2.8813798427581787
+  },
+  {
+    "step": 629,
+    "loss": 2.3890798091888428
+  },
+  {
+    "step": 630,
+    "loss": 1.9115877151489258
+  },
+  {
+    "step": 631,
+    "loss": 1.8879164457321167
+  },
+  {
+    "step": 632,
+    "loss": 2.415476083755493
+  },
+  {
+    "step": 633,
+    "loss": 2.3512673377990723
+  },
+  {
+    "step": 634,
+    "loss": 2.330165147781372
+  },
+  {
+    "step": 635,
+    "loss": 2.368882179260254
+  },
+  {
+    "step": 636,
+    "loss": 1.8848557472229004
+  },
+  {
+    "step": 637,
+    "loss": 2.5454752445220947
+  },
+  {
+    "step": 638,
+    "loss": 2.4458537101745605
+  },
+  {
+    "step": 639,
+    "loss": 2.3046398162841797
+  },
+  {
+    "step": 640,
+    "loss": 2.293977737426758
+  },
+  {
+    "step": 641,
+    "loss": 2.0221903324127197
+  },
+  {
+    "step": 642,
+    "loss": 1.678128719329834
+  },
+  {
+    "step": 643,
+    "loss": 2.55545711517334
+  },
+  {
+    "step": 644,
+    "loss": 2.0510752201080322
+  },
+  {
+    "step": 645,
+    "loss": 1.8273422718048096
+  },
+  {
+    "step": 646,
+    "loss": 2.4667928218841553
+  },
+  {
+    "step": 647,
+    "loss": 2.062159538269043
+  },
+  {
+    "step": 648,
+    "loss": 1.8708369731903076
+  },
+  {
+    "step": 649,
+    "loss": 1.8367586135864258
+  },
+  {
+    "step": 650,
+    "loss": 2.3304603099823
+  },
+  {
+    "step": 651,
+    "loss": 2.2214672565460205
+  },
+  {
+    "step": 652,
+    "loss": 2.156398057937622
+  },
+  {
+    "step": 653,
+    "loss": 1.802478551864624
+  },
+  {
+    "step": 654,
+    "loss": 2.1194801330566406
+  },
+  {
+    "step": 655,
+    "loss": 1.832618236541748
+  },
+  {
+    "step": 656,
+    "loss": 2.7607004642486572
+  },
+  {
+    "step": 657,
+    "loss": 1.5378355979919434
+  },
+  {
+    "step": 658,
+    "loss": 2.871095895767212
+  },
+  {
+    "step": 659,
+    "loss": 2.1772589683532715
+  },
+  {
+    "step": 660,
+    "loss": 2.378739356994629
+  },
+  {
+    "step": 661,
+    "loss": 1.9543912410736084
+  },
+  {
+    "step": 662,
+    "loss": 1.7253490686416626
+  },
+  {
+    "step": 663,
+    "loss": 2.3326663970947266
+  },
+  {
+    "step": 664,
+    "loss": 2.0331671237945557
+  },
+  {
+    "step": 665,
+    "loss": 2.8661580085754395
+  },
+  {
+    "step": 666,
+    "loss": 2.4486398696899414
+  },
+  {
+    "step": 667,
+    "loss": 2.2856521606445312
+  },
+  {
+    "step": 668,
+    "loss": 2.0959157943725586
+  },
+  {
+    "step": 669,
+    "loss": 1.828498363494873
+  },
+  {
+    "step": 670,
+    "loss": 2.580878257751465
+  },
+  {
+    "step": 671,
+    "loss": 2.111854076385498
+  },
+  {
+    "step": 672,
+    "loss": 2.3081603050231934
+  },
+  {
+    "step": 673,
+    "loss": 2.1535303592681885
+  },
+  {
+    "step": 674,
+    "loss": 2.4697322845458984
+  },
+  {
+    "step": 675,
+    "loss": 1.8599785566329956
+  },
+  {
+    "step": 676,
+    "loss": 2.156494140625
+  },
+  {
+    "step": 677,
+    "loss": 2.1473135948181152
+  },
+  {
+    "step": 678,
+    "loss": 1.5099081993103027
+  },
+  {
+    "step": 679,
+    "loss": 2.241101026535034
+  },
+  {
+    "step": 680,
+    "loss": 2.242471694946289
+  },
+  {
+    "step": 681,
+    "loss": 2.042699098587036
+  },
+  {
+    "step": 682,
+    "loss": 2.1123008728027344
+  },
+  {
+    "step": 683,
+    "loss": 2.017486095428467
+  },
+  {
+    "step": 684,
+    "loss": 2.0131030082702637
+  },
+  {
+    "step": 685,
+    "loss": 1.8260565996170044
+  },
+  {
+    "step": 686,
+    "loss": 1.8099098205566406
+  },
+  {
+    "step": 687,
+    "loss": 1.9493796825408936
+  },
+  {
+    "step": 688,
+    "loss": 1.7958455085754395
+  },
+  {
+    "step": 689,
+    "loss": 2.12551212310791
+  },
+  {
+    "step": 690,
+    "loss": 1.8851398229599
+  },
+  {
+    "step": 691,
+    "loss": 2.169377326965332
+  },
+  {
+    "step": 692,
+    "loss": 2.345599412918091
+  },
+  {
+    "step": 693,
+    "loss": 2.6371800899505615
+  },
+  {
+    "step": 694,
+    "loss": 2.054779291152954
+  },
+  {
+    "step": 695,
+    "loss": 1.8875532150268555
+  },
+  {
+    "step": 696,
+    "loss": 1.899794101715088
+  },
+  {
+    "step": 697,
+    "loss": 1.9862229824066162
+  },
+  {
+    "step": 698,
+    "loss": 2.069486141204834
+  },
+  {
+    "step": 699,
+    "loss": 2.5258560180664062
+  },
+  {
+    "step": 700,
+    "loss": 2.138136863708496
+  },
+  {
+    "step": 701,
+    "loss": 1.7787747383117676
+  },
+  {
+    "step": 702,
+    "loss": 2.3944613933563232
+  },
+  {
+    "step": 703,
+    "loss": 2.2432310581207275
+  },
+  {
+    "step": 704,
+    "loss": 2.23433780670166
+  },
+  {
+    "step": 705,
+    "loss": 2.3525569438934326
+  },
+  {
+    "step": 706,
+    "loss": 1.683660626411438
+  },
+  {
+    "step": 707,
+    "loss": 1.928051233291626
+  },
+  {
+    "step": 708,
+    "loss": 2.214559316635132
+  },
+  {
+    "step": 709,
+    "loss": 2.444596290588379
+  },
+  {
+    "step": 710,
+    "loss": 2.5637311935424805
+  },
+  {
+    "step": 711,
+    "loss": 2.094400405883789
+  },
+  {
+    "step": 712,
+    "loss": 2.1752796173095703
+  },
+  {
+    "step": 713,
+    "loss": 2.1646933555603027
+  },
+  {
+    "step": 714,
+    "loss": 2.3239498138427734
+  },
+  {
+    "step": 715,
+    "loss": 2.528728485107422
+  },
+  {
+    "step": 716,
+    "loss": 1.7567914724349976
+  },
+  {
+    "step": 717,
+    "loss": 1.8295328617095947
+  },
+  {
+    "step": 718,
+    "loss": 2.579841375350952
+  },
+  {
+    "step": 719,
+    "loss": 1.9017343521118164
+  },
+  {
+    "step": 720,
+    "loss": 2.507222890853882
+  },
+  {
+    "step": 721,
+    "loss": 2.127558946609497
+  },
+  {
+    "step": 722,
+    "loss": 2.1579627990722656
+  },
+  {
+    "step": 723,
+    "loss": 1.957413673400879
+  },
+  {
+    "step": 724,
+    "loss": 1.7173194885253906
+  },
+  {
+    "step": 725,
+    "loss": 1.8139698505401611
+  },
+  {
+    "step": 726,
+    "loss": 2.3142149448394775
+  },
+  {
+    "step": 727,
+    "loss": 2.4957833290100098
+  },
+  {
+    "step": 728,
+    "loss": 2.096470832824707
+  },
+  {
+    "step": 729,
+    "loss": 2.1391425132751465
+  },
+  {
+    "step": 730,
+    "loss": 2.0562264919281006
+  },
+  {
+    "step": 731,
+    "loss": 1.704184651374817
+  },
+  {
+    "step": 732,
+    "loss": 2.186826467514038
+  },
+  {
+    "step": 733,
+    "loss": 2.098335027694702
+  },
+  {
+    "step": 734,
+    "loss": 1.9378281831741333
+  },
+  {
+    "step": 735,
+    "loss": 1.9070260524749756
+  },
+  {
+    "step": 736,
+    "loss": 2.5211658477783203
+  },
+  {
+    "step": 737,
+    "loss": 1.8523521423339844
+  },
+  {
+    "step": 738,
+    "loss": 2.3545069694519043
+  },
+  {
+    "step": 739,
+    "loss": 1.715818166732788
+  },
+  {
+    "step": 740,
+    "loss": 1.9143247604370117
+  },
+  {
+    "step": 741,
+    "loss": 1.833640456199646
+  },
+  {
+    "step": 742,
+    "loss": 3.0031652450561523
+  },
+  {
+    "step": 743,
+    "loss": 1.5467760562896729
+  },
+  {
+    "step": 744,
+    "loss": 1.8195242881774902
+  },
+  {
+    "step": 745,
+    "loss": 1.785135269165039
+  },
+  {
+    "step": 746,
+    "loss": 2.0208964347839355
+  },
+  {
+    "step": 747,
+    "loss": 1.799407958984375
+  },
+  {
+    "step": 748,
+    "loss": 2.357728958129883
+  },
+  {
+    "step": 749,
+    "loss": 2.19157338142395
+  },
+  {
+    "step": 750,
+    "loss": 1.7044637203216553
+  },
+  {
+    "step": 751,
+    "loss": 2.1935999393463135
+  },
+  {
+    "step": 752,
+    "loss": 1.8042278289794922
+  },
+  {
+    "step": 753,
+    "loss": 2.340193271636963
+  },
+  {
+    "step": 754,
+    "loss": 1.8830957412719727
+  },
+  {
+    "step": 755,
+    "loss": 2.1636412143707275
+  },
+  {
+    "step": 756,
+    "loss": 2.573277473449707
+  },
+  {
+    "step": 757,
+    "loss": 2.185680866241455
+  },
+  {
+    "step": 758,
+    "loss": 2.005404472351074
+  },
+  {
+    "step": 759,
+    "loss": 2.041130304336548
+  },
+  {
+    "step": 760,
+    "loss": 2.069777250289917
+  },
+  {
+    "step": 761,
+    "loss": 1.942754864692688
+  },
+  {
+    "step": 762,
+    "loss": 2.273555278778076
+  },
+  {
+    "step": 763,
+    "loss": 1.8626675605773926
+  },
+  {
+    "step": 764,
+    "loss": 3.090045690536499
+  },
+  {
+    "step": 765,
+    "loss": 1.6991760730743408
+  },
+  {
+    "step": 766,
+    "loss": 1.9688661098480225
+  },
+  {
+    "step": 767,
+    "loss": 2.0735771656036377
+  },
+  {
+    "step": 768,
+    "loss": 1.9161018133163452
+  },
+  {
+    "step": 769,
+    "loss": 1.935367226600647
+  },
+  {
+    "step": 770,
+    "loss": 2.512490749359131
+  },
+  {
+    "step": 771,
+    "loss": 1.9653754234313965
+  },
+  {
+    "step": 772,
+    "loss": 1.9006037712097168
+  },
+  {
+    "step": 773,
+    "loss": 2.1403775215148926
+  },
+  {
+    "step": 774,
+    "loss": 1.9985692501068115
+  },
+  {
+    "step": 775,
+    "loss": 2.2423832416534424
+  },
+  {
+    "step": 776,
+    "loss": 2.272416114807129
+  },
+  {
+    "step": 777,
+    "loss": 1.6806894540786743
+  },
+  {
+    "step": 778,
+    "loss": 1.6961314678192139
+  },
+  {
+    "step": 779,
+    "loss": 2.070193290710449
+  },
+  {
+    "step": 780,
+    "loss": 2.30169415473938
+  },
+  {
+    "step": 781,
+    "loss": 1.498708963394165
+  },
+  {
+    "step": 782,
+    "loss": 2.672607898712158
+  },
+  {
+    "step": 783,
+    "loss": 2.000545024871826
+  },
+  {
+    "step": 784,
+    "loss": 2.1863222122192383
+  },
+  {
+    "step": 785,
+    "loss": 1.955033302307129
+  },
+  {
+    "step": 786,
+    "loss": 2.0105948448181152
+  },
+  {
+    "step": 787,
+    "loss": 2.3913588523864746
+  },
+  {
+    "step": 788,
+    "loss": 2.0229620933532715
+  },
+  {
+    "step": 789,
+    "loss": 2.0052614212036133
+  },
+  {
+    "step": 790,
+    "loss": 2.718447685241699
+  },
+  {
+    "step": 791,
+    "loss": 2.2307233810424805
+  },
+  {
+    "step": 792,
+    "loss": 2.1480185985565186
+  },
+  {
+    "step": 793,
+    "loss": 2.508347988128662
+  },
+  {
+    "step": 794,
+    "loss": 1.927217960357666
+  },
+  {
+    "step": 795,
+    "loss": 2.075195789337158
+  },
+  {
+    "step": 796,
+    "loss": 2.0269381999969482
+  },
+  {
+    "step": 797,
+    "loss": 1.7403855323791504
+  },
+  {
+    "step": 798,
+    "loss": 2.3028817176818848
+  },
+  {
+    "step": 799,
+    "loss": 2.2278242111206055
+  },
+  {
+    "step": 800,
+    "loss": 2.3212714195251465
+  },
+  {
+    "step": 801,
+    "loss": 2.1449832916259766
+  },
+  {
+    "step": 802,
+    "loss": 1.9621870517730713
+  },
+  {
+    "step": 803,
+    "loss": 2.1465606689453125
+  },
+  {
+    "step": 804,
+    "loss": 2.28023624420166
+  },
+  {
+    "step": 805,
+    "loss": 2.3931326866149902
+  },
+  {
+    "step": 806,
+    "loss": 1.9575012922286987
+  },
+  {
+    "step": 807,
+    "loss": 2.2189478874206543
+  },
+  {
+    "step": 808,
+    "loss": 2.313659906387329
+  },
+  {
+    "step": 809,
+    "loss": 1.785354495048523
+  },
+  {
+    "step": 810,
+    "loss": 2.360384941101074
+  },
+  {
+    "step": 811,
+    "loss": 1.5126988887786865
+  },
+  {
+    "step": 812,
+    "loss": 2.0700507164001465
+  },
+  {
+    "step": 813,
+    "loss": 2.364596128463745
+  },
+  {
+    "step": 814,
+    "loss": 1.7121427059173584
+  },
+  {
+    "step": 815,
+    "loss": 2.4048376083374023
+  },
+  {
+    "step": 816,
+    "loss": 2.1315109729766846
+  },
+  {
+    "step": 817,
+    "loss": 2.0960779190063477
+  },
+  {
+    "step": 818,
+    "loss": 2.1370670795440674
+  },
+  {
+    "step": 819,
+    "loss": 2.2387843132019043
+  },
+  {
+    "step": 820,
+    "loss": 2.6564176082611084
+  },
+  {
+    "step": 821,
+    "loss": 2.3899805545806885
+  },
+  {
+    "step": 822,
+    "loss": 1.8396912813186646
+  },
+  {
+    "step": 823,
+    "loss": 1.849434494972229
+  },
+  {
+    "step": 824,
+    "loss": 2.4848148822784424
+  },
+  {
+    "step": 825,
+    "loss": 2.300788640975952
+  },
+  {
+    "step": 826,
+    "loss": 1.6741901636123657
+  },
+  {
+    "step": 827,
+    "loss": 1.9888312816619873
+  },
+  {
+    "step": 828,
+    "loss": 2.1556782722473145
+  },
+  {
+    "step": 829,
+    "loss": 2.0511889457702637
+  },
+  {
+    "step": 830,
+    "loss": 2.110619068145752
+  },
+  {
+    "step": 831,
+    "loss": 1.8331103324890137
+  },
+  {
+    "step": 832,
+    "loss": 2.0915446281433105
+  },
+  {
+    "step": 833,
+    "loss": 1.3950932025909424
+  },
+  {
+    "step": 834,
+    "loss": 2.5744056701660156
+  },
+  {
+    "step": 835,
+    "loss": 2.351382255554199
+  },
+  {
+    "step": 836,
+    "loss": 2.207592248916626
+  },
+  {
+    "step": 837,
+    "loss": 2.0599913597106934
+  },
+  {
+    "step": 838,
+    "loss": 2.4455690383911133
+  },
+  {
+    "step": 839,
+    "loss": 2.037224769592285
+  },
+  {
+    "step": 840,
+    "loss": 2.1246533393859863
+  },
+  {
+    "step": 841,
+    "loss": 2.539519786834717
+  },
+  {
+    "step": 842,
+    "loss": 2.3089704513549805
+  },
+  {
+    "step": 843,
+    "loss": 1.8031303882598877
+  },
+  {
+    "step": 844,
+    "loss": 2.1725902557373047
+  },
+  {
+    "step": 845,
+    "loss": 1.9818854331970215
+  },
+  {
+    "step": 846,
+    "loss": 2.469529151916504
+  },
+  {
+    "step": 847,
+    "loss": 1.6893788576126099
+  },
+  {
+    "step": 848,
+    "loss": 1.9128904342651367
+  },
+  {
+    "step": 849,
+    "loss": 2.3154168128967285
+  },
+  {
+    "step": 850,
+    "loss": 1.864374041557312
+  },
+  {
+    "step": 851,
+    "loss": 2.139346122741699
+  },
+  {
+    "step": 852,
+    "loss": 1.9899048805236816
+  },
+  {
+    "step": 853,
+    "loss": 1.8425148725509644
+  },
+  {
+    "step": 854,
+    "loss": 2.196641445159912
+  },
+  {
+    "step": 855,
+    "loss": 2.084127187728882
+  },
+  {
+    "step": 856,
+    "loss": 2.589137077331543
+  },
+  {
+    "step": 857,
+    "loss": 1.9049241542816162
+  },
+  {
+    "step": 858,
+    "loss": 2.1088719367980957
+  },
+  {
+    "step": 859,
+    "loss": 1.8666791915893555
+  },
+  {
+    "step": 860,
+    "loss": 2.291273355484009
+  },
+  {
+    "step": 861,
+    "loss": 2.7720913887023926
+  },
+  {
+    "step": 862,
+    "loss": 2.0325875282287598
+  },
+  {
+    "step": 863,
+    "loss": 2.1262521743774414
+  },
+  {
+    "step": 864,
+    "loss": 2.1930947303771973
+  },
+  {
+    "step": 865,
+    "loss": 2.0483975410461426
+  },
+  {
+    "step": 866,
+    "loss": 2.1810200214385986
+  },
+  {
+    "step": 867,
+    "loss": 2.0406017303466797
+  },
+  {
+    "step": 868,
+    "loss": 1.9476172924041748
+  },
+  {
+    "step": 869,
+    "loss": 2.3409388065338135
+  },
+  {
+    "step": 870,
+    "loss": 2.2193973064422607
+  },
+  {
+    "step": 871,
+    "loss": 2.135343313217163
+  },
+  {
+    "step": 872,
+    "loss": 2.0815932750701904
+  },
+  {
+    "step": 873,
+    "loss": 2.2342116832733154
+  },
+  {
+    "step": 874,
+    "loss": 1.839571237564087
+  },
+  {
+    "step": 875,
+    "loss": 2.225438356399536
+  },
+  {
+    "step": 876,
+    "loss": 2.303863525390625
+  },
+  {
+    "step": 877,
+    "loss": 1.9251621961593628
+  },
+  {
+    "step": 878,
+    "loss": 2.1342930793762207
+  },
+  {
+    "step": 879,
+    "loss": 2.1234943866729736
+  },
+  {
+    "step": 880,
+    "loss": 2.137087821960449
+  },
+  {
+    "step": 881,
+    "loss": 1.9579668045043945
+  },
+  {
+    "step": 882,
+    "loss": 2.0309898853302
+  },
+  {
+    "step": 883,
+    "loss": 1.799654245376587
+  },
+  {
+    "step": 884,
+    "loss": 2.4847488403320312
+  },
+  {
+    "step": 885,
+    "loss": 2.6662018299102783
+  },
+  {
+    "step": 886,
+    "loss": 1.9268032312393188
+  },
+  {
+    "step": 887,
+    "loss": 2.043844223022461
+  },
+  {
+    "step": 888,
+    "loss": 2.038583278656006
+  },
+  {
+    "step": 889,
+    "loss": 2.393343925476074
+  },
+  {
+    "step": 890,
+    "loss": 2.155910015106201
+  },
+  {
+    "step": 891,
+    "loss": 2.047548532485962
+  },
+  {
+    "step": 892,
+    "loss": 2.4230449199676514
+  },
+  {
+    "step": 893,
+    "loss": 1.7401704788208008
+  },
+  {
+    "step": 894,
+    "loss": 2.0996835231781006
+  },
+  {
+    "step": 895,
+    "loss": 1.96319580078125
+  },
+  {
+    "step": 896,
+    "loss": 1.9458671808242798
+  },
+  {
+    "step": 897,
+    "loss": 2.0543224811553955
+  },
+  {
+    "step": 898,
+    "loss": 2.5579683780670166
+  },
+  {
+    "step": 899,
+    "loss": 2.102567434310913
+  },
+  {
+    "step": 900,
+    "loss": 1.797571063041687
+  },
+  {
+    "step": 901,
+    "loss": 2.612189292907715
+  },
+  {
+    "step": 902,
+    "loss": 1.8275275230407715
+  },
+  {
+    "step": 903,
+    "loss": 2.3661575317382812
+  },
+  {
+    "step": 904,
+    "loss": 2.412741184234619
+  },
+  {
+    "step": 905,
+    "loss": 1.7417240142822266
+  },
+  {
+    "step": 906,
+    "loss": 1.9783049821853638
+  },
+  {
+    "step": 907,
+    "loss": 3.020042896270752
+  },
+  {
+    "step": 908,
+    "loss": 2.264007568359375
+  },
+  {
+    "step": 909,
+    "loss": 2.6521012783050537
+  },
+  {
+    "step": 910,
+    "loss": 1.8450102806091309
+  },
+  {
+    "step": 911,
+    "loss": 2.0339226722717285
+  },
+  {
+    "step": 912,
+    "loss": 1.9741251468658447
+  },
+  {
+    "step": 913,
+    "loss": 2.638288736343384
+  },
+  {
+    "step": 914,
+    "loss": 2.128150463104248
+  },
+  {
+    "step": 915,
+    "loss": 2.2978391647338867
+  },
+  {
+    "step": 916,
+    "loss": 2.329345226287842
+  },
+  {
+    "step": 917,
+    "loss": 1.7687416076660156
+  },
+  {
+    "step": 918,
+    "loss": 1.7877784967422485
+  },
+  {
+    "step": 919,
+    "loss": 2.0238168239593506
+  },
+  {
+    "step": 920,
+    "loss": 2.0090293884277344
+  },
+  {
+    "step": 921,
+    "loss": 2.5923585891723633
+  },
+  {
+    "step": 922,
+    "loss": 2.2417752742767334
+  },
+  {
+    "step": 923,
+    "loss": 2.1116175651550293
+  },
+  {
+    "step": 924,
+    "loss": 1.826296091079712
+  },
+  {
+    "step": 925,
+    "loss": 1.888626217842102
+  },
+  {
+    "step": 926,
+    "loss": 1.9428234100341797
+  },
+  {
+    "step": 927,
+    "loss": 1.937356948852539
+  },
+  {
+    "step": 928,
+    "loss": 2.575594902038574
+  },
+  {
+    "step": 929,
+    "loss": 2.1356945037841797
+  },
+  {
+    "step": 930,
+    "loss": 2.0911166667938232
+  },
+  {
+    "step": 931,
+    "loss": 2.0979466438293457
+  },
+  {
+    "step": 932,
+    "loss": 2.5593225955963135
+  },
+  {
+    "step": 933,
+    "loss": 1.8475861549377441
+  },
+  {
+    "step": 934,
+    "loss": 1.9928505420684814
+  },
+  {
+    "step": 935,
+    "loss": 1.6050671339035034
+  },
+  {
+    "step": 936,
+    "loss": 2.3365602493286133
+  },
+  {
+    "step": 937,
+    "loss": 1.6974786520004272
+  },
+  {
+    "step": 938,
+    "loss": 2.5650625228881836
+  },
+  {
+    "step": 939,
+    "loss": 2.400352954864502
+  },
+  {
+    "step": 940,
+    "loss": 2.04494571685791
+  },
+  {
+    "step": 941,
+    "loss": 1.9382586479187012
+  },
+  {
+    "step": 942,
+    "loss": 2.147663116455078
+  },
+  {
+    "step": 943,
+    "loss": 1.8787052631378174
+  },
+  {
+    "step": 944,
+    "loss": 2.428316593170166
+  },
+  {
+    "step": 945,
+    "loss": 2.1108169555664062
+  },
+  {
+    "step": 946,
+    "loss": 1.6542246341705322
+  },
+  {
+    "step": 947,
+    "loss": 2.0597152709960938
+  },
+  {
+    "step": 948,
+    "loss": 2.3472602367401123
+  },
+  {
+    "step": 949,
+    "loss": 1.8338260650634766
+  },
+  {
+    "step": 950,
+    "loss": 1.7510230541229248
+  },
+  {
+    "step": 951,
+    "loss": 1.7876065969467163
+  },
+  {
+    "step": 952,
+    "loss": 2.431952714920044
+  },
+  {
+    "step": 953,
+    "loss": 1.9844751358032227
+  },
+  {
+    "step": 954,
+    "loss": 1.6035586595535278
+  },
+  {
+    "step": 955,
+    "loss": 2.2497174739837646
+  },
+  {
+    "step": 956,
+    "loss": 2.1397483348846436
+  },
+  {
+    "step": 957,
+    "loss": 2.418480396270752
+  },
+  {
+    "step": 958,
+    "loss": 2.0681729316711426
+  },
+  {
+    "step": 959,
+    "loss": 2.1492745876312256
+  },
+  {
+    "step": 960,
+    "loss": 2.292433023452759
+  },
+  {
+    "step": 961,
+    "loss": 1.993412733078003
+  },
+  {
+    "step": 962,
+    "loss": 1.9851655960083008
+  },
+  {
+    "step": 963,
+    "loss": 2.1893622875213623
+  },
+  {
+    "step": 964,
+    "loss": 2.258875608444214
+  },
+  {
+    "step": 965,
+    "loss": 2.1283998489379883
+  },
+  {
+    "step": 966,
+    "loss": 1.8134756088256836
+  },
+  {
+    "step": 967,
+    "loss": 1.8318551778793335
+  },
+  {
+    "step": 968,
+    "loss": 2.4340434074401855
+  },
+  {
+    "step": 969,
+    "loss": 1.9633982181549072
+  },
+  {
+    "step": 970,
+    "loss": 2.085658311843872
+  },
+  {
+    "step": 971,
+    "loss": 1.3723973035812378
+  },
+  {
+    "step": 972,
+    "loss": 3.041292667388916
+  },
+  {
+    "step": 973,
+    "loss": 2.3183510303497314
+  },
+  {
+    "step": 974,
+    "loss": 1.9262609481811523
+  },
+  {
+    "step": 975,
+    "loss": 2.1205694675445557
+  },
+  {
+    "step": 976,
+    "loss": 1.4980692863464355
+  },
+  {
+    "step": 977,
+    "loss": 2.5546534061431885
+  },
+  {
+    "step": 978,
+    "loss": 2.7014734745025635
+  },
+  {
+    "step": 979,
+    "loss": 1.676489233970642
+  },
+  {
+    "step": 980,
+    "loss": 1.5694572925567627
+  },
+  {
+    "step": 981,
+    "loss": 2.120713233947754
+  },
+  {
+    "step": 982,
+    "loss": 2.21758770942688
+  },
+  {
+    "step": 983,
+    "loss": 1.9932773113250732
+  },
+  {
+    "step": 984,
+    "loss": 2.172217607498169
+  },
+  {
+    "step": 985,
+    "loss": 1.980347990989685
+  },
+  {
+    "step": 986,
+    "loss": 2.1737043857574463
+  },
+  {
+    "step": 987,
+    "loss": 2.1837902069091797
+  },
+  {
+    "step": 988,
+    "loss": 1.7776117324829102
+  },
+  {
+    "step": 989,
+    "loss": 2.1192994117736816
+  },
+  {
+    "step": 990,
+    "loss": 1.7178640365600586
+  },
+  {
+    "step": 991,
+    "loss": 2.1105740070343018
+  },
+  {
+    "step": 992,
+    "loss": 1.9493019580841064
+  },
+  {
+    "step": 993,
+    "loss": 2.4504644870758057
+  },
+  {
+    "step": 994,
+    "loss": 2.0112550258636475
+  },
+  {
+    "step": 995,
+    "loss": 2.2686667442321777
+  },
+  {
+    "step": 996,
+    "loss": 2.4370152950286865
+  },
+  {
+    "step": 997,
+    "loss": 1.8057717084884644
+  },
+  {
+    "step": 998,
+    "loss": 1.7339015007019043
+  },
+  {
+    "step": 999,
+    "loss": 1.915513038635254
+  }
+]
diff --git a/lecture_6/verified_examples/fmm-lagrangian/config.json b/lecture_6/verified_examples/fmm-lagrangian/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..fe1456ddc9c7d2dc7f4935b7ced6c013db18287e
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-lagrangian/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "fmm-lagrangian",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/fmm-lagrangian"
+}
diff --git a/lecture_6/verified_examples/fmm-lagrangian/losses.json b/lecture_6/verified_examples/fmm-lagrangian/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..83fdbb195fcaf8536e251d62c26195c3cbf3c75a
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-lagrangian/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 1.8834762573242188,
+    "diagonal": 1.8811585903167725,
+    "finite": 0.46352335810661316
+  },
+  {
+    "step": 1,
+    "loss": 2.410313367843628,
+    "diagonal": 2.4072864055633545,
+    "finite": 0.30269578099250793
+  },
+  {
+    "step": 2,
+    "loss": 1.7741981744766235,
+    "diagonal": 1.772092580795288,
+    "finite": 0.1403733491897583
+  },
+  {
+    "step": 3,
+    "loss": 2.0622472763061523,
+    "diagonal": 2.057574510574341,
+    "finite": 0.23363852500915527
+  },
+  {
+    "step": 4,
+    "loss": 1.9686061143875122,
+    "diagonal": 1.963993787765503,
+    "finite": 0.18449346721172333
+  },
+  {
+    "step": 5,
+    "loss": 2.624300479888916,
+    "diagonal": 2.6148414611816406,
+    "finite": 0.3152969479560852
+  },
+  {
+    "step": 6,
+    "loss": 2.1316163539886475,
+    "diagonal": 2.1243269443511963,
+    "finite": 0.20826739072799683
+  },
+  {
+    "step": 7,
+    "loss": 1.7774150371551514,
+    "diagonal": 1.7675979137420654,
+    "finite": 0.2454279065132141
+  },
+  {
+    "step": 8,
+    "loss": 1.4608162641525269,
+    "diagonal": 1.4536592960357666,
+    "finite": 0.1590435653924942
+  },
+  {
+    "step": 9,
+    "loss": 1.7388123273849487,
+    "diagonal": 1.7241240739822388,
+    "finite": 0.29376500844955444
+  },
+  {
+    "step": 10,
+    "loss": 1.974505066871643,
+    "diagonal": 1.9596054553985596,
+    "finite": 0.270902156829834
+  },
+  {
+    "step": 11,
+    "loss": 2.550447702407837,
+    "diagonal": 2.530093193054199,
+    "finite": 0.33924242854118347
+  },
+  {
+    "step": 12,
+    "loss": 1.7855415344238281,
+    "diagonal": 1.7726017236709595,
+    "finite": 0.19907385110855103
+  },
+  {
+    "step": 13,
+    "loss": 2.136251449584961,
+    "diagonal": 2.1204605102539062,
+    "finite": 0.2255842685699463
+  },
+  {
+    "step": 14,
+    "loss": 1.9860035181045532,
+    "diagonal": 1.9671200513839722,
+    "finite": 0.25177881121635437
+  },
+  {
+    "step": 15,
+    "loss": 2.0396599769592285,
+    "diagonal": 2.0174474716186523,
+    "finite": 0.2776564061641693
+  },
+  {
+    "step": 16,
+    "loss": 1.7397992610931396,
+    "diagonal": 1.7150850296020508,
+    "finite": 0.2907557785511017
+  },
+  {
+    "step": 17,
+    "loss": 1.7374577522277832,
+    "diagonal": 1.712680697441101,
+    "finite": 0.2753007411956787
+  },
+  {
+    "step": 18,
+    "loss": 1.8114666938781738,
+    "diagonal": 1.7891925573349,
+    "finite": 0.23446418344974518
+  },
+  {
+    "step": 19,
+    "loss": 2.160842180252075,
+    "diagonal": 2.123384952545166,
+    "finite": 0.37457171082496643
+  },
+  {
+    "step": 20,
+    "loss": 2.4927868843078613,
+    "diagonal": 2.460023880004883,
+    "finite": 0.3120296895503998
+  },
+  {
+    "step": 21,
+    "loss": 1.9685323238372803,
+    "diagonal": 1.9339964389801025,
+    "finite": 0.31396204233169556
+  },
+  {
+    "step": 22,
+    "loss": 1.8799480199813843,
+    "diagonal": 1.8486807346343994,
+    "finite": 0.2718892991542816
+  },
+  {
+    "step": 23,
+    "loss": 2.1192426681518555,
+    "diagonal": 2.088029384613037,
+    "finite": 0.26010996103286743
+  },
+  {
+    "step": 24,
+    "loss": 1.8155083656311035,
+    "diagonal": 1.792250156402588,
+    "finite": 0.1860657036304474
+  },
+  {
+    "step": 25,
+    "loss": 2.38384747505188,
+    "diagonal": 2.349881172180176,
+    "finite": 0.26127851009368896
+  },
+  {
+    "step": 26,
+    "loss": 2.0021023750305176,
+    "diagonal": 1.954608678817749,
+    "finite": 0.3518051505088806
+  },
+  {
+    "step": 27,
+    "loss": 1.8204407691955566,
+    "diagonal": 1.7796223163604736,
+    "finite": 0.29156017303466797
+  },
+  {
+    "step": 28,
+    "loss": 2.3195011615753174,
+    "diagonal": 2.292196273803711,
+    "finite": 0.18830987811088562
+  },
+  {
+    "step": 29,
+    "loss": 1.7484846115112305,
+    "diagonal": 1.7082695960998535,
+    "finite": 0.2680997848510742
+  },
+  {
+    "step": 30,
+    "loss": 1.6886029243469238,
+    "diagonal": 1.656844973564148,
+    "finite": 0.20488983392715454
+  },
+  {
+    "step": 31,
+    "loss": 2.195298671722412,
+    "diagonal": 2.171109676361084,
+    "finite": 0.151181161403656
+  },
+  {
+    "step": 32,
+    "loss": 1.7480932474136353,
+    "diagonal": 1.707398533821106,
+    "finite": 0.24663442373275757
+  },
+  {
+    "step": 33,
+    "loss": 2.530231237411499,
+    "diagonal": 2.4872775077819824,
+    "finite": 0.25266900658607483
+  },
+  {
+    "step": 34,
+    "loss": 2.073239326477051,
+    "diagonal": 2.052609920501709,
+    "finite": 0.11788204312324524
+  },
+  {
+    "step": 35,
+    "loss": 2.300211191177368,
+    "diagonal": 2.273676633834839,
+    "finite": 0.14741428196430206
+  },
+  {
+    "step": 36,
+    "loss": 2.6104753017425537,
+    "diagonal": 2.575808525085449,
+    "finite": 0.18738830089569092
+  },
+  {
+    "step": 37,
+    "loss": 2.3542609214782715,
+    "diagonal": 2.321110963821411,
+    "finite": 0.17447403073310852
+  },
+  {
+    "step": 38,
+    "loss": 2.113025426864624,
+    "diagonal": 2.077169179916382,
+    "finite": 0.18387830257415771
+  },
+  {
+    "step": 39,
+    "loss": 2.1741533279418945,
+    "diagonal": 2.136781930923462,
+    "finite": 0.18685752153396606
+  },
+  {
+    "step": 40,
+    "loss": 1.7082499265670776,
+    "diagonal": 1.6293373107910156,
+    "finite": 0.3849397897720337
+  },
+  {
+    "step": 41,
+    "loss": 2.583921194076538,
+    "diagonal": 2.488401174545288,
+    "finite": 0.4548575282096863
+  },
+  {
+    "step": 42,
+    "loss": 2.40718674659729,
+    "diagonal": 2.3666303157806396,
+    "finite": 0.18863454461097717
+  },
+  {
+    "step": 43,
+    "loss": 2.751209020614624,
+    "diagonal": 2.705693244934082,
+    "finite": 0.20689038932323456
+  },
+  {
+    "step": 44,
+    "loss": 1.983818531036377,
+    "diagonal": 1.9275013208389282,
+    "finite": 0.25029894709587097
+  },
+  {
+    "step": 45,
+    "loss": 2.1940717697143555,
+    "diagonal": 2.115964889526367,
+    "finite": 0.339595228433609
+  },
+  {
+    "step": 46,
+    "loss": 2.049490213394165,
+    "diagonal": 1.9971535205841064,
+    "finite": 0.22270908951759338
+  },
+  {
+    "step": 47,
+    "loss": 2.449239730834961,
+    "diagonal": 2.385824203491211,
+    "finite": 0.2642309367656708
+  },
+  {
+    "step": 48,
+    "loss": 2.22090482711792,
+    "diagonal": 2.158033609390259,
+    "finite": 0.25661686062812805
+  },
+  {
+    "step": 49,
+    "loss": 2.254350185394287,
+    "diagonal": 2.210489273071289,
+    "finite": 0.17544354498386383
+  },
+  {
+    "step": 50,
+    "loss": 1.736269474029541,
+    "diagonal": 1.653875470161438,
+    "finite": 0.3231135904788971
+  },
+  {
+    "step": 51,
+    "loss": 1.9656188488006592,
+    "diagonal": 1.911318302154541,
+    "finite": 0.20884840190410614
+  },
+  {
+    "step": 52,
+    "loss": 2.0577614307403564,
+    "diagonal": 1.9897661209106445,
+    "finite": 0.25658589601516724
+  },
+  {
+    "step": 53,
+    "loss": 2.432464361190796,
+    "diagonal": 2.370994806289673,
+    "finite": 0.22766458988189697
+  },
+  {
+    "step": 54,
+    "loss": 1.967360019683838,
+    "diagonal": 1.8452755212783813,
+    "finite": 0.44394350051879883
+  },
+  {
+    "step": 55,
+    "loss": 2.136977195739746,
+    "diagonal": 2.06503963470459,
+    "finite": 0.2569194436073303
+  },
+  {
+    "step": 56,
+    "loss": 2.5953023433685303,
+    "diagonal": 2.5214226245880127,
+    "finite": 0.2592272162437439
+  },
+  {
+    "step": 57,
+    "loss": 2.137213945388794,
+    "diagonal": 2.06386399269104,
+    "finite": 0.2529308795928955
+  },
+  {
+    "step": 58,
+    "loss": 1.938163161277771,
+    "diagonal": 1.860087275505066,
+    "finite": 0.264663964509964
+  },
+  {
+    "step": 59,
+    "loss": 1.7344310283660889,
+    "diagonal": 1.6773791313171387,
+    "finite": 0.19017285108566284
+  },
+  {
+    "step": 60,
+    "loss": 1.9868046045303345,
+    "diagonal": 1.9542254209518433,
+    "finite": 0.10681694000959396
+  },
+  {
+    "step": 61,
+    "loss": 2.3941490650177,
+    "diagonal": 2.3377339839935303,
+    "finite": 0.18198421597480774
+  },
+  {
+    "step": 62,
+    "loss": 1.879172444343567,
+    "diagonal": 1.8177731037139893,
+    "finite": 0.1949186623096466
+  },
+  {
+    "step": 63,
+    "loss": 2.1949374675750732,
+    "diagonal": 2.1509711742401123,
+    "finite": 0.1373949497938156
+  },
+  {
+    "step": 64,
+    "loss": 2.7754151821136475,
+    "diagonal": 2.7345147132873535,
+    "finite": 0.12584754824638367
+  },
+  {
+    "step": 65,
+    "loss": 2.0289502143859863,
+    "diagonal": 1.9471843242645264,
+    "finite": 0.24777528643608093
+  },
+  {
+    "step": 66,
+    "loss": 2.177422285079956,
+    "diagonal": 2.082765579223633,
+    "finite": 0.2825572192668915
+  },
+  {
+    "step": 67,
+    "loss": 2.1364328861236572,
+    "diagonal": 2.066453218460083,
+    "finite": 0.20582222938537598
+  },
+  {
+    "step": 68,
+    "loss": 2.0395946502685547,
+    "diagonal": 1.9948338270187378,
+    "finite": 0.12974153459072113
+  },
+  {
+    "step": 69,
+    "loss": 2.942321538925171,
+    "diagonal": 2.8623387813568115,
+    "finite": 0.22852246463298798
+  },
+  {
+    "step": 70,
+    "loss": 2.2783260345458984,
+    "diagonal": 2.2056634426116943,
+    "finite": 0.2046831250190735
+  },
+  {
+    "step": 71,
+    "loss": 2.174983263015747,
+    "diagonal": 2.102452278137207,
+    "finite": 0.20147523283958435
+  },
+  {
+    "step": 72,
+    "loss": 1.9965882301330566,
+    "diagonal": 1.922891616821289,
+    "finite": 0.20190836489200592
+  },
+  {
+    "step": 73,
+    "loss": 2.094773530960083,
+    "diagonal": 1.9694294929504395,
+    "finite": 0.3387673795223236
+  },
+  {
+    "step": 74,
+    "loss": 2.038822889328003,
+    "diagonal": 1.9120218753814697,
+    "finite": 0.3381362855434418
+  },
+  {
+    "step": 75,
+    "loss": 1.787461519241333,
+    "diagonal": 1.7066688537597656,
+    "finite": 0.21261216700077057
+  },
+  {
+    "step": 76,
+    "loss": 1.7911145687103271,
+    "diagonal": 1.703869342803955,
+    "finite": 0.2266109734773636
+  },
+  {
+    "step": 77,
+    "loss": 2.061724901199341,
+    "diagonal": 1.9768143892288208,
+    "finite": 0.21771901845932007
+  },
+  {
+    "step": 78,
+    "loss": 2.397684335708618,
+    "diagonal": 2.310436248779297,
+    "finite": 0.22088129818439484
+  },
+  {
+    "step": 79,
+    "loss": 2.991274356842041,
+    "diagonal": 2.8499362468719482,
+    "finite": 0.3533453047275543
+  },
+  {
+    "step": 80,
+    "loss": 1.7959686517715454,
+    "diagonal": 1.7046501636505127,
+    "finite": 0.2254776805639267
+  },
+  {
+    "step": 81,
+    "loss": 2.553548812866211,
+    "diagonal": 2.4802088737487793,
+    "finite": 0.17887815833091736
+  },
+  {
+    "step": 82,
+    "loss": 2.132654905319214,
+    "diagonal": 1.9976673126220703,
+    "finite": 0.3252713084220886
+  },
+  {
+    "step": 83,
+    "loss": 2.1746644973754883,
+    "diagonal": 2.0329430103302,
+    "finite": 0.33743229508399963
+  },
+  {
+    "step": 84,
+    "loss": 2.019010305404663,
+    "diagonal": 1.8776929378509521,
+    "finite": 0.33251139521598816
+  },
+  {
+    "step": 85,
+    "loss": 1.7566226720809937,
+    "diagonal": 1.6955426931381226,
+    "finite": 0.14204655587673187
+  },
+  {
+    "step": 86,
+    "loss": 1.9441670179367065,
+    "diagonal": 1.8367176055908203,
+    "finite": 0.2470100373029709
+  },
+  {
+    "step": 87,
+    "loss": 1.8592932224273682,
+    "diagonal": 1.787132978439331,
+    "finite": 0.1640004813671112
+  },
+  {
+    "step": 88,
+    "loss": 1.8907891511917114,
+    "diagonal": 1.8135743141174316,
+    "finite": 0.17351660132408142
+  },
+  {
+    "step": 89,
+    "loss": 2.291184902191162,
+    "diagonal": 2.2377846240997314,
+    "finite": 0.118667371571064
+  },
+  {
+    "step": 90,
+    "loss": 2.00964617729187,
+    "diagonal": 1.9108381271362305,
+    "finite": 0.21716074645519257
+  },
+  {
+    "step": 91,
+    "loss": 1.7540745735168457,
+    "diagonal": 1.6080998182296753,
+    "finite": 0.3173365592956543
+  },
+  {
+    "step": 92,
+    "loss": 1.8393348455429077,
+    "diagonal": 1.754899501800537,
+    "finite": 0.18158143758773804
+  },
+  {
+    "step": 93,
+    "loss": 1.8603005409240723,
+    "diagonal": 1.7607250213623047,
+    "finite": 0.2118627279996872
+  },
+  {
+    "step": 94,
+    "loss": 1.8744863271713257,
+    "diagonal": 1.806694507598877,
+    "finite": 0.14271964132785797
+  },
+  {
+    "step": 95,
+    "loss": 2.047955274581909,
+    "diagonal": 1.9767273664474487,
+    "finite": 0.1483912616968155
+  },
+  {
+    "step": 96,
+    "loss": 1.9215730428695679,
+    "diagonal": 1.8425264358520508,
+    "finite": 0.16298270225524902
+  },
+  {
+    "step": 97,
+    "loss": 2.076960802078247,
+    "diagonal": 1.9940800666809082,
+    "finite": 0.16914424300193787
+  },
+  {
+    "step": 98,
+    "loss": 2.0113046169281006,
+    "diagonal": 1.9245195388793945,
+    "finite": 0.1753234714269638
+  },
+  {
+    "step": 99,
+    "loss": 2.3144655227661133,
+    "diagonal": 2.2299816608428955,
+    "finite": 0.16896767914295197
+  },
+  {
+    "step": 100,
+    "loss": 1.9848586320877075,
+    "diagonal": 1.916944980621338,
+    "finite": 0.13448256254196167
+  },
+  {
+    "step": 101,
+    "loss": 1.8651962280273438,
+    "diagonal": 1.7855689525604248,
+    "finite": 0.15613186359405518
+  },
+  {
+    "step": 102,
+    "loss": 2.4529359340667725,
+    "diagonal": 2.3659582138061523,
+    "finite": 0.16888859868049622
+  },
+  {
+    "step": 103,
+    "loss": 1.696691632270813,
+    "diagonal": 1.6131428480148315,
+    "finite": 0.16067078709602356
+  },
+  {
+    "step": 104,
+    "loss": 2.2678210735321045,
+    "diagonal": 2.1666266918182373,
+    "finite": 0.19275104999542236
+  },
+  {
+    "step": 105,
+    "loss": 1.6929866075515747,
+    "diagonal": 1.6018810272216797,
+    "finite": 0.171897292137146
+  },
+  {
+    "step": 106,
+    "loss": 2.0644118785858154,
+    "diagonal": 2.016714096069336,
+    "finite": 0.08915483206510544
+  },
+  {
+    "step": 107,
+    "loss": 1.8823177814483643,
+    "diagonal": 1.811112642288208,
+    "finite": 0.13186125457286835
+  },
+  {
+    "step": 108,
+    "loss": 2.1933205127716064,
+    "diagonal": 2.0557661056518555,
+    "finite": 0.25239354372024536
+  },
+  {
+    "step": 109,
+    "loss": 2.227180004119873,
+    "diagonal": 2.1579482555389404,
+    "finite": 0.1258760392665863
+  },
+  {
+    "step": 110,
+    "loss": 2.476125717163086,
+    "diagonal": 2.4034173488616943,
+    "finite": 0.13100607693195343
+  },
+  {
+    "step": 111,
+    "loss": 2.3966064453125,
+    "diagonal": 2.306407928466797,
+    "finite": 0.16106876730918884
+  },
+  {
+    "step": 112,
+    "loss": 2.8558220863342285,
+    "diagonal": 2.788193702697754,
+    "finite": 0.11969617009162903
+  },
+  {
+    "step": 113,
+    "loss": 2.0972485542297363,
+    "diagonal": 2.0373268127441406,
+    "finite": 0.10512585937976837
+  },
+  {
+    "step": 114,
+    "loss": 1.890120029449463,
+    "diagonal": 1.8064675331115723,
+    "finite": 0.14548256993293762
+  },
+  {
+    "step": 115,
+    "loss": 2.03648042678833,
+    "diagonal": 1.9765257835388184,
+    "finite": 0.10337014496326447
+  },
+  {
+    "step": 116,
+    "loss": 2.147674083709717,
+    "diagonal": 1.9982050657272339,
+    "finite": 0.2555026113986969
+  },
+  {
+    "step": 117,
+    "loss": 2.30226469039917,
+    "diagonal": 2.168229341506958,
+    "finite": 0.2271783947944641
+  },
+  {
+    "step": 118,
+    "loss": 2.063002586364746,
+    "diagonal": 1.9724726676940918,
+    "finite": 0.1521509438753128
+  },
+  {
+    "step": 119,
+    "loss": 2.0940403938293457,
+    "diagonal": 1.9948577880859375,
+    "finite": 0.165304496884346
+  },
+  {
+    "step": 120,
+    "loss": 2.3003296852111816,
+    "diagonal": 2.231574296951294,
+    "finite": 0.11364520341157913
+  },
+  {
+    "step": 121,
+    "loss": 2.131779670715332,
+    "diagonal": 2.0372095108032227,
+    "finite": 0.15503285825252533
+  },
+  {
+    "step": 122,
+    "loss": 1.6529617309570312,
+    "diagonal": 1.5538209676742554,
+    "finite": 0.16120441257953644
+  },
+  {
+    "step": 123,
+    "loss": 1.7707880735397339,
+    "diagonal": 1.7028886079788208,
+    "finite": 0.1095152348279953
+  },
+  {
+    "step": 124,
+    "loss": 2.334031105041504,
+    "diagonal": 2.2544946670532227,
+    "finite": 0.1272582858800888
+  },
+  {
+    "step": 125,
+    "loss": 2.341212272644043,
+    "diagonal": 2.1604957580566406,
+    "finite": 0.2868514358997345
+  },
+  {
+    "step": 126,
+    "loss": 2.0622825622558594,
+    "diagonal": 1.9868807792663574,
+    "finite": 0.11874295771121979
+  },
+  {
+    "step": 127,
+    "loss": 2.067052125930786,
+    "diagonal": 1.9878870248794556,
+    "finite": 0.12369533628225327
+  },
+  {
+    "step": 128,
+    "loss": 2.1348342895507812,
+    "diagonal": 2.056900978088379,
+    "finite": 0.12082687020301819
+  },
+  {
+    "step": 129,
+    "loss": 2.4682579040527344,
+    "diagonal": 2.3833189010620117,
+    "finite": 0.13067539036273956
+  },
+  {
+    "step": 130,
+    "loss": 2.23677659034729,
+    "diagonal": 2.1497750282287598,
+    "finite": 0.13282692432403564
+  },
+  {
+    "step": 131,
+    "loss": 2.0575008392333984,
+    "diagonal": 1.9737554788589478,
+    "finite": 0.1268867552280426
+  },
+  {
+    "step": 132,
+    "loss": 1.7156060934066772,
+    "diagonal": 1.6354817152023315,
+    "finite": 0.12048771977424622
+  },
+  {
+    "step": 133,
+    "loss": 2.287933111190796,
+    "diagonal": 2.202054262161255,
+    "finite": 0.12817734479904175
+  },
+  {
+    "step": 134,
+    "loss": 1.9805991649627686,
+    "diagonal": 1.9132441282272339,
+    "finite": 0.09978529810905457
+  },
+  {
+    "step": 135,
+    "loss": 1.936172604560852,
+    "diagonal": 1.8439760208129883,
+    "finite": 0.13558326661586761
+  },
+  {
+    "step": 136,
+    "loss": 1.7757081985473633,
+    "diagonal": 1.669210433959961,
+    "finite": 0.15547119081020355
+  },
+  {
+    "step": 137,
+    "loss": 1.86720871925354,
+    "diagonal": 1.7789109945297241,
+    "finite": 0.1279676854610443
+  },
+  {
+    "step": 138,
+    "loss": 2.281270742416382,
+    "diagonal": 2.188777208328247,
+    "finite": 0.13308434188365936
+  },
+  {
+    "step": 139,
+    "loss": 2.5039479732513428,
+    "diagonal": 2.419433116912842,
+    "finite": 0.12073564529418945
+  },
+  {
+    "step": 140,
+    "loss": 2.6777420043945312,
+    "diagonal": 2.5669145584106445,
+    "finite": 0.15720194578170776
+  },
+  {
+    "step": 141,
+    "loss": 1.9122928380966187,
+    "diagonal": 1.8109073638916016,
+    "finite": 0.1427963823080063
+  },
+  {
+    "step": 142,
+    "loss": 2.401693820953369,
+    "diagonal": 2.2116856575012207,
+    "finite": 0.2657456696033478
+  },
+  {
+    "step": 143,
+    "loss": 2.6658079624176025,
+    "diagonal": 2.515446186065674,
+    "finite": 0.20883587002754211
+  },
+  {
+    "step": 144,
+    "loss": 2.018636703491211,
+    "diagonal": 1.8694742918014526,
+    "finite": 0.20574131608009338
+  },
+  {
+    "step": 145,
+    "loss": 2.073255777359009,
+    "diagonal": 1.9464921951293945,
+    "finite": 0.173648864030838
+  },
+  {
+    "step": 146,
+    "loss": 2.222153663635254,
+    "diagonal": 2.1429243087768555,
+    "finite": 0.10779504477977753
+  },
+  {
+    "step": 147,
+    "loss": 2.059480667114258,
+    "diagonal": 1.9696871042251587,
+    "finite": 0.12134262919425964
+  },
+  {
+    "step": 148,
+    "loss": 2.0134482383728027,
+    "diagonal": 1.8610990047454834,
+    "finite": 0.20449547469615936
+  },
+  {
+    "step": 149,
+    "loss": 2.18005108833313,
+    "diagonal": 2.085005760192871,
+    "finite": 0.12672705948352814
+  },
+  {
+    "step": 150,
+    "loss": 2.5093350410461426,
+    "diagonal": 2.3682186603546143,
+    "finite": 0.18690907955169678
+  },
+  {
+    "step": 151,
+    "loss": 2.793576955795288,
+    "diagonal": 2.7178797721862793,
+    "finite": 0.0996016412973404
+  },
+  {
+    "step": 152,
+    "loss": 2.6768152713775635,
+    "diagonal": 2.5709824562072754,
+    "finite": 0.1383434236049652
+  },
+  {
+    "step": 153,
+    "loss": 2.430969715118408,
+    "diagonal": 2.3234715461730957,
+    "finite": 0.13960814476013184
+  },
+  {
+    "step": 154,
+    "loss": 2.3524789810180664,
+    "diagonal": 2.236165761947632,
+    "finite": 0.15008169412612915
+  },
+  {
+    "step": 155,
+    "loss": 1.9998788833618164,
+    "diagonal": 1.9080265760421753,
+    "finite": 0.11775936186313629
+  },
+  {
+    "step": 156,
+    "loss": 1.9655070304870605,
+    "diagonal": 1.8047047853469849,
+    "finite": 0.20484361052513123
+  },
+  {
+    "step": 157,
+    "loss": 1.927738904953003,
+    "diagonal": 1.801883339881897,
+    "finite": 0.15931080281734467
+  },
+  {
+    "step": 158,
+    "loss": 1.7180259227752686,
+    "diagonal": 1.6293374300003052,
+    "finite": 0.11155778914690018
+  },
+  {
+    "step": 159,
+    "loss": 2.135286808013916,
+    "diagonal": 2.0448107719421387,
+    "finite": 0.11309495568275452
+  },
+  {
+    "step": 160,
+    "loss": 2.5865635871887207,
+    "diagonal": 2.437237501144409,
+    "finite": 0.18549813330173492
+  },
+  {
+    "step": 161,
+    "loss": 1.9221670627593994,
+    "diagonal": 1.8183965682983398,
+    "finite": 0.12811172008514404
+  },
+  {
+    "step": 162,
+    "loss": 2.271533727645874,
+    "diagonal": 2.123633623123169,
+    "finite": 0.18147261440753937
+  },
+  {
+    "step": 163,
+    "loss": 1.6173427104949951,
+    "diagonal": 1.4861150979995728,
+    "finite": 0.16003361344337463
+  },
+  {
+    "step": 164,
+    "loss": 1.9855016469955444,
+    "diagonal": 1.862332820892334,
+    "finite": 0.1492956131696701
+  },
+  {
+    "step": 165,
+    "loss": 2.260411024093628,
+    "diagonal": 2.1536097526550293,
+    "finite": 0.12867619097232819
+  },
+  {
+    "step": 166,
+    "loss": 1.9722237586975098,
+    "diagonal": 1.858464002609253,
+    "finite": 0.1362392008304596
+  },
+  {
+    "step": 167,
+    "loss": 1.8565946817398071,
+    "diagonal": 1.696210503578186,
+    "finite": 0.19093352556228638
+  },
+  {
+    "step": 168,
+    "loss": 1.9115639925003052,
+    "diagonal": 1.8415687084197998,
+    "finite": 0.08283460885286331
+  },
+  {
+    "step": 169,
+    "loss": 2.2937920093536377,
+    "diagonal": 2.1289217472076416,
+    "finite": 0.19396506249904633
+  },
+  {
+    "step": 170,
+    "loss": 2.021174430847168,
+    "diagonal": 1.9093880653381348,
+    "finite": 0.13074442744255066
+  },
+  {
+    "step": 171,
+    "loss": 2.64638090133667,
+    "diagonal": 2.5010879039764404,
+    "finite": 0.1689453274011612
+  },
+  {
+    "step": 172,
+    "loss": 2.772830009460449,
+    "diagonal": 2.609282970428467,
+    "finite": 0.18907177448272705
+  },
+  {
+    "step": 173,
+    "loss": 2.0507447719573975,
+    "diagonal": 1.8663252592086792,
+    "finite": 0.21197646856307983
+  },
+  {
+    "step": 174,
+    "loss": 2.109144926071167,
+    "diagonal": 1.9969813823699951,
+    "finite": 0.12818680703639984
+  },
+  {
+    "step": 175,
+    "loss": 2.1518239974975586,
+    "diagonal": 2.042182445526123,
+    "finite": 0.12459254264831543
+  },
+  {
+    "step": 176,
+    "loss": 1.988581895828247,
+    "diagonal": 1.8725887537002563,
+    "finite": 0.13106568157672882
+  },
+  {
+    "step": 177,
+    "loss": 2.1899430751800537,
+    "diagonal": 2.0864930152893066,
+    "finite": 0.11623591929674149
+  },
+  {
+    "step": 178,
+    "loss": 2.0730209350585938,
+    "diagonal": 1.7005118131637573,
+    "finite": 0.4162113070487976
+  },
+  {
+    "step": 179,
+    "loss": 1.9782038927078247,
+    "diagonal": 1.8411657810211182,
+    "finite": 0.15226459503173828
+  },
+  {
+    "step": 180,
+    "loss": 1.6775771379470825,
+    "diagonal": 1.5459177494049072,
+    "finite": 0.14548003673553467
+  },
+  {
+    "step": 181,
+    "loss": 2.2662436962127686,
+    "diagonal": 2.171684980392456,
+    "finite": 0.10391056537628174
+  },
+  {
+    "step": 182,
+    "loss": 2.562577486038208,
+    "diagonal": 2.376380205154419,
+    "finite": 0.20349425077438354
+  },
+  {
+    "step": 183,
+    "loss": 2.0711231231689453,
+    "diagonal": 1.9290440082550049,
+    "finite": 0.1544337272644043
+  },
+  {
+    "step": 184,
+    "loss": 2.541156768798828,
+    "diagonal": 2.3758304119110107,
+    "finite": 0.17873132228851318
+  },
+  {
+    "step": 185,
+    "loss": 1.9405028820037842,
+    "diagonal": 1.8417261838912964,
+    "finite": 0.10621155053377151
+  },
+  {
+    "step": 186,
+    "loss": 2.050433874130249,
+    "diagonal": 1.8994287252426147,
+    "finite": 0.16150282323360443
+  },
+  {
+    "step": 187,
+    "loss": 2.6799542903900146,
+    "diagonal": 2.4328389167785645,
+    "finite": 0.2628887891769409
+  },
+  {
+    "step": 188,
+    "loss": 2.463594675064087,
+    "diagonal": 2.3792226314544678,
+    "finite": 0.08928264677524567
+  },
+  {
+    "step": 189,
+    "loss": 2.8271546363830566,
+    "diagonal": 2.6766157150268555,
+    "finite": 0.1584620475769043
+  },
+  {
+    "step": 190,
+    "loss": 1.777803659439087,
+    "diagonal": 1.6368472576141357,
+    "finite": 0.14759838581085205
+  },
+  {
+    "step": 191,
+    "loss": 2.236067056655884,
+    "diagonal": 2.132404327392578,
+    "finite": 0.10798195749521255
+  },
+  {
+    "step": 192,
+    "loss": 2.3182272911071777,
+    "diagonal": 2.2131359577178955,
+    "finite": 0.10890306532382965
+  },
+  {
+    "step": 193,
+    "loss": 2.827171564102173,
+    "diagonal": 2.745006561279297,
+    "finite": 0.08470609784126282
+  },
+  {
+    "step": 194,
+    "loss": 2.2870469093322754,
+    "diagonal": 2.147209882736206,
+    "finite": 0.14342260360717773
+  },
+  {
+    "step": 195,
+    "loss": 1.515771508216858,
+    "diagonal": 1.3825080394744873,
+    "finite": 0.13598313927650452
+  },
+  {
+    "step": 196,
+    "loss": 2.7221121788024902,
+    "diagonal": 2.6264052391052246,
+    "finite": 0.09716431051492691
+  },
+  {
+    "step": 197,
+    "loss": 1.787119746208191,
+    "diagonal": 1.6644794940948486,
+    "finite": 0.12387903779745102
+  },
+  {
+    "step": 198,
+    "loss": 1.9687707424163818,
+    "diagonal": 1.8766794204711914,
+    "finite": 0.09255415201187134
+  },
+  {
+    "step": 199,
+    "loss": 1.981062650680542,
+    "diagonal": 1.8205763101577759,
+    "finite": 0.16048632562160492
+  },
+  {
+    "step": 200,
+    "loss": 2.5496065616607666,
+    "diagonal": 2.4405717849731445,
+    "finite": 0.10903473943471909
+  },
+  {
+    "step": 201,
+    "loss": 2.3849375247955322,
+    "diagonal": 2.2594802379608154,
+    "finite": 0.12545721232891083
+  },
+  {
+    "step": 202,
+    "loss": 3.004631519317627,
+    "diagonal": 2.8756442070007324,
+    "finite": 0.12898743152618408
+  },
+  {
+    "step": 203,
+    "loss": 2.2818870544433594,
+    "diagonal": 2.150602102279663,
+    "finite": 0.1312849521636963
+  },
+  {
+    "step": 204,
+    "loss": 2.6382672786712646,
+    "diagonal": 2.4977283477783203,
+    "finite": 0.1405389904975891
+  },
+  {
+    "step": 205,
+    "loss": 2.2950096130371094,
+    "diagonal": 2.1273934841156006,
+    "finite": 0.16761600971221924
+  },
+  {
+    "step": 206,
+    "loss": 2.4128973484039307,
+    "diagonal": 2.2134432792663574,
+    "finite": 0.19945411384105682
+  },
+  {
+    "step": 207,
+    "loss": 1.821271538734436,
+    "diagonal": 1.7202799320220947,
+    "finite": 0.1009916216135025
+  },
+  {
+    "step": 208,
+    "loss": 1.7551491260528564,
+    "diagonal": 1.655957818031311,
+    "finite": 0.09919131547212601
+  },
+  {
+    "step": 209,
+    "loss": 1.9913196563720703,
+    "diagonal": 1.9122496843338013,
+    "finite": 0.07907002419233322
+  },
+  {
+    "step": 210,
+    "loss": 1.9404231309890747,
+    "diagonal": 1.7465527057647705,
+    "finite": 0.1938704550266266
+  },
+  {
+    "step": 211,
+    "loss": 2.0576581954956055,
+    "diagonal": 1.8914568424224854,
+    "finite": 0.1662013977766037
+  },
+  {
+    "step": 212,
+    "loss": 2.0413215160369873,
+    "diagonal": 1.9213237762451172,
+    "finite": 0.11999782174825668
+  },
+  {
+    "step": 213,
+    "loss": 2.497938394546509,
+    "diagonal": 2.377371311187744,
+    "finite": 0.12056713551282883
+  },
+  {
+    "step": 214,
+    "loss": 2.6672987937927246,
+    "diagonal": 2.5438504219055176,
+    "finite": 0.12344837933778763
+  },
+  {
+    "step": 215,
+    "loss": 2.1330485343933105,
+    "diagonal": 1.9096527099609375,
+    "finite": 0.22339585423469543
+  },
+  {
+    "step": 216,
+    "loss": 1.714159369468689,
+    "diagonal": 1.6287275552749634,
+    "finite": 0.08543185889720917
+  },
+  {
+    "step": 217,
+    "loss": 2.0080862045288086,
+    "diagonal": 1.894924521446228,
+    "finite": 0.1131616085767746
+  },
+  {
+    "step": 218,
+    "loss": 2.5216803550720215,
+    "diagonal": 2.375271797180176,
+    "finite": 0.14640867710113525
+  },
+  {
+    "step": 219,
+    "loss": 2.330507278442383,
+    "diagonal": 2.137808084487915,
+    "finite": 0.19269923865795135
+  },
+  {
+    "step": 220,
+    "loss": 2.1229937076568604,
+    "diagonal": 2.039580821990967,
+    "finite": 0.08341297507286072
+  },
+  {
+    "step": 221,
+    "loss": 1.8516446352005005,
+    "diagonal": 1.7308591604232788,
+    "finite": 0.12078546732664108
+  },
+  {
+    "step": 222,
+    "loss": 1.9778047800064087,
+    "diagonal": 1.8184177875518799,
+    "finite": 0.1593869924545288
+  },
+  {
+    "step": 223,
+    "loss": 1.674328327178955,
+    "diagonal": 1.5266222953796387,
+    "finite": 0.1477060168981552
+  },
+  {
+    "step": 224,
+    "loss": 2.49053692817688,
+    "diagonal": 2.355684995651245,
+    "finite": 0.13485199213027954
+  },
+  {
+    "step": 225,
+    "loss": 2.4657394886016846,
+    "diagonal": 2.3574600219726562,
+    "finite": 0.10827938467264175
+  },
+  {
+    "step": 226,
+    "loss": 2.0849316120147705,
+    "diagonal": 1.900611400604248,
+    "finite": 0.18432027101516724
+  },
+  {
+    "step": 227,
+    "loss": 2.350734233856201,
+    "diagonal": 2.23903226852417,
+    "finite": 0.11170193552970886
+  },
+  {
+    "step": 228,
+    "loss": 2.346668004989624,
+    "diagonal": 2.0931437015533447,
+    "finite": 0.2535243332386017
+  },
+  {
+    "step": 229,
+    "loss": 2.4503281116485596,
+    "diagonal": 2.328373908996582,
+    "finite": 0.1219542995095253
+  },
+  {
+    "step": 230,
+    "loss": 2.2599594593048096,
+    "diagonal": 2.1495723724365234,
+    "finite": 0.11038702726364136
+  },
+  {
+    "step": 231,
+    "loss": 1.9176576137542725,
+    "diagonal": 1.8324968814849854,
+    "finite": 0.08516078442335129
+  },
+  {
+    "step": 232,
+    "loss": 1.9554880857467651,
+    "diagonal": 1.8121757507324219,
+    "finite": 0.14331232011318207
+  },
+  {
+    "step": 233,
+    "loss": 2.400893211364746,
+    "diagonal": 2.297463893890381,
+    "finite": 0.10342933982610703
+  },
+  {
+    "step": 234,
+    "loss": 2.5272791385650635,
+    "diagonal": 2.4253733158111572,
+    "finite": 0.10190581530332565
+  },
+  {
+    "step": 235,
+    "loss": 1.6473065614700317,
+    "diagonal": 1.5521901845932007,
+    "finite": 0.09511637687683105
+  },
+  {
+    "step": 236,
+    "loss": 2.535689353942871,
+    "diagonal": 2.4343929290771484,
+    "finite": 0.1012963131070137
+  },
+  {
+    "step": 237,
+    "loss": 2.406677007675171,
+    "diagonal": 2.2941527366638184,
+    "finite": 0.11252428591251373
+  },
+  {
+    "step": 238,
+    "loss": 2.3528835773468018,
+    "diagonal": 2.2493205070495605,
+    "finite": 0.10356307774782181
+  },
+  {
+    "step": 239,
+    "loss": 1.842453122138977,
+    "diagonal": 1.7296160459518433,
+    "finite": 0.1128370389342308
+  },
+  {
+    "step": 240,
+    "loss": 2.09542179107666,
+    "diagonal": 1.9994961023330688,
+    "finite": 0.09592558443546295
+  },
+  {
+    "step": 241,
+    "loss": 1.5635253190994263,
+    "diagonal": 1.4572852849960327,
+    "finite": 0.10624001175165176
+  },
+  {
+    "step": 242,
+    "loss": 1.8221062421798706,
+    "diagonal": 1.6547305583953857,
+    "finite": 0.16737565398216248
+  },
+  {
+    "step": 243,
+    "loss": 3.019317626953125,
+    "diagonal": 2.9001965522766113,
+    "finite": 0.11912116408348083
+  },
+  {
+    "step": 244,
+    "loss": 2.749117374420166,
+    "diagonal": 2.615811586380005,
+    "finite": 0.1333058774471283
+  },
+  {
+    "step": 245,
+    "loss": 2.3912501335144043,
+    "diagonal": 2.1999588012695312,
+    "finite": 0.19129139184951782
+  },
+  {
+    "step": 246,
+    "loss": 2.373037815093994,
+    "diagonal": 2.2279515266418457,
+    "finite": 0.1450863480567932
+  },
+  {
+    "step": 247,
+    "loss": 2.2308144569396973,
+    "diagonal": 2.1054091453552246,
+    "finite": 0.12540525197982788
+  },
+  {
+    "step": 248,
+    "loss": 2.5938496589660645,
+    "diagonal": 2.462865114212036,
+    "finite": 0.13098454475402832
+  },
+  {
+    "step": 249,
+    "loss": 1.768247365951538,
+    "diagonal": 1.646291971206665,
+    "finite": 0.12195538729429245
+  },
+  {
+    "step": 250,
+    "loss": 2.5633652210235596,
+    "diagonal": 2.4351282119750977,
+    "finite": 0.1282370686531067
+  },
+  {
+    "step": 251,
+    "loss": 1.516966462135315,
+    "diagonal": 1.415837049484253,
+    "finite": 0.10112938284873962
+  },
+  {
+    "step": 252,
+    "loss": 2.8146090507507324,
+    "diagonal": 2.6846604347229004,
+    "finite": 0.12994858622550964
+  },
+  {
+    "step": 253,
+    "loss": 1.560897946357727,
+    "diagonal": 1.461669683456421,
+    "finite": 0.09922822564840317
+  },
+  {
+    "step": 254,
+    "loss": 1.691098690032959,
+    "diagonal": 1.5815948247909546,
+    "finite": 0.10950392484664917
+  },
+  {
+    "step": 255,
+    "loss": 2.0520265102386475,
+    "diagonal": 1.8895721435546875,
+    "finite": 0.16245442628860474
+  },
+  {
+    "step": 256,
+    "loss": 1.9020180702209473,
+    "diagonal": 1.8021035194396973,
+    "finite": 0.09991455078125
+  },
+  {
+    "step": 257,
+    "loss": 2.1506261825561523,
+    "diagonal": 2.0563318729400635,
+    "finite": 0.09429426491260529
+  },
+  {
+    "step": 258,
+    "loss": 2.6806435585021973,
+    "diagonal": 2.534127950668335,
+    "finite": 0.14651557803153992
+  },
+  {
+    "step": 259,
+    "loss": 2.282219886779785,
+    "diagonal": 2.1207385063171387,
+    "finite": 0.16148126125335693
+  },
+  {
+    "step": 260,
+    "loss": 2.1785027980804443,
+    "diagonal": 2.0564217567443848,
+    "finite": 0.12208099663257599
+  },
+  {
+    "step": 261,
+    "loss": 1.4817519187927246,
+    "diagonal": 1.365156650543213,
+    "finite": 0.11659525334835052
+  },
+  {
+    "step": 262,
+    "loss": 2.426600217819214,
+    "diagonal": 2.2822835445404053,
+    "finite": 0.14431658387184143
+  },
+  {
+    "step": 263,
+    "loss": 2.4597926139831543,
+    "diagonal": 2.3627772331237793,
+    "finite": 0.09701535105705261
+  },
+  {
+    "step": 264,
+    "loss": 2.0032835006713867,
+    "diagonal": 1.8775755167007446,
+    "finite": 0.1257079392671585
+  },
+  {
+    "step": 265,
+    "loss": 2.0523934364318848,
+    "diagonal": 1.8641902208328247,
+    "finite": 0.1882031410932541
+  },
+  {
+    "step": 266,
+    "loss": 2.2051846981048584,
+    "diagonal": 2.0493216514587402,
+    "finite": 0.15586312115192413
+  },
+  {
+    "step": 267,
+    "loss": 2.4093730449676514,
+    "diagonal": 2.2929069995880127,
+    "finite": 0.11646602302789688
+  },
+  {
+    "step": 268,
+    "loss": 1.6715530157089233,
+    "diagonal": 1.5778652429580688,
+    "finite": 0.09368777275085449
+  },
+  {
+    "step": 269,
+    "loss": 1.7653650045394897,
+    "diagonal": 1.69008469581604,
+    "finite": 0.07528025656938553
+  },
+  {
+    "step": 270,
+    "loss": 2.0924465656280518,
+    "diagonal": 1.968647837638855,
+    "finite": 0.12379872053861618
+  },
+  {
+    "step": 271,
+    "loss": 1.9994651079177856,
+    "diagonal": 1.8843528032302856,
+    "finite": 0.11511234194040298
+  },
+  {
+    "step": 272,
+    "loss": 1.90847647190094,
+    "diagonal": 1.7605446577072144,
+    "finite": 0.1479317992925644
+  },
+  {
+    "step": 273,
+    "loss": 2.66184663772583,
+    "diagonal": 2.436960458755493,
+    "finite": 0.22488610446453094
+  },
+  {
+    "step": 274,
+    "loss": 2.380577325820923,
+    "diagonal": 2.2545523643493652,
+    "finite": 0.12602496147155762
+  },
+  {
+    "step": 275,
+    "loss": 2.0261290073394775,
+    "diagonal": 1.950546145439148,
+    "finite": 0.07558280229568481
+  },
+  {
+    "step": 276,
+    "loss": 1.963229775428772,
+    "diagonal": 1.854487657546997,
+    "finite": 0.1087421327829361
+  },
+  {
+    "step": 277,
+    "loss": 2.79050350189209,
+    "diagonal": 2.6083426475524902,
+    "finite": 0.18216073513031006
+  },
+  {
+    "step": 278,
+    "loss": 2.2598674297332764,
+    "diagonal": 2.0947625637054443,
+    "finite": 0.16510483622550964
+  },
+  {
+    "step": 279,
+    "loss": 2.225565195083618,
+    "diagonal": 2.1335501670837402,
+    "finite": 0.09201512485742569
+  },
+  {
+    "step": 280,
+    "loss": 2.392341375350952,
+    "diagonal": 2.2622432708740234,
+    "finite": 0.13009820878505707
+  },
+  {
+    "step": 281,
+    "loss": 2.7168161869049072,
+    "diagonal": 2.5636510848999023,
+    "finite": 0.1531650722026825
+  },
+  {
+    "step": 282,
+    "loss": 2.033060312271118,
+    "diagonal": 1.919413447380066,
+    "finite": 0.11364677548408508
+  },
+  {
+    "step": 283,
+    "loss": 2.161595344543457,
+    "diagonal": 2.0146727561950684,
+    "finite": 0.14692269265651703
+  },
+  {
+    "step": 284,
+    "loss": 2.300163745880127,
+    "diagonal": 2.208671808242798,
+    "finite": 0.09149187058210373
+  },
+  {
+    "step": 285,
+    "loss": 1.7106434106826782,
+    "diagonal": 1.5831414461135864,
+    "finite": 0.127501979470253
+  },
+  {
+    "step": 286,
+    "loss": 2.1149449348449707,
+    "diagonal": 2.001270294189453,
+    "finite": 0.11367463320493698
+  },
+  {
+    "step": 287,
+    "loss": 2.0463454723358154,
+    "diagonal": 1.9652318954467773,
+    "finite": 0.08111363649368286
+  },
+  {
+    "step": 288,
+    "loss": 2.075659990310669,
+    "diagonal": 1.9302432537078857,
+    "finite": 0.14541664719581604
+  },
+  {
+    "step": 289,
+    "loss": 1.8819067478179932,
+    "diagonal": 1.7716269493103027,
+    "finite": 0.11027977615594864
+  },
+  {
+    "step": 290,
+    "loss": 1.6152000427246094,
+    "diagonal": 1.5173330307006836,
+    "finite": 0.09786704182624817
+  },
+  {
+    "step": 291,
+    "loss": 2.134582757949829,
+    "diagonal": 2.0038342475891113,
+    "finite": 0.13074859976768494
+  },
+  {
+    "step": 292,
+    "loss": 2.0073864459991455,
+    "diagonal": 1.9217426776885986,
+    "finite": 0.08564375340938568
+  },
+  {
+    "step": 293,
+    "loss": 2.200017213821411,
+    "diagonal": 2.0272815227508545,
+    "finite": 0.1727357655763626
+  },
+  {
+    "step": 294,
+    "loss": 2.192932367324829,
+    "diagonal": 2.034703254699707,
+    "finite": 0.15822918713092804
+  },
+  {
+    "step": 295,
+    "loss": 2.400327682495117,
+    "diagonal": 2.259767532348633,
+    "finite": 0.14056022465229034
+  },
+  {
+    "step": 296,
+    "loss": 2.4267587661743164,
+    "diagonal": 2.2800328731536865,
+    "finite": 0.14672598242759705
+  },
+  {
+    "step": 297,
+    "loss": 2.3311009407043457,
+    "diagonal": 2.2224624156951904,
+    "finite": 0.10863860696554184
+  },
+  {
+    "step": 298,
+    "loss": 2.0008559226989746,
+    "diagonal": 1.9057708978652954,
+    "finite": 0.09508509933948517
+  },
+  {
+    "step": 299,
+    "loss": 2.140709400177002,
+    "diagonal": 1.9779257774353027,
+    "finite": 0.16278372704982758
+  },
+  {
+    "step": 300,
+    "loss": 2.1944022178649902,
+    "diagonal": 2.065533399581909,
+    "finite": 0.12886878848075867
+  },
+  {
+    "step": 301,
+    "loss": 2.507081985473633,
+    "diagonal": 2.3790621757507324,
+    "finite": 0.12801985442638397
+  },
+  {
+    "step": 302,
+    "loss": 2.0474581718444824,
+    "diagonal": 1.9441840648651123,
+    "finite": 0.10327416658401489
+  },
+  {
+    "step": 303,
+    "loss": 1.515325903892517,
+    "diagonal": 1.4239246845245361,
+    "finite": 0.09140125662088394
+  },
+  {
+    "step": 304,
+    "loss": 2.579503059387207,
+    "diagonal": 2.422283887863159,
+    "finite": 0.15721917152404785
+  },
+  {
+    "step": 305,
+    "loss": 2.7895233631134033,
+    "diagonal": 2.6884639263153076,
+    "finite": 0.1010594367980957
+  },
+  {
+    "step": 306,
+    "loss": 2.2305691242218018,
+    "diagonal": 2.1432182788848877,
+    "finite": 0.08735083788633347
+  },
+  {
+    "step": 307,
+    "loss": 2.1188812255859375,
+    "diagonal": 2.014108657836914,
+    "finite": 0.10477253794670105
+  },
+  {
+    "step": 308,
+    "loss": 1.9919356107711792,
+    "diagonal": 1.855228304862976,
+    "finite": 0.13670730590820312
+  },
+  {
+    "step": 309,
+    "loss": 2.2089853286743164,
+    "diagonal": 2.144995927810669,
+    "finite": 0.0639893040060997
+  },
+  {
+    "step": 310,
+    "loss": 1.9304932355880737,
+    "diagonal": 1.8039029836654663,
+    "finite": 0.12659023702144623
+  },
+  {
+    "step": 311,
+    "loss": 2.590165376663208,
+    "diagonal": 2.4971954822540283,
+    "finite": 0.09296990185976028
+  },
+  {
+    "step": 312,
+    "loss": 2.2935988903045654,
+    "diagonal": 2.2043800354003906,
+    "finite": 0.08921893686056137
+  },
+  {
+    "step": 313,
+    "loss": 2.3951308727264404,
+    "diagonal": 2.2861328125,
+    "finite": 0.10899806022644043
+  },
+  {
+    "step": 314,
+    "loss": 1.7377313375473022,
+    "diagonal": 1.6438565254211426,
+    "finite": 0.09387480467557907
+  },
+  {
+    "step": 315,
+    "loss": 1.7001556158065796,
+    "diagonal": 1.5853831768035889,
+    "finite": 0.11477245390415192
+  },
+  {
+    "step": 316,
+    "loss": 1.9906291961669922,
+    "diagonal": 1.8834829330444336,
+    "finite": 0.1071462631225586
+  },
+  {
+    "step": 317,
+    "loss": 1.9735572338104248,
+    "diagonal": 1.7766196727752686,
+    "finite": 0.19693757593631744
+  },
+  {
+    "step": 318,
+    "loss": 1.766493797302246,
+    "diagonal": 1.6518446207046509,
+    "finite": 0.11464914679527283
+  },
+  {
+    "step": 319,
+    "loss": 1.990927815437317,
+    "diagonal": 1.8869295120239258,
+    "finite": 0.10399831086397171
+  },
+  {
+    "step": 320,
+    "loss": 2.094113826751709,
+    "diagonal": 2.014355421066284,
+    "finite": 0.07975836098194122
+  },
+  {
+    "step": 321,
+    "loss": 2.5344040393829346,
+    "diagonal": 2.4313297271728516,
+    "finite": 0.10307426750659943
+  },
+  {
+    "step": 322,
+    "loss": 2.0862934589385986,
+    "diagonal": 1.9721723794937134,
+    "finite": 0.11412116885185242
+  },
+  {
+    "step": 323,
+    "loss": 2.038322925567627,
+    "diagonal": 1.9203683137893677,
+    "finite": 0.11795451492071152
+  },
+  {
+    "step": 324,
+    "loss": 1.9885239601135254,
+    "diagonal": 1.9177966117858887,
+    "finite": 0.07072737067937851
+  },
+  {
+    "step": 325,
+    "loss": 1.93319833278656,
+    "diagonal": 1.826420545578003,
+    "finite": 0.10677783191204071
+  },
+  {
+    "step": 326,
+    "loss": 1.6727701425552368,
+    "diagonal": 1.5912795066833496,
+    "finite": 0.08149062842130661
+  },
+  {
+    "step": 327,
+    "loss": 2.0462074279785156,
+    "diagonal": 1.9514217376708984,
+    "finite": 0.09478568285703659
+  },
+  {
+    "step": 328,
+    "loss": 1.9729228019714355,
+    "diagonal": 1.8798154592514038,
+    "finite": 0.09310739487409592
+  },
+  {
+    "step": 329,
+    "loss": 2.4674344062805176,
+    "diagonal": 2.3727033138275146,
+    "finite": 0.09473110735416412
+  },
+  {
+    "step": 330,
+    "loss": 2.424899101257324,
+    "diagonal": 2.269827365875244,
+    "finite": 0.15507176518440247
+  },
+  {
+    "step": 331,
+    "loss": 2.092338800430298,
+    "diagonal": 1.986587643623352,
+    "finite": 0.10575118660926819
+  },
+  {
+    "step": 332,
+    "loss": 2.084962844848633,
+    "diagonal": 1.9273045063018799,
+    "finite": 0.15765823423862457
+  },
+  {
+    "step": 333,
+    "loss": 2.511352062225342,
+    "diagonal": 2.4174892902374268,
+    "finite": 0.09386284649372101
+  },
+  {
+    "step": 334,
+    "loss": 2.447315216064453,
+    "diagonal": 2.324314832687378,
+    "finite": 0.12300040572881699
+  },
+  {
+    "step": 335,
+    "loss": 2.077857732772827,
+    "diagonal": 1.9848681688308716,
+    "finite": 0.0929894894361496
+  },
+  {
+    "step": 336,
+    "loss": 1.9506375789642334,
+    "diagonal": 1.8329784870147705,
+    "finite": 0.11765909194946289
+  },
+  {
+    "step": 337,
+    "loss": 2.0687415599823,
+    "diagonal": 1.8241169452667236,
+    "finite": 0.24462468922138214
+  },
+  {
+    "step": 338,
+    "loss": 2.2751762866973877,
+    "diagonal": 2.128490447998047,
+    "finite": 0.1466858834028244
+  },
+  {
+    "step": 339,
+    "loss": 2.1788578033447266,
+    "diagonal": 2.0786657333374023,
+    "finite": 0.10019201040267944
+  },
+  {
+    "step": 340,
+    "loss": 1.8935879468917847,
+    "diagonal": 1.794973373413086,
+    "finite": 0.09861456602811813
+  },
+  {
+    "step": 341,
+    "loss": 2.258375406265259,
+    "diagonal": 2.156095266342163,
+    "finite": 0.10228005796670914
+  },
+  {
+    "step": 342,
+    "loss": 2.1345248222351074,
+    "diagonal": 1.9756059646606445,
+    "finite": 0.1589188128709793
+  },
+  {
+    "step": 343,
+    "loss": 2.1410908699035645,
+    "diagonal": 2.0330729484558105,
+    "finite": 0.1080179512500763
+  },
+  {
+    "step": 344,
+    "loss": 1.946272373199463,
+    "diagonal": 1.8379731178283691,
+    "finite": 0.10829919576644897
+  },
+  {
+    "step": 345,
+    "loss": 2.8291943073272705,
+    "diagonal": 2.7141036987304688,
+    "finite": 0.11509057134389877
+  },
+  {
+    "step": 346,
+    "loss": 2.1762049198150635,
+    "diagonal": 1.9961618185043335,
+    "finite": 0.18004319071769714
+  },
+  {
+    "step": 347,
+    "loss": 1.949375867843628,
+    "diagonal": 1.8453162908554077,
+    "finite": 0.10405951738357544
+  },
+  {
+    "step": 348,
+    "loss": 2.3476123809814453,
+    "diagonal": 2.2306675910949707,
+    "finite": 0.1169448271393776
+  },
+  {
+    "step": 349,
+    "loss": 2.062262535095215,
+    "diagonal": 1.9354791641235352,
+    "finite": 0.12678346037864685
+  },
+  {
+    "step": 350,
+    "loss": 2.5651626586914062,
+    "diagonal": 2.334932327270508,
+    "finite": 0.23023027181625366
+  },
+  {
+    "step": 351,
+    "loss": 2.006885290145874,
+    "diagonal": 1.8240923881530762,
+    "finite": 0.18279291689395905
+  },
+  {
+    "step": 352,
+    "loss": 1.9160799980163574,
+    "diagonal": 1.8236907720565796,
+    "finite": 0.09238918125629425
+  },
+  {
+    "step": 353,
+    "loss": 1.7907676696777344,
+    "diagonal": 1.6732138395309448,
+    "finite": 0.11755385249853134
+  },
+  {
+    "step": 354,
+    "loss": 2.436673402786255,
+    "diagonal": 2.3609464168548584,
+    "finite": 0.07572708278894424
+  },
+  {
+    "step": 355,
+    "loss": 1.8849327564239502,
+    "diagonal": 1.75223708152771,
+    "finite": 0.13269563019275665
+  },
+  {
+    "step": 356,
+    "loss": 2.1256706714630127,
+    "diagonal": 2.005955219268799,
+    "finite": 0.11971550434827805
+  },
+  {
+    "step": 357,
+    "loss": 2.17618727684021,
+    "diagonal": 2.0369863510131836,
+    "finite": 0.1392008364200592
+  },
+  {
+    "step": 358,
+    "loss": 2.165767192840576,
+    "diagonal": 2.071606159210205,
+    "finite": 0.0941610112786293
+  },
+  {
+    "step": 359,
+    "loss": 2.1800119876861572,
+    "diagonal": 2.0485546588897705,
+    "finite": 0.13145743310451508
+  },
+  {
+    "step": 360,
+    "loss": 2.036891222000122,
+    "diagonal": 1.95878005027771,
+    "finite": 0.0781112015247345
+  },
+  {
+    "step": 361,
+    "loss": 1.954573154449463,
+    "diagonal": 1.8534228801727295,
+    "finite": 0.1011502742767334
+  },
+  {
+    "step": 362,
+    "loss": 2.397752523422241,
+    "diagonal": 2.2568562030792236,
+    "finite": 0.14089623093605042
+  },
+  {
+    "step": 363,
+    "loss": 2.4945833683013916,
+    "diagonal": 2.3907313346862793,
+    "finite": 0.10385198146104813
+  },
+  {
+    "step": 364,
+    "loss": 1.9609036445617676,
+    "diagonal": 1.8961902856826782,
+    "finite": 0.06471332162618637
+  },
+  {
+    "step": 365,
+    "loss": 2.0343236923217773,
+    "diagonal": 1.9298425912857056,
+    "finite": 0.10448110848665237
+  },
+  {
+    "step": 366,
+    "loss": 2.1907095909118652,
+    "diagonal": 2.047642230987549,
+    "finite": 0.14306727051734924
+  },
+  {
+    "step": 367,
+    "loss": 1.794110894203186,
+    "diagonal": 1.6691266298294067,
+    "finite": 0.12498430162668228
+  },
+  {
+    "step": 368,
+    "loss": 2.5144896507263184,
+    "diagonal": 2.42977237701416,
+    "finite": 0.08471737802028656
+  },
+  {
+    "step": 369,
+    "loss": 1.9306564331054688,
+    "diagonal": 1.847023844718933,
+    "finite": 0.08363252878189087
+  },
+  {
+    "step": 370,
+    "loss": 1.9663715362548828,
+    "diagonal": 1.780413269996643,
+    "finite": 0.18595832586288452
+  },
+  {
+    "step": 371,
+    "loss": 2.104201078414917,
+    "diagonal": 1.9918749332427979,
+    "finite": 0.1123262345790863
+  },
+  {
+    "step": 372,
+    "loss": 2.2571558952331543,
+    "diagonal": 2.1696882247924805,
+    "finite": 0.0874677523970604
+  },
+  {
+    "step": 373,
+    "loss": 2.193514108657837,
+    "diagonal": 2.031940460205078,
+    "finite": 0.16157373785972595
+  },
+  {
+    "step": 374,
+    "loss": 2.042855739593506,
+    "diagonal": 1.9334263801574707,
+    "finite": 0.10942932963371277
+  },
+  {
+    "step": 375,
+    "loss": 2.1609466075897217,
+    "diagonal": 2.061831474304199,
+    "finite": 0.09911513328552246
+  },
+  {
+    "step": 376,
+    "loss": 2.1839518547058105,
+    "diagonal": 2.107536792755127,
+    "finite": 0.07641494274139404
+  },
+  {
+    "step": 377,
+    "loss": 1.8354164361953735,
+    "diagonal": 1.7671329975128174,
+    "finite": 0.06828340888023376
+  },
+  {
+    "step": 378,
+    "loss": 2.187243700027466,
+    "diagonal": 2.078099489212036,
+    "finite": 0.10914423316717148
+  },
+  {
+    "step": 379,
+    "loss": 1.9175395965576172,
+    "diagonal": 1.7882314920425415,
+    "finite": 0.1293080896139145
+  },
+  {
+    "step": 380,
+    "loss": 1.942840337753296,
+    "diagonal": 1.8177518844604492,
+    "finite": 0.1250884234905243
+  },
+  {
+    "step": 381,
+    "loss": 2.433638334274292,
+    "diagonal": 2.3603830337524414,
+    "finite": 0.07325521856546402
+  },
+  {
+    "step": 382,
+    "loss": 2.3947672843933105,
+    "diagonal": 2.286320447921753,
+    "finite": 0.10844682902097702
+  },
+  {
+    "step": 383,
+    "loss": 2.1757986545562744,
+    "diagonal": 2.0704569816589355,
+    "finite": 0.10534161329269409
+  },
+  {
+    "step": 384,
+    "loss": 1.979349136352539,
+    "diagonal": 1.8262196779251099,
+    "finite": 0.1531294733285904
+  },
+  {
+    "step": 385,
+    "loss": 2.106426954269409,
+    "diagonal": 1.9737309217453003,
+    "finite": 0.13269612193107605
+  },
+  {
+    "step": 386,
+    "loss": 3.1127662658691406,
+    "diagonal": 3.0104353427886963,
+    "finite": 0.10233103483915329
+  },
+  {
+    "step": 387,
+    "loss": 1.7548551559448242,
+    "diagonal": 1.6633695363998413,
+    "finite": 0.09148555994033813
+  },
+  {
+    "step": 388,
+    "loss": 2.299161434173584,
+    "diagonal": 2.2464468479156494,
+    "finite": 0.052714671939611435
+  },
+  {
+    "step": 389,
+    "loss": 2.0631933212280273,
+    "diagonal": 1.9973598718643188,
+    "finite": 0.06583356857299805
+  },
+  {
+    "step": 390,
+    "loss": 2.2109882831573486,
+    "diagonal": 2.127464771270752,
+    "finite": 0.08352341502904892
+  },
+  {
+    "step": 391,
+    "loss": 2.7489845752716064,
+    "diagonal": 2.6045684814453125,
+    "finite": 0.1444161832332611
+  },
+  {
+    "step": 392,
+    "loss": 2.0633468627929688,
+    "diagonal": 1.9688047170639038,
+    "finite": 0.09454217553138733
+  },
+  {
+    "step": 393,
+    "loss": 2.397554636001587,
+    "diagonal": 2.1617720127105713,
+    "finite": 0.2357826828956604
+  },
+  {
+    "step": 394,
+    "loss": 1.9025778770446777,
+    "diagonal": 1.804000973701477,
+    "finite": 0.09857689589262009
+  },
+  {
+    "step": 395,
+    "loss": 2.5791239738464355,
+    "diagonal": 2.4446001052856445,
+    "finite": 0.13452374935150146
+  },
+  {
+    "step": 396,
+    "loss": 2.5498528480529785,
+    "diagonal": 2.4587857723236084,
+    "finite": 0.09106697142124176
+  },
+  {
+    "step": 397,
+    "loss": 2.8331336975097656,
+    "diagonal": 2.7293503284454346,
+    "finite": 0.1037834882736206
+  },
+  {
+    "step": 398,
+    "loss": 2.2180206775665283,
+    "diagonal": 2.051621913909912,
+    "finite": 0.1663987934589386
+  },
+  {
+    "step": 399,
+    "loss": 2.413780450820923,
+    "diagonal": 2.2690470218658447,
+    "finite": 0.14473353326320648
+  },
+  {
+    "step": 400,
+    "loss": 2.3055191040039062,
+    "diagonal": 2.2061967849731445,
+    "finite": 0.0993223488330841
+  },
+  {
+    "step": 401,
+    "loss": 1.8080666065216064,
+    "diagonal": 1.7484512329101562,
+    "finite": 0.0596153624355793
+  },
+  {
+    "step": 402,
+    "loss": 2.379653215408325,
+    "diagonal": 2.2925260066986084,
+    "finite": 0.08712732046842575
+  },
+  {
+    "step": 403,
+    "loss": 2.1442668437957764,
+    "diagonal": 1.9995224475860596,
+    "finite": 0.1447443664073944
+  },
+  {
+    "step": 404,
+    "loss": 1.9498196840286255,
+    "diagonal": 1.849203109741211,
+    "finite": 0.10061655938625336
+  },
+  {
+    "step": 405,
+    "loss": 2.0205955505371094,
+    "diagonal": 1.9449210166931152,
+    "finite": 0.07567441463470459
+  },
+  {
+    "step": 406,
+    "loss": 2.0517423152923584,
+    "diagonal": 1.9350553750991821,
+    "finite": 0.11668693274259567
+  },
+  {
+    "step": 407,
+    "loss": 2.2758572101593018,
+    "diagonal": 2.1745505332946777,
+    "finite": 0.10130666196346283
+  },
+  {
+    "step": 408,
+    "loss": 1.9167674779891968,
+    "diagonal": 1.8208903074264526,
+    "finite": 0.09587718546390533
+  },
+  {
+    "step": 409,
+    "loss": 1.9811288118362427,
+    "diagonal": 1.8894309997558594,
+    "finite": 0.0916978120803833
+  },
+  {
+    "step": 410,
+    "loss": 2.076092004776001,
+    "diagonal": 2.0044267177581787,
+    "finite": 0.0716651901602745
+  },
+  {
+    "step": 411,
+    "loss": 2.023237943649292,
+    "diagonal": 1.9446913003921509,
+    "finite": 0.0785466656088829
+  },
+  {
+    "step": 412,
+    "loss": 2.2650744915008545,
+    "diagonal": 2.1393039226531982,
+    "finite": 0.12577056884765625
+  },
+  {
+    "step": 413,
+    "loss": 2.480079174041748,
+    "diagonal": 2.4013161659240723,
+    "finite": 0.07876304537057877
+  },
+  {
+    "step": 414,
+    "loss": 2.128715991973877,
+    "diagonal": 2.0103330612182617,
+    "finite": 0.1183829978108406
+  },
+  {
+    "step": 415,
+    "loss": 2.0679452419281006,
+    "diagonal": 1.9675931930541992,
+    "finite": 0.10035215318202972
+  },
+  {
+    "step": 416,
+    "loss": 2.1025748252868652,
+    "diagonal": 2.009406566619873,
+    "finite": 0.09316834807395935
+  },
+  {
+    "step": 417,
+    "loss": 2.5621535778045654,
+    "diagonal": 2.4596784114837646,
+    "finite": 0.10247516632080078
+  },
+  {
+    "step": 418,
+    "loss": 2.258939504623413,
+    "diagonal": 2.1811137199401855,
+    "finite": 0.07782573997974396
+  },
+  {
+    "step": 419,
+    "loss": 2.087392568588257,
+    "diagonal": 1.9932044744491577,
+    "finite": 0.09418803453445435
+  },
+  {
+    "step": 420,
+    "loss": 2.27272891998291,
+    "diagonal": 2.1207597255706787,
+    "finite": 0.1519690752029419
+  },
+  {
+    "step": 421,
+    "loss": 2.264932632446289,
+    "diagonal": 2.1743030548095703,
+    "finite": 0.09062966704368591
+  },
+  {
+    "step": 422,
+    "loss": 2.077672004699707,
+    "diagonal": 1.9217664003372192,
+    "finite": 0.15590548515319824
+  },
+  {
+    "step": 423,
+    "loss": 2.440814971923828,
+    "diagonal": 2.321270227432251,
+    "finite": 0.11954480409622192
+  },
+  {
+    "step": 424,
+    "loss": 2.207139253616333,
+    "diagonal": 2.0498032569885254,
+    "finite": 0.15733610093593597
+  },
+  {
+    "step": 425,
+    "loss": 1.6397367715835571,
+    "diagonal": 1.5551958084106445,
+    "finite": 0.08454099297523499
+  },
+  {
+    "step": 426,
+    "loss": 1.7689390182495117,
+    "diagonal": 1.6844134330749512,
+    "finite": 0.08452555537223816
+  },
+  {
+    "step": 427,
+    "loss": 2.4939749240875244,
+    "diagonal": 2.3978641033172607,
+    "finite": 0.09611085057258606
+  },
+  {
+    "step": 428,
+    "loss": 1.8708864450454712,
+    "diagonal": 1.6956329345703125,
+    "finite": 0.1752535104751587
+  },
+  {
+    "step": 429,
+    "loss": 2.031618356704712,
+    "diagonal": 1.9036990404129028,
+    "finite": 0.12791922688484192
+  },
+  {
+    "step": 430,
+    "loss": 2.20802640914917,
+    "diagonal": 2.1422383785247803,
+    "finite": 0.06578794121742249
+  },
+  {
+    "step": 431,
+    "loss": 2.137195348739624,
+    "diagonal": 1.9926350116729736,
+    "finite": 0.1445603370666504
+  },
+  {
+    "step": 432,
+    "loss": 2.1043848991394043,
+    "diagonal": 1.9929871559143066,
+    "finite": 0.11139770597219467
+  },
+  {
+    "step": 433,
+    "loss": 2.0552635192871094,
+    "diagonal": 1.9704868793487549,
+    "finite": 0.0847766101360321
+  },
+  {
+    "step": 434,
+    "loss": 2.3853893280029297,
+    "diagonal": 2.3025102615356445,
+    "finite": 0.08287918567657471
+  },
+  {
+    "step": 435,
+    "loss": 2.3983778953552246,
+    "diagonal": 2.3113951683044434,
+    "finite": 0.08698274195194244
+  },
+  {
+    "step": 436,
+    "loss": 1.8139419555664062,
+    "diagonal": 1.7201242446899414,
+    "finite": 0.09381771832704544
+  },
+  {
+    "step": 437,
+    "loss": 1.7583167552947998,
+    "diagonal": 1.6329350471496582,
+    "finite": 0.12538166344165802
+  },
+  {
+    "step": 438,
+    "loss": 1.9303923845291138,
+    "diagonal": 1.8389647006988525,
+    "finite": 0.09142773598432541
+  },
+  {
+    "step": 439,
+    "loss": 1.7296910285949707,
+    "diagonal": 1.6651629209518433,
+    "finite": 0.06452806293964386
+  },
+  {
+    "step": 440,
+    "loss": 1.4731913805007935,
+    "diagonal": 1.3963191509246826,
+    "finite": 0.07687222957611084
+  },
+  {
+    "step": 441,
+    "loss": 2.1378631591796875,
+    "diagonal": 1.9661343097686768,
+    "finite": 0.1717287302017212
+  },
+  {
+    "step": 442,
+    "loss": 2.414212226867676,
+    "diagonal": 2.296175479888916,
+    "finite": 0.11803677678108215
+  },
+  {
+    "step": 443,
+    "loss": 2.3599627017974854,
+    "diagonal": 2.2669224739074707,
+    "finite": 0.09304016828536987
+  },
+  {
+    "step": 444,
+    "loss": 2.48468017578125,
+    "diagonal": 2.376070261001587,
+    "finite": 0.10861003398895264
+  },
+  {
+    "step": 445,
+    "loss": 1.5967094898223877,
+    "diagonal": 1.525386095046997,
+    "finite": 0.07132342457771301
+  },
+  {
+    "step": 446,
+    "loss": 1.82455575466156,
+    "diagonal": 1.7243863344192505,
+    "finite": 0.10016945004463196
+  },
+  {
+    "step": 447,
+    "loss": 1.6568013429641724,
+    "diagonal": 1.569603681564331,
+    "finite": 0.0871976837515831
+  },
+  {
+    "step": 448,
+    "loss": 2.165432929992676,
+    "diagonal": 2.05241060256958,
+    "finite": 0.11302223056554794
+  },
+  {
+    "step": 449,
+    "loss": 2.5723578929901123,
+    "diagonal": 2.5031981468200684,
+    "finite": 0.06915963441133499
+  },
+  {
+    "step": 450,
+    "loss": 2.32314133644104,
+    "diagonal": 2.2408065795898438,
+    "finite": 0.0823347419500351
+  },
+  {
+    "step": 451,
+    "loss": 2.1157307624816895,
+    "diagonal": 1.9942245483398438,
+    "finite": 0.12150625884532928
+  },
+  {
+    "step": 452,
+    "loss": 2.532665967941284,
+    "diagonal": 2.4539668560028076,
+    "finite": 0.07869908958673477
+  },
+  {
+    "step": 453,
+    "loss": 1.715051531791687,
+    "diagonal": 1.5950255393981934,
+    "finite": 0.12002597749233246
+  },
+  {
+    "step": 454,
+    "loss": 2.253530740737915,
+    "diagonal": 2.1533427238464355,
+    "finite": 0.10018795728683472
+  },
+  {
+    "step": 455,
+    "loss": 1.7024338245391846,
+    "diagonal": 1.6384867429733276,
+    "finite": 0.06394704431295395
+  },
+  {
+    "step": 456,
+    "loss": 2.130223512649536,
+    "diagonal": 2.057319164276123,
+    "finite": 0.0729043185710907
+  },
+  {
+    "step": 457,
+    "loss": 2.401289224624634,
+    "diagonal": 2.3184452056884766,
+    "finite": 0.08284394443035126
+  },
+  {
+    "step": 458,
+    "loss": 1.6563761234283447,
+    "diagonal": 1.5364394187927246,
+    "finite": 0.11993665248155594
+  },
+  {
+    "step": 459,
+    "loss": 2.335848808288574,
+    "diagonal": 2.2670774459838867,
+    "finite": 0.0687713697552681
+  },
+  {
+    "step": 460,
+    "loss": 2.1544227600097656,
+    "diagonal": 2.0698492527008057,
+    "finite": 0.08457358181476593
+  },
+  {
+    "step": 461,
+    "loss": 2.48052978515625,
+    "diagonal": 2.3223066329956055,
+    "finite": 0.15822304785251617
+  },
+  {
+    "step": 462,
+    "loss": 2.1679203510284424,
+    "diagonal": 2.029632329940796,
+    "finite": 0.13828811049461365
+  },
+  {
+    "step": 463,
+    "loss": 1.809983253479004,
+    "diagonal": 1.6833559274673462,
+    "finite": 0.12662726640701294
+  },
+  {
+    "step": 464,
+    "loss": 2.142472505569458,
+    "diagonal": 2.018463611602783,
+    "finite": 0.12400895357131958
+  },
+  {
+    "step": 465,
+    "loss": 2.814786911010742,
+    "diagonal": 2.717694044113159,
+    "finite": 0.09709291160106659
+  },
+  {
+    "step": 466,
+    "loss": 2.7408673763275146,
+    "diagonal": 2.6704463958740234,
+    "finite": 0.07042089104652405
+  },
+  {
+    "step": 467,
+    "loss": 2.587161064147949,
+    "diagonal": 2.437943696975708,
+    "finite": 0.14921748638153076
+  },
+  {
+    "step": 468,
+    "loss": 2.3208718299865723,
+    "diagonal": 2.198336601257324,
+    "finite": 0.12253521382808685
+  },
+  {
+    "step": 469,
+    "loss": 1.9965280294418335,
+    "diagonal": 1.9262491464614868,
+    "finite": 0.07027890533208847
+  },
+  {
+    "step": 470,
+    "loss": 2.092128276824951,
+    "diagonal": 2.0026700496673584,
+    "finite": 0.08945830166339874
+  },
+  {
+    "step": 471,
+    "loss": 2.2978744506835938,
+    "diagonal": 2.1630043983459473,
+    "finite": 0.1348700225353241
+  },
+  {
+    "step": 472,
+    "loss": 2.3866167068481445,
+    "diagonal": 2.316218852996826,
+    "finite": 0.07039778679609299
+  },
+  {
+    "step": 473,
+    "loss": 2.2725753784179688,
+    "diagonal": 2.1758484840393066,
+    "finite": 0.09672693908214569
+  },
+  {
+    "step": 474,
+    "loss": 2.211280107498169,
+    "diagonal": 2.081394910812378,
+    "finite": 0.12988513708114624
+  },
+  {
+    "step": 475,
+    "loss": 2.4495084285736084,
+    "diagonal": 2.2404541969299316,
+    "finite": 0.20905417203903198
+  },
+  {
+    "step": 476,
+    "loss": 2.204369306564331,
+    "diagonal": 2.10776424407959,
+    "finite": 0.09660512953996658
+  },
+  {
+    "step": 477,
+    "loss": 1.6343857049942017,
+    "diagonal": 1.5570495128631592,
+    "finite": 0.07733624428510666
+  },
+  {
+    "step": 478,
+    "loss": 2.2721991539001465,
+    "diagonal": 2.1750521659851074,
+    "finite": 0.09714706242084503
+  },
+  {
+    "step": 479,
+    "loss": 1.8793948888778687,
+    "diagonal": 1.798342227935791,
+    "finite": 0.08105266094207764
+  },
+  {
+    "step": 480,
+    "loss": 2.1578457355499268,
+    "diagonal": 2.074742317199707,
+    "finite": 0.08310341089963913
+  },
+  {
+    "step": 481,
+    "loss": 2.4226396083831787,
+    "diagonal": 2.3125112056732178,
+    "finite": 0.1101284846663475
+  },
+  {
+    "step": 482,
+    "loss": 2.117837905883789,
+    "diagonal": 1.9530993700027466,
+    "finite": 0.16473859548568726
+  },
+  {
+    "step": 483,
+    "loss": 2.5232651233673096,
+    "diagonal": 2.4084770679473877,
+    "finite": 0.11478804051876068
+  },
+  {
+    "step": 484,
+    "loss": 1.7978904247283936,
+    "diagonal": 1.677517056465149,
+    "finite": 0.12037334591150284
+  },
+  {
+    "step": 485,
+    "loss": 1.8702843189239502,
+    "diagonal": 1.7583378553390503,
+    "finite": 0.11194652318954468
+  },
+  {
+    "step": 486,
+    "loss": 1.876565933227539,
+    "diagonal": 1.8035656213760376,
+    "finite": 0.07300026714801788
+  },
+  {
+    "step": 487,
+    "loss": 2.574625015258789,
+    "diagonal": 2.45090389251709,
+    "finite": 0.123721182346344
+  },
+  {
+    "step": 488,
+    "loss": 2.38362455368042,
+    "diagonal": 2.294126510620117,
+    "finite": 0.08949799090623856
+  },
+  {
+    "step": 489,
+    "loss": 1.8464648723602295,
+    "diagonal": 1.7160120010375977,
+    "finite": 0.13045287132263184
+  },
+  {
+    "step": 490,
+    "loss": 2.474999189376831,
+    "diagonal": 2.39982271194458,
+    "finite": 0.07517638057470322
+  },
+  {
+    "step": 491,
+    "loss": 2.1693358421325684,
+    "diagonal": 2.0818631649017334,
+    "finite": 0.08747255802154541
+  },
+  {
+    "step": 492,
+    "loss": 1.9833695888519287,
+    "diagonal": 1.8270467519760132,
+    "finite": 0.15632280707359314
+  },
+  {
+    "step": 493,
+    "loss": 1.825190544128418,
+    "diagonal": 1.7262377738952637,
+    "finite": 0.0989527478814125
+  },
+  {
+    "step": 494,
+    "loss": 1.9327336549758911,
+    "diagonal": 1.8054156303405762,
+    "finite": 0.12731806933879852
+  },
+  {
+    "step": 495,
+    "loss": 2.540618896484375,
+    "diagonal": 2.396677017211914,
+    "finite": 0.1439419686794281
+  },
+  {
+    "step": 496,
+    "loss": 2.19675350189209,
+    "diagonal": 2.03952693939209,
+    "finite": 0.15722668170928955
+  },
+  {
+    "step": 497,
+    "loss": 2.305875301361084,
+    "diagonal": 2.245612382888794,
+    "finite": 0.060262829065322876
+  },
+  {
+    "step": 498,
+    "loss": 1.9880238771438599,
+    "diagonal": 1.8217978477478027,
+    "finite": 0.16622604429721832
+  },
+  {
+    "step": 499,
+    "loss": 2.18117356300354,
+    "diagonal": 2.017505168914795,
+    "finite": 0.16366848349571228
+  },
+  {
+    "step": 500,
+    "loss": 2.696000099182129,
+    "diagonal": 2.5476109981536865,
+    "finite": 0.14838907122612
+  },
+  {
+    "step": 501,
+    "loss": 2.0901215076446533,
+    "diagonal": 1.9615375995635986,
+    "finite": 0.12858380377292633
+  },
+  {
+    "step": 502,
+    "loss": 1.688367247581482,
+    "diagonal": 1.593512773513794,
+    "finite": 0.09485447406768799
+  },
+  {
+    "step": 503,
+    "loss": 2.3145604133605957,
+    "diagonal": 2.192899227142334,
+    "finite": 0.12166114151477814
+  },
+  {
+    "step": 504,
+    "loss": 2.550276517868042,
+    "diagonal": 2.436495065689087,
+    "finite": 0.11378155648708344
+  },
+  {
+    "step": 505,
+    "loss": 1.8054641485214233,
+    "diagonal": 1.671557903289795,
+    "finite": 0.13390621542930603
+  },
+  {
+    "step": 506,
+    "loss": 1.808647632598877,
+    "diagonal": 1.7114166021347046,
+    "finite": 0.09723098576068878
+  },
+  {
+    "step": 507,
+    "loss": 2.1155505180358887,
+    "diagonal": 1.990610122680664,
+    "finite": 0.12494033575057983
+  },
+  {
+    "step": 508,
+    "loss": 2.067996025085449,
+    "diagonal": 1.9792747497558594,
+    "finite": 0.08872115612030029
+  },
+  {
+    "step": 509,
+    "loss": 2.4010791778564453,
+    "diagonal": 2.2751827239990234,
+    "finite": 0.12589643895626068
+  },
+  {
+    "step": 510,
+    "loss": 1.4832712411880493,
+    "diagonal": 1.3988503217697144,
+    "finite": 0.08442097157239914
+  },
+  {
+    "step": 511,
+    "loss": 2.29624342918396,
+    "diagonal": 2.204180955886841,
+    "finite": 0.0920625701546669
+  },
+  {
+    "step": 512,
+    "loss": 2.5672671794891357,
+    "diagonal": 2.4025440216064453,
+    "finite": 0.164723202586174
+  },
+  {
+    "step": 513,
+    "loss": 2.337441921234131,
+    "diagonal": 2.2282559871673584,
+    "finite": 0.10918600112199783
+  },
+  {
+    "step": 514,
+    "loss": 2.318774700164795,
+    "diagonal": 2.215817451477051,
+    "finite": 0.10295712947845459
+  },
+  {
+    "step": 515,
+    "loss": 1.647640347480774,
+    "diagonal": 1.5057481527328491,
+    "finite": 0.1418922394514084
+  },
+  {
+    "step": 516,
+    "loss": 2.1686196327209473,
+    "diagonal": 2.0759119987487793,
+    "finite": 0.09270752221345901
+  },
+  {
+    "step": 517,
+    "loss": 1.5364021062850952,
+    "diagonal": 1.4504181146621704,
+    "finite": 0.0859839990735054
+  },
+  {
+    "step": 518,
+    "loss": 2.015601396560669,
+    "diagonal": 1.9382896423339844,
+    "finite": 0.0773116946220398
+  },
+  {
+    "step": 519,
+    "loss": 2.6950643062591553,
+    "diagonal": 2.6107888221740723,
+    "finite": 0.0842754915356636
+  },
+  {
+    "step": 520,
+    "loss": 1.7778505086898804,
+    "diagonal": 1.6811633110046387,
+    "finite": 0.0966871976852417
+  },
+  {
+    "step": 521,
+    "loss": 2.3338212966918945,
+    "diagonal": 2.210869789123535,
+    "finite": 0.12295158952474594
+  },
+  {
+    "step": 522,
+    "loss": 2.0558736324310303,
+    "diagonal": 1.9653836488723755,
+    "finite": 0.09048990160226822
+  },
+  {
+    "step": 523,
+    "loss": 1.9388490915298462,
+    "diagonal": 1.848314642906189,
+    "finite": 0.09053441882133484
+  },
+  {
+    "step": 524,
+    "loss": 2.2267274856567383,
+    "diagonal": 2.119502544403076,
+    "finite": 0.10722487419843674
+  },
+  {
+    "step": 525,
+    "loss": 1.6735090017318726,
+    "diagonal": 1.5717649459838867,
+    "finite": 0.10174402594566345
+  },
+  {
+    "step": 526,
+    "loss": 2.825854539871216,
+    "diagonal": 2.665919065475464,
+    "finite": 0.1599355787038803
+  },
+  {
+    "step": 527,
+    "loss": 2.691826105117798,
+    "diagonal": 2.538872241973877,
+    "finite": 0.15295378863811493
+  },
+  {
+    "step": 528,
+    "loss": 1.7915235757827759,
+    "diagonal": 1.6993123292922974,
+    "finite": 0.09221122413873672
+  },
+  {
+    "step": 529,
+    "loss": 1.860345482826233,
+    "diagonal": 1.7752048969268799,
+    "finite": 0.08514060825109482
+  },
+  {
+    "step": 530,
+    "loss": 2.284491777420044,
+    "diagonal": 2.2150347232818604,
+    "finite": 0.06945699453353882
+  },
+  {
+    "step": 531,
+    "loss": 2.377875566482544,
+    "diagonal": 2.313950538635254,
+    "finite": 0.06392495334148407
+  },
+  {
+    "step": 532,
+    "loss": 1.9816255569458008,
+    "diagonal": 1.765378475189209,
+    "finite": 0.2162470519542694
+  },
+  {
+    "step": 533,
+    "loss": 1.9581074714660645,
+    "diagonal": 1.8477572202682495,
+    "finite": 0.11035022884607315
+  },
+  {
+    "step": 534,
+    "loss": 2.7769217491149902,
+    "diagonal": 2.6973533630371094,
+    "finite": 0.07956836372613907
+  },
+  {
+    "step": 535,
+    "loss": 2.1436421871185303,
+    "diagonal": 2.0245678424835205,
+    "finite": 0.1190742775797844
+  },
+  {
+    "step": 536,
+    "loss": 1.9704657793045044,
+    "diagonal": 1.8742624521255493,
+    "finite": 0.09620337188243866
+  },
+  {
+    "step": 537,
+    "loss": 2.2910146713256836,
+    "diagonal": 2.20278263092041,
+    "finite": 0.08823202550411224
+  },
+  {
+    "step": 538,
+    "loss": 1.8928877115249634,
+    "diagonal": 1.7750722169876099,
+    "finite": 0.11781546473503113
+  },
+  {
+    "step": 539,
+    "loss": 2.4331674575805664,
+    "diagonal": 2.3181703090667725,
+    "finite": 0.11499723047018051
+  },
+  {
+    "step": 540,
+    "loss": 1.948508381843567,
+    "diagonal": 1.876084327697754,
+    "finite": 0.0724240243434906
+  },
+  {
+    "step": 541,
+    "loss": 1.9685389995574951,
+    "diagonal": 1.840688705444336,
+    "finite": 0.12785035371780396
+  },
+  {
+    "step": 542,
+    "loss": 2.4902966022491455,
+    "diagonal": 2.4215164184570312,
+    "finite": 0.0687800794839859
+  },
+  {
+    "step": 543,
+    "loss": 1.817626953125,
+    "diagonal": 1.768710732460022,
+    "finite": 0.048916250467300415
+  },
+  {
+    "step": 544,
+    "loss": 2.114642858505249,
+    "diagonal": 2.0186004638671875,
+    "finite": 0.09604240208864212
+  },
+  {
+    "step": 545,
+    "loss": 2.35642409324646,
+    "diagonal": 2.2538070678710938,
+    "finite": 0.10261692106723785
+  },
+  {
+    "step": 546,
+    "loss": 1.967259407043457,
+    "diagonal": 1.8507999181747437,
+    "finite": 0.11645949631929398
+  },
+  {
+    "step": 547,
+    "loss": 2.3993759155273438,
+    "diagonal": 2.2868900299072266,
+    "finite": 0.11248598247766495
+  },
+  {
+    "step": 548,
+    "loss": 1.7786405086517334,
+    "diagonal": 1.6880030632019043,
+    "finite": 0.09063740074634552
+  },
+  {
+    "step": 549,
+    "loss": 1.7972080707550049,
+    "diagonal": 1.727524995803833,
+    "finite": 0.06968308985233307
+  },
+  {
+    "step": 550,
+    "loss": 1.768668293952942,
+    "diagonal": 1.6922805309295654,
+    "finite": 0.07638771086931229
+  },
+  {
+    "step": 551,
+    "loss": 2.5775327682495117,
+    "diagonal": 2.4979920387268066,
+    "finite": 0.0795406922698021
+  },
+  {
+    "step": 552,
+    "loss": 2.2393922805786133,
+    "diagonal": 2.1705737113952637,
+    "finite": 0.06881865113973618
+  },
+  {
+    "step": 553,
+    "loss": 2.3070878982543945,
+    "diagonal": 2.2112555503845215,
+    "finite": 0.09583237767219543
+  },
+  {
+    "step": 554,
+    "loss": 1.962609887123108,
+    "diagonal": 1.8541350364685059,
+    "finite": 0.10847486555576324
+  },
+  {
+    "step": 555,
+    "loss": 1.8338888883590698,
+    "diagonal": 1.7164702415466309,
+    "finite": 0.11741866171360016
+  },
+  {
+    "step": 556,
+    "loss": 1.755461573600769,
+    "diagonal": 1.6521258354187012,
+    "finite": 0.10333576798439026
+  },
+  {
+    "step": 557,
+    "loss": 2.271118402481079,
+    "diagonal": 2.15254807472229,
+    "finite": 0.11857029795646667
+  },
+  {
+    "step": 558,
+    "loss": 2.079092264175415,
+    "diagonal": 1.9899572134017944,
+    "finite": 0.08913496136665344
+  },
+  {
+    "step": 559,
+    "loss": 2.5224673748016357,
+    "diagonal": 2.4135868549346924,
+    "finite": 0.10888049006462097
+  },
+  {
+    "step": 560,
+    "loss": 2.2615344524383545,
+    "diagonal": 2.1954615116119385,
+    "finite": 0.06607300788164139
+  },
+  {
+    "step": 561,
+    "loss": 2.0084798336029053,
+    "diagonal": 1.9204522371292114,
+    "finite": 0.08802764117717743
+  },
+  {
+    "step": 562,
+    "loss": 1.8481245040893555,
+    "diagonal": 1.744511604309082,
+    "finite": 0.10361292958259583
+  },
+  {
+    "step": 563,
+    "loss": 1.4274705648422241,
+    "diagonal": 1.2517529726028442,
+    "finite": 0.1757175475358963
+  },
+  {
+    "step": 564,
+    "loss": 2.079822063446045,
+    "diagonal": 1.971023678779602,
+    "finite": 0.1087983101606369
+  },
+  {
+    "step": 565,
+    "loss": 1.6260250806808472,
+    "diagonal": 1.5633574724197388,
+    "finite": 0.06266757845878601
+  },
+  {
+    "step": 566,
+    "loss": 2.2293548583984375,
+    "diagonal": 2.1372146606445312,
+    "finite": 0.09214013814926147
+  },
+  {
+    "step": 567,
+    "loss": 2.0381226539611816,
+    "diagonal": 1.9655253887176514,
+    "finite": 0.07259735465049744
+  },
+  {
+    "step": 568,
+    "loss": 2.428593158721924,
+    "diagonal": 2.362973213195801,
+    "finite": 0.06561996787786484
+  },
+  {
+    "step": 569,
+    "loss": 1.9125057458877563,
+    "diagonal": 1.8469547033309937,
+    "finite": 0.06555108726024628
+  },
+  {
+    "step": 570,
+    "loss": 2.25111985206604,
+    "diagonal": 2.1335933208465576,
+    "finite": 0.11752660572528839
+  },
+  {
+    "step": 571,
+    "loss": 2.3705170154571533,
+    "diagonal": 2.2678334712982178,
+    "finite": 0.10268348455429077
+  },
+  {
+    "step": 572,
+    "loss": 2.952711582183838,
+    "diagonal": 2.827670097351074,
+    "finite": 0.1250413954257965
+  },
+  {
+    "step": 573,
+    "loss": 2.27884578704834,
+    "diagonal": 2.1965436935424805,
+    "finite": 0.08230218291282654
+  },
+  {
+    "step": 574,
+    "loss": 2.1831297874450684,
+    "diagonal": 2.1039936542510986,
+    "finite": 0.07913602143526077
+  },
+  {
+    "step": 575,
+    "loss": 2.0126869678497314,
+    "diagonal": 1.8972821235656738,
+    "finite": 0.11540491878986359
+  },
+  {
+    "step": 576,
+    "loss": 1.9560377597808838,
+    "diagonal": 1.8644193410873413,
+    "finite": 0.09161847084760666
+  },
+  {
+    "step": 577,
+    "loss": 1.8905185461044312,
+    "diagonal": 1.8522865772247314,
+    "finite": 0.038231950253248215
+  },
+  {
+    "step": 578,
+    "loss": 2.5604138374328613,
+    "diagonal": 2.483774185180664,
+    "finite": 0.07663962244987488
+  },
+  {
+    "step": 579,
+    "loss": 2.031463861465454,
+    "diagonal": 1.9732040166854858,
+    "finite": 0.05825993791222572
+  },
+  {
+    "step": 580,
+    "loss": 1.996787428855896,
+    "diagonal": 1.9151467084884644,
+    "finite": 0.08164075762033463
+  },
+  {
+    "step": 581,
+    "loss": 2.4562158584594727,
+    "diagonal": 2.363156795501709,
+    "finite": 0.09305912256240845
+  },
+  {
+    "step": 582,
+    "loss": 1.4069912433624268,
+    "diagonal": 1.337705373764038,
+    "finite": 0.06928587704896927
+  },
+  {
+    "step": 583,
+    "loss": 1.8000880479812622,
+    "diagonal": 1.7149332761764526,
+    "finite": 0.08515473455190659
+  },
+  {
+    "step": 584,
+    "loss": 2.0330002307891846,
+    "diagonal": 1.9473381042480469,
+    "finite": 0.08566205948591232
+  },
+  {
+    "step": 585,
+    "loss": 2.211728572845459,
+    "diagonal": 2.1100611686706543,
+    "finite": 0.10166752338409424
+  },
+  {
+    "step": 586,
+    "loss": 1.769185185432434,
+    "diagonal": 1.6831424236297607,
+    "finite": 0.08604274690151215
+  },
+  {
+    "step": 587,
+    "loss": 2.2071313858032227,
+    "diagonal": 2.104426145553589,
+    "finite": 0.10270527750253677
+  },
+  {
+    "step": 588,
+    "loss": 1.9298248291015625,
+    "diagonal": 1.8463529348373413,
+    "finite": 0.08347191661596298
+  },
+  {
+    "step": 589,
+    "loss": 2.14509654045105,
+    "diagonal": 2.0503644943237305,
+    "finite": 0.0947321355342865
+  },
+  {
+    "step": 590,
+    "loss": 2.245737075805664,
+    "diagonal": 2.15737247467041,
+    "finite": 0.08836458623409271
+  },
+  {
+    "step": 591,
+    "loss": 2.269484043121338,
+    "diagonal": 2.1957640647888184,
+    "finite": 0.07371997833251953
+  },
+  {
+    "step": 592,
+    "loss": 1.880434513092041,
+    "diagonal": 1.8003392219543457,
+    "finite": 0.0800953358411789
+  },
+  {
+    "step": 593,
+    "loss": 2.467414140701294,
+    "diagonal": 2.344735622406006,
+    "finite": 0.12267862260341644
+  },
+  {
+    "step": 594,
+    "loss": 2.2795088291168213,
+    "diagonal": 2.189457416534424,
+    "finite": 0.09005134552717209
+  },
+  {
+    "step": 595,
+    "loss": 1.8370152711868286,
+    "diagonal": 1.7714587450027466,
+    "finite": 0.06555654853582382
+  },
+  {
+    "step": 596,
+    "loss": 2.6727805137634277,
+    "diagonal": 2.5620598793029785,
+    "finite": 0.11072075366973877
+  },
+  {
+    "step": 597,
+    "loss": 2.3139262199401855,
+    "diagonal": 2.204723834991455,
+    "finite": 0.10920245200395584
+  },
+  {
+    "step": 598,
+    "loss": 1.9660472869873047,
+    "diagonal": 1.7934550046920776,
+    "finite": 0.17259228229522705
+  },
+  {
+    "step": 599,
+    "loss": 2.117711305618286,
+    "diagonal": 2.028942346572876,
+    "finite": 0.08876907080411911
+  },
+  {
+    "step": 600,
+    "loss": 2.0886659622192383,
+    "diagonal": 1.9944610595703125,
+    "finite": 0.09420502185821533
+  },
+  {
+    "step": 601,
+    "loss": 2.0787858963012695,
+    "diagonal": 1.995507836341858,
+    "finite": 0.0832780972123146
+  },
+  {
+    "step": 602,
+    "loss": 2.2305033206939697,
+    "diagonal": 2.1323060989379883,
+    "finite": 0.09819725155830383
+  },
+  {
+    "step": 603,
+    "loss": 2.283308982849121,
+    "diagonal": 2.2026140689849854,
+    "finite": 0.0806950107216835
+  },
+  {
+    "step": 604,
+    "loss": 1.7572224140167236,
+    "diagonal": 1.6642978191375732,
+    "finite": 0.09292464703321457
+  },
+  {
+    "step": 605,
+    "loss": 1.943607211112976,
+    "diagonal": 1.8750578165054321,
+    "finite": 0.06854941695928574
+  },
+  {
+    "step": 606,
+    "loss": 2.231694221496582,
+    "diagonal": 2.1300089359283447,
+    "finite": 0.10168521106243134
+  },
+  {
+    "step": 607,
+    "loss": 2.2367331981658936,
+    "diagonal": 2.1580936908721924,
+    "finite": 0.07863950729370117
+  },
+  {
+    "step": 608,
+    "loss": 2.175818920135498,
+    "diagonal": 2.0978281497955322,
+    "finite": 0.07799069583415985
+  },
+  {
+    "step": 609,
+    "loss": 1.926400065422058,
+    "diagonal": 1.862467646598816,
+    "finite": 0.0639323890209198
+  },
+  {
+    "step": 610,
+    "loss": 2.1014485359191895,
+    "diagonal": 1.9926694631576538,
+    "finite": 0.10877896845340729
+  },
+  {
+    "step": 611,
+    "loss": 2.1994214057922363,
+    "diagonal": 2.1103224754333496,
+    "finite": 0.08909889310598373
+  },
+  {
+    "step": 612,
+    "loss": 1.8258475065231323,
+    "diagonal": 1.722983717918396,
+    "finite": 0.10286377370357513
+  },
+  {
+    "step": 613,
+    "loss": 2.3022258281707764,
+    "diagonal": 2.2233595848083496,
+    "finite": 0.07886625081300735
+  },
+  {
+    "step": 614,
+    "loss": 2.3073346614837646,
+    "diagonal": 2.2411017417907715,
+    "finite": 0.0662328451871872
+  },
+  {
+    "step": 615,
+    "loss": 1.7829450368881226,
+    "diagonal": 1.7052671909332275,
+    "finite": 0.07767785340547562
+  },
+  {
+    "step": 616,
+    "loss": 2.0678346157073975,
+    "diagonal": 1.9825425148010254,
+    "finite": 0.08529208600521088
+  },
+  {
+    "step": 617,
+    "loss": 2.003138542175293,
+    "diagonal": 1.8911539316177368,
+    "finite": 0.1119845062494278
+  },
+  {
+    "step": 618,
+    "loss": 2.051600694656372,
+    "diagonal": 1.9708609580993652,
+    "finite": 0.08073965460062027
+  },
+  {
+    "step": 619,
+    "loss": 1.7834954261779785,
+    "diagonal": 1.6996712684631348,
+    "finite": 0.08382418006658554
+  },
+  {
+    "step": 620,
+    "loss": 2.0372838973999023,
+    "diagonal": 1.9624769687652588,
+    "finite": 0.07480698078870773
+  },
+  {
+    "step": 621,
+    "loss": 2.267145872116089,
+    "diagonal": 2.1932730674743652,
+    "finite": 0.07387275248765945
+  },
+  {
+    "step": 622,
+    "loss": 2.01015305519104,
+    "diagonal": 1.7888453006744385,
+    "finite": 0.22130781412124634
+  },
+  {
+    "step": 623,
+    "loss": 2.0270724296569824,
+    "diagonal": 1.932886004447937,
+    "finite": 0.09418641775846481
+  },
+  {
+    "step": 624,
+    "loss": 1.4502663612365723,
+    "diagonal": 1.398263931274414,
+    "finite": 0.05200238525867462
+  },
+  {
+    "step": 625,
+    "loss": 2.1745429039001465,
+    "diagonal": 2.1201701164245605,
+    "finite": 0.05437280982732773
+  },
+  {
+    "step": 626,
+    "loss": 2.1654551029205322,
+    "diagonal": 2.0835044384002686,
+    "finite": 0.08195067942142487
+  },
+  {
+    "step": 627,
+    "loss": 2.0928409099578857,
+    "diagonal": 2.037476062774658,
+    "finite": 0.05536495894193649
+  },
+  {
+    "step": 628,
+    "loss": 2.2602038383483887,
+    "diagonal": 2.023391008377075,
+    "finite": 0.23681285977363586
+  },
+  {
+    "step": 629,
+    "loss": 2.2923972606658936,
+    "diagonal": 2.204610824584961,
+    "finite": 0.08778639137744904
+  },
+  {
+    "step": 630,
+    "loss": 1.7094099521636963,
+    "diagonal": 1.6331082582473755,
+    "finite": 0.0763016864657402
+  },
+  {
+    "step": 631,
+    "loss": 2.045921564102173,
+    "diagonal": 1.9674708843231201,
+    "finite": 0.07845061272382736
+  },
+  {
+    "step": 632,
+    "loss": 1.851439356803894,
+    "diagonal": 1.772316575050354,
+    "finite": 0.07912281155586243
+  },
+  {
+    "step": 633,
+    "loss": 1.7849249839782715,
+    "diagonal": 1.7069337368011475,
+    "finite": 0.07799126952886581
+  },
+  {
+    "step": 634,
+    "loss": 1.8786931037902832,
+    "diagonal": 1.7953746318817139,
+    "finite": 0.08331847935914993
+  },
+  {
+    "step": 635,
+    "loss": 1.8537043333053589,
+    "diagonal": 1.766579508781433,
+    "finite": 0.08712482452392578
+  },
+  {
+    "step": 636,
+    "loss": 2.697880268096924,
+    "diagonal": 2.6064813137054443,
+    "finite": 0.09139902889728546
+  },
+  {
+    "step": 637,
+    "loss": 1.991755723953247,
+    "diagonal": 1.841356873512268,
+    "finite": 0.15039889514446259
+  },
+  {
+    "step": 638,
+    "loss": 2.085801124572754,
+    "diagonal": 1.968138575553894,
+    "finite": 0.1176624447107315
+  },
+  {
+    "step": 639,
+    "loss": 1.497753381729126,
+    "diagonal": 1.4293839931488037,
+    "finite": 0.06836933642625809
+  },
+  {
+    "step": 640,
+    "loss": 1.8497955799102783,
+    "diagonal": 1.766968011856079,
+    "finite": 0.08282750844955444
+  },
+  {
+    "step": 641,
+    "loss": 2.1572012901306152,
+    "diagonal": 2.098590135574341,
+    "finite": 0.058611251413822174
+  },
+  {
+    "step": 642,
+    "loss": 2.49760365486145,
+    "diagonal": 2.4133365154266357,
+    "finite": 0.08426713943481445
+  },
+  {
+    "step": 643,
+    "loss": 2.142324447631836,
+    "diagonal": 2.079869031906128,
+    "finite": 0.0624554380774498
+  },
+  {
+    "step": 644,
+    "loss": 2.223518133163452,
+    "diagonal": 2.1428799629211426,
+    "finite": 0.08063807338476181
+  },
+  {
+    "step": 645,
+    "loss": 2.0497069358825684,
+    "diagonal": 1.9862369298934937,
+    "finite": 0.06346996128559113
+  },
+  {
+    "step": 646,
+    "loss": 2.48201322555542,
+    "diagonal": 2.369333028793335,
+    "finite": 0.11268031597137451
+  },
+  {
+    "step": 647,
+    "loss": 1.7838163375854492,
+    "diagonal": 1.7070175409317017,
+    "finite": 0.07679884880781174
+  },
+  {
+    "step": 648,
+    "loss": 2.3648571968078613,
+    "diagonal": 2.291804313659668,
+    "finite": 0.07305288314819336
+  },
+  {
+    "step": 649,
+    "loss": 2.115345001220703,
+    "diagonal": 2.0379891395568848,
+    "finite": 0.0773557499051094
+  },
+  {
+    "step": 650,
+    "loss": 1.8863186836242676,
+    "diagonal": 1.7556771039962769,
+    "finite": 0.13064156472682953
+  },
+  {
+    "step": 651,
+    "loss": 2.066729784011841,
+    "diagonal": 1.987816572189331,
+    "finite": 0.0789131447672844
+  },
+  {
+    "step": 652,
+    "loss": 1.9287956953048706,
+    "diagonal": 1.7947953939437866,
+    "finite": 0.13400030136108398
+  },
+  {
+    "step": 653,
+    "loss": 2.047694683074951,
+    "diagonal": 1.9299777746200562,
+    "finite": 0.11771679669618607
+  },
+  {
+    "step": 654,
+    "loss": 2.1974363327026367,
+    "diagonal": 2.109031915664673,
+    "finite": 0.08840448409318924
+  },
+  {
+    "step": 655,
+    "loss": 2.2294132709503174,
+    "diagonal": 2.166637897491455,
+    "finite": 0.06277533620595932
+  },
+  {
+    "step": 656,
+    "loss": 2.101339817047119,
+    "diagonal": 2.0049002170562744,
+    "finite": 0.09643968194723129
+  },
+  {
+    "step": 657,
+    "loss": 2.215935468673706,
+    "diagonal": 2.120591640472412,
+    "finite": 0.09534385055303574
+  },
+  {
+    "step": 658,
+    "loss": 2.009404420852661,
+    "diagonal": 1.8726311922073364,
+    "finite": 0.1367732286453247
+  },
+  {
+    "step": 659,
+    "loss": 2.6862330436706543,
+    "diagonal": 2.6135683059692383,
+    "finite": 0.0726647898554802
+  },
+  {
+    "step": 660,
+    "loss": 1.936991572380066,
+    "diagonal": 1.8510611057281494,
+    "finite": 0.08593044430017471
+  },
+  {
+    "step": 661,
+    "loss": 1.8660415410995483,
+    "diagonal": 1.7585573196411133,
+    "finite": 0.10748422890901566
+  },
+  {
+    "step": 662,
+    "loss": 1.7834725379943848,
+    "diagonal": 1.719294548034668,
+    "finite": 0.06417803466320038
+  },
+  {
+    "step": 663,
+    "loss": 2.147949457168579,
+    "diagonal": 2.058692216873169,
+    "finite": 0.08925726264715195
+  },
+  {
+    "step": 664,
+    "loss": 1.7980550527572632,
+    "diagonal": 1.7278236150741577,
+    "finite": 0.07023148983716965
+  },
+  {
+    "step": 665,
+    "loss": 1.958516240119934,
+    "diagonal": 1.85720694065094,
+    "finite": 0.10130930691957474
+  },
+  {
+    "step": 666,
+    "loss": 2.076359510421753,
+    "diagonal": 1.9968485832214355,
+    "finite": 0.07951083034276962
+  },
+  {
+    "step": 667,
+    "loss": 2.279221534729004,
+    "diagonal": 2.1925272941589355,
+    "finite": 0.08669432252645493
+  },
+  {
+    "step": 668,
+    "loss": 2.435772180557251,
+    "diagonal": 2.3710713386535645,
+    "finite": 0.06470075249671936
+  },
+  {
+    "step": 669,
+    "loss": 2.3843753337860107,
+    "diagonal": 2.278088092803955,
+    "finite": 0.10628725588321686
+  },
+  {
+    "step": 670,
+    "loss": 1.4063395261764526,
+    "diagonal": 1.2588379383087158,
+    "finite": 0.14750155806541443
+  },
+  {
+    "step": 671,
+    "loss": 1.9377245903015137,
+    "diagonal": 1.8776661157608032,
+    "finite": 0.06005849689245224
+  },
+  {
+    "step": 672,
+    "loss": 2.1897811889648438,
+    "diagonal": 2.110948085784912,
+    "finite": 0.07883298397064209
+  },
+  {
+    "step": 673,
+    "loss": 2.387803792953491,
+    "diagonal": 2.296304702758789,
+    "finite": 0.09149917215108871
+  },
+  {
+    "step": 674,
+    "loss": 1.6435266733169556,
+    "diagonal": 1.5748780965805054,
+    "finite": 0.0686485767364502
+  },
+  {
+    "step": 675,
+    "loss": 1.849292516708374,
+    "diagonal": 1.7702045440673828,
+    "finite": 0.07908803224563599
+  },
+  {
+    "step": 676,
+    "loss": 1.8263094425201416,
+    "diagonal": 1.7572656869888306,
+    "finite": 0.06904375553131104
+  },
+  {
+    "step": 677,
+    "loss": 2.112423896789551,
+    "diagonal": 1.999542236328125,
+    "finite": 0.11288157105445862
+  },
+  {
+    "step": 678,
+    "loss": 2.40378475189209,
+    "diagonal": 2.310215950012207,
+    "finite": 0.09356892108917236
+  },
+  {
+    "step": 679,
+    "loss": 1.8737764358520508,
+    "diagonal": 1.7906298637390137,
+    "finite": 0.08314652740955353
+  },
+  {
+    "step": 680,
+    "loss": 2.875784397125244,
+    "diagonal": 2.8173928260803223,
+    "finite": 0.05839146673679352
+  },
+  {
+    "step": 681,
+    "loss": 2.762315273284912,
+    "diagonal": 2.651533842086792,
+    "finite": 0.11078150570392609
+  },
+  {
+    "step": 682,
+    "loss": 1.736037015914917,
+    "diagonal": 1.6780281066894531,
+    "finite": 0.05800887197256088
+  },
+  {
+    "step": 683,
+    "loss": 1.9595067501068115,
+    "diagonal": 1.8748130798339844,
+    "finite": 0.08469370007514954
+  },
+  {
+    "step": 684,
+    "loss": 2.187183380126953,
+    "diagonal": 2.1213207244873047,
+    "finite": 0.06586276739835739
+  },
+  {
+    "step": 685,
+    "loss": 2.392484664916992,
+    "diagonal": 2.3081741333007812,
+    "finite": 0.08431043475866318
+  },
+  {
+    "step": 686,
+    "loss": 1.8072731494903564,
+    "diagonal": 1.7404379844665527,
+    "finite": 0.06683511286973953
+  },
+  {
+    "step": 687,
+    "loss": 1.8854014873504639,
+    "diagonal": 1.8088319301605225,
+    "finite": 0.0765695795416832
+  },
+  {
+    "step": 688,
+    "loss": 1.7530826330184937,
+    "diagonal": 1.6615769863128662,
+    "finite": 0.09150560200214386
+  },
+  {
+    "step": 689,
+    "loss": 1.5006961822509766,
+    "diagonal": 1.431480884552002,
+    "finite": 0.06921535730361938
+  },
+  {
+    "step": 690,
+    "loss": 2.003544569015503,
+    "diagonal": 1.9139078855514526,
+    "finite": 0.08963675796985626
+  },
+  {
+    "step": 691,
+    "loss": 2.1984987258911133,
+    "diagonal": 2.1356189250946045,
+    "finite": 0.06287969648838043
+  },
+  {
+    "step": 692,
+    "loss": 1.5726803541183472,
+    "diagonal": 1.5130486488342285,
+    "finite": 0.059631649404764175
+  },
+  {
+    "step": 693,
+    "loss": 1.8429887294769287,
+    "diagonal": 1.720321774482727,
+    "finite": 0.12266691774129868
+  },
+  {
+    "step": 694,
+    "loss": 2.7696666717529297,
+    "diagonal": 2.7018470764160156,
+    "finite": 0.06781952828168869
+  },
+  {
+    "step": 695,
+    "loss": 2.1588752269744873,
+    "diagonal": 2.0147433280944824,
+    "finite": 0.14413191378116608
+  },
+  {
+    "step": 696,
+    "loss": 1.7983198165893555,
+    "diagonal": 1.7116929292678833,
+    "finite": 0.08662682771682739
+  },
+  {
+    "step": 697,
+    "loss": 1.7373418807983398,
+    "diagonal": 1.6522133350372314,
+    "finite": 0.08512856066226959
+  },
+  {
+    "step": 698,
+    "loss": 2.205016851425171,
+    "diagonal": 2.1320960521698,
+    "finite": 0.0729207843542099
+  },
+  {
+    "step": 699,
+    "loss": 2.280332565307617,
+    "diagonal": 2.1639671325683594,
+    "finite": 0.11636552214622498
+  },
+  {
+    "step": 700,
+    "loss": 2.162325143814087,
+    "diagonal": 2.078115224838257,
+    "finite": 0.0842098519206047
+  },
+  {
+    "step": 701,
+    "loss": 1.6875381469726562,
+    "diagonal": 1.6166749000549316,
+    "finite": 0.07086330652236938
+  },
+  {
+    "step": 702,
+    "loss": 1.9385114908218384,
+    "diagonal": 1.8449972867965698,
+    "finite": 0.09351425617933273
+  },
+  {
+    "step": 703,
+    "loss": 1.8797963857650757,
+    "diagonal": 1.7513744831085205,
+    "finite": 0.1284218728542328
+  },
+  {
+    "step": 704,
+    "loss": 1.7799100875854492,
+    "diagonal": 1.6881405115127563,
+    "finite": 0.09176955372095108
+  },
+  {
+    "step": 705,
+    "loss": 2.513443946838379,
+    "diagonal": 2.4142510890960693,
+    "finite": 0.0991927981376648
+  },
+  {
+    "step": 706,
+    "loss": 1.8891487121582031,
+    "diagonal": 1.7844825983047485,
+    "finite": 0.10466617345809937
+  },
+  {
+    "step": 707,
+    "loss": 2.0638487339019775,
+    "diagonal": 1.96449875831604,
+    "finite": 0.09934990108013153
+  },
+  {
+    "step": 708,
+    "loss": 1.841427206993103,
+    "diagonal": 1.760492205619812,
+    "finite": 0.08093500137329102
+  },
+  {
+    "step": 709,
+    "loss": 1.3780128955841064,
+    "diagonal": 1.3220336437225342,
+    "finite": 0.055979304015636444
+  },
+  {
+    "step": 710,
+    "loss": 1.900815725326538,
+    "diagonal": 1.7419365644454956,
+    "finite": 0.1588791161775589
+  },
+  {
+    "step": 711,
+    "loss": 1.9898611307144165,
+    "diagonal": 1.8978159427642822,
+    "finite": 0.09204523265361786
+  },
+  {
+    "step": 712,
+    "loss": 1.6796672344207764,
+    "diagonal": 1.6155803203582764,
+    "finite": 0.0640868991613388
+  },
+  {
+    "step": 713,
+    "loss": 1.774307370185852,
+    "diagonal": 1.7088881731033325,
+    "finite": 0.06541918963193893
+  },
+  {
+    "step": 714,
+    "loss": 2.4090182781219482,
+    "diagonal": 2.3109190464019775,
+    "finite": 0.09809920936822891
+  },
+  {
+    "step": 715,
+    "loss": 2.05635929107666,
+    "diagonal": 1.9618616104125977,
+    "finite": 0.09449774771928787
+  },
+  {
+    "step": 716,
+    "loss": 2.1893181800842285,
+    "diagonal": 2.1086933612823486,
+    "finite": 0.08062483370304108
+  },
+  {
+    "step": 717,
+    "loss": 2.2191293239593506,
+    "diagonal": 2.1340084075927734,
+    "finite": 0.08512094616889954
+  },
+  {
+    "step": 718,
+    "loss": 1.9101558923721313,
+    "diagonal": 1.8153347969055176,
+    "finite": 0.09482113271951675
+  },
+  {
+    "step": 719,
+    "loss": 1.3673747777938843,
+    "diagonal": 1.2692444324493408,
+    "finite": 0.09813035279512405
+  },
+  {
+    "step": 720,
+    "loss": 1.7332969903945923,
+    "diagonal": 1.666003704071045,
+    "finite": 0.06729327142238617
+  },
+  {
+    "step": 721,
+    "loss": 2.30422306060791,
+    "diagonal": 2.2136597633361816,
+    "finite": 0.09056339412927628
+  },
+  {
+    "step": 722,
+    "loss": 1.9639581441879272,
+    "diagonal": 1.8922309875488281,
+    "finite": 0.07172713428735733
+  },
+  {
+    "step": 723,
+    "loss": 1.8745753765106201,
+    "diagonal": 1.7617595195770264,
+    "finite": 0.11281586438417435
+  },
+  {
+    "step": 724,
+    "loss": 1.8815817832946777,
+    "diagonal": 1.7820314168930054,
+    "finite": 0.09955034404993057
+  },
+  {
+    "step": 725,
+    "loss": 1.899718999862671,
+    "diagonal": 1.8265408277511597,
+    "finite": 0.07317813485860825
+  },
+  {
+    "step": 726,
+    "loss": 2.150036334991455,
+    "diagonal": 2.0670289993286133,
+    "finite": 0.08300730586051941
+  },
+  {
+    "step": 727,
+    "loss": 2.2238597869873047,
+    "diagonal": 2.1296796798706055,
+    "finite": 0.09418012201786041
+  },
+  {
+    "step": 728,
+    "loss": 2.0671093463897705,
+    "diagonal": 1.9408074617385864,
+    "finite": 0.12630191445350647
+  },
+  {
+    "step": 729,
+    "loss": 2.154109001159668,
+    "diagonal": 2.0650813579559326,
+    "finite": 0.08902771770954132
+  },
+  {
+    "step": 730,
+    "loss": 1.6746857166290283,
+    "diagonal": 1.592378854751587,
+    "finite": 0.08230689913034439
+  },
+  {
+    "step": 731,
+    "loss": 1.9933336973190308,
+    "diagonal": 1.8948334455490112,
+    "finite": 0.09850026667118073
+  },
+  {
+    "step": 732,
+    "loss": 2.172903537750244,
+    "diagonal": 2.0883493423461914,
+    "finite": 0.0845542922616005
+  },
+  {
+    "step": 733,
+    "loss": 2.612182140350342,
+    "diagonal": 2.479811668395996,
+    "finite": 0.13237053155899048
+  },
+  {
+    "step": 734,
+    "loss": 2.3437323570251465,
+    "diagonal": 2.2261157035827637,
+    "finite": 0.11761663854122162
+  },
+  {
+    "step": 735,
+    "loss": 2.8022942543029785,
+    "diagonal": 2.712064743041992,
+    "finite": 0.0902295857667923
+  },
+  {
+    "step": 736,
+    "loss": 1.856689691543579,
+    "diagonal": 1.7525066137313843,
+    "finite": 0.10418309271335602
+  },
+  {
+    "step": 737,
+    "loss": 1.3831028938293457,
+    "diagonal": 1.2831605672836304,
+    "finite": 0.09994234144687653
+  },
+  {
+    "step": 738,
+    "loss": 2.297405958175659,
+    "diagonal": 2.2121987342834473,
+    "finite": 0.08520729094743729
+  },
+  {
+    "step": 739,
+    "loss": 1.9293625354766846,
+    "diagonal": 1.8515586853027344,
+    "finite": 0.07780386507511139
+  },
+  {
+    "step": 740,
+    "loss": 2.086259365081787,
+    "diagonal": 1.9842169284820557,
+    "finite": 0.10204236209392548
+  },
+  {
+    "step": 741,
+    "loss": 1.7411121129989624,
+    "diagonal": 1.628035545349121,
+    "finite": 0.1130765825510025
+  },
+  {
+    "step": 742,
+    "loss": 2.0821189880371094,
+    "diagonal": 2.0073256492614746,
+    "finite": 0.07479323446750641
+  },
+  {
+    "step": 743,
+    "loss": 2.4952070713043213,
+    "diagonal": 2.4281136989593506,
+    "finite": 0.06709333509206772
+  },
+  {
+    "step": 744,
+    "loss": 2.034536600112915,
+    "diagonal": 1.9377691745758057,
+    "finite": 0.09676751494407654
+  },
+  {
+    "step": 745,
+    "loss": 2.162999391555786,
+    "diagonal": 2.079988718032837,
+    "finite": 0.08301074802875519
+  },
+  {
+    "step": 746,
+    "loss": 1.8516515493392944,
+    "diagonal": 1.7937170267105103,
+    "finite": 0.05793454125523567
+  },
+  {
+    "step": 747,
+    "loss": 1.8822145462036133,
+    "diagonal": 1.785207986831665,
+    "finite": 0.09700661152601242
+  },
+  {
+    "step": 748,
+    "loss": 2.1644461154937744,
+    "diagonal": 2.0952131748199463,
+    "finite": 0.06923305243253708
+  },
+  {
+    "step": 749,
+    "loss": 1.8105666637420654,
+    "diagonal": 1.746201992034912,
+    "finite": 0.06436464190483093
+  },
+  {
+    "step": 750,
+    "loss": 1.4070665836334229,
+    "diagonal": 1.2894606590270996,
+    "finite": 0.11760596930980682
+  },
+  {
+    "step": 751,
+    "loss": 1.7118442058563232,
+    "diagonal": 1.5924222469329834,
+    "finite": 0.11942193657159805
+  },
+  {
+    "step": 752,
+    "loss": 2.2334330081939697,
+    "diagonal": 2.1014318466186523,
+    "finite": 0.1320011168718338
+  },
+  {
+    "step": 753,
+    "loss": 1.8725699186325073,
+    "diagonal": 1.7941606044769287,
+    "finite": 0.07840926945209503
+  },
+  {
+    "step": 754,
+    "loss": 2.6814005374908447,
+    "diagonal": 2.602144479751587,
+    "finite": 0.07925604283809662
+  },
+  {
+    "step": 755,
+    "loss": 2.340548276901245,
+    "diagonal": 2.212251663208008,
+    "finite": 0.1282966285943985
+  },
+  {
+    "step": 756,
+    "loss": 2.286916971206665,
+    "diagonal": 2.2018883228302,
+    "finite": 0.08502866327762604
+  },
+  {
+    "step": 757,
+    "loss": 1.8426191806793213,
+    "diagonal": 1.7549808025360107,
+    "finite": 0.08763838559389114
+  },
+  {
+    "step": 758,
+    "loss": 2.418147325515747,
+    "diagonal": 2.3239078521728516,
+    "finite": 0.09423942863941193
+  },
+  {
+    "step": 759,
+    "loss": 2.348609209060669,
+    "diagonal": 2.2786755561828613,
+    "finite": 0.06993376463651657
+  },
+  {
+    "step": 760,
+    "loss": 2.550865888595581,
+    "diagonal": 2.434368848800659,
+    "finite": 0.1164969801902771
+  },
+  {
+    "step": 761,
+    "loss": 2.3375184535980225,
+    "diagonal": 2.24957013130188,
+    "finite": 0.08794838935136795
+  },
+  {
+    "step": 762,
+    "loss": 2.6501805782318115,
+    "diagonal": 2.5992236137390137,
+    "finite": 0.05095706880092621
+  },
+  {
+    "step": 763,
+    "loss": 1.827953815460205,
+    "diagonal": 1.738436222076416,
+    "finite": 0.08951757848262787
+  },
+  {
+    "step": 764,
+    "loss": 1.7303600311279297,
+    "diagonal": 1.6594346761703491,
+    "finite": 0.07092539966106415
+  },
+  {
+    "step": 765,
+    "loss": 1.5290840864181519,
+    "diagonal": 1.4883148670196533,
+    "finite": 0.04076921194791794
+  },
+  {
+    "step": 766,
+    "loss": 2.530853748321533,
+    "diagonal": 2.4097251892089844,
+    "finite": 0.12112850695848465
+  },
+  {
+    "step": 767,
+    "loss": 2.0240683555603027,
+    "diagonal": 1.9485256671905518,
+    "finite": 0.07554265111684799
+  },
+  {
+    "step": 768,
+    "loss": 2.5046823024749756,
+    "diagonal": 2.4496662616729736,
+    "finite": 0.055015984922647476
+  },
+  {
+    "step": 769,
+    "loss": 2.02002215385437,
+    "diagonal": 1.915184736251831,
+    "finite": 0.1048373356461525
+  },
+  {
+    "step": 770,
+    "loss": 1.8592923879623413,
+    "diagonal": 1.776900291442871,
+    "finite": 0.08239207416772842
+  },
+  {
+    "step": 771,
+    "loss": 1.6480787992477417,
+    "diagonal": 1.579465389251709,
+    "finite": 0.06861341744661331
+  },
+  {
+    "step": 772,
+    "loss": 1.6346668004989624,
+    "diagonal": 1.553243637084961,
+    "finite": 0.08142318576574326
+  },
+  {
+    "step": 773,
+    "loss": 1.9803814888000488,
+    "diagonal": 1.8810653686523438,
+    "finite": 0.09931611269712448
+  },
+  {
+    "step": 774,
+    "loss": 1.602897047996521,
+    "diagonal": 1.5028016567230225,
+    "finite": 0.10009538382291794
+  },
+  {
+    "step": 775,
+    "loss": 2.2419629096984863,
+    "diagonal": 2.1530206203460693,
+    "finite": 0.08894234150648117
+  },
+  {
+    "step": 776,
+    "loss": 1.8222415447235107,
+    "diagonal": 1.71942138671875,
+    "finite": 0.10282017290592194
+  },
+  {
+    "step": 777,
+    "loss": 2.175605297088623,
+    "diagonal": 2.090127944946289,
+    "finite": 0.08547737449407578
+  },
+  {
+    "step": 778,
+    "loss": 2.138730049133301,
+    "diagonal": 2.037745237350464,
+    "finite": 0.10098491609096527
+  },
+  {
+    "step": 779,
+    "loss": 1.5336061716079712,
+    "diagonal": 1.4741995334625244,
+    "finite": 0.05940661579370499
+  },
+  {
+    "step": 780,
+    "loss": 2.432887077331543,
+    "diagonal": 2.329174518585205,
+    "finite": 0.10371244698762894
+  },
+  {
+    "step": 781,
+    "loss": 1.5388188362121582,
+    "diagonal": 1.403420090675354,
+    "finite": 0.1353987157344818
+  },
+  {
+    "step": 782,
+    "loss": 2.0550034046173096,
+    "diagonal": 1.978022813796997,
+    "finite": 0.07698068022727966
+  },
+  {
+    "step": 783,
+    "loss": 1.9667439460754395,
+    "diagonal": 1.9021097421646118,
+    "finite": 0.06463414430618286
+  },
+  {
+    "step": 784,
+    "loss": 1.5303027629852295,
+    "diagonal": 1.4585236310958862,
+    "finite": 0.07177913188934326
+  },
+  {
+    "step": 785,
+    "loss": 2.2372052669525146,
+    "diagonal": 2.161116123199463,
+    "finite": 0.07608921825885773
+  },
+  {
+    "step": 786,
+    "loss": 2.5683066844940186,
+    "diagonal": 2.4937994480133057,
+    "finite": 0.07450729608535767
+  },
+  {
+    "step": 787,
+    "loss": 2.625216007232666,
+    "diagonal": 2.5568883419036865,
+    "finite": 0.0683276429772377
+  },
+  {
+    "step": 788,
+    "loss": 1.9576023817062378,
+    "diagonal": 1.9158519506454468,
+    "finite": 0.04175041988492012
+  },
+  {
+    "step": 789,
+    "loss": 1.7392640113830566,
+    "diagonal": 1.676574945449829,
+    "finite": 0.06268911063671112
+  },
+  {
+    "step": 790,
+    "loss": 2.4283945560455322,
+    "diagonal": 2.3495473861694336,
+    "finite": 0.07884728163480759
+  },
+  {
+    "step": 791,
+    "loss": 2.5498573780059814,
+    "diagonal": 2.4795703887939453,
+    "finite": 0.07028698921203613
+  },
+  {
+    "step": 792,
+    "loss": 2.3155946731567383,
+    "diagonal": 2.240088701248169,
+    "finite": 0.07550585269927979
+  },
+  {
+    "step": 793,
+    "loss": 1.7791467905044556,
+    "diagonal": 1.7351558208465576,
+    "finite": 0.043990954756736755
+  },
+  {
+    "step": 794,
+    "loss": 2.1888086795806885,
+    "diagonal": 2.1432125568389893,
+    "finite": 0.04559601843357086
+  },
+  {
+    "step": 795,
+    "loss": 2.0911877155303955,
+    "diagonal": 2.03666353225708,
+    "finite": 0.054524101316928864
+  },
+  {
+    "step": 796,
+    "loss": 2.3679399490356445,
+    "diagonal": 2.2980926036834717,
+    "finite": 0.06984726339578629
+  },
+  {
+    "step": 797,
+    "loss": 2.3991148471832275,
+    "diagonal": 2.3301591873168945,
+    "finite": 0.06895561516284943
+  },
+  {
+    "step": 798,
+    "loss": 2.018751621246338,
+    "diagonal": 1.9564149379730225,
+    "finite": 0.06233668699860573
+  },
+  {
+    "step": 799,
+    "loss": 2.086918592453003,
+    "diagonal": 2.031484603881836,
+    "finite": 0.055433906614780426
+  },
+  {
+    "step": 800,
+    "loss": 1.7987736463546753,
+    "diagonal": 1.7238616943359375,
+    "finite": 0.07491191476583481
+  },
+  {
+    "step": 801,
+    "loss": 1.6690618991851807,
+    "diagonal": 1.5915225744247437,
+    "finite": 0.07753930985927582
+  },
+  {
+    "step": 802,
+    "loss": 2.218951940536499,
+    "diagonal": 2.161884069442749,
+    "finite": 0.057067930698394775
+  },
+  {
+    "step": 803,
+    "loss": 2.005551338195801,
+    "diagonal": 1.9208849668502808,
+    "finite": 0.08466626703739166
+  },
+  {
+    "step": 804,
+    "loss": 2.333702564239502,
+    "diagonal": 2.236433267593384,
+    "finite": 0.09726925194263458
+  },
+  {
+    "step": 805,
+    "loss": 2.3892295360565186,
+    "diagonal": 2.285834312438965,
+    "finite": 0.10339526832103729
+  },
+  {
+    "step": 806,
+    "loss": 2.393855333328247,
+    "diagonal": 2.2947123050689697,
+    "finite": 0.09914301335811615
+  },
+  {
+    "step": 807,
+    "loss": 2.099714994430542,
+    "diagonal": 2.0273091793060303,
+    "finite": 0.07240588963031769
+  },
+  {
+    "step": 808,
+    "loss": 1.826454997062683,
+    "diagonal": 1.7558053731918335,
+    "finite": 0.07064958661794662
+  },
+  {
+    "step": 809,
+    "loss": 2.5690505504608154,
+    "diagonal": 2.481783390045166,
+    "finite": 0.08726706355810165
+  },
+  {
+    "step": 810,
+    "loss": 2.4064323902130127,
+    "diagonal": 2.2961690425872803,
+    "finite": 0.11026332527399063
+  },
+  {
+    "step": 811,
+    "loss": 1.771790623664856,
+    "diagonal": 1.710686206817627,
+    "finite": 0.061104439198970795
+  },
+  {
+    "step": 812,
+    "loss": 1.6119179725646973,
+    "diagonal": 1.5213429927825928,
+    "finite": 0.09057494252920151
+  },
+  {
+    "step": 813,
+    "loss": 2.160881280899048,
+    "diagonal": 2.067054271697998,
+    "finite": 0.09382709860801697
+  },
+  {
+    "step": 814,
+    "loss": 2.2132773399353027,
+    "diagonal": 2.151167631149292,
+    "finite": 0.062109675258398056
+  },
+  {
+    "step": 815,
+    "loss": 2.550957441329956,
+    "diagonal": 2.4980475902557373,
+    "finite": 0.05290992558002472
+  },
+  {
+    "step": 816,
+    "loss": 1.9703750610351562,
+    "diagonal": 1.8857977390289307,
+    "finite": 0.08457735925912857
+  },
+  {
+    "step": 817,
+    "loss": 2.094510316848755,
+    "diagonal": 2.0279786586761475,
+    "finite": 0.06653167307376862
+  },
+  {
+    "step": 818,
+    "loss": 1.6702759265899658,
+    "diagonal": 1.5987664461135864,
+    "finite": 0.07150944322347641
+  },
+  {
+    "step": 819,
+    "loss": 2.101909875869751,
+    "diagonal": 1.995273470878601,
+    "finite": 0.10663637518882751
+  },
+  {
+    "step": 820,
+    "loss": 1.731990933418274,
+    "diagonal": 1.6559028625488281,
+    "finite": 0.07608810067176819
+  },
+  {
+    "step": 821,
+    "loss": 1.887628436088562,
+    "diagonal": 1.797888159751892,
+    "finite": 0.08974030613899231
+  },
+  {
+    "step": 822,
+    "loss": 2.2057864665985107,
+    "diagonal": 2.114922285079956,
+    "finite": 0.09086407721042633
+  },
+  {
+    "step": 823,
+    "loss": 2.122868537902832,
+    "diagonal": 2.0237443447113037,
+    "finite": 0.09912415593862534
+  },
+  {
+    "step": 824,
+    "loss": 2.070683717727661,
+    "diagonal": 1.9991174936294556,
+    "finite": 0.07156633585691452
+  },
+  {
+    "step": 825,
+    "loss": 2.2563509941101074,
+    "diagonal": 2.1854939460754395,
+    "finite": 0.07085700333118439
+  },
+  {
+    "step": 826,
+    "loss": 2.296647787094116,
+    "diagonal": 2.2155280113220215,
+    "finite": 0.08111979067325592
+  },
+  {
+    "step": 827,
+    "loss": 2.3421473503112793,
+    "diagonal": 2.2640433311462402,
+    "finite": 0.07810398191213608
+  },
+  {
+    "step": 828,
+    "loss": 2.375129461288452,
+    "diagonal": 2.3127150535583496,
+    "finite": 0.062414415180683136
+  },
+  {
+    "step": 829,
+    "loss": 1.8310787677764893,
+    "diagonal": 1.7665358781814575,
+    "finite": 0.06454291194677353
+  },
+  {
+    "step": 830,
+    "loss": 2.249891757965088,
+    "diagonal": 2.1387484073638916,
+    "finite": 0.11114323139190674
+  },
+  {
+    "step": 831,
+    "loss": 1.776137113571167,
+    "diagonal": 1.7172725200653076,
+    "finite": 0.05886463820934296
+  },
+  {
+    "step": 832,
+    "loss": 1.9274216890335083,
+    "diagonal": 1.840738296508789,
+    "finite": 0.08668334782123566
+  },
+  {
+    "step": 833,
+    "loss": 2.1331722736358643,
+    "diagonal": 2.001939535140991,
+    "finite": 0.13123270869255066
+  },
+  {
+    "step": 834,
+    "loss": 1.6774588823318481,
+    "diagonal": 1.5935605764389038,
+    "finite": 0.08389831334352493
+  },
+  {
+    "step": 835,
+    "loss": 2.5633761882781982,
+    "diagonal": 2.484490156173706,
+    "finite": 0.07888611406087875
+  },
+  {
+    "step": 836,
+    "loss": 1.2297955751419067,
+    "diagonal": 1.1384421586990356,
+    "finite": 0.09135337918996811
+  },
+  {
+    "step": 837,
+    "loss": 2.2393972873687744,
+    "diagonal": 2.1670563220977783,
+    "finite": 0.07234087586402893
+  },
+  {
+    "step": 838,
+    "loss": 2.0156710147857666,
+    "diagonal": 1.9491084814071655,
+    "finite": 0.0665624588727951
+  },
+  {
+    "step": 839,
+    "loss": 2.158006191253662,
+    "diagonal": 2.086189031600952,
+    "finite": 0.07181710004806519
+  },
+  {
+    "step": 840,
+    "loss": 1.5761730670928955,
+    "diagonal": 1.4911842346191406,
+    "finite": 0.0849888026714325
+  },
+  {
+    "step": 841,
+    "loss": 2.1585237979888916,
+    "diagonal": 2.0704028606414795,
+    "finite": 0.08812098205089569
+  },
+  {
+    "step": 842,
+    "loss": 1.596935749053955,
+    "diagonal": 1.5126657485961914,
+    "finite": 0.08427003026008606
+  },
+  {
+    "step": 843,
+    "loss": 2.1621780395507812,
+    "diagonal": 2.087754726409912,
+    "finite": 0.07442334294319153
+  },
+  {
+    "step": 844,
+    "loss": 2.418325901031494,
+    "diagonal": 2.3341150283813477,
+    "finite": 0.08421091735363007
+  },
+  {
+    "step": 845,
+    "loss": 2.011904001235962,
+    "diagonal": 1.9390313625335693,
+    "finite": 0.0728725865483284
+  },
+  {
+    "step": 846,
+    "loss": 1.6464780569076538,
+    "diagonal": 1.5821667909622192,
+    "finite": 0.06431131064891815
+  },
+  {
+    "step": 847,
+    "loss": 2.1026358604431152,
+    "diagonal": 2.004990577697754,
+    "finite": 0.09764521569013596
+  },
+  {
+    "step": 848,
+    "loss": 2.568742036819458,
+    "diagonal": 2.5031445026397705,
+    "finite": 0.06559762358665466
+  },
+  {
+    "step": 849,
+    "loss": 2.16658616065979,
+    "diagonal": 2.0782668590545654,
+    "finite": 0.08831918984651566
+  },
+  {
+    "step": 850,
+    "loss": 2.0161962509155273,
+    "diagonal": 1.964712142944336,
+    "finite": 0.051484160125255585
+  },
+  {
+    "step": 851,
+    "loss": 2.1796345710754395,
+    "diagonal": 2.080207347869873,
+    "finite": 0.0994272530078888
+  },
+  {
+    "step": 852,
+    "loss": 2.2930400371551514,
+    "diagonal": 2.218275785446167,
+    "finite": 0.07476426661014557
+  },
+  {
+    "step": 853,
+    "loss": 2.3728740215301514,
+    "diagonal": 2.312525987625122,
+    "finite": 0.060348086059093475
+  },
+  {
+    "step": 854,
+    "loss": 2.2445356845855713,
+    "diagonal": 2.1906230449676514,
+    "finite": 0.05391263961791992
+  },
+  {
+    "step": 855,
+    "loss": 2.2733609676361084,
+    "diagonal": 2.1840898990631104,
+    "finite": 0.0892711728811264
+  },
+  {
+    "step": 856,
+    "loss": 2.1252830028533936,
+    "diagonal": 2.06278920173645,
+    "finite": 0.06249375641345978
+  },
+  {
+    "step": 857,
+    "loss": 2.296081304550171,
+    "diagonal": 2.211909532546997,
+    "finite": 0.08417187631130219
+  },
+  {
+    "step": 858,
+    "loss": 2.4398515224456787,
+    "diagonal": 2.375952959060669,
+    "finite": 0.06389864534139633
+  },
+  {
+    "step": 859,
+    "loss": 2.360753059387207,
+    "diagonal": 2.2078804969787598,
+    "finite": 0.15287257730960846
+  },
+  {
+    "step": 860,
+    "loss": 1.5809237957000732,
+    "diagonal": 1.4711723327636719,
+    "finite": 0.10975149273872375
+  },
+  {
+    "step": 861,
+    "loss": 1.841496467590332,
+    "diagonal": 1.7884578704833984,
+    "finite": 0.05303856357932091
+  },
+  {
+    "step": 862,
+    "loss": 1.7284533977508545,
+    "diagonal": 1.6469409465789795,
+    "finite": 0.08151249587535858
+  },
+  {
+    "step": 863,
+    "loss": 2.0043838024139404,
+    "diagonal": 1.9212089776992798,
+    "finite": 0.08317474275827408
+  },
+  {
+    "step": 864,
+    "loss": 2.628100872039795,
+    "diagonal": 2.5580525398254395,
+    "finite": 0.07004843652248383
+  },
+  {
+    "step": 865,
+    "loss": 2.0610971450805664,
+    "diagonal": 1.9737634658813477,
+    "finite": 0.08733359724283218
+  },
+  {
+    "step": 866,
+    "loss": 1.628873348236084,
+    "diagonal": 1.5209615230560303,
+    "finite": 0.1079118624329567
+  },
+  {
+    "step": 867,
+    "loss": 2.0908422470092773,
+    "diagonal": 1.9338880777359009,
+    "finite": 0.15695422887802124
+  },
+  {
+    "step": 868,
+    "loss": 2.4386003017425537,
+    "diagonal": 2.338392972946167,
+    "finite": 0.10020733624696732
+  },
+  {
+    "step": 869,
+    "loss": 2.130202531814575,
+    "diagonal": 2.0378310680389404,
+    "finite": 0.09237146377563477
+  },
+  {
+    "step": 870,
+    "loss": 2.096646785736084,
+    "diagonal": 2.0196590423583984,
+    "finite": 0.07698767632246017
+  },
+  {
+    "step": 871,
+    "loss": 1.6055017709732056,
+    "diagonal": 1.516653060913086,
+    "finite": 0.08884871006011963
+  },
+  {
+    "step": 872,
+    "loss": 1.559715747833252,
+    "diagonal": 1.4673250913619995,
+    "finite": 0.09239063411951065
+  },
+  {
+    "step": 873,
+    "loss": 2.161520004272461,
+    "diagonal": 2.0633580684661865,
+    "finite": 0.09816200286149979
+  },
+  {
+    "step": 874,
+    "loss": 2.1782748699188232,
+    "diagonal": 2.0875232219696045,
+    "finite": 0.0907517522573471
+  },
+  {
+    "step": 875,
+    "loss": 2.4289915561676025,
+    "diagonal": 2.3138797283172607,
+    "finite": 0.11511188745498657
+  },
+  {
+    "step": 876,
+    "loss": 1.8363492488861084,
+    "diagonal": 1.7403695583343506,
+    "finite": 0.09597963094711304
+  },
+  {
+    "step": 877,
+    "loss": 2.364863872528076,
+    "diagonal": 2.2744250297546387,
+    "finite": 0.0904388576745987
+  },
+  {
+    "step": 878,
+    "loss": 2.0002987384796143,
+    "diagonal": 1.9477791786193848,
+    "finite": 0.05251955986022949
+  },
+  {
+    "step": 879,
+    "loss": 1.9060989618301392,
+    "diagonal": 1.843878149986267,
+    "finite": 0.06222076341509819
+  },
+  {
+    "step": 880,
+    "loss": 2.2074360847473145,
+    "diagonal": 2.132880926132202,
+    "finite": 0.07455524057149887
+  },
+  {
+    "step": 881,
+    "loss": 2.327284336090088,
+    "diagonal": 2.2603065967559814,
+    "finite": 0.06697776913642883
+  },
+  {
+    "step": 882,
+    "loss": 1.7720730304718018,
+    "diagonal": 1.7111542224884033,
+    "finite": 0.060918793082237244
+  },
+  {
+    "step": 883,
+    "loss": 2.6556458473205566,
+    "diagonal": 2.5721595287323,
+    "finite": 0.08348622173070908
+  },
+  {
+    "step": 884,
+    "loss": 2.5530929565429688,
+    "diagonal": 2.4719417095184326,
+    "finite": 0.08115118741989136
+  },
+  {
+    "step": 885,
+    "loss": 2.046588897705078,
+    "diagonal": 1.968887448310852,
+    "finite": 0.07770133763551712
+  },
+  {
+    "step": 886,
+    "loss": 2.3350319862365723,
+    "diagonal": 2.285097599029541,
+    "finite": 0.04993448033928871
+  },
+  {
+    "step": 887,
+    "loss": 2.156144142150879,
+    "diagonal": 2.08308744430542,
+    "finite": 0.07305672764778137
+  },
+  {
+    "step": 888,
+    "loss": 2.8872132301330566,
+    "diagonal": 2.8043644428253174,
+    "finite": 0.08284875750541687
+  },
+  {
+    "step": 889,
+    "loss": 1.9372175931930542,
+    "diagonal": 1.859354853630066,
+    "finite": 0.07786276936531067
+  },
+  {
+    "step": 890,
+    "loss": 1.7413400411605835,
+    "diagonal": 1.636101484298706,
+    "finite": 0.10523852705955505
+  },
+  {
+    "step": 891,
+    "loss": 1.9811437129974365,
+    "diagonal": 1.915731430053711,
+    "finite": 0.06541230529546738
+  },
+  {
+    "step": 892,
+    "loss": 2.0546815395355225,
+    "diagonal": 1.9846267700195312,
+    "finite": 0.07005473971366882
+  },
+  {
+    "step": 893,
+    "loss": 1.9624826908111572,
+    "diagonal": 1.882953405380249,
+    "finite": 0.07952933013439178
+  },
+  {
+    "step": 894,
+    "loss": 2.1450748443603516,
+    "diagonal": 2.0762522220611572,
+    "finite": 0.06882260739803314
+  },
+  {
+    "step": 895,
+    "loss": 1.8466306924819946,
+    "diagonal": 1.7476599216461182,
+    "finite": 0.09897073358297348
+  },
+  {
+    "step": 896,
+    "loss": 1.7739769220352173,
+    "diagonal": 1.716465950012207,
+    "finite": 0.05751096084713936
+  },
+  {
+    "step": 897,
+    "loss": 2.218876838684082,
+    "diagonal": 2.1242940425872803,
+    "finite": 0.09458288550376892
+  },
+  {
+    "step": 898,
+    "loss": 2.037770986557007,
+    "diagonal": 1.980349063873291,
+    "finite": 0.057422030717134476
+  },
+  {
+    "step": 899,
+    "loss": 1.963530421257019,
+    "diagonal": 1.893385410308838,
+    "finite": 0.07014499604701996
+  },
+  {
+    "step": 900,
+    "loss": 2.008894443511963,
+    "diagonal": 1.9208626747131348,
+    "finite": 0.08803167194128036
+  },
+  {
+    "step": 901,
+    "loss": 2.3609979152679443,
+    "diagonal": 2.3084654808044434,
+    "finite": 0.05253246799111366
+  },
+  {
+    "step": 902,
+    "loss": 2.2494091987609863,
+    "diagonal": 2.18135142326355,
+    "finite": 0.0680578425526619
+  },
+  {
+    "step": 903,
+    "loss": 2.052591562271118,
+    "diagonal": 1.995392084121704,
+    "finite": 0.057199396193027496
+  },
+  {
+    "step": 904,
+    "loss": 1.4874160289764404,
+    "diagonal": 1.389596939086914,
+    "finite": 0.09781914949417114
+  },
+  {
+    "step": 905,
+    "loss": 1.5527480840682983,
+    "diagonal": 1.473314881324768,
+    "finite": 0.07943323999643326
+  },
+  {
+    "step": 906,
+    "loss": 2.0131144523620605,
+    "diagonal": 1.9107394218444824,
+    "finite": 0.10237496346235275
+  },
+  {
+    "step": 907,
+    "loss": 1.5182287693023682,
+    "diagonal": 1.4167660474777222,
+    "finite": 0.10146275162696838
+  },
+  {
+    "step": 908,
+    "loss": 1.839720606803894,
+    "diagonal": 1.7438912391662598,
+    "finite": 0.09582941979169846
+  },
+  {
+    "step": 909,
+    "loss": 1.8993241786956787,
+    "diagonal": 1.7995202541351318,
+    "finite": 0.0998038798570633
+  },
+  {
+    "step": 910,
+    "loss": 1.4498546123504639,
+    "diagonal": 1.3839668035507202,
+    "finite": 0.06588782370090485
+  },
+  {
+    "step": 911,
+    "loss": 1.9077420234680176,
+    "diagonal": 1.8218082189559937,
+    "finite": 0.08593383431434631
+  },
+  {
+    "step": 912,
+    "loss": 2.5503931045532227,
+    "diagonal": 2.4520444869995117,
+    "finite": 0.09834864735603333
+  },
+  {
+    "step": 913,
+    "loss": 2.068960666656494,
+    "diagonal": 1.9971829652786255,
+    "finite": 0.07177779823541641
+  },
+  {
+    "step": 914,
+    "loss": 1.9238725900650024,
+    "diagonal": 1.871443271636963,
+    "finite": 0.05242932587862015
+  },
+  {
+    "step": 915,
+    "loss": 1.648309350013733,
+    "diagonal": 1.5626835823059082,
+    "finite": 0.08562572300434113
+  },
+  {
+    "step": 916,
+    "loss": 2.672884941101074,
+    "diagonal": 2.6055169105529785,
+    "finite": 0.06736794859170914
+  },
+  {
+    "step": 917,
+    "loss": 2.329993724822998,
+    "diagonal": 2.2659406661987305,
+    "finite": 0.06405315548181534
+  },
+  {
+    "step": 918,
+    "loss": 2.159458637237549,
+    "diagonal": 2.0939342975616455,
+    "finite": 0.06552425771951675
+  },
+  {
+    "step": 919,
+    "loss": 2.020683526992798,
+    "diagonal": 1.9382219314575195,
+    "finite": 0.08246153593063354
+  },
+  {
+    "step": 920,
+    "loss": 2.013545274734497,
+    "diagonal": 1.955202579498291,
+    "finite": 0.05834263935685158
+  },
+  {
+    "step": 921,
+    "loss": 2.4135711193084717,
+    "diagonal": 2.3411049842834473,
+    "finite": 0.07246614992618561
+  },
+  {
+    "step": 922,
+    "loss": 2.0158815383911133,
+    "diagonal": 1.9380137920379639,
+    "finite": 0.07786773145198822
+  },
+  {
+    "step": 923,
+    "loss": 2.11675763130188,
+    "diagonal": 2.044532537460327,
+    "finite": 0.07222501933574677
+  },
+  {
+    "step": 924,
+    "loss": 2.1241157054901123,
+    "diagonal": 2.0367355346679688,
+    "finite": 0.08738022297620773
+  },
+  {
+    "step": 925,
+    "loss": 2.019484043121338,
+    "diagonal": 1.9375303983688354,
+    "finite": 0.08195360004901886
+  },
+  {
+    "step": 926,
+    "loss": 2.168172597885132,
+    "diagonal": 2.0609588623046875,
+    "finite": 0.10721380263566971
+  },
+  {
+    "step": 927,
+    "loss": 1.6841694116592407,
+    "diagonal": 1.6009914875030518,
+    "finite": 0.08317788690328598
+  },
+  {
+    "step": 928,
+    "loss": 1.6996759176254272,
+    "diagonal": 1.6129199266433716,
+    "finite": 0.08675600588321686
+  },
+  {
+    "step": 929,
+    "loss": 1.7557041645050049,
+    "diagonal": 1.6626794338226318,
+    "finite": 0.09302469342947006
+  },
+  {
+    "step": 930,
+    "loss": 1.7809624671936035,
+    "diagonal": 1.6794260740280151,
+    "finite": 0.1015363410115242
+  },
+  {
+    "step": 931,
+    "loss": 2.3198986053466797,
+    "diagonal": 2.239021062850952,
+    "finite": 0.08087759464979172
+  },
+  {
+    "step": 932,
+    "loss": 2.337085247039795,
+    "diagonal": 2.2857601642608643,
+    "finite": 0.051324985921382904
+  },
+  {
+    "step": 933,
+    "loss": 2.058471441268921,
+    "diagonal": 1.9683586359024048,
+    "finite": 0.09011281281709671
+  },
+  {
+    "step": 934,
+    "loss": 2.5812370777130127,
+    "diagonal": 2.5050570964813232,
+    "finite": 0.07617990672588348
+  },
+  {
+    "step": 935,
+    "loss": 2.5413243770599365,
+    "diagonal": 2.462347984313965,
+    "finite": 0.07897645235061646
+  },
+  {
+    "step": 936,
+    "loss": 1.8613035678863525,
+    "diagonal": 1.7709038257598877,
+    "finite": 0.09039971232414246
+  },
+  {
+    "step": 937,
+    "loss": 1.9809787273406982,
+    "diagonal": 1.9162542819976807,
+    "finite": 0.06472446024417877
+  },
+  {
+    "step": 938,
+    "loss": 2.3991734981536865,
+    "diagonal": 2.300981283187866,
+    "finite": 0.0981922373175621
+  },
+  {
+    "step": 939,
+    "loss": 1.5378535985946655,
+    "diagonal": 1.4647579193115234,
+    "finite": 0.07309563457965851
+  },
+  {
+    "step": 940,
+    "loss": 2.217547655105591,
+    "diagonal": 2.1416893005371094,
+    "finite": 0.07585837692022324
+  },
+  {
+    "step": 941,
+    "loss": 1.8720831871032715,
+    "diagonal": 1.7850806713104248,
+    "finite": 0.08700250834226608
+  },
+  {
+    "step": 942,
+    "loss": 2.1567037105560303,
+    "diagonal": 2.022859811782837,
+    "finite": 0.13384395837783813
+  },
+  {
+    "step": 943,
+    "loss": 2.7837634086608887,
+    "diagonal": 2.7053608894348145,
+    "finite": 0.07840247452259064
+  },
+  {
+    "step": 944,
+    "loss": 2.0683600902557373,
+    "diagonal": 1.960649847984314,
+    "finite": 0.10771013051271439
+  },
+  {
+    "step": 945,
+    "loss": 1.7970091104507446,
+    "diagonal": 1.7354201078414917,
+    "finite": 0.06158895790576935
+  },
+  {
+    "step": 946,
+    "loss": 1.4452234506607056,
+    "diagonal": 1.3589980602264404,
+    "finite": 0.08622542023658752
+  },
+  {
+    "step": 947,
+    "loss": 2.322227716445923,
+    "diagonal": 2.237175703048706,
+    "finite": 0.0850519984960556
+  },
+  {
+    "step": 948,
+    "loss": 1.9171861410140991,
+    "diagonal": 1.8133022785186768,
+    "finite": 0.10388383269309998
+  },
+  {
+    "step": 949,
+    "loss": 1.7205723524093628,
+    "diagonal": 1.6450741291046143,
+    "finite": 0.07549826055765152
+  },
+  {
+    "step": 950,
+    "loss": 1.821412444114685,
+    "diagonal": 1.7450528144836426,
+    "finite": 0.07635962963104248
+  },
+  {
+    "step": 951,
+    "loss": 2.1190717220306396,
+    "diagonal": 2.019486904144287,
+    "finite": 0.09958476573228836
+  },
+  {
+    "step": 952,
+    "loss": 1.8399122953414917,
+    "diagonal": 1.7643144130706787,
+    "finite": 0.0755978673696518
+  },
+  {
+    "step": 953,
+    "loss": 2.5084590911865234,
+    "diagonal": 2.426344633102417,
+    "finite": 0.08211454749107361
+  },
+  {
+    "step": 954,
+    "loss": 2.3166136741638184,
+    "diagonal": 2.2447447776794434,
+    "finite": 0.07186899334192276
+  },
+  {
+    "step": 955,
+    "loss": 2.4886531829833984,
+    "diagonal": 2.43328857421875,
+    "finite": 0.055364567786455154
+  },
+  {
+    "step": 956,
+    "loss": 1.639319896697998,
+    "diagonal": 1.5724506378173828,
+    "finite": 0.06686929613351822
+  },
+  {
+    "step": 957,
+    "loss": 2.676346778869629,
+    "diagonal": 2.588594436645508,
+    "finite": 0.0877523422241211
+  },
+  {
+    "step": 958,
+    "loss": 2.0425689220428467,
+    "diagonal": 1.9829492568969727,
+    "finite": 0.05961955338716507
+  },
+  {
+    "step": 959,
+    "loss": 2.0963759422302246,
+    "diagonal": 2.0187249183654785,
+    "finite": 0.07765094190835953
+  },
+  {
+    "step": 960,
+    "loss": 2.1340739727020264,
+    "diagonal": 2.0805046558380127,
+    "finite": 0.05356936901807785
+  },
+  {
+    "step": 961,
+    "loss": 1.7406092882156372,
+    "diagonal": 1.6803842782974243,
+    "finite": 0.06022505834698677
+  },
+  {
+    "step": 962,
+    "loss": 2.3021810054779053,
+    "diagonal": 2.2468786239624023,
+    "finite": 0.0553024485707283
+  },
+  {
+    "step": 963,
+    "loss": 2.0637001991271973,
+    "diagonal": 1.986904263496399,
+    "finite": 0.0767960399389267
+  },
+  {
+    "step": 964,
+    "loss": 2.3394229412078857,
+    "diagonal": 2.285645008087158,
+    "finite": 0.05377793312072754
+  },
+  {
+    "step": 965,
+    "loss": 1.6338658332824707,
+    "diagonal": 1.5558080673217773,
+    "finite": 0.07805773615837097
+  },
+  {
+    "step": 966,
+    "loss": 2.008291244506836,
+    "diagonal": 1.939972162246704,
+    "finite": 0.06831905990839005
+  },
+  {
+    "step": 967,
+    "loss": 1.7164145708084106,
+    "diagonal": 1.6432480812072754,
+    "finite": 0.07316647469997406
+  },
+  {
+    "step": 968,
+    "loss": 2.3968234062194824,
+    "diagonal": 2.301628828048706,
+    "finite": 0.09519460052251816
+  },
+  {
+    "step": 969,
+    "loss": 2.321223497390747,
+    "diagonal": 2.238149881362915,
+    "finite": 0.08307360857725143
+  },
+  {
+    "step": 970,
+    "loss": 2.3952584266662598,
+    "diagonal": 2.3109474182128906,
+    "finite": 0.08431088924407959
+  },
+  {
+    "step": 971,
+    "loss": 2.408984899520874,
+    "diagonal": 2.3140785694122314,
+    "finite": 0.0949062779545784
+  },
+  {
+    "step": 972,
+    "loss": 1.7207655906677246,
+    "diagonal": 1.5984910726547241,
+    "finite": 0.12227445840835571
+  },
+  {
+    "step": 973,
+    "loss": 1.5881401300430298,
+    "diagonal": 1.5021107196807861,
+    "finite": 0.08602946251630783
+  },
+  {
+    "step": 974,
+    "loss": 1.8305597305297852,
+    "diagonal": 1.7613184452056885,
+    "finite": 0.06924129277467728
+  },
+  {
+    "step": 975,
+    "loss": 2.0379693508148193,
+    "diagonal": 1.9411557912826538,
+    "finite": 0.09681351482868195
+  },
+  {
+    "step": 976,
+    "loss": 2.124161958694458,
+    "diagonal": 2.049821138381958,
+    "finite": 0.07434071600437164
+  },
+  {
+    "step": 977,
+    "loss": 2.057866096496582,
+    "diagonal": 1.9899623394012451,
+    "finite": 0.0679038017988205
+  },
+  {
+    "step": 978,
+    "loss": 2.0935301780700684,
+    "diagonal": 2.007246971130371,
+    "finite": 0.08628323674201965
+  },
+  {
+    "step": 979,
+    "loss": 1.6923373937606812,
+    "diagonal": 1.5803395509719849,
+    "finite": 0.11199786514043808
+  },
+  {
+    "step": 980,
+    "loss": 2.672483444213867,
+    "diagonal": 2.6082942485809326,
+    "finite": 0.06418915838003159
+  },
+  {
+    "step": 981,
+    "loss": 2.3095133304595947,
+    "diagonal": 2.245654344558716,
+    "finite": 0.06385891139507294
+  },
+  {
+    "step": 982,
+    "loss": 1.913534164428711,
+    "diagonal": 1.784883737564087,
+    "finite": 0.12865039706230164
+  },
+  {
+    "step": 983,
+    "loss": 1.9418858289718628,
+    "diagonal": 1.8643608093261719,
+    "finite": 0.07752497494220734
+  },
+  {
+    "step": 984,
+    "loss": 2.3199450969696045,
+    "diagonal": 2.2627248764038086,
+    "finite": 0.05722012743353844
+  },
+  {
+    "step": 985,
+    "loss": 1.7705199718475342,
+    "diagonal": 1.6920242309570312,
+    "finite": 0.07849578559398651
+  },
+  {
+    "step": 986,
+    "loss": 1.854490876197815,
+    "diagonal": 1.7580150365829468,
+    "finite": 0.09647578746080399
+  },
+  {
+    "step": 987,
+    "loss": 2.50732159614563,
+    "diagonal": 2.4291586875915527,
+    "finite": 0.07816290855407715
+  },
+  {
+    "step": 988,
+    "loss": 1.9389808177947998,
+    "diagonal": 1.8756567239761353,
+    "finite": 0.06332407891750336
+  },
+  {
+    "step": 989,
+    "loss": 2.0306990146636963,
+    "diagonal": 1.9322803020477295,
+    "finite": 0.09841866791248322
+  },
+  {
+    "step": 990,
+    "loss": 1.959067940711975,
+    "diagonal": 1.8771295547485352,
+    "finite": 0.08193835616111755
+  },
+  {
+    "step": 991,
+    "loss": 2.6271119117736816,
+    "diagonal": 2.561443567276001,
+    "finite": 0.06566823273897171
+  },
+  {
+    "step": 992,
+    "loss": 1.8806583881378174,
+    "diagonal": 1.8173261880874634,
+    "finite": 0.06333225220441818
+  },
+  {
+    "step": 993,
+    "loss": 1.8079125881195068,
+    "diagonal": 1.7428779602050781,
+    "finite": 0.06503457576036453
+  },
+  {
+    "step": 994,
+    "loss": 1.3931167125701904,
+    "diagonal": 1.3063713312149048,
+    "finite": 0.08674541860818863
+  },
+  {
+    "step": 995,
+    "loss": 1.7508292198181152,
+    "diagonal": 1.6599665880203247,
+    "finite": 0.09086258709430695
+  },
+  {
+    "step": 996,
+    "loss": 2.359309196472168,
+    "diagonal": 2.243549346923828,
+    "finite": 0.11575978249311447
+  },
+  {
+    "step": 997,
+    "loss": 1.936157464981079,
+    "diagonal": 1.8833801746368408,
+    "finite": 0.052777327597141266
+  },
+  {
+    "step": 998,
+    "loss": 1.813249945640564,
+    "diagonal": 1.7494232654571533,
+    "finite": 0.06382665038108826
+  },
+  {
+    "step": 999,
+    "loss": 2.259532928466797,
+    "diagonal": 2.200343370437622,
+    "finite": 0.059189580380916595
+  }
+]
diff --git a/lecture_6/verified_examples/fmm-lagrangian/report.json b/lecture_6/verified_examples/fmm-lagrangian/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..aa6211bba706aa17ef237e0f12beea8ac207effd
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-lagrangian/report.json
@@ -0,0 +1,24 @@
+{
+  "method": "fmm-lagrangian",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 1.9876888394355774,
+  "train_loss_last_20_mean": 2.0523160219192507,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "composition_rmse": 0.2169521600008011,
+  "finite_samples": true,
+  "mean_distance_to_center": 0.4607406556606293,
+  "mode_fractions": [
+    0.28125,
+    0.234375,
+    0.2421875,
+    0.2421875
+  ],
+  "mode_entropy": 1.3836723566055298,
+  "mean_target_log_density": -3.690403699874878,
+  "elapsed_seconds": 5.863147705000301
+}
diff --git a/lecture_6/verified_examples/fmm-lagrangian/samples.txt b/lecture_6/verified_examples/fmm-lagrangian/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..65997bc75a487f3b6442fc40de8620e8cc00fe7e
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-lagrangian/samples.txt
@@ -0,0 +1,128 @@
+-1.3278185 1.6820691
+-1.5418448 1.5469987
+-1.7611860 -1.6454232
+-1.5328344 -0.0415199
+0.9066193 -1.4831111
+-1.4795260 1.5873954
+1.5275240 -1.8757236
+-1.6086195 -1.8298488
+-1.5584389 -1.5391321
+1.3049731 1.6934463
+0.6455939 1.3606055
+1.7081059 -1.1833944
+1.6491803 0.9235042
+1.1353095 -0.2482351
+-1.4491105 -1.6002954
+1.6609671 -1.7283275
+1.4170817 1.4600878
+1.2835495 -1.8435428
+0.9891380 1.1028188
+1.4867049 -1.6419179
+-1.5846868 1.5862733
+-1.5252461 -1.2775636
+-1.5985999 -1.7557237
+-1.4928935 -1.7882928
+-0.0003635 -1.6924905
+-1.6113970 0.7338643
+1.3307358 0.4692556
+-1.0684515 -1.7107477
+-1.5940543 1.3439547
+-1.0669305 -1.7601857
+-1.3310384 -1.4529927
+-1.9008613 -1.5928868
+-0.9132605 -1.9570482
+-1.5452100 -1.6307976
+1.6976430 1.6314477
+-0.3863406 -1.5862762
+1.6382798 1.3498902
+-0.3168637 1.6957549
+1.6540465 1.9461741
+1.5242766 -0.7474399
+0.6645597 1.5540551
+-1.6145804 -1.1643951
+-0.3946215 -1.4774010
+1.7829919 1.1904821
+-1.5936536 -1.6047722
+-0.9964541 1.5326971
+-1.4403754 -1.5029913
+1.5075421 -1.7251998
+1.4892414 1.8112689
+-1.5846255 1.2575506
+0.9525587 1.5871593
+0.3192041 -0.8703824
+1.2621270 -1.3411655
+1.2057084 1.4867818
+-0.7363333 1.7491509
+-1.7809191 1.2928647
+1.3426573 -1.3718876
+-0.7194183 1.2998811
+-1.5930607 -1.4280379
+-1.5765346 2.0001354
+-1.5739514 -0.9717392
+1.3596343 1.6290557
+0.8878333 1.5331285
+1.6537726 0.9390051
+1.7601290 -1.7655483
+1.4947344 -2.0105731
+0.2576364 -1.3506711
+1.6640955 -1.6753021
+-1.5331277 -1.5810797
+-1.6287444 -1.2436841
+1.5521272 1.2985317
+1.5133823 0.5699425
+0.3695794 -0.5448714
+-0.8952543 1.3637630
+1.5969610 1.5750918
+-0.2853080 -1.7451742
+1.4723595 -1.8242214
+1.7005225 -1.6106212
+1.5659775 1.4568938
+1.7632967 -1.5137576
+-1.2437248 1.7190182
+1.5464469 1.2694767
+1.4787947 1.7910008
+-1.3331991 2.1438994
+-1.3681700 -1.1973753
+-1.6944155 -1.2720313
+2.2254298 1.6382221
+-0.6233863 1.3988867
+-1.7141161 1.5676718
+-0.1386489 -0.6067886
+1.8141469 1.2850636
+-1.8070954 1.4146632
+1.9224131 -1.7148764
+1.4448723 1.4770308
+-1.6109557 0.8161051
+-1.2281183 1.3865756
+-0.8154960 1.2982699
+1.3656654 -1.6596509
+-1.5814723 -0.3679101
+1.2331023 -1.6441729
+-1.6585326 -1.5748717
+-1.5372355 1.0562510
+-1.1229112 1.6812800
+-1.7498765 -1.3818748
+-1.5828302 -1.7239511
+-1.6296320 1.5071090
+1.0345559 -1.7234499
+1.3180280 -1.7186500
+-1.9054312 -1.6337386
+-1.2896770 1.4177539
+-1.1724725 -1.6391048
+1.8312510 1.2299412
+1.1639934 1.1565661
+1.3075126 -1.6882548
+1.6744270 -1.6021879
+-1.4405501 -1.3315662
+1.5203753 1.7968894
+1.7954619 1.5011322
+1.3189499 -1.1676972
+-1.7007061 -1.6001855
+1.9341354 -1.6703284
+-1.7390256 0.1802153
+-1.5896363 1.4306442
+1.5925889 1.7582756
+1.3445278 -1.6973186
+-1.8541969 1.5629830
+-1.3685384 1.2564037
+1.7035003 -1.7064919
diff --git a/lecture_6/verified_examples/fmm-lagrangian/teacher_losses.json b/lecture_6/verified_examples/fmm-lagrangian/teacher_losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..3ff375a40b898f709a65c41934258725cfb7ef43
--- /dev/null
+++ b/lecture_6/verified_examples/fmm-lagrangian/teacher_losses.json
@@ -0,0 +1,4002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.901901960372925
+  },
+  {
+    "step": 1,
+    "loss": 4.030956745147705
+  },
+  {
+    "step": 2,
+    "loss": 3.7361669540405273
+  },
+  {
+    "step": 3,
+    "loss": 3.1736671924591064
+  },
+  {
+    "step": 4,
+    "loss": 3.2819948196411133
+  },
+  {
+    "step": 5,
+    "loss": 2.6870734691619873
+  },
+  {
+    "step": 6,
+    "loss": 3.2287180423736572
+  },
+  {
+    "step": 7,
+    "loss": 3.540705919265747
+  },
+  {
+    "step": 8,
+    "loss": 2.320319652557373
+  },
+  {
+    "step": 9,
+    "loss": 3.2631494998931885
+  },
+  {
+    "step": 10,
+    "loss": 3.2428276538848877
+  },
+  {
+    "step": 11,
+    "loss": 3.1067261695861816
+  },
+  {
+    "step": 12,
+    "loss": 2.9945061206817627
+  },
+  {
+    "step": 13,
+    "loss": 3.429009199142456
+  },
+  {
+    "step": 14,
+    "loss": 3.202871084213257
+  },
+  {
+    "step": 15,
+    "loss": 3.343949317932129
+  },
+  {
+    "step": 16,
+    "loss": 3.338503837585449
+  },
+  {
+    "step": 17,
+    "loss": 2.27468204498291
+  },
+  {
+    "step": 18,
+    "loss": 3.2059783935546875
+  },
+  {
+    "step": 19,
+    "loss": 3.2105021476745605
+  },
+  {
+    "step": 20,
+    "loss": 3.607123374938965
+  },
+  {
+    "step": 21,
+    "loss": 2.5147407054901123
+  },
+  {
+    "step": 22,
+    "loss": 2.4429540634155273
+  },
+  {
+    "step": 23,
+    "loss": 2.693626880645752
+  },
+  {
+    "step": 24,
+    "loss": 2.922039031982422
+  },
+  {
+    "step": 25,
+    "loss": 3.412623405456543
+  },
+  {
+    "step": 26,
+    "loss": 3.049421548843384
+  },
+  {
+    "step": 27,
+    "loss": 3.4507718086242676
+  },
+  {
+    "step": 28,
+    "loss": 3.2085723876953125
+  },
+  {
+    "step": 29,
+    "loss": 3.431762933731079
+  },
+  {
+    "step": 30,
+    "loss": 3.186777114868164
+  },
+  {
+    "step": 31,
+    "loss": 2.358400821685791
+  },
+  {
+    "step": 32,
+    "loss": 2.739171028137207
+  },
+  {
+    "step": 33,
+    "loss": 3.3288445472717285
+  },
+  {
+    "step": 34,
+    "loss": 2.9850246906280518
+  },
+  {
+    "step": 35,
+    "loss": 2.979214906692505
+  },
+  {
+    "step": 36,
+    "loss": 3.4282126426696777
+  },
+  {
+    "step": 37,
+    "loss": 2.3601138591766357
+  },
+  {
+    "step": 38,
+    "loss": 2.754340410232544
+  },
+  {
+    "step": 39,
+    "loss": 2.772657871246338
+  },
+  {
+    "step": 40,
+    "loss": 3.816230535507202
+  },
+  {
+    "step": 41,
+    "loss": 2.872300624847412
+  },
+  {
+    "step": 42,
+    "loss": 3.0081868171691895
+  },
+  {
+    "step": 43,
+    "loss": 2.6166443824768066
+  },
+  {
+    "step": 44,
+    "loss": 2.4548749923706055
+  },
+  {
+    "step": 45,
+    "loss": 2.7366158962249756
+  },
+  {
+    "step": 46,
+    "loss": 2.7148921489715576
+  },
+  {
+    "step": 47,
+    "loss": 2.800400972366333
+  },
+  {
+    "step": 48,
+    "loss": 2.9447460174560547
+  },
+  {
+    "step": 49,
+    "loss": 2.708866834640503
+  },
+  {
+    "step": 50,
+    "loss": 2.883293628692627
+  },
+  {
+    "step": 51,
+    "loss": 2.8611910343170166
+  },
+  {
+    "step": 52,
+    "loss": 2.477092742919922
+  },
+  {
+    "step": 53,
+    "loss": 2.551604986190796
+  },
+  {
+    "step": 54,
+    "loss": 2.338512897491455
+  },
+  {
+    "step": 55,
+    "loss": 3.476226329803467
+  },
+  {
+    "step": 56,
+    "loss": 2.717756509780884
+  },
+  {
+    "step": 57,
+    "loss": 2.5666332244873047
+  },
+  {
+    "step": 58,
+    "loss": 2.3942244052886963
+  },
+  {
+    "step": 59,
+    "loss": 2.3049826622009277
+  },
+  {
+    "step": 60,
+    "loss": 2.817511796951294
+  },
+  {
+    "step": 61,
+    "loss": 2.9381887912750244
+  },
+  {
+    "step": 62,
+    "loss": 3.0970544815063477
+  },
+  {
+    "step": 63,
+    "loss": 2.7542073726654053
+  },
+  {
+    "step": 64,
+    "loss": 2.95668625831604
+  },
+  {
+    "step": 65,
+    "loss": 3.3345565795898438
+  },
+  {
+    "step": 66,
+    "loss": 3.0203516483306885
+  },
+  {
+    "step": 67,
+    "loss": 3.0535619258880615
+  },
+  {
+    "step": 68,
+    "loss": 2.2485365867614746
+  },
+  {
+    "step": 69,
+    "loss": 3.313269853591919
+  },
+  {
+    "step": 70,
+    "loss": 3.151857614517212
+  },
+  {
+    "step": 71,
+    "loss": 3.3004636764526367
+  },
+  {
+    "step": 72,
+    "loss": 3.13859224319458
+  },
+  {
+    "step": 73,
+    "loss": 2.831691026687622
+  },
+  {
+    "step": 74,
+    "loss": 2.824505090713501
+  },
+  {
+    "step": 75,
+    "loss": 3.2724480628967285
+  },
+  {
+    "step": 76,
+    "loss": 3.3112194538116455
+  },
+  {
+    "step": 77,
+    "loss": 3.5525429248809814
+  },
+  {
+    "step": 78,
+    "loss": 3.02317214012146
+  },
+  {
+    "step": 79,
+    "loss": 2.3117425441741943
+  },
+  {
+    "step": 80,
+    "loss": 2.52921986579895
+  },
+  {
+    "step": 81,
+    "loss": 3.346832752227783
+  },
+  {
+    "step": 82,
+    "loss": 2.557271957397461
+  },
+  {
+    "step": 83,
+    "loss": 2.8063182830810547
+  },
+  {
+    "step": 84,
+    "loss": 3.1693220138549805
+  },
+  {
+    "step": 85,
+    "loss": 2.1511852741241455
+  },
+  {
+    "step": 86,
+    "loss": 2.3931725025177
+  },
+  {
+    "step": 87,
+    "loss": 2.7104268074035645
+  },
+  {
+    "step": 88,
+    "loss": 3.144993305206299
+  },
+  {
+    "step": 89,
+    "loss": 2.5371882915496826
+  },
+  {
+    "step": 90,
+    "loss": 2.635395050048828
+  },
+  {
+    "step": 91,
+    "loss": 2.9128007888793945
+  },
+  {
+    "step": 92,
+    "loss": 2.091165781021118
+  },
+  {
+    "step": 93,
+    "loss": 2.678255081176758
+  },
+  {
+    "step": 94,
+    "loss": 3.1458537578582764
+  },
+  {
+    "step": 95,
+    "loss": 3.0256667137145996
+  },
+  {
+    "step": 96,
+    "loss": 3.504319906234741
+  },
+  {
+    "step": 97,
+    "loss": 2.4840328693389893
+  },
+  {
+    "step": 98,
+    "loss": 3.156357765197754
+  },
+  {
+    "step": 99,
+    "loss": 2.409656047821045
+  },
+  {
+    "step": 100,
+    "loss": 2.607604503631592
+  },
+  {
+    "step": 101,
+    "loss": 3.1481847763061523
+  },
+  {
+    "step": 102,
+    "loss": 2.3221395015716553
+  },
+  {
+    "step": 103,
+    "loss": 2.7403645515441895
+  },
+  {
+    "step": 104,
+    "loss": 2.9177207946777344
+  },
+  {
+    "step": 105,
+    "loss": 3.1296420097351074
+  },
+  {
+    "step": 106,
+    "loss": 2.714864492416382
+  },
+  {
+    "step": 107,
+    "loss": 2.2136282920837402
+  },
+  {
+    "step": 108,
+    "loss": 3.0324344635009766
+  },
+  {
+    "step": 109,
+    "loss": 2.8028464317321777
+  },
+  {
+    "step": 110,
+    "loss": 3.500157356262207
+  },
+  {
+    "step": 111,
+    "loss": 3.659149646759033
+  },
+  {
+    "step": 112,
+    "loss": 2.6796770095825195
+  },
+  {
+    "step": 113,
+    "loss": 4.001369476318359
+  },
+  {
+    "step": 114,
+    "loss": 3.12492299079895
+  },
+  {
+    "step": 115,
+    "loss": 2.186939239501953
+  },
+  {
+    "step": 116,
+    "loss": 3.0609922409057617
+  },
+  {
+    "step": 117,
+    "loss": 2.7359426021575928
+  },
+  {
+    "step": 118,
+    "loss": 2.8246054649353027
+  },
+  {
+    "step": 119,
+    "loss": 2.0663673877716064
+  },
+  {
+    "step": 120,
+    "loss": 2.82535719871521
+  },
+  {
+    "step": 121,
+    "loss": 2.7651166915893555
+  },
+  {
+    "step": 122,
+    "loss": 2.3627724647521973
+  },
+  {
+    "step": 123,
+    "loss": 3.1746630668640137
+  },
+  {
+    "step": 124,
+    "loss": 2.2432596683502197
+  },
+  {
+    "step": 125,
+    "loss": 2.632728338241577
+  },
+  {
+    "step": 126,
+    "loss": 3.509660005569458
+  },
+  {
+    "step": 127,
+    "loss": 2.6030969619750977
+  },
+  {
+    "step": 128,
+    "loss": 2.819704532623291
+  },
+  {
+    "step": 129,
+    "loss": 2.7884159088134766
+  },
+  {
+    "step": 130,
+    "loss": 3.066481590270996
+  },
+  {
+    "step": 131,
+    "loss": 2.5375585556030273
+  },
+  {
+    "step": 132,
+    "loss": 2.6820192337036133
+  },
+  {
+    "step": 133,
+    "loss": 2.8677313327789307
+  },
+  {
+    "step": 134,
+    "loss": 3.295163631439209
+  },
+  {
+    "step": 135,
+    "loss": 3.008159637451172
+  },
+  {
+    "step": 136,
+    "loss": 2.6790380477905273
+  },
+  {
+    "step": 137,
+    "loss": 3.2993409633636475
+  },
+  {
+    "step": 138,
+    "loss": 2.3291473388671875
+  },
+  {
+    "step": 139,
+    "loss": 3.2662582397460938
+  },
+  {
+    "step": 140,
+    "loss": 3.1028847694396973
+  },
+  {
+    "step": 141,
+    "loss": 3.5241870880126953
+  },
+  {
+    "step": 142,
+    "loss": 2.6248207092285156
+  },
+  {
+    "step": 143,
+    "loss": 3.289806365966797
+  },
+  {
+    "step": 144,
+    "loss": 2.761228322982788
+  },
+  {
+    "step": 145,
+    "loss": 2.6195461750030518
+  },
+  {
+    "step": 146,
+    "loss": 3.2968337535858154
+  },
+  {
+    "step": 147,
+    "loss": 2.2302370071411133
+  },
+  {
+    "step": 148,
+    "loss": 2.7895140647888184
+  },
+  {
+    "step": 149,
+    "loss": 3.0598552227020264
+  },
+  {
+    "step": 150,
+    "loss": 2.991975784301758
+  },
+  {
+    "step": 151,
+    "loss": 2.758124589920044
+  },
+  {
+    "step": 152,
+    "loss": 2.8041367530822754
+  },
+  {
+    "step": 153,
+    "loss": 2.7885689735412598
+  },
+  {
+    "step": 154,
+    "loss": 2.642705202102661
+  },
+  {
+    "step": 155,
+    "loss": 3.208401679992676
+  },
+  {
+    "step": 156,
+    "loss": 2.890425205230713
+  },
+  {
+    "step": 157,
+    "loss": 3.0730347633361816
+  },
+  {
+    "step": 158,
+    "loss": 2.9297609329223633
+  },
+  {
+    "step": 159,
+    "loss": 3.1628060340881348
+  },
+  {
+    "step": 160,
+    "loss": 2.235241174697876
+  },
+  {
+    "step": 161,
+    "loss": 3.431405544281006
+  },
+  {
+    "step": 162,
+    "loss": 3.1083548069000244
+  },
+  {
+    "step": 163,
+    "loss": 2.592428207397461
+  },
+  {
+    "step": 164,
+    "loss": 2.538461923599243
+  },
+  {
+    "step": 165,
+    "loss": 2.8032314777374268
+  },
+  {
+    "step": 166,
+    "loss": 2.8171889781951904
+  },
+  {
+    "step": 167,
+    "loss": 2.857837677001953
+  },
+  {
+    "step": 168,
+    "loss": 2.95976185798645
+  },
+  {
+    "step": 169,
+    "loss": 2.500030994415283
+  },
+  {
+    "step": 170,
+    "loss": 2.632225513458252
+  },
+  {
+    "step": 171,
+    "loss": 2.696317672729492
+  },
+  {
+    "step": 172,
+    "loss": 2.671130657196045
+  },
+  {
+    "step": 173,
+    "loss": 3.2583823204040527
+  },
+  {
+    "step": 174,
+    "loss": 2.750561237335205
+  },
+  {
+    "step": 175,
+    "loss": 2.7291007041931152
+  },
+  {
+    "step": 176,
+    "loss": 2.5894086360931396
+  },
+  {
+    "step": 177,
+    "loss": 2.551658868789673
+  },
+  {
+    "step": 178,
+    "loss": 2.7688674926757812
+  },
+  {
+    "step": 179,
+    "loss": 2.5460314750671387
+  },
+  {
+    "step": 180,
+    "loss": 2.573371648788452
+  },
+  {
+    "step": 181,
+    "loss": 2.5819363594055176
+  },
+  {
+    "step": 182,
+    "loss": 2.7828993797302246
+  },
+  {
+    "step": 183,
+    "loss": 2.3213307857513428
+  },
+  {
+    "step": 184,
+    "loss": 2.626124382019043
+  },
+  {
+    "step": 185,
+    "loss": 2.0648884773254395
+  },
+  {
+    "step": 186,
+    "loss": 2.6399617195129395
+  },
+  {
+    "step": 187,
+    "loss": 2.4929964542388916
+  },
+  {
+    "step": 188,
+    "loss": 2.738865613937378
+  },
+  {
+    "step": 189,
+    "loss": 2.869166851043701
+  },
+  {
+    "step": 190,
+    "loss": 2.6773924827575684
+  },
+  {
+    "step": 191,
+    "loss": 3.207840919494629
+  },
+  {
+    "step": 192,
+    "loss": 2.593851327896118
+  },
+  {
+    "step": 193,
+    "loss": 3.145773410797119
+  },
+  {
+    "step": 194,
+    "loss": 2.6272592544555664
+  },
+  {
+    "step": 195,
+    "loss": 3.2182958126068115
+  },
+  {
+    "step": 196,
+    "loss": 2.6175713539123535
+  },
+  {
+    "step": 197,
+    "loss": 2.102283000946045
+  },
+  {
+    "step": 198,
+    "loss": 2.3725454807281494
+  },
+  {
+    "step": 199,
+    "loss": 2.310814142227173
+  },
+  {
+    "step": 200,
+    "loss": 2.554727077484131
+  },
+  {
+    "step": 201,
+    "loss": 2.290694236755371
+  },
+  {
+    "step": 202,
+    "loss": 2.0614757537841797
+  },
+  {
+    "step": 203,
+    "loss": 2.4946200847625732
+  },
+  {
+    "step": 204,
+    "loss": 3.1302361488342285
+  },
+  {
+    "step": 205,
+    "loss": 2.4278793334960938
+  },
+  {
+    "step": 206,
+    "loss": 2.7277281284332275
+  },
+  {
+    "step": 207,
+    "loss": 1.6022748947143555
+  },
+  {
+    "step": 208,
+    "loss": 2.2651426792144775
+  },
+  {
+    "step": 209,
+    "loss": 2.446990489959717
+  },
+  {
+    "step": 210,
+    "loss": 2.829681634902954
+  },
+  {
+    "step": 211,
+    "loss": 2.8909616470336914
+  },
+  {
+    "step": 212,
+    "loss": 2.6464128494262695
+  },
+  {
+    "step": 213,
+    "loss": 3.0840983390808105
+  },
+  {
+    "step": 214,
+    "loss": 2.442357063293457
+  },
+  {
+    "step": 215,
+    "loss": 3.077253580093384
+  },
+  {
+    "step": 216,
+    "loss": 3.0163815021514893
+  },
+  {
+    "step": 217,
+    "loss": 3.3182713985443115
+  },
+  {
+    "step": 218,
+    "loss": 2.6422321796417236
+  },
+  {
+    "step": 219,
+    "loss": 2.7757790088653564
+  },
+  {
+    "step": 220,
+    "loss": 2.817136287689209
+  },
+  {
+    "step": 221,
+    "loss": 2.7244391441345215
+  },
+  {
+    "step": 222,
+    "loss": 3.3463165760040283
+  },
+  {
+    "step": 223,
+    "loss": 2.5178160667419434
+  },
+  {
+    "step": 224,
+    "loss": 2.3083720207214355
+  },
+  {
+    "step": 225,
+    "loss": 2.6672210693359375
+  },
+  {
+    "step": 226,
+    "loss": 2.953312635421753
+  },
+  {
+    "step": 227,
+    "loss": 2.245347023010254
+  },
+  {
+    "step": 228,
+    "loss": 2.6127264499664307
+  },
+  {
+    "step": 229,
+    "loss": 2.3829171657562256
+  },
+  {
+    "step": 230,
+    "loss": 1.9589905738830566
+  },
+  {
+    "step": 231,
+    "loss": 2.7865824699401855
+  },
+  {
+    "step": 232,
+    "loss": 2.784212589263916
+  },
+  {
+    "step": 233,
+    "loss": 2.638892412185669
+  },
+  {
+    "step": 234,
+    "loss": 2.2629337310791016
+  },
+  {
+    "step": 235,
+    "loss": 2.3170275688171387
+  },
+  {
+    "step": 236,
+    "loss": 2.3931238651275635
+  },
+  {
+    "step": 237,
+    "loss": 2.5577549934387207
+  },
+  {
+    "step": 238,
+    "loss": 2.67926025390625
+  },
+  {
+    "step": 239,
+    "loss": 2.399914026260376
+  },
+  {
+    "step": 240,
+    "loss": 2.719255208969116
+  },
+  {
+    "step": 241,
+    "loss": 2.645662784576416
+  },
+  {
+    "step": 242,
+    "loss": 2.1666066646575928
+  },
+  {
+    "step": 243,
+    "loss": 2.710801839828491
+  },
+  {
+    "step": 244,
+    "loss": 2.2600297927856445
+  },
+  {
+    "step": 245,
+    "loss": 2.4880356788635254
+  },
+  {
+    "step": 246,
+    "loss": 2.333265542984009
+  },
+  {
+    "step": 247,
+    "loss": 2.3228213787078857
+  },
+  {
+    "step": 248,
+    "loss": 2.98348331451416
+  },
+  {
+    "step": 249,
+    "loss": 2.44199538230896
+  },
+  {
+    "step": 250,
+    "loss": 2.6789755821228027
+  },
+  {
+    "step": 251,
+    "loss": 2.432734489440918
+  },
+  {
+    "step": 252,
+    "loss": 2.3950858116149902
+  },
+  {
+    "step": 253,
+    "loss": 3.024618148803711
+  },
+  {
+    "step": 254,
+    "loss": 2.7950377464294434
+  },
+  {
+    "step": 255,
+    "loss": 2.6282715797424316
+  },
+  {
+    "step": 256,
+    "loss": 2.5368154048919678
+  },
+  {
+    "step": 257,
+    "loss": 2.5300967693328857
+  },
+  {
+    "step": 258,
+    "loss": 2.71651029586792
+  },
+  {
+    "step": 259,
+    "loss": 2.345527172088623
+  },
+  {
+    "step": 260,
+    "loss": 1.991959571838379
+  },
+  {
+    "step": 261,
+    "loss": 2.2183401584625244
+  },
+  {
+    "step": 262,
+    "loss": 2.7822048664093018
+  },
+  {
+    "step": 263,
+    "loss": 2.955565929412842
+  },
+  {
+    "step": 264,
+    "loss": 2.171292781829834
+  },
+  {
+    "step": 265,
+    "loss": 3.007766008377075
+  },
+  {
+    "step": 266,
+    "loss": 2.5466020107269287
+  },
+  {
+    "step": 267,
+    "loss": 2.4173848628997803
+  },
+  {
+    "step": 268,
+    "loss": 2.6756205558776855
+  },
+  {
+    "step": 269,
+    "loss": 2.4434726238250732
+  },
+  {
+    "step": 270,
+    "loss": 2.3825483322143555
+  },
+  {
+    "step": 271,
+    "loss": 2.5813300609588623
+  },
+  {
+    "step": 272,
+    "loss": 2.342559814453125
+  },
+  {
+    "step": 273,
+    "loss": 2.664748191833496
+  },
+  {
+    "step": 274,
+    "loss": 2.8664631843566895
+  },
+  {
+    "step": 275,
+    "loss": 2.8220643997192383
+  },
+  {
+    "step": 276,
+    "loss": 2.6016016006469727
+  },
+  {
+    "step": 277,
+    "loss": 2.292630672454834
+  },
+  {
+    "step": 278,
+    "loss": 2.3435916900634766
+  },
+  {
+    "step": 279,
+    "loss": 2.225806474685669
+  },
+  {
+    "step": 280,
+    "loss": 2.861757755279541
+  },
+  {
+    "step": 281,
+    "loss": 2.4925742149353027
+  },
+  {
+    "step": 282,
+    "loss": 2.3195114135742188
+  },
+  {
+    "step": 283,
+    "loss": 2.723316192626953
+  },
+  {
+    "step": 284,
+    "loss": 2.3318111896514893
+  },
+  {
+    "step": 285,
+    "loss": 2.3740956783294678
+  },
+  {
+    "step": 286,
+    "loss": 2.7161083221435547
+  },
+  {
+    "step": 287,
+    "loss": 1.8623343706130981
+  },
+  {
+    "step": 288,
+    "loss": 3.0774383544921875
+  },
+  {
+    "step": 289,
+    "loss": 2.684474468231201
+  },
+  {
+    "step": 290,
+    "loss": 2.1260976791381836
+  },
+  {
+    "step": 291,
+    "loss": 2.633331775665283
+  },
+  {
+    "step": 292,
+    "loss": 3.048750400543213
+  },
+  {
+    "step": 293,
+    "loss": 2.1517202854156494
+  },
+  {
+    "step": 294,
+    "loss": 2.703066349029541
+  },
+  {
+    "step": 295,
+    "loss": 2.2772347927093506
+  },
+  {
+    "step": 296,
+    "loss": 2.532550573348999
+  },
+  {
+    "step": 297,
+    "loss": 2.5133583545684814
+  },
+  {
+    "step": 298,
+    "loss": 2.2637734413146973
+  },
+  {
+    "step": 299,
+    "loss": 2.8052215576171875
+  },
+  {
+    "step": 300,
+    "loss": 2.3975658416748047
+  },
+  {
+    "step": 301,
+    "loss": 2.142946720123291
+  },
+  {
+    "step": 302,
+    "loss": 2.3383138179779053
+  },
+  {
+    "step": 303,
+    "loss": 2.956615924835205
+  },
+  {
+    "step": 304,
+    "loss": 2.268173933029175
+  },
+  {
+    "step": 305,
+    "loss": 2.2826666831970215
+  },
+  {
+    "step": 306,
+    "loss": 2.504539728164673
+  },
+  {
+    "step": 307,
+    "loss": 2.5966529846191406
+  },
+  {
+    "step": 308,
+    "loss": 1.9715884923934937
+  },
+  {
+    "step": 309,
+    "loss": 2.8570797443389893
+  },
+  {
+    "step": 310,
+    "loss": 2.3709073066711426
+  },
+  {
+    "step": 311,
+    "loss": 2.3691515922546387
+  },
+  {
+    "step": 312,
+    "loss": 2.5264945030212402
+  },
+  {
+    "step": 313,
+    "loss": 2.853039503097534
+  },
+  {
+    "step": 314,
+    "loss": 2.6715211868286133
+  },
+  {
+    "step": 315,
+    "loss": 2.4609460830688477
+  },
+  {
+    "step": 316,
+    "loss": 2.3723304271698
+  },
+  {
+    "step": 317,
+    "loss": 2.623749017715454
+  },
+  {
+    "step": 318,
+    "loss": 2.3588414192199707
+  },
+  {
+    "step": 319,
+    "loss": 2.2384724617004395
+  },
+  {
+    "step": 320,
+    "loss": 2.6265077590942383
+  },
+  {
+    "step": 321,
+    "loss": 2.3127033710479736
+  },
+  {
+    "step": 322,
+    "loss": 2.5432920455932617
+  },
+  {
+    "step": 323,
+    "loss": 2.902012348175049
+  },
+  {
+    "step": 324,
+    "loss": 2.2379114627838135
+  },
+  {
+    "step": 325,
+    "loss": 2.8483102321624756
+  },
+  {
+    "step": 326,
+    "loss": 3.0475165843963623
+  },
+  {
+    "step": 327,
+    "loss": 2.2012202739715576
+  },
+  {
+    "step": 328,
+    "loss": 3.10513973236084
+  },
+  {
+    "step": 329,
+    "loss": 2.7302069664001465
+  },
+  {
+    "step": 330,
+    "loss": 2.05947208404541
+  },
+  {
+    "step": 331,
+    "loss": 2.0735864639282227
+  },
+  {
+    "step": 332,
+    "loss": 2.351263999938965
+  },
+  {
+    "step": 333,
+    "loss": 2.1889426708221436
+  },
+  {
+    "step": 334,
+    "loss": 1.893702745437622
+  },
+  {
+    "step": 335,
+    "loss": 2.886248826980591
+  },
+  {
+    "step": 336,
+    "loss": 2.281409502029419
+  },
+  {
+    "step": 337,
+    "loss": 2.278639793395996
+  },
+  {
+    "step": 338,
+    "loss": 2.7411670684814453
+  },
+  {
+    "step": 339,
+    "loss": 2.242872714996338
+  },
+  {
+    "step": 340,
+    "loss": 2.567128896713257
+  },
+  {
+    "step": 341,
+    "loss": 2.1635279655456543
+  },
+  {
+    "step": 342,
+    "loss": 2.7505345344543457
+  },
+  {
+    "step": 343,
+    "loss": 2.4954588413238525
+  },
+  {
+    "step": 344,
+    "loss": 2.4626471996307373
+  },
+  {
+    "step": 345,
+    "loss": 2.457416296005249
+  },
+  {
+    "step": 346,
+    "loss": 2.4571924209594727
+  },
+  {
+    "step": 347,
+    "loss": 2.3100287914276123
+  },
+  {
+    "step": 348,
+    "loss": 2.4437308311462402
+  },
+  {
+    "step": 349,
+    "loss": 2.0501744747161865
+  },
+  {
+    "step": 350,
+    "loss": 2.1469335556030273
+  },
+  {
+    "step": 351,
+    "loss": 2.464240550994873
+  },
+  {
+    "step": 352,
+    "loss": 1.8512563705444336
+  },
+  {
+    "step": 353,
+    "loss": 2.4845597743988037
+  },
+  {
+    "step": 354,
+    "loss": 2.224407434463501
+  },
+  {
+    "step": 355,
+    "loss": 2.5380733013153076
+  },
+  {
+    "step": 356,
+    "loss": 2.51659893989563
+  },
+  {
+    "step": 357,
+    "loss": 2.0740654468536377
+  },
+  {
+    "step": 358,
+    "loss": 2.069371461868286
+  },
+  {
+    "step": 359,
+    "loss": 2.823765516281128
+  },
+  {
+    "step": 360,
+    "loss": 2.5208475589752197
+  },
+  {
+    "step": 361,
+    "loss": 2.116133213043213
+  },
+  {
+    "step": 362,
+    "loss": 2.556251049041748
+  },
+  {
+    "step": 363,
+    "loss": 2.223443031311035
+  },
+  {
+    "step": 364,
+    "loss": 2.6511716842651367
+  },
+  {
+    "step": 365,
+    "loss": 1.691718339920044
+  },
+  {
+    "step": 366,
+    "loss": 2.411846160888672
+  },
+  {
+    "step": 367,
+    "loss": 2.582014799118042
+  },
+  {
+    "step": 368,
+    "loss": 2.2078142166137695
+  },
+  {
+    "step": 369,
+    "loss": 2.609196662902832
+  },
+  {
+    "step": 370,
+    "loss": 2.444159984588623
+  },
+  {
+    "step": 371,
+    "loss": 2.0085737705230713
+  },
+  {
+    "step": 372,
+    "loss": 2.4077141284942627
+  },
+  {
+    "step": 373,
+    "loss": 2.8086421489715576
+  },
+  {
+    "step": 374,
+    "loss": 2.359715700149536
+  },
+  {
+    "step": 375,
+    "loss": 2.343597888946533
+  },
+  {
+    "step": 376,
+    "loss": 1.948641061782837
+  },
+  {
+    "step": 377,
+    "loss": 2.3641631603240967
+  },
+  {
+    "step": 378,
+    "loss": 2.0386908054351807
+  },
+  {
+    "step": 379,
+    "loss": 2.9259984493255615
+  },
+  {
+    "step": 380,
+    "loss": 2.6643362045288086
+  },
+  {
+    "step": 381,
+    "loss": 2.8584165573120117
+  },
+  {
+    "step": 382,
+    "loss": 2.6431076526641846
+  },
+  {
+    "step": 383,
+    "loss": 2.8262100219726562
+  },
+  {
+    "step": 384,
+    "loss": 2.1087937355041504
+  },
+  {
+    "step": 385,
+    "loss": 2.412994861602783
+  },
+  {
+    "step": 386,
+    "loss": 2.452765703201294
+  },
+  {
+    "step": 387,
+    "loss": 2.2612946033477783
+  },
+  {
+    "step": 388,
+    "loss": 2.9486331939697266
+  },
+  {
+    "step": 389,
+    "loss": 2.2730305194854736
+  },
+  {
+    "step": 390,
+    "loss": 2.526773691177368
+  },
+  {
+    "step": 391,
+    "loss": 2.397615909576416
+  },
+  {
+    "step": 392,
+    "loss": 2.3714022636413574
+  },
+  {
+    "step": 393,
+    "loss": 2.501068353652954
+  },
+  {
+    "step": 394,
+    "loss": 2.101055860519409
+  },
+  {
+    "step": 395,
+    "loss": 1.8332078456878662
+  },
+  {
+    "step": 396,
+    "loss": 2.620009183883667
+  },
+  {
+    "step": 397,
+    "loss": 2.6437087059020996
+  },
+  {
+    "step": 398,
+    "loss": 2.1969316005706787
+  },
+  {
+    "step": 399,
+    "loss": 2.578944444656372
+  },
+  {
+    "step": 400,
+    "loss": 2.8199615478515625
+  },
+  {
+    "step": 401,
+    "loss": 1.9555848836898804
+  },
+  {
+    "step": 402,
+    "loss": 2.3566293716430664
+  },
+  {
+    "step": 403,
+    "loss": 1.9274892807006836
+  },
+  {
+    "step": 404,
+    "loss": 2.3533687591552734
+  },
+  {
+    "step": 405,
+    "loss": 2.3114140033721924
+  },
+  {
+    "step": 406,
+    "loss": 2.3387277126312256
+  },
+  {
+    "step": 407,
+    "loss": 2.3504040241241455
+  },
+  {
+    "step": 408,
+    "loss": 2.694427490234375
+  },
+  {
+    "step": 409,
+    "loss": 2.370358467102051
+  },
+  {
+    "step": 410,
+    "loss": 1.8371087312698364
+  },
+  {
+    "step": 411,
+    "loss": 2.34598970413208
+  },
+  {
+    "step": 412,
+    "loss": 2.001140832901001
+  },
+  {
+    "step": 413,
+    "loss": 2.0652122497558594
+  },
+  {
+    "step": 414,
+    "loss": 2.631736993789673
+  },
+  {
+    "step": 415,
+    "loss": 2.3046376705169678
+  },
+  {
+    "step": 416,
+    "loss": 2.365978240966797
+  },
+  {
+    "step": 417,
+    "loss": 2.047502040863037
+  },
+  {
+    "step": 418,
+    "loss": 2.6210899353027344
+  },
+  {
+    "step": 419,
+    "loss": 2.1412880420684814
+  },
+  {
+    "step": 420,
+    "loss": 2.2439045906066895
+  },
+  {
+    "step": 421,
+    "loss": 2.1576952934265137
+  },
+  {
+    "step": 422,
+    "loss": 2.051438331604004
+  },
+  {
+    "step": 423,
+    "loss": 2.0313544273376465
+  },
+  {
+    "step": 424,
+    "loss": 3.118997573852539
+  },
+  {
+    "step": 425,
+    "loss": 2.471263885498047
+  },
+  {
+    "step": 426,
+    "loss": 1.698156714439392
+  },
+  {
+    "step": 427,
+    "loss": 2.799497365951538
+  },
+  {
+    "step": 428,
+    "loss": 2.1427876949310303
+  },
+  {
+    "step": 429,
+    "loss": 2.820594549179077
+  },
+  {
+    "step": 430,
+    "loss": 1.9575327634811401
+  },
+  {
+    "step": 431,
+    "loss": 2.6089365482330322
+  },
+  {
+    "step": 432,
+    "loss": 2.0574324131011963
+  },
+  {
+    "step": 433,
+    "loss": 2.868596315383911
+  },
+  {
+    "step": 434,
+    "loss": 2.1540873050689697
+  },
+  {
+    "step": 435,
+    "loss": 2.039017677307129
+  },
+  {
+    "step": 436,
+    "loss": 2.4460833072662354
+  },
+  {
+    "step": 437,
+    "loss": 2.5863380432128906
+  },
+  {
+    "step": 438,
+    "loss": 2.5211329460144043
+  },
+  {
+    "step": 439,
+    "loss": 2.0439255237579346
+  },
+  {
+    "step": 440,
+    "loss": 2.083531141281128
+  },
+  {
+    "step": 441,
+    "loss": 2.2036032676696777
+  },
+  {
+    "step": 442,
+    "loss": 2.1617541313171387
+  },
+  {
+    "step": 443,
+    "loss": 2.2706785202026367
+  },
+  {
+    "step": 444,
+    "loss": 2.3687477111816406
+  },
+  {
+    "step": 445,
+    "loss": 2.1419553756713867
+  },
+  {
+    "step": 446,
+    "loss": 2.3326170444488525
+  },
+  {
+    "step": 447,
+    "loss": 2.0808708667755127
+  },
+  {
+    "step": 448,
+    "loss": 2.309194803237915
+  },
+  {
+    "step": 449,
+    "loss": 2.8360342979431152
+  },
+  {
+    "step": 450,
+    "loss": 2.3126049041748047
+  },
+  {
+    "step": 451,
+    "loss": 2.2485318183898926
+  },
+  {
+    "step": 452,
+    "loss": 2.6139726638793945
+  },
+  {
+    "step": 453,
+    "loss": 2.174654483795166
+  },
+  {
+    "step": 454,
+    "loss": 2.4408035278320312
+  },
+  {
+    "step": 455,
+    "loss": 2.3054635524749756
+  },
+  {
+    "step": 456,
+    "loss": 2.500479221343994
+  },
+  {
+    "step": 457,
+    "loss": 2.712820053100586
+  },
+  {
+    "step": 458,
+    "loss": 2.3475780487060547
+  },
+  {
+    "step": 459,
+    "loss": 2.476759910583496
+  },
+  {
+    "step": 460,
+    "loss": 2.163086175918579
+  },
+  {
+    "step": 461,
+    "loss": 2.1306872367858887
+  },
+  {
+    "step": 462,
+    "loss": 2.569213390350342
+  },
+  {
+    "step": 463,
+    "loss": 1.9032127857208252
+  },
+  {
+    "step": 464,
+    "loss": 2.670799493789673
+  },
+  {
+    "step": 465,
+    "loss": 2.116924285888672
+  },
+  {
+    "step": 466,
+    "loss": 2.200054883956909
+  },
+  {
+    "step": 467,
+    "loss": 2.726794719696045
+  },
+  {
+    "step": 468,
+    "loss": 2.4743218421936035
+  },
+  {
+    "step": 469,
+    "loss": 2.1093218326568604
+  },
+  {
+    "step": 470,
+    "loss": 1.994795322418213
+  },
+  {
+    "step": 471,
+    "loss": 2.4643502235412598
+  },
+  {
+    "step": 472,
+    "loss": 2.4895074367523193
+  },
+  {
+    "step": 473,
+    "loss": 2.212019920349121
+  },
+  {
+    "step": 474,
+    "loss": 1.9118317365646362
+  },
+  {
+    "step": 475,
+    "loss": 1.9181571006774902
+  },
+  {
+    "step": 476,
+    "loss": 2.6781809329986572
+  },
+  {
+    "step": 477,
+    "loss": 1.9821468591690063
+  },
+  {
+    "step": 478,
+    "loss": 2.641598701477051
+  },
+  {
+    "step": 479,
+    "loss": 2.110565185546875
+  },
+  {
+    "step": 480,
+    "loss": 2.528163194656372
+  },
+  {
+    "step": 481,
+    "loss": 2.2186732292175293
+  },
+  {
+    "step": 482,
+    "loss": 1.94599187374115
+  },
+  {
+    "step": 483,
+    "loss": 2.3718581199645996
+  },
+  {
+    "step": 484,
+    "loss": 2.222639560699463
+  },
+  {
+    "step": 485,
+    "loss": 2.4093661308288574
+  },
+  {
+    "step": 486,
+    "loss": 2.54209041595459
+  },
+  {
+    "step": 487,
+    "loss": 2.024200201034546
+  },
+  {
+    "step": 488,
+    "loss": 2.5153119564056396
+  },
+  {
+    "step": 489,
+    "loss": 1.658121943473816
+  },
+  {
+    "step": 490,
+    "loss": 2.2563576698303223
+  },
+  {
+    "step": 491,
+    "loss": 2.3844380378723145
+  },
+  {
+    "step": 492,
+    "loss": 2.1449241638183594
+  },
+  {
+    "step": 493,
+    "loss": 2.2108402252197266
+  },
+  {
+    "step": 494,
+    "loss": 2.344649314880371
+  },
+  {
+    "step": 495,
+    "loss": 2.548719644546509
+  },
+  {
+    "step": 496,
+    "loss": 1.7746530771255493
+  },
+  {
+    "step": 497,
+    "loss": 2.309767246246338
+  },
+  {
+    "step": 498,
+    "loss": 2.0731115341186523
+  },
+  {
+    "step": 499,
+    "loss": 2.5398313999176025
+  },
+  {
+    "step": 500,
+    "loss": 2.091824769973755
+  },
+  {
+    "step": 501,
+    "loss": 1.9239593744277954
+  },
+  {
+    "step": 502,
+    "loss": 1.9768168926239014
+  },
+  {
+    "step": 503,
+    "loss": 2.260188341140747
+  },
+  {
+    "step": 504,
+    "loss": 2.553421974182129
+  },
+  {
+    "step": 505,
+    "loss": 2.4699223041534424
+  },
+  {
+    "step": 506,
+    "loss": 2.630557060241699
+  },
+  {
+    "step": 507,
+    "loss": 2.0340492725372314
+  },
+  {
+    "step": 508,
+    "loss": 2.028682231903076
+  },
+  {
+    "step": 509,
+    "loss": 2.45908260345459
+  },
+  {
+    "step": 510,
+    "loss": 2.2142536640167236
+  },
+  {
+    "step": 511,
+    "loss": 2.4662668704986572
+  },
+  {
+    "step": 512,
+    "loss": 2.27579927444458
+  },
+  {
+    "step": 513,
+    "loss": 2.2575185298919678
+  },
+  {
+    "step": 514,
+    "loss": 2.6080620288848877
+  },
+  {
+    "step": 515,
+    "loss": 2.5972297191619873
+  },
+  {
+    "step": 516,
+    "loss": 2.1600301265716553
+  },
+  {
+    "step": 517,
+    "loss": 1.9268064498901367
+  },
+  {
+    "step": 518,
+    "loss": 2.278988838195801
+  },
+  {
+    "step": 519,
+    "loss": 2.4084134101867676
+  },
+  {
+    "step": 520,
+    "loss": 2.7133266925811768
+  },
+  {
+    "step": 521,
+    "loss": 2.123317003250122
+  },
+  {
+    "step": 522,
+    "loss": 2.0050742626190186
+  },
+  {
+    "step": 523,
+    "loss": 2.311730146408081
+  },
+  {
+    "step": 524,
+    "loss": 2.100144624710083
+  },
+  {
+    "step": 525,
+    "loss": 2.182567834854126
+  },
+  {
+    "step": 526,
+    "loss": 2.6850223541259766
+  },
+  {
+    "step": 527,
+    "loss": 2.64558482170105
+  },
+  {
+    "step": 528,
+    "loss": 2.065207004547119
+  },
+  {
+    "step": 529,
+    "loss": 2.57641339302063
+  },
+  {
+    "step": 530,
+    "loss": 2.37033748626709
+  },
+  {
+    "step": 531,
+    "loss": 2.3202273845672607
+  },
+  {
+    "step": 532,
+    "loss": 2.5949063301086426
+  },
+  {
+    "step": 533,
+    "loss": 2.621664047241211
+  },
+  {
+    "step": 534,
+    "loss": 2.4353041648864746
+  },
+  {
+    "step": 535,
+    "loss": 2.0931382179260254
+  },
+  {
+    "step": 536,
+    "loss": 2.1506476402282715
+  },
+  {
+    "step": 537,
+    "loss": 2.0098910331726074
+  },
+  {
+    "step": 538,
+    "loss": 1.8340765237808228
+  },
+  {
+    "step": 539,
+    "loss": 2.3008437156677246
+  },
+  {
+    "step": 540,
+    "loss": 2.4273364543914795
+  },
+  {
+    "step": 541,
+    "loss": 2.4804060459136963
+  },
+  {
+    "step": 542,
+    "loss": 2.25795841217041
+  },
+  {
+    "step": 543,
+    "loss": 2.357149600982666
+  },
+  {
+    "step": 544,
+    "loss": 2.1500396728515625
+  },
+  {
+    "step": 545,
+    "loss": 2.459463596343994
+  },
+  {
+    "step": 546,
+    "loss": 2.2286086082458496
+  },
+  {
+    "step": 547,
+    "loss": 2.4219624996185303
+  },
+  {
+    "step": 548,
+    "loss": 2.686821222305298
+  },
+  {
+    "step": 549,
+    "loss": 2.2649004459381104
+  },
+  {
+    "step": 550,
+    "loss": 2.307349920272827
+  },
+  {
+    "step": 551,
+    "loss": 1.8991062641143799
+  },
+  {
+    "step": 552,
+    "loss": 1.9229987859725952
+  },
+  {
+    "step": 553,
+    "loss": 2.5056543350219727
+  },
+  {
+    "step": 554,
+    "loss": 2.1609060764312744
+  },
+  {
+    "step": 555,
+    "loss": 1.9778512716293335
+  },
+  {
+    "step": 556,
+    "loss": 2.471957206726074
+  },
+  {
+    "step": 557,
+    "loss": 1.8614418506622314
+  },
+  {
+    "step": 558,
+    "loss": 2.335939884185791
+  },
+  {
+    "step": 559,
+    "loss": 1.712602972984314
+  },
+  {
+    "step": 560,
+    "loss": 2.4900341033935547
+  },
+  {
+    "step": 561,
+    "loss": 2.3448946475982666
+  },
+  {
+    "step": 562,
+    "loss": 2.333690643310547
+  },
+  {
+    "step": 563,
+    "loss": 2.3033447265625
+  },
+  {
+    "step": 564,
+    "loss": 1.985489010810852
+  },
+  {
+    "step": 565,
+    "loss": 2.1400845050811768
+  },
+  {
+    "step": 566,
+    "loss": 2.6713786125183105
+  },
+  {
+    "step": 567,
+    "loss": 2.2288951873779297
+  },
+  {
+    "step": 568,
+    "loss": 1.8685835599899292
+  },
+  {
+    "step": 569,
+    "loss": 1.8806357383728027
+  },
+  {
+    "step": 570,
+    "loss": 2.147825241088867
+  },
+  {
+    "step": 571,
+    "loss": 1.928283452987671
+  },
+  {
+    "step": 572,
+    "loss": 1.8230233192443848
+  },
+  {
+    "step": 573,
+    "loss": 1.8360440731048584
+  },
+  {
+    "step": 574,
+    "loss": 2.6959915161132812
+  },
+  {
+    "step": 575,
+    "loss": 1.9693267345428467
+  },
+  {
+    "step": 576,
+    "loss": 2.7600269317626953
+  },
+  {
+    "step": 577,
+    "loss": 2.2720563411712646
+  },
+  {
+    "step": 578,
+    "loss": 2.299776077270508
+  },
+  {
+    "step": 579,
+    "loss": 2.212860584259033
+  },
+  {
+    "step": 580,
+    "loss": 2.3061680793762207
+  },
+  {
+    "step": 581,
+    "loss": 2.2603089809417725
+  },
+  {
+    "step": 582,
+    "loss": 2.0869574546813965
+  },
+  {
+    "step": 583,
+    "loss": 2.23502254486084
+  },
+  {
+    "step": 584,
+    "loss": 2.2090988159179688
+  },
+  {
+    "step": 585,
+    "loss": 2.244767427444458
+  },
+  {
+    "step": 586,
+    "loss": 2.256420135498047
+  },
+  {
+    "step": 587,
+    "loss": 1.9098711013793945
+  },
+  {
+    "step": 588,
+    "loss": 2.3755404949188232
+  },
+  {
+    "step": 589,
+    "loss": 2.6855807304382324
+  },
+  {
+    "step": 590,
+    "loss": 2.460073471069336
+  },
+  {
+    "step": 591,
+    "loss": 1.8837049007415771
+  },
+  {
+    "step": 592,
+    "loss": 2.081373929977417
+  },
+  {
+    "step": 593,
+    "loss": 2.1925439834594727
+  },
+  {
+    "step": 594,
+    "loss": 1.9564194679260254
+  },
+  {
+    "step": 595,
+    "loss": 2.205615758895874
+  },
+  {
+    "step": 596,
+    "loss": 2.478692054748535
+  },
+  {
+    "step": 597,
+    "loss": 2.0080032348632812
+  },
+  {
+    "step": 598,
+    "loss": 2.469820976257324
+  },
+  {
+    "step": 599,
+    "loss": 1.8856621980667114
+  },
+  {
+    "step": 600,
+    "loss": 1.6023671627044678
+  },
+  {
+    "step": 601,
+    "loss": 2.1479015350341797
+  },
+  {
+    "step": 602,
+    "loss": 2.306637763977051
+  },
+  {
+    "step": 603,
+    "loss": 2.2650392055511475
+  },
+  {
+    "step": 604,
+    "loss": 2.517967939376831
+  },
+  {
+    "step": 605,
+    "loss": 2.248115062713623
+  },
+  {
+    "step": 606,
+    "loss": 2.1899242401123047
+  },
+  {
+    "step": 607,
+    "loss": 2.3952863216400146
+  },
+  {
+    "step": 608,
+    "loss": 2.0763449668884277
+  },
+  {
+    "step": 609,
+    "loss": 2.3016607761383057
+  },
+  {
+    "step": 610,
+    "loss": 2.283357858657837
+  },
+  {
+    "step": 611,
+    "loss": 1.9581166505813599
+  },
+  {
+    "step": 612,
+    "loss": 2.4603822231292725
+  },
+  {
+    "step": 613,
+    "loss": 2.20369553565979
+  },
+  {
+    "step": 614,
+    "loss": 2.3975698947906494
+  },
+  {
+    "step": 615,
+    "loss": 2.3169641494750977
+  },
+  {
+    "step": 616,
+    "loss": 2.176382303237915
+  },
+  {
+    "step": 617,
+    "loss": 2.343982219696045
+  },
+  {
+    "step": 618,
+    "loss": 1.8763999938964844
+  },
+  {
+    "step": 619,
+    "loss": 2.083078384399414
+  },
+  {
+    "step": 620,
+    "loss": 1.902529239654541
+  },
+  {
+    "step": 621,
+    "loss": 2.0607450008392334
+  },
+  {
+    "step": 622,
+    "loss": 2.078382730484009
+  },
+  {
+    "step": 623,
+    "loss": 2.4523744583129883
+  },
+  {
+    "step": 624,
+    "loss": 2.1366493701934814
+  },
+  {
+    "step": 625,
+    "loss": 2.0985474586486816
+  },
+  {
+    "step": 626,
+    "loss": 2.5543007850646973
+  },
+  {
+    "step": 627,
+    "loss": 2.5027101039886475
+  },
+  {
+    "step": 628,
+    "loss": 2.8813798427581787
+  },
+  {
+    "step": 629,
+    "loss": 2.3890798091888428
+  },
+  {
+    "step": 630,
+    "loss": 1.9115877151489258
+  },
+  {
+    "step": 631,
+    "loss": 1.8879164457321167
+  },
+  {
+    "step": 632,
+    "loss": 2.415476083755493
+  },
+  {
+    "step": 633,
+    "loss": 2.3512673377990723
+  },
+  {
+    "step": 634,
+    "loss": 2.330165147781372
+  },
+  {
+    "step": 635,
+    "loss": 2.368882179260254
+  },
+  {
+    "step": 636,
+    "loss": 1.8848557472229004
+  },
+  {
+    "step": 637,
+    "loss": 2.5454752445220947
+  },
+  {
+    "step": 638,
+    "loss": 2.4458537101745605
+  },
+  {
+    "step": 639,
+    "loss": 2.3046398162841797
+  },
+  {
+    "step": 640,
+    "loss": 2.293977737426758
+  },
+  {
+    "step": 641,
+    "loss": 2.0221903324127197
+  },
+  {
+    "step": 642,
+    "loss": 1.678128719329834
+  },
+  {
+    "step": 643,
+    "loss": 2.55545711517334
+  },
+  {
+    "step": 644,
+    "loss": 2.0510752201080322
+  },
+  {
+    "step": 645,
+    "loss": 1.8273422718048096
+  },
+  {
+    "step": 646,
+    "loss": 2.4667928218841553
+  },
+  {
+    "step": 647,
+    "loss": 2.062159538269043
+  },
+  {
+    "step": 648,
+    "loss": 1.8708369731903076
+  },
+  {
+    "step": 649,
+    "loss": 1.8367586135864258
+  },
+  {
+    "step": 650,
+    "loss": 2.3304603099823
+  },
+  {
+    "step": 651,
+    "loss": 2.2214672565460205
+  },
+  {
+    "step": 652,
+    "loss": 2.156398057937622
+  },
+  {
+    "step": 653,
+    "loss": 1.802478551864624
+  },
+  {
+    "step": 654,
+    "loss": 2.1194801330566406
+  },
+  {
+    "step": 655,
+    "loss": 1.832618236541748
+  },
+  {
+    "step": 656,
+    "loss": 2.7607004642486572
+  },
+  {
+    "step": 657,
+    "loss": 1.5378355979919434
+  },
+  {
+    "step": 658,
+    "loss": 2.871095895767212
+  },
+  {
+    "step": 659,
+    "loss": 2.1772589683532715
+  },
+  {
+    "step": 660,
+    "loss": 2.378739356994629
+  },
+  {
+    "step": 661,
+    "loss": 1.9543912410736084
+  },
+  {
+    "step": 662,
+    "loss": 1.7253490686416626
+  },
+  {
+    "step": 663,
+    "loss": 2.3326663970947266
+  },
+  {
+    "step": 664,
+    "loss": 2.0331671237945557
+  },
+  {
+    "step": 665,
+    "loss": 2.8661580085754395
+  },
+  {
+    "step": 666,
+    "loss": 2.4486398696899414
+  },
+  {
+    "step": 667,
+    "loss": 2.2856521606445312
+  },
+  {
+    "step": 668,
+    "loss": 2.0959157943725586
+  },
+  {
+    "step": 669,
+    "loss": 1.828498363494873
+  },
+  {
+    "step": 670,
+    "loss": 2.580878257751465
+  },
+  {
+    "step": 671,
+    "loss": 2.111854076385498
+  },
+  {
+    "step": 672,
+    "loss": 2.3081603050231934
+  },
+  {
+    "step": 673,
+    "loss": 2.1535303592681885
+  },
+  {
+    "step": 674,
+    "loss": 2.4697322845458984
+  },
+  {
+    "step": 675,
+    "loss": 1.8599785566329956
+  },
+  {
+    "step": 676,
+    "loss": 2.156494140625
+  },
+  {
+    "step": 677,
+    "loss": 2.1473135948181152
+  },
+  {
+    "step": 678,
+    "loss": 1.5099081993103027
+  },
+  {
+    "step": 679,
+    "loss": 2.241101026535034
+  },
+  {
+    "step": 680,
+    "loss": 2.242471694946289
+  },
+  {
+    "step": 681,
+    "loss": 2.042699098587036
+  },
+  {
+    "step": 682,
+    "loss": 2.1123008728027344
+  },
+  {
+    "step": 683,
+    "loss": 2.017486095428467
+  },
+  {
+    "step": 684,
+    "loss": 2.0131030082702637
+  },
+  {
+    "step": 685,
+    "loss": 1.8260565996170044
+  },
+  {
+    "step": 686,
+    "loss": 1.8099098205566406
+  },
+  {
+    "step": 687,
+    "loss": 1.9493796825408936
+  },
+  {
+    "step": 688,
+    "loss": 1.7958455085754395
+  },
+  {
+    "step": 689,
+    "loss": 2.12551212310791
+  },
+  {
+    "step": 690,
+    "loss": 1.8851398229599
+  },
+  {
+    "step": 691,
+    "loss": 2.169377326965332
+  },
+  {
+    "step": 692,
+    "loss": 2.345599412918091
+  },
+  {
+    "step": 693,
+    "loss": 2.6371800899505615
+  },
+  {
+    "step": 694,
+    "loss": 2.054779291152954
+  },
+  {
+    "step": 695,
+    "loss": 1.8875532150268555
+  },
+  {
+    "step": 696,
+    "loss": 1.899794101715088
+  },
+  {
+    "step": 697,
+    "loss": 1.9862229824066162
+  },
+  {
+    "step": 698,
+    "loss": 2.069486141204834
+  },
+  {
+    "step": 699,
+    "loss": 2.5258560180664062
+  },
+  {
+    "step": 700,
+    "loss": 2.138136863708496
+  },
+  {
+    "step": 701,
+    "loss": 1.7787747383117676
+  },
+  {
+    "step": 702,
+    "loss": 2.3944613933563232
+  },
+  {
+    "step": 703,
+    "loss": 2.2432310581207275
+  },
+  {
+    "step": 704,
+    "loss": 2.23433780670166
+  },
+  {
+    "step": 705,
+    "loss": 2.3525569438934326
+  },
+  {
+    "step": 706,
+    "loss": 1.683660626411438
+  },
+  {
+    "step": 707,
+    "loss": 1.928051233291626
+  },
+  {
+    "step": 708,
+    "loss": 2.214559316635132
+  },
+  {
+    "step": 709,
+    "loss": 2.444596290588379
+  },
+  {
+    "step": 710,
+    "loss": 2.5637311935424805
+  },
+  {
+    "step": 711,
+    "loss": 2.094400405883789
+  },
+  {
+    "step": 712,
+    "loss": 2.1752796173095703
+  },
+  {
+    "step": 713,
+    "loss": 2.1646933555603027
+  },
+  {
+    "step": 714,
+    "loss": 2.3239498138427734
+  },
+  {
+    "step": 715,
+    "loss": 2.528728485107422
+  },
+  {
+    "step": 716,
+    "loss": 1.7567914724349976
+  },
+  {
+    "step": 717,
+    "loss": 1.8295328617095947
+  },
+  {
+    "step": 718,
+    "loss": 2.579841375350952
+  },
+  {
+    "step": 719,
+    "loss": 1.9017343521118164
+  },
+  {
+    "step": 720,
+    "loss": 2.507222890853882
+  },
+  {
+    "step": 721,
+    "loss": 2.127558946609497
+  },
+  {
+    "step": 722,
+    "loss": 2.1579627990722656
+  },
+  {
+    "step": 723,
+    "loss": 1.957413673400879
+  },
+  {
+    "step": 724,
+    "loss": 1.7173194885253906
+  },
+  {
+    "step": 725,
+    "loss": 1.8139698505401611
+  },
+  {
+    "step": 726,
+    "loss": 2.3142149448394775
+  },
+  {
+    "step": 727,
+    "loss": 2.4957833290100098
+  },
+  {
+    "step": 728,
+    "loss": 2.096470832824707
+  },
+  {
+    "step": 729,
+    "loss": 2.1391425132751465
+  },
+  {
+    "step": 730,
+    "loss": 2.0562264919281006
+  },
+  {
+    "step": 731,
+    "loss": 1.704184651374817
+  },
+  {
+    "step": 732,
+    "loss": 2.186826467514038
+  },
+  {
+    "step": 733,
+    "loss": 2.098335027694702
+  },
+  {
+    "step": 734,
+    "loss": 1.9378281831741333
+  },
+  {
+    "step": 735,
+    "loss": 1.9070260524749756
+  },
+  {
+    "step": 736,
+    "loss": 2.5211658477783203
+  },
+  {
+    "step": 737,
+    "loss": 1.8523521423339844
+  },
+  {
+    "step": 738,
+    "loss": 2.3545069694519043
+  },
+  {
+    "step": 739,
+    "loss": 1.715818166732788
+  },
+  {
+    "step": 740,
+    "loss": 1.9143247604370117
+  },
+  {
+    "step": 741,
+    "loss": 1.833640456199646
+  },
+  {
+    "step": 742,
+    "loss": 3.0031652450561523
+  },
+  {
+    "step": 743,
+    "loss": 1.5467760562896729
+  },
+  {
+    "step": 744,
+    "loss": 1.8195242881774902
+  },
+  {
+    "step": 745,
+    "loss": 1.785135269165039
+  },
+  {
+    "step": 746,
+    "loss": 2.0208964347839355
+  },
+  {
+    "step": 747,
+    "loss": 1.799407958984375
+  },
+  {
+    "step": 748,
+    "loss": 2.357728958129883
+  },
+  {
+    "step": 749,
+    "loss": 2.19157338142395
+  },
+  {
+    "step": 750,
+    "loss": 1.7044637203216553
+  },
+  {
+    "step": 751,
+    "loss": 2.1935999393463135
+  },
+  {
+    "step": 752,
+    "loss": 1.8042278289794922
+  },
+  {
+    "step": 753,
+    "loss": 2.340193271636963
+  },
+  {
+    "step": 754,
+    "loss": 1.8830957412719727
+  },
+  {
+    "step": 755,
+    "loss": 2.1636412143707275
+  },
+  {
+    "step": 756,
+    "loss": 2.573277473449707
+  },
+  {
+    "step": 757,
+    "loss": 2.185680866241455
+  },
+  {
+    "step": 758,
+    "loss": 2.005404472351074
+  },
+  {
+    "step": 759,
+    "loss": 2.041130304336548
+  },
+  {
+    "step": 760,
+    "loss": 2.069777250289917
+  },
+  {
+    "step": 761,
+    "loss": 1.942754864692688
+  },
+  {
+    "step": 762,
+    "loss": 2.273555278778076
+  },
+  {
+    "step": 763,
+    "loss": 1.8626675605773926
+  },
+  {
+    "step": 764,
+    "loss": 3.090045690536499
+  },
+  {
+    "step": 765,
+    "loss": 1.6991760730743408
+  },
+  {
+    "step": 766,
+    "loss": 1.9688661098480225
+  },
+  {
+    "step": 767,
+    "loss": 2.0735771656036377
+  },
+  {
+    "step": 768,
+    "loss": 1.9161018133163452
+  },
+  {
+    "step": 769,
+    "loss": 1.935367226600647
+  },
+  {
+    "step": 770,
+    "loss": 2.512490749359131
+  },
+  {
+    "step": 771,
+    "loss": 1.9653754234313965
+  },
+  {
+    "step": 772,
+    "loss": 1.9006037712097168
+  },
+  {
+    "step": 773,
+    "loss": 2.1403775215148926
+  },
+  {
+    "step": 774,
+    "loss": 1.9985692501068115
+  },
+  {
+    "step": 775,
+    "loss": 2.2423832416534424
+  },
+  {
+    "step": 776,
+    "loss": 2.272416114807129
+  },
+  {
+    "step": 777,
+    "loss": 1.6806894540786743
+  },
+  {
+    "step": 778,
+    "loss": 1.6961314678192139
+  },
+  {
+    "step": 779,
+    "loss": 2.070193290710449
+  },
+  {
+    "step": 780,
+    "loss": 2.30169415473938
+  },
+  {
+    "step": 781,
+    "loss": 1.498708963394165
+  },
+  {
+    "step": 782,
+    "loss": 2.672607898712158
+  },
+  {
+    "step": 783,
+    "loss": 2.000545024871826
+  },
+  {
+    "step": 784,
+    "loss": 2.1863222122192383
+  },
+  {
+    "step": 785,
+    "loss": 1.955033302307129
+  },
+  {
+    "step": 786,
+    "loss": 2.0105948448181152
+  },
+  {
+    "step": 787,
+    "loss": 2.3913588523864746
+  },
+  {
+    "step": 788,
+    "loss": 2.0229620933532715
+  },
+  {
+    "step": 789,
+    "loss": 2.0052614212036133
+  },
+  {
+    "step": 790,
+    "loss": 2.718447685241699
+  },
+  {
+    "step": 791,
+    "loss": 2.2307233810424805
+  },
+  {
+    "step": 792,
+    "loss": 2.1480185985565186
+  },
+  {
+    "step": 793,
+    "loss": 2.508347988128662
+  },
+  {
+    "step": 794,
+    "loss": 1.927217960357666
+  },
+  {
+    "step": 795,
+    "loss": 2.075195789337158
+  },
+  {
+    "step": 796,
+    "loss": 2.0269381999969482
+  },
+  {
+    "step": 797,
+    "loss": 1.7403855323791504
+  },
+  {
+    "step": 798,
+    "loss": 2.3028817176818848
+  },
+  {
+    "step": 799,
+    "loss": 2.2278242111206055
+  },
+  {
+    "step": 800,
+    "loss": 2.3212714195251465
+  },
+  {
+    "step": 801,
+    "loss": 2.1449832916259766
+  },
+  {
+    "step": 802,
+    "loss": 1.9621870517730713
+  },
+  {
+    "step": 803,
+    "loss": 2.1465606689453125
+  },
+  {
+    "step": 804,
+    "loss": 2.28023624420166
+  },
+  {
+    "step": 805,
+    "loss": 2.3931326866149902
+  },
+  {
+    "step": 806,
+    "loss": 1.9575012922286987
+  },
+  {
+    "step": 807,
+    "loss": 2.2189478874206543
+  },
+  {
+    "step": 808,
+    "loss": 2.313659906387329
+  },
+  {
+    "step": 809,
+    "loss": 1.785354495048523
+  },
+  {
+    "step": 810,
+    "loss": 2.360384941101074
+  },
+  {
+    "step": 811,
+    "loss": 1.5126988887786865
+  },
+  {
+    "step": 812,
+    "loss": 2.0700507164001465
+  },
+  {
+    "step": 813,
+    "loss": 2.364596128463745
+  },
+  {
+    "step": 814,
+    "loss": 1.7121427059173584
+  },
+  {
+    "step": 815,
+    "loss": 2.4048376083374023
+  },
+  {
+    "step": 816,
+    "loss": 2.1315109729766846
+  },
+  {
+    "step": 817,
+    "loss": 2.0960779190063477
+  },
+  {
+    "step": 818,
+    "loss": 2.1370670795440674
+  },
+  {
+    "step": 819,
+    "loss": 2.2387843132019043
+  },
+  {
+    "step": 820,
+    "loss": 2.6564176082611084
+  },
+  {
+    "step": 821,
+    "loss": 2.3899805545806885
+  },
+  {
+    "step": 822,
+    "loss": 1.8396912813186646
+  },
+  {
+    "step": 823,
+    "loss": 1.849434494972229
+  },
+  {
+    "step": 824,
+    "loss": 2.4848148822784424
+  },
+  {
+    "step": 825,
+    "loss": 2.300788640975952
+  },
+  {
+    "step": 826,
+    "loss": 1.6741901636123657
+  },
+  {
+    "step": 827,
+    "loss": 1.9888312816619873
+  },
+  {
+    "step": 828,
+    "loss": 2.1556782722473145
+  },
+  {
+    "step": 829,
+    "loss": 2.0511889457702637
+  },
+  {
+    "step": 830,
+    "loss": 2.110619068145752
+  },
+  {
+    "step": 831,
+    "loss": 1.8331103324890137
+  },
+  {
+    "step": 832,
+    "loss": 2.0915446281433105
+  },
+  {
+    "step": 833,
+    "loss": 1.3950932025909424
+  },
+  {
+    "step": 834,
+    "loss": 2.5744056701660156
+  },
+  {
+    "step": 835,
+    "loss": 2.351382255554199
+  },
+  {
+    "step": 836,
+    "loss": 2.207592248916626
+  },
+  {
+    "step": 837,
+    "loss": 2.0599913597106934
+  },
+  {
+    "step": 838,
+    "loss": 2.4455690383911133
+  },
+  {
+    "step": 839,
+    "loss": 2.037224769592285
+  },
+  {
+    "step": 840,
+    "loss": 2.1246533393859863
+  },
+  {
+    "step": 841,
+    "loss": 2.539519786834717
+  },
+  {
+    "step": 842,
+    "loss": 2.3089704513549805
+  },
+  {
+    "step": 843,
+    "loss": 1.8031303882598877
+  },
+  {
+    "step": 844,
+    "loss": 2.1725902557373047
+  },
+  {
+    "step": 845,
+    "loss": 1.9818854331970215
+  },
+  {
+    "step": 846,
+    "loss": 2.469529151916504
+  },
+  {
+    "step": 847,
+    "loss": 1.6893788576126099
+  },
+  {
+    "step": 848,
+    "loss": 1.9128904342651367
+  },
+  {
+    "step": 849,
+    "loss": 2.3154168128967285
+  },
+  {
+    "step": 850,
+    "loss": 1.864374041557312
+  },
+  {
+    "step": 851,
+    "loss": 2.139346122741699
+  },
+  {
+    "step": 852,
+    "loss": 1.9899048805236816
+  },
+  {
+    "step": 853,
+    "loss": 1.8425148725509644
+  },
+  {
+    "step": 854,
+    "loss": 2.196641445159912
+  },
+  {
+    "step": 855,
+    "loss": 2.084127187728882
+  },
+  {
+    "step": 856,
+    "loss": 2.589137077331543
+  },
+  {
+    "step": 857,
+    "loss": 1.9049241542816162
+  },
+  {
+    "step": 858,
+    "loss": 2.1088719367980957
+  },
+  {
+    "step": 859,
+    "loss": 1.8666791915893555
+  },
+  {
+    "step": 860,
+    "loss": 2.291273355484009
+  },
+  {
+    "step": 861,
+    "loss": 2.7720913887023926
+  },
+  {
+    "step": 862,
+    "loss": 2.0325875282287598
+  },
+  {
+    "step": 863,
+    "loss": 2.1262521743774414
+  },
+  {
+    "step": 864,
+    "loss": 2.1930947303771973
+  },
+  {
+    "step": 865,
+    "loss": 2.0483975410461426
+  },
+  {
+    "step": 866,
+    "loss": 2.1810200214385986
+  },
+  {
+    "step": 867,
+    "loss": 2.0406017303466797
+  },
+  {
+    "step": 868,
+    "loss": 1.9476172924041748
+  },
+  {
+    "step": 869,
+    "loss": 2.3409388065338135
+  },
+  {
+    "step": 870,
+    "loss": 2.2193973064422607
+  },
+  {
+    "step": 871,
+    "loss": 2.135343313217163
+  },
+  {
+    "step": 872,
+    "loss": 2.0815932750701904
+  },
+  {
+    "step": 873,
+    "loss": 2.2342116832733154
+  },
+  {
+    "step": 874,
+    "loss": 1.839571237564087
+  },
+  {
+    "step": 875,
+    "loss": 2.225438356399536
+  },
+  {
+    "step": 876,
+    "loss": 2.303863525390625
+  },
+  {
+    "step": 877,
+    "loss": 1.9251621961593628
+  },
+  {
+    "step": 878,
+    "loss": 2.1342930793762207
+  },
+  {
+    "step": 879,
+    "loss": 2.1234943866729736
+  },
+  {
+    "step": 880,
+    "loss": 2.137087821960449
+  },
+  {
+    "step": 881,
+    "loss": 1.9579668045043945
+  },
+  {
+    "step": 882,
+    "loss": 2.0309898853302
+  },
+  {
+    "step": 883,
+    "loss": 1.799654245376587
+  },
+  {
+    "step": 884,
+    "loss": 2.4847488403320312
+  },
+  {
+    "step": 885,
+    "loss": 2.6662018299102783
+  },
+  {
+    "step": 886,
+    "loss": 1.9268032312393188
+  },
+  {
+    "step": 887,
+    "loss": 2.043844223022461
+  },
+  {
+    "step": 888,
+    "loss": 2.038583278656006
+  },
+  {
+    "step": 889,
+    "loss": 2.393343925476074
+  },
+  {
+    "step": 890,
+    "loss": 2.155910015106201
+  },
+  {
+    "step": 891,
+    "loss": 2.047548532485962
+  },
+  {
+    "step": 892,
+    "loss": 2.4230449199676514
+  },
+  {
+    "step": 893,
+    "loss": 1.7401704788208008
+  },
+  {
+    "step": 894,
+    "loss": 2.0996835231781006
+  },
+  {
+    "step": 895,
+    "loss": 1.96319580078125
+  },
+  {
+    "step": 896,
+    "loss": 1.9458671808242798
+  },
+  {
+    "step": 897,
+    "loss": 2.0543224811553955
+  },
+  {
+    "step": 898,
+    "loss": 2.5579683780670166
+  },
+  {
+    "step": 899,
+    "loss": 2.102567434310913
+  },
+  {
+    "step": 900,
+    "loss": 1.797571063041687
+  },
+  {
+    "step": 901,
+    "loss": 2.612189292907715
+  },
+  {
+    "step": 902,
+    "loss": 1.8275275230407715
+  },
+  {
+    "step": 903,
+    "loss": 2.3661575317382812
+  },
+  {
+    "step": 904,
+    "loss": 2.412741184234619
+  },
+  {
+    "step": 905,
+    "loss": 1.7417240142822266
+  },
+  {
+    "step": 906,
+    "loss": 1.9783049821853638
+  },
+  {
+    "step": 907,
+    "loss": 3.020042896270752
+  },
+  {
+    "step": 908,
+    "loss": 2.264007568359375
+  },
+  {
+    "step": 909,
+    "loss": 2.6521012783050537
+  },
+  {
+    "step": 910,
+    "loss": 1.8450102806091309
+  },
+  {
+    "step": 911,
+    "loss": 2.0339226722717285
+  },
+  {
+    "step": 912,
+    "loss": 1.9741251468658447
+  },
+  {
+    "step": 913,
+    "loss": 2.638288736343384
+  },
+  {
+    "step": 914,
+    "loss": 2.128150463104248
+  },
+  {
+    "step": 915,
+    "loss": 2.2978391647338867
+  },
+  {
+    "step": 916,
+    "loss": 2.329345226287842
+  },
+  {
+    "step": 917,
+    "loss": 1.7687416076660156
+  },
+  {
+    "step": 918,
+    "loss": 1.7877784967422485
+  },
+  {
+    "step": 919,
+    "loss": 2.0238168239593506
+  },
+  {
+    "step": 920,
+    "loss": 2.0090293884277344
+  },
+  {
+    "step": 921,
+    "loss": 2.5923585891723633
+  },
+  {
+    "step": 922,
+    "loss": 2.2417752742767334
+  },
+  {
+    "step": 923,
+    "loss": 2.1116175651550293
+  },
+  {
+    "step": 924,
+    "loss": 1.826296091079712
+  },
+  {
+    "step": 925,
+    "loss": 1.888626217842102
+  },
+  {
+    "step": 926,
+    "loss": 1.9428234100341797
+  },
+  {
+    "step": 927,
+    "loss": 1.937356948852539
+  },
+  {
+    "step": 928,
+    "loss": 2.575594902038574
+  },
+  {
+    "step": 929,
+    "loss": 2.1356945037841797
+  },
+  {
+    "step": 930,
+    "loss": 2.0911166667938232
+  },
+  {
+    "step": 931,
+    "loss": 2.0979466438293457
+  },
+  {
+    "step": 932,
+    "loss": 2.5593225955963135
+  },
+  {
+    "step": 933,
+    "loss": 1.8475861549377441
+  },
+  {
+    "step": 934,
+    "loss": 1.9928505420684814
+  },
+  {
+    "step": 935,
+    "loss": 1.6050671339035034
+  },
+  {
+    "step": 936,
+    "loss": 2.3365602493286133
+  },
+  {
+    "step": 937,
+    "loss": 1.6974786520004272
+  },
+  {
+    "step": 938,
+    "loss": 2.5650625228881836
+  },
+  {
+    "step": 939,
+    "loss": 2.400352954864502
+  },
+  {
+    "step": 940,
+    "loss": 2.04494571685791
+  },
+  {
+    "step": 941,
+    "loss": 1.9382586479187012
+  },
+  {
+    "step": 942,
+    "loss": 2.147663116455078
+  },
+  {
+    "step": 943,
+    "loss": 1.8787052631378174
+  },
+  {
+    "step": 944,
+    "loss": 2.428316593170166
+  },
+  {
+    "step": 945,
+    "loss": 2.1108169555664062
+  },
+  {
+    "step": 946,
+    "loss": 1.6542246341705322
+  },
+  {
+    "step": 947,
+    "loss": 2.0597152709960938
+  },
+  {
+    "step": 948,
+    "loss": 2.3472602367401123
+  },
+  {
+    "step": 949,
+    "loss": 1.8338260650634766
+  },
+  {
+    "step": 950,
+    "loss": 1.7510230541229248
+  },
+  {
+    "step": 951,
+    "loss": 1.7876065969467163
+  },
+  {
+    "step": 952,
+    "loss": 2.431952714920044
+  },
+  {
+    "step": 953,
+    "loss": 1.9844751358032227
+  },
+  {
+    "step": 954,
+    "loss": 1.6035586595535278
+  },
+  {
+    "step": 955,
+    "loss": 2.2497174739837646
+  },
+  {
+    "step": 956,
+    "loss": 2.1397483348846436
+  },
+  {
+    "step": 957,
+    "loss": 2.418480396270752
+  },
+  {
+    "step": 958,
+    "loss": 2.0681729316711426
+  },
+  {
+    "step": 959,
+    "loss": 2.1492745876312256
+  },
+  {
+    "step": 960,
+    "loss": 2.292433023452759
+  },
+  {
+    "step": 961,
+    "loss": 1.993412733078003
+  },
+  {
+    "step": 962,
+    "loss": 1.9851655960083008
+  },
+  {
+    "step": 963,
+    "loss": 2.1893622875213623
+  },
+  {
+    "step": 964,
+    "loss": 2.258875608444214
+  },
+  {
+    "step": 965,
+    "loss": 2.1283998489379883
+  },
+  {
+    "step": 966,
+    "loss": 1.8134756088256836
+  },
+  {
+    "step": 967,
+    "loss": 1.8318551778793335
+  },
+  {
+    "step": 968,
+    "loss": 2.4340434074401855
+  },
+  {
+    "step": 969,
+    "loss": 1.9633982181549072
+  },
+  {
+    "step": 970,
+    "loss": 2.085658311843872
+  },
+  {
+    "step": 971,
+    "loss": 1.3723973035812378
+  },
+  {
+    "step": 972,
+    "loss": 3.041292667388916
+  },
+  {
+    "step": 973,
+    "loss": 2.3183510303497314
+  },
+  {
+    "step": 974,
+    "loss": 1.9262609481811523
+  },
+  {
+    "step": 975,
+    "loss": 2.1205694675445557
+  },
+  {
+    "step": 976,
+    "loss": 1.4980692863464355
+  },
+  {
+    "step": 977,
+    "loss": 2.5546534061431885
+  },
+  {
+    "step": 978,
+    "loss": 2.7014734745025635
+  },
+  {
+    "step": 979,
+    "loss": 1.676489233970642
+  },
+  {
+    "step": 980,
+    "loss": 1.5694572925567627
+  },
+  {
+    "step": 981,
+    "loss": 2.120713233947754
+  },
+  {
+    "step": 982,
+    "loss": 2.21758770942688
+  },
+  {
+    "step": 983,
+    "loss": 1.9932773113250732
+  },
+  {
+    "step": 984,
+    "loss": 2.172217607498169
+  },
+  {
+    "step": 985,
+    "loss": 1.980347990989685
+  },
+  {
+    "step": 986,
+    "loss": 2.1737043857574463
+  },
+  {
+    "step": 987,
+    "loss": 2.1837902069091797
+  },
+  {
+    "step": 988,
+    "loss": 1.7776117324829102
+  },
+  {
+    "step": 989,
+    "loss": 2.1192994117736816
+  },
+  {
+    "step": 990,
+    "loss": 1.7178640365600586
+  },
+  {
+    "step": 991,
+    "loss": 2.1105740070343018
+  },
+  {
+    "step": 992,
+    "loss": 1.9493019580841064
+  },
+  {
+    "step": 993,
+    "loss": 2.4504644870758057
+  },
+  {
+    "step": 994,
+    "loss": 2.0112550258636475
+  },
+  {
+    "step": 995,
+    "loss": 2.2686667442321777
+  },
+  {
+    "step": 996,
+    "loss": 2.4370152950286865
+  },
+  {
+    "step": 997,
+    "loss": 1.8057717084884644
+  },
+  {
+    "step": 998,
+    "loss": 1.7339015007019043
+  },
+  {
+    "step": 999,
+    "loss": 1.915513038635254
+  }
+]
diff --git a/lecture_6/verified_examples/latent/config.json b/lecture_6/verified_examples/latent/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..a67ee7d27c835fb836afba40de9a9307d52e2982
--- /dev/null
+++ b/lecture_6/verified_examples/latent/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "latent",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/latent"
+}
diff --git a/lecture_6/verified_examples/latent/losses.json b/lecture_6/verified_examples/latent/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..6d7500cbbc7c366dc71a92ceb2fbccf4ddf4acc9
--- /dev/null
+++ b/lecture_6/verified_examples/latent/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.0633597373962402,
+    "diagonal": 2.0633597373962402,
+    "finite": 5.157379746378865e-06
+  },
+  {
+    "step": 1,
+    "loss": 1.848502516746521,
+    "diagonal": 1.8484972715377808,
+    "finite": 0.000518804183229804
+  },
+  {
+    "step": 2,
+    "loss": 2.1166515350341797,
+    "diagonal": 2.1166226863861084,
+    "finite": 0.001915960805490613
+  },
+  {
+    "step": 3,
+    "loss": 1.4786566495895386,
+    "diagonal": 1.4785940647125244,
+    "finite": 0.0031271150801330805
+  },
+  {
+    "step": 4,
+    "loss": 1.8815160989761353,
+    "diagonal": 1.8814043998718262,
+    "finite": 0.004466929007321596
+  },
+  {
+    "step": 5,
+    "loss": 1.7209069728851318,
+    "diagonal": 1.7207109928131104,
+    "finite": 0.006531933322548866
+  },
+  {
+    "step": 6,
+    "loss": 2.0290701389312744,
+    "diagonal": 2.0288071632385254,
+    "finite": 0.00751365115866065
+  },
+  {
+    "step": 7,
+    "loss": 1.9841641187667847,
+    "diagonal": 1.9838989973068237,
+    "finite": 0.006629041861742735
+  },
+  {
+    "step": 8,
+    "loss": 2.3056068420410156,
+    "diagonal": 2.305274486541748,
+    "finite": 0.00738601665943861
+  },
+  {
+    "step": 9,
+    "loss": 2.1479885578155518,
+    "diagonal": 2.147549867630005,
+    "finite": 0.008775176480412483
+  },
+  {
+    "step": 10,
+    "loss": 2.066880226135254,
+    "diagonal": 2.0662682056427,
+    "finite": 0.011126442812383175
+  },
+  {
+    "step": 11,
+    "loss": 1.8322392702102661,
+    "diagonal": 1.8317251205444336,
+    "finite": 0.008569600060582161
+  },
+  {
+    "step": 12,
+    "loss": 2.01680326461792,
+    "diagonal": 2.016187906265259,
+    "finite": 0.009465959854424
+  },
+  {
+    "step": 13,
+    "loss": 1.92188560962677,
+    "diagonal": 1.921330451965332,
+    "finite": 0.007930836640298367
+  },
+  {
+    "step": 14,
+    "loss": 2.2216906547546387,
+    "diagonal": 2.220975160598755,
+    "finite": 0.009539654478430748
+  },
+  {
+    "step": 15,
+    "loss": 1.8328619003295898,
+    "diagonal": 1.832388162612915,
+    "finite": 0.005922072567045689
+  },
+  {
+    "step": 16,
+    "loss": 2.1402742862701416,
+    "diagonal": 2.139753580093384,
+    "finite": 0.006125968415290117
+  },
+  {
+    "step": 17,
+    "loss": 1.7541886568069458,
+    "diagonal": 1.753554105758667,
+    "finite": 0.0070511880330741405
+  },
+  {
+    "step": 18,
+    "loss": 1.892225980758667,
+    "diagonal": 1.8915139436721802,
+    "finite": 0.007494914345443249
+  },
+  {
+    "step": 19,
+    "loss": 1.8389052152633667,
+    "diagonal": 1.838186264038086,
+    "finite": 0.00718920212239027
+  },
+  {
+    "step": 20,
+    "loss": 1.9491249322891235,
+    "diagonal": 1.9482641220092773,
+    "finite": 0.008198411203920841
+  },
+  {
+    "step": 21,
+    "loss": 1.9145851135253906,
+    "diagonal": 1.9138469696044922,
+    "finite": 0.00671061547473073
+  },
+  {
+    "step": 22,
+    "loss": 2.271775245666504,
+    "diagonal": 2.2708356380462646,
+    "finite": 0.00816966500133276
+  },
+  {
+    "step": 23,
+    "loss": 1.664848804473877,
+    "diagonal": 1.6639245748519897,
+    "finite": 0.007701673079282045
+  },
+  {
+    "step": 24,
+    "loss": 1.9195092916488647,
+    "diagonal": 1.9184972047805786,
+    "finite": 0.00809629075229168
+  },
+  {
+    "step": 25,
+    "loss": 1.7289173603057861,
+    "diagonal": 1.7275090217590332,
+    "finite": 0.010833228938281536
+  },
+  {
+    "step": 26,
+    "loss": 2.055927038192749,
+    "diagonal": 2.0546185970306396,
+    "finite": 0.009692441672086716
+  },
+  {
+    "step": 27,
+    "loss": 2.1013412475585938,
+    "diagonal": 2.1000888347625732,
+    "finite": 0.00894553866237402
+  },
+  {
+    "step": 28,
+    "loss": 2.061234951019287,
+    "diagonal": 2.060030221939087,
+    "finite": 0.008309146389365196
+  },
+  {
+    "step": 29,
+    "loss": 1.8904435634613037,
+    "diagonal": 1.889382004737854,
+    "finite": 0.00707666389644146
+  },
+  {
+    "step": 30,
+    "loss": 1.9365174770355225,
+    "diagonal": 1.9357255697250366,
+    "finite": 0.005109241232275963
+  },
+  {
+    "step": 31,
+    "loss": 2.0065906047821045,
+    "diagonal": 2.0057787895202637,
+    "finite": 0.0050732470117509365
+  },
+  {
+    "step": 32,
+    "loss": 2.012580156326294,
+    "diagonal": 2.0116615295410156,
+    "finite": 0.005567183718085289
+  },
+  {
+    "step": 33,
+    "loss": 1.7918833494186401,
+    "diagonal": 1.7911839485168457,
+    "finite": 0.004114143550395966
+  },
+  {
+    "step": 34,
+    "loss": 1.9804810285568237,
+    "diagonal": 1.979921817779541,
+    "finite": 0.0031955407466739416
+  },
+  {
+    "step": 35,
+    "loss": 1.576391339302063,
+    "diagonal": 1.5755157470703125,
+    "finite": 0.004864729940891266
+  },
+  {
+    "step": 36,
+    "loss": 1.9540200233459473,
+    "diagonal": 1.9532382488250732,
+    "finite": 0.004225606564432383
+  },
+  {
+    "step": 37,
+    "loss": 2.1866402626037598,
+    "diagonal": 2.1860058307647705,
+    "finite": 0.003339666873216629
+  },
+  {
+    "step": 38,
+    "loss": 2.5636396408081055,
+    "diagonal": 2.562856912612915,
+    "finite": 0.004013444762676954
+  },
+  {
+    "step": 39,
+    "loss": 1.9441949129104614,
+    "diagonal": 1.943385362625122,
+    "finite": 0.004047550726681948
+  },
+  {
+    "step": 40,
+    "loss": 2.0328783988952637,
+    "diagonal": 2.0321309566497803,
+    "finite": 0.003645530669018626
+  },
+  {
+    "step": 41,
+    "loss": 2.2338833808898926,
+    "diagonal": 2.232987642288208,
+    "finite": 0.004265072289854288
+  },
+  {
+    "step": 42,
+    "loss": 2.3692827224731445,
+    "diagonal": 2.3680315017700195,
+    "finite": 0.005819857120513916
+  },
+  {
+    "step": 43,
+    "loss": 2.3109140396118164,
+    "diagonal": 2.309260129928589,
+    "finite": 0.007517943624407053
+  },
+  {
+    "step": 44,
+    "loss": 1.8954378366470337,
+    "diagonal": 1.8933777809143066,
+    "finite": 0.009155580773949623
+  },
+  {
+    "step": 45,
+    "loss": 1.764718770980835,
+    "diagonal": 1.762801170349121,
+    "finite": 0.008337389677762985
+  },
+  {
+    "step": 46,
+    "loss": 2.247434616088867,
+    "diagonal": 2.245309352874756,
+    "finite": 0.009043490514159203
+  },
+  {
+    "step": 47,
+    "loss": 2.0939762592315674,
+    "diagonal": 2.0913896560668945,
+    "finite": 0.010777072049677372
+  },
+  {
+    "step": 48,
+    "loss": 1.9394044876098633,
+    "diagonal": 1.9372071027755737,
+    "finite": 0.00896899402141571
+  },
+  {
+    "step": 49,
+    "loss": 1.8614723682403564,
+    "diagonal": 1.8593006134033203,
+    "finite": 0.008687114343047142
+  },
+  {
+    "step": 50,
+    "loss": 2.1078803539276123,
+    "diagonal": 2.105034351348877,
+    "finite": 0.011160435155034065
+  },
+  {
+    "step": 51,
+    "loss": 1.9297951459884644,
+    "diagonal": 1.9271132946014404,
+    "finite": 0.010314994491636753
+  },
+  {
+    "step": 52,
+    "loss": 1.9862236976623535,
+    "diagonal": 1.9837288856506348,
+    "finite": 0.00941440835595131
+  },
+  {
+    "step": 53,
+    "loss": 1.6618595123291016,
+    "diagonal": 1.6599112749099731,
+    "finite": 0.007215844467282295
+  },
+  {
+    "step": 54,
+    "loss": 2.330822706222534,
+    "diagonal": 2.328831434249878,
+    "finite": 0.007241400424391031
+  },
+  {
+    "step": 55,
+    "loss": 2.333482503890991,
+    "diagonal": 2.3314318656921387,
+    "finite": 0.007323993369936943
+  },
+  {
+    "step": 56,
+    "loss": 2.0293195247650146,
+    "diagonal": 2.0275466442108154,
+    "finite": 0.006221034098416567
+  },
+  {
+    "step": 57,
+    "loss": 2.024484634399414,
+    "diagonal": 2.0230982303619385,
+    "finite": 0.004780397284775972
+  },
+  {
+    "step": 58,
+    "loss": 1.8769967555999756,
+    "diagonal": 1.8757678270339966,
+    "finite": 0.004165777005255222
+  },
+  {
+    "step": 59,
+    "loss": 1.9052032232284546,
+    "diagonal": 1.9038214683532715,
+    "finite": 0.0046058036386966705
+  },
+  {
+    "step": 60,
+    "loss": 2.1714131832122803,
+    "diagonal": 2.1704049110412598,
+    "finite": 0.003305611200630665
+  },
+  {
+    "step": 61,
+    "loss": 2.0589752197265625,
+    "diagonal": 2.057999610900879,
+    "finite": 0.0031471620313823223
+  },
+  {
+    "step": 62,
+    "loss": 1.9781664609909058,
+    "diagonal": 1.977149248123169,
+    "finite": 0.003229217603802681
+  },
+  {
+    "step": 63,
+    "loss": 1.977628469467163,
+    "diagonal": 1.9769281148910522,
+    "finite": 0.002188651589676738
+  },
+  {
+    "step": 64,
+    "loss": 2.290938377380371,
+    "diagonal": 2.289763927459717,
+    "finite": 0.0036139723379164934
+  },
+  {
+    "step": 65,
+    "loss": 1.835976004600525,
+    "diagonal": 1.8344436883926392,
+    "finite": 0.0046432106755673885
+  },
+  {
+    "step": 66,
+    "loss": 1.6582880020141602,
+    "diagonal": 1.6570807695388794,
+    "finite": 0.00360376900061965
+  },
+  {
+    "step": 67,
+    "loss": 1.9591904878616333,
+    "diagonal": 1.9579964876174927,
+    "finite": 0.0035116905346512794
+  },
+  {
+    "step": 68,
+    "loss": 2.062385320663452,
+    "diagonal": 2.061173915863037,
+    "finite": 0.0035115163773298264
+  },
+  {
+    "step": 69,
+    "loss": 1.8776788711547852,
+    "diagonal": 1.8762030601501465,
+    "finite": 0.0042167589999735355
+  },
+  {
+    "step": 70,
+    "loss": 1.9187620878219604,
+    "diagonal": 1.91710364818573,
+    "finite": 0.0046715522184967995
+  },
+  {
+    "step": 71,
+    "loss": 1.9792839288711548,
+    "diagonal": 1.977296233177185,
+    "finite": 0.005521291866898537
+  },
+  {
+    "step": 72,
+    "loss": 1.9226932525634766,
+    "diagonal": 1.9204843044281006,
+    "finite": 0.006051770411431789
+  },
+  {
+    "step": 73,
+    "loss": 2.365950345993042,
+    "diagonal": 2.363877296447754,
+    "finite": 0.005602612625807524
+  },
+  {
+    "step": 74,
+    "loss": 2.1013906002044678,
+    "diagonal": 2.0987491607666016,
+    "finite": 0.0070435842499136925
+  },
+  {
+    "step": 75,
+    "loss": 1.5505326986312866,
+    "diagonal": 1.5481760501861572,
+    "finite": 0.006201614160090685
+  },
+  {
+    "step": 76,
+    "loss": 1.6053892374038696,
+    "diagonal": 1.6026060581207275,
+    "finite": 0.007229064591228962
+  },
+  {
+    "step": 77,
+    "loss": 1.9248136281967163,
+    "diagonal": 1.9221032857894897,
+    "finite": 0.006949451752007008
+  },
+  {
+    "step": 78,
+    "loss": 1.8265973329544067,
+    "diagonal": 1.8238375186920166,
+    "finite": 0.0069868676364421844
+  },
+  {
+    "step": 79,
+    "loss": 2.49477219581604,
+    "diagonal": 2.4916512966156006,
+    "finite": 0.007802227512001991
+  },
+  {
+    "step": 80,
+    "loss": 2.0468263626098633,
+    "diagonal": 2.0436737537384033,
+    "finite": 0.007784037850797176
+  },
+  {
+    "step": 81,
+    "loss": 2.2369184494018555,
+    "diagonal": 2.233565330505371,
+    "finite": 0.008178211748600006
+  },
+  {
+    "step": 82,
+    "loss": 1.9136089086532593,
+    "diagonal": 1.9107773303985596,
+    "finite": 0.006823033094406128
+  },
+  {
+    "step": 83,
+    "loss": 1.810907006263733,
+    "diagonal": 1.8074321746826172,
+    "finite": 0.008273418992757797
+  },
+  {
+    "step": 84,
+    "loss": 2.185173749923706,
+    "diagonal": 2.1819708347320557,
+    "finite": 0.007536125835031271
+  },
+  {
+    "step": 85,
+    "loss": 2.080589771270752,
+    "diagonal": 2.0768651962280273,
+    "finite": 0.008661972358822823
+  },
+  {
+    "step": 86,
+    "loss": 2.0401251316070557,
+    "diagonal": 2.036313772201538,
+    "finite": 0.008761744014918804
+  },
+  {
+    "step": 87,
+    "loss": 1.9308428764343262,
+    "diagonal": 1.9269565343856812,
+    "finite": 0.008832577615976334
+  },
+  {
+    "step": 88,
+    "loss": 1.9025429487228394,
+    "diagonal": 1.899100422859192,
+    "finite": 0.007735886611044407
+  },
+  {
+    "step": 89,
+    "loss": 1.77372145652771,
+    "diagonal": 1.7700921297073364,
+    "finite": 0.008065092377364635
+  },
+  {
+    "step": 90,
+    "loss": 1.8394935131072998,
+    "diagonal": 1.8361518383026123,
+    "finite": 0.007344432175159454
+  },
+  {
+    "step": 91,
+    "loss": 2.580009698867798,
+    "diagonal": 2.5762648582458496,
+    "finite": 0.008141081780195236
+  },
+  {
+    "step": 92,
+    "loss": 1.8440016508102417,
+    "diagonal": 1.841064691543579,
+    "finite": 0.006316064391285181
+  },
+  {
+    "step": 93,
+    "loss": 1.8939523696899414,
+    "diagonal": 1.8911608457565308,
+    "finite": 0.0059393467381596565
+  },
+  {
+    "step": 94,
+    "loss": 2.0561821460723877,
+    "diagonal": 2.053894519805908,
+    "finite": 0.004815907217562199
+  },
+  {
+    "step": 95,
+    "loss": 1.5816874504089355,
+    "diagonal": 1.5796945095062256,
+    "finite": 0.004151930566877127
+  },
+  {
+    "step": 96,
+    "loss": 2.093074083328247,
+    "diagonal": 2.0911736488342285,
+    "finite": 0.003918326459825039
+  },
+  {
+    "step": 97,
+    "loss": 1.3992998600006104,
+    "diagonal": 1.3978699445724487,
+    "finite": 0.0029182378202676773
+  },
+  {
+    "step": 98,
+    "loss": 2.1473934650421143,
+    "diagonal": 2.145338296890259,
+    "finite": 0.004151912871748209
+  },
+  {
+    "step": 99,
+    "loss": 1.873613953590393,
+    "diagonal": 1.872289776802063,
+    "finite": 0.002648434368893504
+  },
+  {
+    "step": 100,
+    "loss": 1.7672995328903198,
+    "diagonal": 1.7658876180648804,
+    "finite": 0.002795781008899212
+  },
+  {
+    "step": 101,
+    "loss": 1.7502763271331787,
+    "diagonal": 1.7487488985061646,
+    "finite": 0.0029950204771012068
+  },
+  {
+    "step": 102,
+    "loss": 2.0282866954803467,
+    "diagonal": 2.0270938873291016,
+    "finite": 0.002316121244803071
+  },
+  {
+    "step": 103,
+    "loss": 1.720176339149475,
+    "diagonal": 1.7187341451644897,
+    "finite": 0.0027733948081731796
+  },
+  {
+    "step": 104,
+    "loss": 2.2138607501983643,
+    "diagonal": 2.2122251987457275,
+    "finite": 0.0031154598109424114
+  },
+  {
+    "step": 105,
+    "loss": 2.1407973766326904,
+    "diagonal": 2.1385786533355713,
+    "finite": 0.004186451435089111
+  },
+  {
+    "step": 106,
+    "loss": 1.7685844898223877,
+    "diagonal": 1.7673084735870361,
+    "finite": 0.002385052852332592
+  },
+  {
+    "step": 107,
+    "loss": 2.1964375972747803,
+    "diagonal": 2.1950886249542236,
+    "finite": 0.0024979549925774336
+  },
+  {
+    "step": 108,
+    "loss": 2.253859281539917,
+    "diagonal": 2.252511501312256,
+    "finite": 0.0024728558491915464
+  },
+  {
+    "step": 109,
+    "loss": 2.061476707458496,
+    "diagonal": 2.060408592224121,
+    "finite": 0.0019419376039877534
+  },
+  {
+    "step": 110,
+    "loss": 1.8914921283721924,
+    "diagonal": 1.8898327350616455,
+    "finite": 0.002989922882989049
+  },
+  {
+    "step": 111,
+    "loss": 1.9125211238861084,
+    "diagonal": 1.9104080200195312,
+    "finite": 0.0037734711077064276
+  },
+  {
+    "step": 112,
+    "loss": 1.7839490175247192,
+    "diagonal": 1.7822048664093018,
+    "finite": 0.003086889162659645
+  },
+  {
+    "step": 113,
+    "loss": 2.2757363319396973,
+    "diagonal": 2.2736799716949463,
+    "finite": 0.0036077082622796297
+  },
+  {
+    "step": 114,
+    "loss": 1.7450343370437622,
+    "diagonal": 1.742779016494751,
+    "finite": 0.003922274336218834
+  },
+  {
+    "step": 115,
+    "loss": 1.8085838556289673,
+    "diagonal": 1.8067991733551025,
+    "finite": 0.0030770893208682537
+  },
+  {
+    "step": 116,
+    "loss": 1.7390153408050537,
+    "diagonal": 1.7359908819198608,
+    "finite": 0.0051699476316571236
+  },
+  {
+    "step": 117,
+    "loss": 1.781869888305664,
+    "diagonal": 1.779585599899292,
+    "finite": 0.003871727967634797
+  },
+  {
+    "step": 118,
+    "loss": 1.5752241611480713,
+    "diagonal": 1.5733110904693604,
+    "finite": 0.0032152258791029453
+  },
+  {
+    "step": 119,
+    "loss": 2.161782741546631,
+    "diagonal": 2.160198926925659,
+    "finite": 0.0026398731861263514
+  },
+  {
+    "step": 120,
+    "loss": 2.080052137374878,
+    "diagonal": 2.077972650527954,
+    "finite": 0.0034372902009636164
+  },
+  {
+    "step": 121,
+    "loss": 1.6583144664764404,
+    "diagonal": 1.6559563875198364,
+    "finite": 0.0038657227996736765
+  },
+  {
+    "step": 122,
+    "loss": 1.9139682054519653,
+    "diagonal": 1.9123904705047607,
+    "finite": 0.0025654456112533808
+  },
+  {
+    "step": 123,
+    "loss": 1.696832537651062,
+    "diagonal": 1.6943442821502686,
+    "finite": 0.004013396333903074
+  },
+  {
+    "step": 124,
+    "loss": 1.9795798063278198,
+    "diagonal": 1.9779300689697266,
+    "finite": 0.002639657584950328
+  },
+  {
+    "step": 125,
+    "loss": 1.8671547174453735,
+    "diagonal": 1.8652626276016235,
+    "finite": 0.0030032319482415915
+  },
+  {
+    "step": 126,
+    "loss": 1.8138620853424072,
+    "diagonal": 1.811327576637268,
+    "finite": 0.003991320729255676
+  },
+  {
+    "step": 127,
+    "loss": 1.8775303363800049,
+    "diagonal": 1.8752856254577637,
+    "finite": 0.003507345449179411
+  },
+  {
+    "step": 128,
+    "loss": 1.8259104490280151,
+    "diagonal": 1.8220475912094116,
+    "finite": 0.0059888833202421665
+  },
+  {
+    "step": 129,
+    "loss": 1.832137107849121,
+    "diagonal": 1.8246896266937256,
+    "finite": 0.011457754299044609
+  },
+  {
+    "step": 130,
+    "loss": 1.9505209922790527,
+    "diagonal": 1.9406899213790894,
+    "finite": 0.015009297989308834
+  },
+  {
+    "step": 131,
+    "loss": 1.9251856803894043,
+    "diagonal": 1.9161949157714844,
+    "finite": 0.013622330501675606
+  },
+  {
+    "step": 132,
+    "loss": 1.5679614543914795,
+    "diagonal": 1.5560534000396729,
+    "finite": 0.017906909808516502
+  },
+  {
+    "step": 133,
+    "loss": 1.7084301710128784,
+    "diagonal": 1.6965709924697876,
+    "finite": 0.01770024187862873
+  },
+  {
+    "step": 134,
+    "loss": 1.9677884578704834,
+    "diagonal": 1.958111047744751,
+    "finite": 0.014336967840790749
+  },
+  {
+    "step": 135,
+    "loss": 2.3899571895599365,
+    "diagonal": 2.3809893131256104,
+    "finite": 0.013188176788389683
+  },
+  {
+    "step": 136,
+    "loss": 1.9997498989105225,
+    "diagonal": 1.9880090951919556,
+    "finite": 0.017139878123998642
+  },
+  {
+    "step": 137,
+    "loss": 2.002605438232422,
+    "diagonal": 1.9950019121170044,
+    "finite": 0.011019622907042503
+  },
+  {
+    "step": 138,
+    "loss": 2.395442247390747,
+    "diagonal": 2.388214111328125,
+    "finite": 0.010400260798633099
+  },
+  {
+    "step": 139,
+    "loss": 1.536936640739441,
+    "diagonal": 1.5295872688293457,
+    "finite": 0.010499099269509315
+  },
+  {
+    "step": 140,
+    "loss": 1.7778104543685913,
+    "diagonal": 1.7682806253433228,
+    "finite": 0.013517536222934723
+  },
+  {
+    "step": 141,
+    "loss": 2.07684588432312,
+    "diagonal": 2.067103147506714,
+    "finite": 0.013722267933189869
+  },
+  {
+    "step": 142,
+    "loss": 1.9361976385116577,
+    "diagonal": 1.9306825399398804,
+    "finite": 0.007713355123996735
+  },
+  {
+    "step": 143,
+    "loss": 1.8111745119094849,
+    "diagonal": 1.8057725429534912,
+    "finite": 0.007502792403101921
+  },
+  {
+    "step": 144,
+    "loss": 1.8713377714157104,
+    "diagonal": 1.8666529655456543,
+    "finite": 0.006461829412728548
+  },
+  {
+    "step": 145,
+    "loss": 1.7670761346817017,
+    "diagonal": 1.7618370056152344,
+    "finite": 0.007176941726356745
+  },
+  {
+    "step": 146,
+    "loss": 1.864658236503601,
+    "diagonal": 1.8579225540161133,
+    "finite": 0.009164192713797092
+  },
+  {
+    "step": 147,
+    "loss": 2.2937400341033936,
+    "diagonal": 2.288409948348999,
+    "finite": 0.007202959153801203
+  },
+  {
+    "step": 148,
+    "loss": 1.621505618095398,
+    "diagonal": 1.6168135404586792,
+    "finite": 0.0062980446964502335
+  },
+  {
+    "step": 149,
+    "loss": 1.885402798652649,
+    "diagonal": 1.881335735321045,
+    "finite": 0.005422687623649836
+  },
+  {
+    "step": 150,
+    "loss": 2.1496028900146484,
+    "diagonal": 2.140255928039551,
+    "finite": 0.012380138970911503
+  },
+  {
+    "step": 151,
+    "loss": 2.071133613586426,
+    "diagonal": 2.0650506019592285,
+    "finite": 0.008004087023437023
+  },
+  {
+    "step": 152,
+    "loss": 1.4892420768737793,
+    "diagonal": 1.480042815208435,
+    "finite": 0.012025176547467709
+  },
+  {
+    "step": 153,
+    "loss": 2.0304808616638184,
+    "diagonal": 2.0220553874969482,
+    "finite": 0.01094222441315651
+  },
+  {
+    "step": 154,
+    "loss": 1.5494519472122192,
+    "diagonal": 1.5402085781097412,
+    "finite": 0.011926965788006783
+  },
+  {
+    "step": 155,
+    "loss": 1.710510492324829,
+    "diagonal": 1.7016003131866455,
+    "finite": 0.01142331212759018
+  },
+  {
+    "step": 156,
+    "loss": 1.7518517971038818,
+    "diagonal": 1.7441887855529785,
+    "finite": 0.00976182147860527
+  },
+  {
+    "step": 157,
+    "loss": 1.9940459728240967,
+    "diagonal": 1.9846925735473633,
+    "finite": 0.011839719489216805
+  },
+  {
+    "step": 158,
+    "loss": 1.6207184791564941,
+    "diagonal": 1.6089215278625488,
+    "finite": 0.014838936738669872
+  },
+  {
+    "step": 159,
+    "loss": 2.1702678203582764,
+    "diagonal": 2.1577539443969727,
+    "finite": 0.01564236544072628
+  },
+  {
+    "step": 160,
+    "loss": 1.4835405349731445,
+    "diagonal": 1.4710664749145508,
+    "finite": 0.0154957827180624
+  },
+  {
+    "step": 161,
+    "loss": 1.5782041549682617,
+    "diagonal": 1.5677945613861084,
+    "finite": 0.012851300649344921
+  },
+  {
+    "step": 162,
+    "loss": 2.11539363861084,
+    "diagonal": 2.108659505844116,
+    "finite": 0.008262716233730316
+  },
+  {
+    "step": 163,
+    "loss": 1.6583858728408813,
+    "diagonal": 1.6510748863220215,
+    "finite": 0.008915865793824196
+  },
+  {
+    "step": 164,
+    "loss": 1.5944777727127075,
+    "diagonal": 1.5874592065811157,
+    "finite": 0.008507362566888332
+  },
+  {
+    "step": 165,
+    "loss": 1.7532023191452026,
+    "diagonal": 1.7475038766860962,
+    "finite": 0.006865574512630701
+  },
+  {
+    "step": 166,
+    "loss": 1.7093398571014404,
+    "diagonal": 1.6968249082565308,
+    "finite": 0.01498796883970499
+  },
+  {
+    "step": 167,
+    "loss": 1.9623291492462158,
+    "diagonal": 1.9511144161224365,
+    "finite": 0.013350940309464931
+  },
+  {
+    "step": 168,
+    "loss": 1.6581257581710815,
+    "diagonal": 1.6475310325622559,
+    "finite": 0.012538178823888302
+  },
+  {
+    "step": 169,
+    "loss": 1.687132716178894,
+    "diagonal": 1.6650681495666504,
+    "finite": 0.025958344340324402
+  },
+  {
+    "step": 170,
+    "loss": 2.1025054454803467,
+    "diagonal": 2.090855836868286,
+    "finite": 0.01362515613436699
+  },
+  {
+    "step": 171,
+    "loss": 1.8875256776809692,
+    "diagonal": 1.8781708478927612,
+    "finite": 0.01087774895131588
+  },
+  {
+    "step": 172,
+    "loss": 1.6261810064315796,
+    "diagonal": 1.6145401000976562,
+    "finite": 0.013457726687192917
+  },
+  {
+    "step": 173,
+    "loss": 1.8468906879425049,
+    "diagonal": 1.8347647190093994,
+    "finite": 0.01393788494169712
+  },
+  {
+    "step": 174,
+    "loss": 1.9651027917861938,
+    "diagonal": 1.955794095993042,
+    "finite": 0.010638466104865074
+  },
+  {
+    "step": 175,
+    "loss": 1.8536707162857056,
+    "diagonal": 1.8364646434783936,
+    "finite": 0.0195523239672184
+  },
+  {
+    "step": 176,
+    "loss": 1.6710608005523682,
+    "diagonal": 1.6570583581924438,
+    "finite": 0.015822021290659904
+  },
+  {
+    "step": 177,
+    "loss": 1.680512547492981,
+    "diagonal": 1.665656328201294,
+    "finite": 0.016692429780960083
+  },
+  {
+    "step": 178,
+    "loss": 1.8663040399551392,
+    "diagonal": 1.8551157712936401,
+    "finite": 0.012500815093517303
+  },
+  {
+    "step": 179,
+    "loss": 1.9047249555587769,
+    "diagonal": 1.8836579322814941,
+    "finite": 0.023407800123095512
+  },
+  {
+    "step": 180,
+    "loss": 2.2035298347473145,
+    "diagonal": 2.18880033493042,
+    "finite": 0.016275761649012566
+  },
+  {
+    "step": 181,
+    "loss": 2.0476927757263184,
+    "diagonal": 2.031651020050049,
+    "finite": 0.017628414556384087
+  },
+  {
+    "step": 182,
+    "loss": 1.5188641548156738,
+    "diagonal": 1.5027995109558105,
+    "finite": 0.01755703054368496
+  },
+  {
+    "step": 183,
+    "loss": 1.9270422458648682,
+    "diagonal": 1.909806728363037,
+    "finite": 0.018734216690063477
+  },
+  {
+    "step": 184,
+    "loss": 1.835508942604065,
+    "diagonal": 1.8190711736679077,
+    "finite": 0.01777050644159317
+  },
+  {
+    "step": 185,
+    "loss": 1.4962308406829834,
+    "diagonal": 1.4834247827529907,
+    "finite": 0.013769918121397495
+  },
+  {
+    "step": 186,
+    "loss": 1.5900505781173706,
+    "diagonal": 1.5663024187088013,
+    "finite": 0.025399040430784225
+  },
+  {
+    "step": 187,
+    "loss": 1.5727498531341553,
+    "diagonal": 1.5447570085525513,
+    "finite": 0.02977965958416462
+  },
+  {
+    "step": 188,
+    "loss": 2.1843605041503906,
+    "diagonal": 2.164243221282959,
+    "finite": 0.021288104355335236
+  },
+  {
+    "step": 189,
+    "loss": 1.928359031677246,
+    "diagonal": 1.9104844331741333,
+    "finite": 0.018815360963344574
+  },
+  {
+    "step": 190,
+    "loss": 1.5886894464492798,
+    "diagonal": 1.5698527097702026,
+    "finite": 0.019724329933524132
+  },
+  {
+    "step": 191,
+    "loss": 1.6587048768997192,
+    "diagonal": 1.6416418552398682,
+    "finite": 0.017773961648344994
+  },
+  {
+    "step": 192,
+    "loss": 1.3546810150146484,
+    "diagonal": 1.3400565385818481,
+    "finite": 0.015154849737882614
+  },
+  {
+    "step": 193,
+    "loss": 1.558281421661377,
+    "diagonal": 1.534585952758789,
+    "finite": 0.02442828193306923
+  },
+  {
+    "step": 194,
+    "loss": 1.72617506980896,
+    "diagonal": 1.7061817646026611,
+    "finite": 0.02050597220659256
+  },
+  {
+    "step": 195,
+    "loss": 1.5967297554016113,
+    "diagonal": 1.575078010559082,
+    "finite": 0.022093672305345535
+  },
+  {
+    "step": 196,
+    "loss": 2.255427598953247,
+    "diagonal": 2.241380214691162,
+    "finite": 0.014261211268603802
+  },
+  {
+    "step": 197,
+    "loss": 1.5184298753738403,
+    "diagonal": 1.4930864572525024,
+    "finite": 0.025599418208003044
+  },
+  {
+    "step": 198,
+    "loss": 1.6152151823043823,
+    "diagonal": 1.600233793258667,
+    "finite": 0.01505663525313139
+  },
+  {
+    "step": 199,
+    "loss": 1.7996004819869995,
+    "diagonal": 1.7883660793304443,
+    "finite": 0.011234434321522713
+  },
+  {
+    "step": 200,
+    "loss": 1.8002030849456787,
+    "diagonal": 1.7605314254760742,
+    "finite": 0.03967159986495972
+  },
+  {
+    "step": 201,
+    "loss": 1.6186020374298096,
+    "diagonal": 1.5996043682098389,
+    "finite": 0.018997637555003166
+  },
+  {
+    "step": 202,
+    "loss": 1.883861780166626,
+    "diagonal": 1.8707525730133057,
+    "finite": 0.013109156861901283
+  },
+  {
+    "step": 203,
+    "loss": 1.9220162630081177,
+    "diagonal": 1.9009830951690674,
+    "finite": 0.021033210679888725
+  },
+  {
+    "step": 204,
+    "loss": 1.696799397468567,
+    "diagonal": 1.674917221069336,
+    "finite": 0.021882228553295135
+  },
+  {
+    "step": 205,
+    "loss": 2.075293779373169,
+    "diagonal": 2.051989793777466,
+    "finite": 0.023303939029574394
+  },
+  {
+    "step": 206,
+    "loss": 1.8128310441970825,
+    "diagonal": 1.789884328842163,
+    "finite": 0.0229466762393713
+  },
+  {
+    "step": 207,
+    "loss": 1.5765573978424072,
+    "diagonal": 1.554987907409668,
+    "finite": 0.021569496020674706
+  },
+  {
+    "step": 208,
+    "loss": 1.6638001203536987,
+    "diagonal": 1.638461709022522,
+    "finite": 0.02533837780356407
+  },
+  {
+    "step": 209,
+    "loss": 1.7894446849822998,
+    "diagonal": 1.7589075565338135,
+    "finite": 0.030537115409970284
+  },
+  {
+    "step": 210,
+    "loss": 1.5929056406021118,
+    "diagonal": 1.5664767026901245,
+    "finite": 0.026428965851664543
+  },
+  {
+    "step": 211,
+    "loss": 1.76612389087677,
+    "diagonal": 1.7452341318130493,
+    "finite": 0.020889751613140106
+  },
+  {
+    "step": 212,
+    "loss": 2.039567470550537,
+    "diagonal": 2.023627281188965,
+    "finite": 0.015940096229314804
+  },
+  {
+    "step": 213,
+    "loss": 2.1088690757751465,
+    "diagonal": 2.0805656909942627,
+    "finite": 0.028303345665335655
+  },
+  {
+    "step": 214,
+    "loss": 1.358785629272461,
+    "diagonal": 1.3478748798370361,
+    "finite": 0.010910768061876297
+  },
+  {
+    "step": 215,
+    "loss": 1.3024884462356567,
+    "diagonal": 1.277728796005249,
+    "finite": 0.024759674444794655
+  },
+  {
+    "step": 216,
+    "loss": 1.6660796403884888,
+    "diagonal": 1.640732765197754,
+    "finite": 0.025346841663122177
+  },
+  {
+    "step": 217,
+    "loss": 1.7516316175460815,
+    "diagonal": 1.710773229598999,
+    "finite": 0.04085838422179222
+  },
+  {
+    "step": 218,
+    "loss": 1.7343966960906982,
+    "diagonal": 1.6925535202026367,
+    "finite": 0.04184320941567421
+  },
+  {
+    "step": 219,
+    "loss": 1.614927053451538,
+    "diagonal": 1.5849719047546387,
+    "finite": 0.029955115169286728
+  },
+  {
+    "step": 220,
+    "loss": 1.507643699645996,
+    "diagonal": 1.4849804639816284,
+    "finite": 0.022663192823529243
+  },
+  {
+    "step": 221,
+    "loss": 1.5359200239181519,
+    "diagonal": 1.5075552463531494,
+    "finite": 0.028364812955260277
+  },
+  {
+    "step": 222,
+    "loss": 1.9229952096939087,
+    "diagonal": 1.889191746711731,
+    "finite": 0.033803436905145645
+  },
+  {
+    "step": 223,
+    "loss": 1.824427604675293,
+    "diagonal": 1.7809901237487793,
+    "finite": 0.04343749210238457
+  },
+  {
+    "step": 224,
+    "loss": 1.8712538480758667,
+    "diagonal": 1.832260012626648,
+    "finite": 0.03899386152625084
+  },
+  {
+    "step": 225,
+    "loss": 1.726125955581665,
+    "diagonal": 1.706830620765686,
+    "finite": 0.01929529756307602
+  },
+  {
+    "step": 226,
+    "loss": 1.5230019092559814,
+    "diagonal": 1.4973864555358887,
+    "finite": 0.025615444406867027
+  },
+  {
+    "step": 227,
+    "loss": 1.86158287525177,
+    "diagonal": 1.8270095586776733,
+    "finite": 0.03457329049706459
+  },
+  {
+    "step": 228,
+    "loss": 1.7223087549209595,
+    "diagonal": 1.6980955600738525,
+    "finite": 0.024213235825300217
+  },
+  {
+    "step": 229,
+    "loss": 2.049482583999634,
+    "diagonal": 2.024553060531616,
+    "finite": 0.02492963895201683
+  },
+  {
+    "step": 230,
+    "loss": 1.743828296661377,
+    "diagonal": 1.7188663482666016,
+    "finite": 0.02496197447180748
+  },
+  {
+    "step": 231,
+    "loss": 1.3113892078399658,
+    "diagonal": 1.276261806488037,
+    "finite": 0.03512737527489662
+  },
+  {
+    "step": 232,
+    "loss": 1.6228176355361938,
+    "diagonal": 1.588728427886963,
+    "finite": 0.034089259803295135
+  },
+  {
+    "step": 233,
+    "loss": 1.6302876472473145,
+    "diagonal": 1.6038964986801147,
+    "finite": 0.026391150429844856
+  },
+  {
+    "step": 234,
+    "loss": 1.8476542234420776,
+    "diagonal": 1.8183512687683105,
+    "finite": 0.02930292673408985
+  },
+  {
+    "step": 235,
+    "loss": 1.8114811182022095,
+    "diagonal": 1.7718000411987305,
+    "finite": 0.03968106955289841
+  },
+  {
+    "step": 236,
+    "loss": 1.5882494449615479,
+    "diagonal": 1.5431959629058838,
+    "finite": 0.04505344480276108
+  },
+  {
+    "step": 237,
+    "loss": 1.7547756433486938,
+    "diagonal": 1.713289737701416,
+    "finite": 0.04148588329553604
+  },
+  {
+    "step": 238,
+    "loss": 1.5857255458831787,
+    "diagonal": 1.5472949743270874,
+    "finite": 0.03843052685260773
+  },
+  {
+    "step": 239,
+    "loss": 1.9224674701690674,
+    "diagonal": 1.8734161853790283,
+    "finite": 0.04905130714178085
+  },
+  {
+    "step": 240,
+    "loss": 2.155921459197998,
+    "diagonal": 2.1206066608428955,
+    "finite": 0.03531481325626373
+  },
+  {
+    "step": 241,
+    "loss": 1.7272772789001465,
+    "diagonal": 1.702865719795227,
+    "finite": 0.024411510676145554
+  },
+  {
+    "step": 242,
+    "loss": 1.7784342765808105,
+    "diagonal": 1.7181711196899414,
+    "finite": 0.06026314198970795
+  },
+  {
+    "step": 243,
+    "loss": 1.757760763168335,
+    "diagonal": 1.7360166311264038,
+    "finite": 0.021744152531027794
+  },
+  {
+    "step": 244,
+    "loss": 1.842108964920044,
+    "diagonal": 1.7990031242370605,
+    "finite": 0.0431058444082737
+  },
+  {
+    "step": 245,
+    "loss": 1.3224424123764038,
+    "diagonal": 1.2987053394317627,
+    "finite": 0.023737113922834396
+  },
+  {
+    "step": 246,
+    "loss": 2.0601837635040283,
+    "diagonal": 2.026090145111084,
+    "finite": 0.03409350663423538
+  },
+  {
+    "step": 247,
+    "loss": 1.4731510877609253,
+    "diagonal": 1.4449042081832886,
+    "finite": 0.028246920555830002
+  },
+  {
+    "step": 248,
+    "loss": 1.5744719505310059,
+    "diagonal": 1.5405840873718262,
+    "finite": 0.03388781100511551
+  },
+  {
+    "step": 249,
+    "loss": 1.4004459381103516,
+    "diagonal": 1.370222568511963,
+    "finite": 0.030223386362195015
+  },
+  {
+    "step": 250,
+    "loss": 1.5227192640304565,
+    "diagonal": 1.4847203493118286,
+    "finite": 0.03799889236688614
+  },
+  {
+    "step": 251,
+    "loss": 1.6966242790222168,
+    "diagonal": 1.6569650173187256,
+    "finite": 0.0396592877805233
+  },
+  {
+    "step": 252,
+    "loss": 1.894404411315918,
+    "diagonal": 1.868257761001587,
+    "finite": 0.026146607473492622
+  },
+  {
+    "step": 253,
+    "loss": 1.9867398738861084,
+    "diagonal": 1.9508602619171143,
+    "finite": 0.03587961569428444
+  },
+  {
+    "step": 254,
+    "loss": 1.6675171852111816,
+    "diagonal": 1.6271288394927979,
+    "finite": 0.040388330817222595
+  },
+  {
+    "step": 255,
+    "loss": 1.3950135707855225,
+    "diagonal": 1.361351728439331,
+    "finite": 0.033661846071481705
+  },
+  {
+    "step": 256,
+    "loss": 1.6662967205047607,
+    "diagonal": 1.6320730447769165,
+    "finite": 0.03422369062900543
+  },
+  {
+    "step": 257,
+    "loss": 1.4889659881591797,
+    "diagonal": 1.457689642906189,
+    "finite": 0.031276289373636246
+  },
+  {
+    "step": 258,
+    "loss": 1.6490492820739746,
+    "diagonal": 1.6272960901260376,
+    "finite": 0.021753152832388878
+  },
+  {
+    "step": 259,
+    "loss": 2.0105979442596436,
+    "diagonal": 1.9741864204406738,
+    "finite": 0.03641163557767868
+  },
+  {
+    "step": 260,
+    "loss": 1.7029708623886108,
+    "diagonal": 1.6716176271438599,
+    "finite": 0.0313531868159771
+  },
+  {
+    "step": 261,
+    "loss": 1.4841887950897217,
+    "diagonal": 1.434834361076355,
+    "finite": 0.04935444891452789
+  },
+  {
+    "step": 262,
+    "loss": 1.9676827192306519,
+    "diagonal": 1.942431926727295,
+    "finite": 0.02525085024535656
+  },
+  {
+    "step": 263,
+    "loss": 1.5568042993545532,
+    "diagonal": 1.5267032384872437,
+    "finite": 0.030101042240858078
+  },
+  {
+    "step": 264,
+    "loss": 1.7440367937088013,
+    "diagonal": 1.7168723344802856,
+    "finite": 0.02716449648141861
+  },
+  {
+    "step": 265,
+    "loss": 1.779833436012268,
+    "diagonal": 1.7513428926467896,
+    "finite": 0.02849050611257553
+  },
+  {
+    "step": 266,
+    "loss": 1.6291375160217285,
+    "diagonal": 1.6041760444641113,
+    "finite": 0.02496141381561756
+  },
+  {
+    "step": 267,
+    "loss": 1.5699374675750732,
+    "diagonal": 1.5328187942504883,
+    "finite": 0.03711866959929466
+  },
+  {
+    "step": 268,
+    "loss": 1.7074750661849976,
+    "diagonal": 1.673995852470398,
+    "finite": 0.033479224890470505
+  },
+  {
+    "step": 269,
+    "loss": 1.6033881902694702,
+    "diagonal": 1.5829968452453613,
+    "finite": 0.020391326397657394
+  },
+  {
+    "step": 270,
+    "loss": 1.9477851390838623,
+    "diagonal": 1.9207773208618164,
+    "finite": 0.02700783498585224
+  },
+  {
+    "step": 271,
+    "loss": 1.6208930015563965,
+    "diagonal": 1.5883992910385132,
+    "finite": 0.03249373286962509
+  },
+  {
+    "step": 272,
+    "loss": 1.920357346534729,
+    "diagonal": 1.8908907175064087,
+    "finite": 0.029466625303030014
+  },
+  {
+    "step": 273,
+    "loss": 1.4388525485992432,
+    "diagonal": 1.4027833938598633,
+    "finite": 0.03606920316815376
+  },
+  {
+    "step": 274,
+    "loss": 1.5239267349243164,
+    "diagonal": 1.4876682758331299,
+    "finite": 0.03625842556357384
+  },
+  {
+    "step": 275,
+    "loss": 1.6758949756622314,
+    "diagonal": 1.6544097661972046,
+    "finite": 0.0214852225035429
+  },
+  {
+    "step": 276,
+    "loss": 1.8989654779434204,
+    "diagonal": 1.8694772720336914,
+    "finite": 0.029488198459148407
+  },
+  {
+    "step": 277,
+    "loss": 2.1471054553985596,
+    "diagonal": 2.1029107570648193,
+    "finite": 0.044194675981998444
+  },
+  {
+    "step": 278,
+    "loss": 1.2994449138641357,
+    "diagonal": 1.2649056911468506,
+    "finite": 0.03453924134373665
+  },
+  {
+    "step": 279,
+    "loss": 1.5414882898330688,
+    "diagonal": 1.492552399635315,
+    "finite": 0.04893587529659271
+  },
+  {
+    "step": 280,
+    "loss": 1.711195945739746,
+    "diagonal": 1.6601790189743042,
+    "finite": 0.051016874611377716
+  },
+  {
+    "step": 281,
+    "loss": 1.6559592485427856,
+    "diagonal": 1.624230146408081,
+    "finite": 0.03172910213470459
+  },
+  {
+    "step": 282,
+    "loss": 1.6853351593017578,
+    "diagonal": 1.6457436084747314,
+    "finite": 0.039591506123542786
+  },
+  {
+    "step": 283,
+    "loss": 1.570255160331726,
+    "diagonal": 1.5244522094726562,
+    "finite": 0.04580299183726311
+  },
+  {
+    "step": 284,
+    "loss": 1.7341408729553223,
+    "diagonal": 1.7116328477859497,
+    "finite": 0.022508013993501663
+  },
+  {
+    "step": 285,
+    "loss": 2.0482430458068848,
+    "diagonal": 2.024195432662964,
+    "finite": 0.02404758706688881
+  },
+  {
+    "step": 286,
+    "loss": 1.7163488864898682,
+    "diagonal": 1.6741307973861694,
+    "finite": 0.04221806675195694
+  },
+  {
+    "step": 287,
+    "loss": 1.7259327173233032,
+    "diagonal": 1.6815211772918701,
+    "finite": 0.04441148787736893
+  },
+  {
+    "step": 288,
+    "loss": 1.53972327709198,
+    "diagonal": 1.502634048461914,
+    "finite": 0.03708923980593681
+  },
+  {
+    "step": 289,
+    "loss": 1.7566378116607666,
+    "diagonal": 1.7085222005844116,
+    "finite": 0.04811565950512886
+  },
+  {
+    "step": 290,
+    "loss": 1.8250668048858643,
+    "diagonal": 1.7990331649780273,
+    "finite": 0.026033669710159302
+  },
+  {
+    "step": 291,
+    "loss": 1.6358048915863037,
+    "diagonal": 1.6058229207992554,
+    "finite": 0.029982000589370728
+  },
+  {
+    "step": 292,
+    "loss": 1.4949896335601807,
+    "diagonal": 1.4583739042282104,
+    "finite": 0.03661569207906723
+  },
+  {
+    "step": 293,
+    "loss": 1.8632501363754272,
+    "diagonal": 1.8135731220245361,
+    "finite": 0.0496770441532135
+  },
+  {
+    "step": 294,
+    "loss": 1.6871933937072754,
+    "diagonal": 1.654305100440979,
+    "finite": 0.03288829326629639
+  },
+  {
+    "step": 295,
+    "loss": 1.5298807621002197,
+    "diagonal": 1.4977227449417114,
+    "finite": 0.03215804696083069
+  },
+  {
+    "step": 296,
+    "loss": 2.099421739578247,
+    "diagonal": 2.0684056282043457,
+    "finite": 0.031016109511256218
+  },
+  {
+    "step": 297,
+    "loss": 1.852696180343628,
+    "diagonal": 1.821060061454773,
+    "finite": 0.03163610398769379
+  },
+  {
+    "step": 298,
+    "loss": 1.5587043762207031,
+    "diagonal": 1.5272915363311768,
+    "finite": 0.03141281008720398
+  },
+  {
+    "step": 299,
+    "loss": 1.946006178855896,
+    "diagonal": 1.9109615087509155,
+    "finite": 0.03504469618201256
+  },
+  {
+    "step": 300,
+    "loss": 1.427458643913269,
+    "diagonal": 1.3932960033416748,
+    "finite": 0.03416263312101364
+  },
+  {
+    "step": 301,
+    "loss": 1.4941952228546143,
+    "diagonal": 1.4607799053192139,
+    "finite": 0.03341534733772278
+  },
+  {
+    "step": 302,
+    "loss": 1.3858771324157715,
+    "diagonal": 1.3629108667373657,
+    "finite": 0.022966213524341583
+  },
+  {
+    "step": 303,
+    "loss": 1.50737726688385,
+    "diagonal": 1.463188648223877,
+    "finite": 0.044188663363456726
+  },
+  {
+    "step": 304,
+    "loss": 1.5802234411239624,
+    "diagonal": 1.54123854637146,
+    "finite": 0.03898494690656662
+  },
+  {
+    "step": 305,
+    "loss": 1.3276320695877075,
+    "diagonal": 1.3015142679214478,
+    "finite": 0.026117775589227676
+  },
+  {
+    "step": 306,
+    "loss": 1.8392386436462402,
+    "diagonal": 1.803044080734253,
+    "finite": 0.03619461506605148
+  },
+  {
+    "step": 307,
+    "loss": 1.5475695133209229,
+    "diagonal": 1.5047587156295776,
+    "finite": 0.0428108349442482
+  },
+  {
+    "step": 308,
+    "loss": 1.8853600025177002,
+    "diagonal": 1.856512427330017,
+    "finite": 0.028847569599747658
+  },
+  {
+    "step": 309,
+    "loss": 1.8709843158721924,
+    "diagonal": 1.8453491926193237,
+    "finite": 0.02563510090112686
+  },
+  {
+    "step": 310,
+    "loss": 1.8926117420196533,
+    "diagonal": 1.848783254623413,
+    "finite": 0.04382844269275665
+  },
+  {
+    "step": 311,
+    "loss": 1.5620229244232178,
+    "diagonal": 1.5442085266113281,
+    "finite": 0.01781434938311577
+  },
+  {
+    "step": 312,
+    "loss": 1.4793027639389038,
+    "diagonal": 1.4505083560943604,
+    "finite": 0.02879440411925316
+  },
+  {
+    "step": 313,
+    "loss": 1.4761110544204712,
+    "diagonal": 1.4562444686889648,
+    "finite": 0.01986655220389366
+  },
+  {
+    "step": 314,
+    "loss": 1.8899116516113281,
+    "diagonal": 1.8724493980407715,
+    "finite": 0.017462274059653282
+  },
+  {
+    "step": 315,
+    "loss": 1.4817485809326172,
+    "diagonal": 1.4629766941070557,
+    "finite": 0.01877184398472309
+  },
+  {
+    "step": 316,
+    "loss": 1.7281150817871094,
+    "diagonal": 1.687668800354004,
+    "finite": 0.04044630005955696
+  },
+  {
+    "step": 317,
+    "loss": 1.790019154548645,
+    "diagonal": 1.7573630809783936,
+    "finite": 0.03265606239438057
+  },
+  {
+    "step": 318,
+    "loss": 1.6894686222076416,
+    "diagonal": 1.6642756462097168,
+    "finite": 0.025192957371473312
+  },
+  {
+    "step": 319,
+    "loss": 1.3526729345321655,
+    "diagonal": 1.3246840238571167,
+    "finite": 0.027988862246274948
+  },
+  {
+    "step": 320,
+    "loss": 1.5577048063278198,
+    "diagonal": 1.528607726097107,
+    "finite": 0.029097091406583786
+  },
+  {
+    "step": 321,
+    "loss": 1.5807774066925049,
+    "diagonal": 1.558405876159668,
+    "finite": 0.022371511906385422
+  },
+  {
+    "step": 322,
+    "loss": 1.421081304550171,
+    "diagonal": 1.388279676437378,
+    "finite": 0.03280157968401909
+  },
+  {
+    "step": 323,
+    "loss": 1.5767592191696167,
+    "diagonal": 1.5419310331344604,
+    "finite": 0.03482819348573685
+  },
+  {
+    "step": 324,
+    "loss": 1.7543165683746338,
+    "diagonal": 1.7257399559020996,
+    "finite": 0.028576642274856567
+  },
+  {
+    "step": 325,
+    "loss": 2.147761583328247,
+    "diagonal": 2.1179187297821045,
+    "finite": 0.029842928051948547
+  },
+  {
+    "step": 326,
+    "loss": 1.4016646146774292,
+    "diagonal": 1.3750797510147095,
+    "finite": 0.026584869250655174
+  },
+  {
+    "step": 327,
+    "loss": 1.5289057493209839,
+    "diagonal": 1.4989535808563232,
+    "finite": 0.029952215030789375
+  },
+  {
+    "step": 328,
+    "loss": 1.4805481433868408,
+    "diagonal": 1.4583731889724731,
+    "finite": 0.022174950689077377
+  },
+  {
+    "step": 329,
+    "loss": 1.7637465000152588,
+    "diagonal": 1.734523892402649,
+    "finite": 0.029222652316093445
+  },
+  {
+    "step": 330,
+    "loss": 1.7456432580947876,
+    "diagonal": 1.7192808389663696,
+    "finite": 0.026362445205450058
+  },
+  {
+    "step": 331,
+    "loss": 1.4983900785446167,
+    "diagonal": 1.4733188152313232,
+    "finite": 0.02507123537361622
+  },
+  {
+    "step": 332,
+    "loss": 1.586923599243164,
+    "diagonal": 1.5611814260482788,
+    "finite": 0.025742139667272568
+  },
+  {
+    "step": 333,
+    "loss": 1.9215389490127563,
+    "diagonal": 1.9001083374023438,
+    "finite": 0.021430592983961105
+  },
+  {
+    "step": 334,
+    "loss": 1.5902373790740967,
+    "diagonal": 1.5594719648361206,
+    "finite": 0.030765417963266373
+  },
+  {
+    "step": 335,
+    "loss": 1.8387746810913086,
+    "diagonal": 1.8137736320495605,
+    "finite": 0.025001028552651405
+  },
+  {
+    "step": 336,
+    "loss": 1.796298861503601,
+    "diagonal": 1.7473567724227905,
+    "finite": 0.04894203320145607
+  },
+  {
+    "step": 337,
+    "loss": 1.8823206424713135,
+    "diagonal": 1.8589829206466675,
+    "finite": 0.023337693884968758
+  },
+  {
+    "step": 338,
+    "loss": 1.2674312591552734,
+    "diagonal": 1.2352545261383057,
+    "finite": 0.032176673412323
+  },
+  {
+    "step": 339,
+    "loss": 1.8216263055801392,
+    "diagonal": 1.7977180480957031,
+    "finite": 0.023908298462629318
+  },
+  {
+    "step": 340,
+    "loss": 1.834427833557129,
+    "diagonal": 1.7918827533721924,
+    "finite": 0.04254506155848503
+  },
+  {
+    "step": 341,
+    "loss": 1.8439527750015259,
+    "diagonal": 1.8212114572525024,
+    "finite": 0.02274133265018463
+  },
+  {
+    "step": 342,
+    "loss": 1.7300853729248047,
+    "diagonal": 1.7058250904083252,
+    "finite": 0.024260304868221283
+  },
+  {
+    "step": 343,
+    "loss": 1.769057035446167,
+    "diagonal": 1.7376738786697388,
+    "finite": 0.0313832089304924
+  },
+  {
+    "step": 344,
+    "loss": 1.361230492591858,
+    "diagonal": 1.331987977027893,
+    "finite": 0.02924256958067417
+  },
+  {
+    "step": 345,
+    "loss": 1.6988961696624756,
+    "diagonal": 1.6725523471832275,
+    "finite": 0.026343844830989838
+  },
+  {
+    "step": 346,
+    "loss": 1.7042672634124756,
+    "diagonal": 1.6856521368026733,
+    "finite": 0.018615107983350754
+  },
+  {
+    "step": 347,
+    "loss": 1.5162509679794312,
+    "diagonal": 1.4722301959991455,
+    "finite": 0.044020719826221466
+  },
+  {
+    "step": 348,
+    "loss": 1.3719409704208374,
+    "diagonal": 1.3459765911102295,
+    "finite": 0.02596435695886612
+  },
+  {
+    "step": 349,
+    "loss": 1.7721189260482788,
+    "diagonal": 1.7460345029830933,
+    "finite": 0.02608438953757286
+  },
+  {
+    "step": 350,
+    "loss": 1.5592912435531616,
+    "diagonal": 1.5329961776733398,
+    "finite": 0.026295017451047897
+  },
+  {
+    "step": 351,
+    "loss": 1.410772681236267,
+    "diagonal": 1.3879637718200684,
+    "finite": 0.022808939218521118
+  },
+  {
+    "step": 352,
+    "loss": 1.6197725534439087,
+    "diagonal": 1.5987863540649414,
+    "finite": 0.02098623849451542
+  },
+  {
+    "step": 353,
+    "loss": 1.6684963703155518,
+    "diagonal": 1.6412991285324097,
+    "finite": 0.027197301387786865
+  },
+  {
+    "step": 354,
+    "loss": 1.4339910745620728,
+    "diagonal": 1.4106539487838745,
+    "finite": 0.02333718352019787
+  },
+  {
+    "step": 355,
+    "loss": 1.5073965787887573,
+    "diagonal": 1.4810277223587036,
+    "finite": 0.026368821039795876
+  },
+  {
+    "step": 356,
+    "loss": 1.5217958688735962,
+    "diagonal": 1.4955946207046509,
+    "finite": 0.026201194152235985
+  },
+  {
+    "step": 357,
+    "loss": 1.548848271369934,
+    "diagonal": 1.5298091173171997,
+    "finite": 0.01903913915157318
+  },
+  {
+    "step": 358,
+    "loss": 1.5680865049362183,
+    "diagonal": 1.5486615896224976,
+    "finite": 0.01942490227520466
+  },
+  {
+    "step": 359,
+    "loss": 1.864074945449829,
+    "diagonal": 1.8401490449905396,
+    "finite": 0.02392593026161194
+  },
+  {
+    "step": 360,
+    "loss": 1.4817808866500854,
+    "diagonal": 1.460225224494934,
+    "finite": 0.021555690094828606
+  },
+  {
+    "step": 361,
+    "loss": 1.6517829895019531,
+    "diagonal": 1.622077226638794,
+    "finite": 0.029705747961997986
+  },
+  {
+    "step": 362,
+    "loss": 1.6330431699752808,
+    "diagonal": 1.592515468597412,
+    "finite": 0.04052773863077164
+  },
+  {
+    "step": 363,
+    "loss": 1.3914538621902466,
+    "diagonal": 1.3725972175598145,
+    "finite": 0.018856598064303398
+  },
+  {
+    "step": 364,
+    "loss": 1.5186680555343628,
+    "diagonal": 1.4977943897247314,
+    "finite": 0.020873619243502617
+  },
+  {
+    "step": 365,
+    "loss": 1.8347678184509277,
+    "diagonal": 1.8022606372833252,
+    "finite": 0.032507143914699554
+  },
+  {
+    "step": 366,
+    "loss": 1.927010416984558,
+    "diagonal": 1.8973926305770874,
+    "finite": 0.029617784544825554
+  },
+  {
+    "step": 367,
+    "loss": 1.677878499031067,
+    "diagonal": 1.6555559635162354,
+    "finite": 0.022322557866573334
+  },
+  {
+    "step": 368,
+    "loss": 2.0203206539154053,
+    "diagonal": 1.99257230758667,
+    "finite": 0.027748290449380875
+  },
+  {
+    "step": 369,
+    "loss": 1.543515682220459,
+    "diagonal": 1.5190000534057617,
+    "finite": 0.024515576660633087
+  },
+  {
+    "step": 370,
+    "loss": 1.612745761871338,
+    "diagonal": 1.577170729637146,
+    "finite": 0.035574980080127716
+  },
+  {
+    "step": 371,
+    "loss": 1.2184237241744995,
+    "diagonal": 1.196923017501831,
+    "finite": 0.0215007234364748
+  },
+  {
+    "step": 372,
+    "loss": 1.7116847038269043,
+    "diagonal": 1.6908133029937744,
+    "finite": 0.020871412009000778
+  },
+  {
+    "step": 373,
+    "loss": 1.6127231121063232,
+    "diagonal": 1.5834226608276367,
+    "finite": 0.029300477355718613
+  },
+  {
+    "step": 374,
+    "loss": 1.675929069519043,
+    "diagonal": 1.6541379690170288,
+    "finite": 0.02179105021059513
+  },
+  {
+    "step": 375,
+    "loss": 1.5844789743423462,
+    "diagonal": 1.5547479391098022,
+    "finite": 0.029731005430221558
+  },
+  {
+    "step": 376,
+    "loss": 1.698810338973999,
+    "diagonal": 1.6695239543914795,
+    "finite": 0.029286406934261322
+  },
+  {
+    "step": 377,
+    "loss": 1.3762210607528687,
+    "diagonal": 1.3383532762527466,
+    "finite": 0.03786776214838028
+  },
+  {
+    "step": 378,
+    "loss": 1.6243717670440674,
+    "diagonal": 1.6065503358840942,
+    "finite": 0.0178214143961668
+  },
+  {
+    "step": 379,
+    "loss": 1.5901545286178589,
+    "diagonal": 1.5608948469161987,
+    "finite": 0.029259687289595604
+  },
+  {
+    "step": 380,
+    "loss": 1.4847605228424072,
+    "diagonal": 1.4627258777618408,
+    "finite": 0.0220346637070179
+  },
+  {
+    "step": 381,
+    "loss": 1.4044245481491089,
+    "diagonal": 1.3856569528579712,
+    "finite": 0.018767572939395905
+  },
+  {
+    "step": 382,
+    "loss": 1.482181429862976,
+    "diagonal": 1.4736661911010742,
+    "finite": 0.008515190333127975
+  },
+  {
+    "step": 383,
+    "loss": 1.452149510383606,
+    "diagonal": 1.4378244876861572,
+    "finite": 0.014325069263577461
+  },
+  {
+    "step": 384,
+    "loss": 1.8115651607513428,
+    "diagonal": 1.7994680404663086,
+    "finite": 0.012097112834453583
+  },
+  {
+    "step": 385,
+    "loss": 1.723371982574463,
+    "diagonal": 1.7040045261383057,
+    "finite": 0.019367428496479988
+  },
+  {
+    "step": 386,
+    "loss": 1.3682870864868164,
+    "diagonal": 1.352014183998108,
+    "finite": 0.016272909939289093
+  },
+  {
+    "step": 387,
+    "loss": 1.6742136478424072,
+    "diagonal": 1.6593835353851318,
+    "finite": 0.01483006402850151
+  },
+  {
+    "step": 388,
+    "loss": 1.3610038757324219,
+    "diagonal": 1.3380184173583984,
+    "finite": 0.02298545092344284
+  },
+  {
+    "step": 389,
+    "loss": 1.3676068782806396,
+    "diagonal": 1.3544082641601562,
+    "finite": 0.01319858804345131
+  },
+  {
+    "step": 390,
+    "loss": 1.357764720916748,
+    "diagonal": 1.3389277458190918,
+    "finite": 0.018836969509720802
+  },
+  {
+    "step": 391,
+    "loss": 1.2765213251113892,
+    "diagonal": 1.2662311792373657,
+    "finite": 0.010290147736668587
+  },
+  {
+    "step": 392,
+    "loss": 1.6987262964248657,
+    "diagonal": 1.688199520111084,
+    "finite": 0.010526834055781364
+  },
+  {
+    "step": 393,
+    "loss": 1.7508668899536133,
+    "diagonal": 1.7370575666427612,
+    "finite": 0.013809263706207275
+  },
+  {
+    "step": 394,
+    "loss": 1.5143887996673584,
+    "diagonal": 1.5018808841705322,
+    "finite": 0.012507914565503597
+  },
+  {
+    "step": 395,
+    "loss": 1.49958074092865,
+    "diagonal": 1.4891791343688965,
+    "finite": 0.010401658713817596
+  },
+  {
+    "step": 396,
+    "loss": 1.6460927724838257,
+    "diagonal": 1.636078953742981,
+    "finite": 0.01001385971903801
+  },
+  {
+    "step": 397,
+    "loss": 1.9733964204788208,
+    "diagonal": 1.9610456228256226,
+    "finite": 0.012350744567811489
+  },
+  {
+    "step": 398,
+    "loss": 1.513574481010437,
+    "diagonal": 1.4940377473831177,
+    "finite": 0.019536778330802917
+  },
+  {
+    "step": 399,
+    "loss": 1.8950508832931519,
+    "diagonal": 1.8827723264694214,
+    "finite": 0.012278555892407894
+  },
+  {
+    "step": 400,
+    "loss": 1.552445411682129,
+    "diagonal": 1.535899043083191,
+    "finite": 0.016546398401260376
+  },
+  {
+    "step": 401,
+    "loss": 1.5625168085098267,
+    "diagonal": 1.5490866899490356,
+    "finite": 0.0134300971403718
+  },
+  {
+    "step": 402,
+    "loss": 1.877975344657898,
+    "diagonal": 1.8641835451126099,
+    "finite": 0.0137917660176754
+  },
+  {
+    "step": 403,
+    "loss": 1.6111714839935303,
+    "diagonal": 1.5983200073242188,
+    "finite": 0.012851518578827381
+  },
+  {
+    "step": 404,
+    "loss": 1.5505971908569336,
+    "diagonal": 1.5327337980270386,
+    "finite": 0.017863335087895393
+  },
+  {
+    "step": 405,
+    "loss": 1.5725747346878052,
+    "diagonal": 1.5488883256912231,
+    "finite": 0.023686382919549942
+  },
+  {
+    "step": 406,
+    "loss": 1.4189774990081787,
+    "diagonal": 1.3982625007629395,
+    "finite": 0.02071503922343254
+  },
+  {
+    "step": 407,
+    "loss": 1.3912228345870972,
+    "diagonal": 1.3578473329544067,
+    "finite": 0.033375468105077744
+  },
+  {
+    "step": 408,
+    "loss": 1.372083067893982,
+    "diagonal": 1.3430975675582886,
+    "finite": 0.028985489159822464
+  },
+  {
+    "step": 409,
+    "loss": 1.6254481077194214,
+    "diagonal": 1.6046228408813477,
+    "finite": 0.020825250074267387
+  },
+  {
+    "step": 410,
+    "loss": 1.8960325717926025,
+    "diagonal": 1.873687505722046,
+    "finite": 0.022345108911395073
+  },
+  {
+    "step": 411,
+    "loss": 1.7006707191467285,
+    "diagonal": 1.6733601093292236,
+    "finite": 0.02731056697666645
+  },
+  {
+    "step": 412,
+    "loss": 1.5760993957519531,
+    "diagonal": 1.555132269859314,
+    "finite": 0.02096712216734886
+  },
+  {
+    "step": 413,
+    "loss": 1.6625187397003174,
+    "diagonal": 1.6476596593856812,
+    "finite": 0.01485913060605526
+  },
+  {
+    "step": 414,
+    "loss": 1.810511589050293,
+    "diagonal": 1.7949140071868896,
+    "finite": 0.0155976302921772
+  },
+  {
+    "step": 415,
+    "loss": 1.239068627357483,
+    "diagonal": 1.2216286659240723,
+    "finite": 0.017439980059862137
+  },
+  {
+    "step": 416,
+    "loss": 1.6959697008132935,
+    "diagonal": 1.6757009029388428,
+    "finite": 0.020268777385354042
+  },
+  {
+    "step": 417,
+    "loss": 1.6274501085281372,
+    "diagonal": 1.6167473793029785,
+    "finite": 0.010702776722609997
+  },
+  {
+    "step": 418,
+    "loss": 1.7257071733474731,
+    "diagonal": 1.7114810943603516,
+    "finite": 0.014226113446056843
+  },
+  {
+    "step": 419,
+    "loss": 1.4813021421432495,
+    "diagonal": 1.4677964448928833,
+    "finite": 0.013505665585398674
+  },
+  {
+    "step": 420,
+    "loss": 1.4197393655776978,
+    "diagonal": 1.404209852218628,
+    "finite": 0.015529518015682697
+  },
+  {
+    "step": 421,
+    "loss": 1.7309887409210205,
+    "diagonal": 1.7119487524032593,
+    "finite": 0.019040031358599663
+  },
+  {
+    "step": 422,
+    "loss": 1.5582352876663208,
+    "diagonal": 1.5424505472183228,
+    "finite": 0.015784790739417076
+  },
+  {
+    "step": 423,
+    "loss": 1.602924108505249,
+    "diagonal": 1.5872372388839722,
+    "finite": 0.015686918050050735
+  },
+  {
+    "step": 424,
+    "loss": 1.568458080291748,
+    "diagonal": 1.5451942682266235,
+    "finite": 0.02326386794447899
+  },
+  {
+    "step": 425,
+    "loss": 1.4312940835952759,
+    "diagonal": 1.4068092107772827,
+    "finite": 0.024484848603606224
+  },
+  {
+    "step": 426,
+    "loss": 1.5512992143630981,
+    "diagonal": 1.5381428003311157,
+    "finite": 0.01315638143569231
+  },
+  {
+    "step": 427,
+    "loss": 1.486489176750183,
+    "diagonal": 1.4722962379455566,
+    "finite": 0.01419292576611042
+  },
+  {
+    "step": 428,
+    "loss": 1.4894249439239502,
+    "diagonal": 1.4763696193695068,
+    "finite": 0.013055375777184963
+  },
+  {
+    "step": 429,
+    "loss": 1.538106918334961,
+    "diagonal": 1.5207723379135132,
+    "finite": 0.017334554344415665
+  },
+  {
+    "step": 430,
+    "loss": 1.468593716621399,
+    "diagonal": 1.4486677646636963,
+    "finite": 0.01992589607834816
+  },
+  {
+    "step": 431,
+    "loss": 1.57157301902771,
+    "diagonal": 1.5488566160202026,
+    "finite": 0.02271638810634613
+  },
+  {
+    "step": 432,
+    "loss": 1.4326740503311157,
+    "diagonal": 1.4141590595245361,
+    "finite": 0.018515031784772873
+  },
+  {
+    "step": 433,
+    "loss": 1.7163958549499512,
+    "diagonal": 1.7039216756820679,
+    "finite": 0.012474140152335167
+  },
+  {
+    "step": 434,
+    "loss": 1.948410987854004,
+    "diagonal": 1.9326708316802979,
+    "finite": 0.01574009843170643
+  },
+  {
+    "step": 435,
+    "loss": 1.424537181854248,
+    "diagonal": 1.4140472412109375,
+    "finite": 0.01048998162150383
+  },
+  {
+    "step": 436,
+    "loss": 1.9012300968170166,
+    "diagonal": 1.8912389278411865,
+    "finite": 0.009991127997636795
+  },
+  {
+    "step": 437,
+    "loss": 1.794600486755371,
+    "diagonal": 1.7843043804168701,
+    "finite": 0.010296115651726723
+  },
+  {
+    "step": 438,
+    "loss": 1.756414532661438,
+    "diagonal": 1.74089515209198,
+    "finite": 0.015519330278038979
+  },
+  {
+    "step": 439,
+    "loss": 1.3101449012756348,
+    "diagonal": 1.3027350902557373,
+    "finite": 0.007409815676510334
+  },
+  {
+    "step": 440,
+    "loss": 1.779738426208496,
+    "diagonal": 1.7726266384124756,
+    "finite": 0.007111778482794762
+  },
+  {
+    "step": 441,
+    "loss": 1.6909985542297363,
+    "diagonal": 1.6821547746658325,
+    "finite": 0.008843786083161831
+  },
+  {
+    "step": 442,
+    "loss": 1.4454864263534546,
+    "diagonal": 1.4327951669692993,
+    "finite": 0.012691305950284004
+  },
+  {
+    "step": 443,
+    "loss": 1.4991689920425415,
+    "diagonal": 1.4843422174453735,
+    "finite": 0.014826791360974312
+  },
+  {
+    "step": 444,
+    "loss": 1.628718376159668,
+    "diagonal": 1.6118115186691284,
+    "finite": 0.016906892880797386
+  },
+  {
+    "step": 445,
+    "loss": 1.8617578744888306,
+    "diagonal": 1.849082112312317,
+    "finite": 0.012675769627094269
+  },
+  {
+    "step": 446,
+    "loss": 1.6753803491592407,
+    "diagonal": 1.6478267908096313,
+    "finite": 0.02755359373986721
+  },
+  {
+    "step": 447,
+    "loss": 1.6084882020950317,
+    "diagonal": 1.5906398296356201,
+    "finite": 0.017848381772637367
+  },
+  {
+    "step": 448,
+    "loss": 1.3475308418273926,
+    "diagonal": 1.3308316469192505,
+    "finite": 0.016699185594916344
+  },
+  {
+    "step": 449,
+    "loss": 1.485628604888916,
+    "diagonal": 1.4701521396636963,
+    "finite": 0.015476420521736145
+  },
+  {
+    "step": 450,
+    "loss": 1.644531488418579,
+    "diagonal": 1.6241507530212402,
+    "finite": 0.02038072980940342
+  },
+  {
+    "step": 451,
+    "loss": 1.505068302154541,
+    "diagonal": 1.4950259923934937,
+    "finite": 0.010042347013950348
+  },
+  {
+    "step": 452,
+    "loss": 1.7355316877365112,
+    "diagonal": 1.7276663780212402,
+    "finite": 0.00786527805030346
+  },
+  {
+    "step": 453,
+    "loss": 1.2617632150650024,
+    "diagonal": 1.2549258470535278,
+    "finite": 0.006837359629571438
+  },
+  {
+    "step": 454,
+    "loss": 1.607006549835205,
+    "diagonal": 1.5977588891983032,
+    "finite": 0.00924772024154663
+  },
+  {
+    "step": 455,
+    "loss": 1.5510449409484863,
+    "diagonal": 1.544722080230713,
+    "finite": 0.006322881206870079
+  },
+  {
+    "step": 456,
+    "loss": 1.5871772766113281,
+    "diagonal": 1.5817073583602905,
+    "finite": 0.0054698605090379715
+  },
+  {
+    "step": 457,
+    "loss": 1.8811705112457275,
+    "diagonal": 1.872939109802246,
+    "finite": 0.008231413550674915
+  },
+  {
+    "step": 458,
+    "loss": 1.7218838930130005,
+    "diagonal": 1.7122570276260376,
+    "finite": 0.009626904502511024
+  },
+  {
+    "step": 459,
+    "loss": 1.4036109447479248,
+    "diagonal": 1.3881196975708008,
+    "finite": 0.015491213649511337
+  },
+  {
+    "step": 460,
+    "loss": 1.469662070274353,
+    "diagonal": 1.456414818763733,
+    "finite": 0.013247309252619743
+  },
+  {
+    "step": 461,
+    "loss": 1.8830792903900146,
+    "diagonal": 1.8739440441131592,
+    "finite": 0.009135239757597446
+  },
+  {
+    "step": 462,
+    "loss": 1.5896450281143188,
+    "diagonal": 1.5759341716766357,
+    "finite": 0.013710854575037956
+  },
+  {
+    "step": 463,
+    "loss": 1.5507144927978516,
+    "diagonal": 1.537628173828125,
+    "finite": 0.013086307793855667
+  },
+  {
+    "step": 464,
+    "loss": 1.4639146327972412,
+    "diagonal": 1.4534775018692017,
+    "finite": 0.010437163524329662
+  },
+  {
+    "step": 465,
+    "loss": 1.6398602724075317,
+    "diagonal": 1.6318343877792358,
+    "finite": 0.008025883696973324
+  },
+  {
+    "step": 466,
+    "loss": 1.4734110832214355,
+    "diagonal": 1.456184983253479,
+    "finite": 0.01722610928118229
+  },
+  {
+    "step": 467,
+    "loss": 1.4731472730636597,
+    "diagonal": 1.4626963138580322,
+    "finite": 0.010450921021401882
+  },
+  {
+    "step": 468,
+    "loss": 1.408603310585022,
+    "diagonal": 1.393855333328247,
+    "finite": 0.014747994020581245
+  },
+  {
+    "step": 469,
+    "loss": 1.5199998617172241,
+    "diagonal": 1.5009487867355347,
+    "finite": 0.019051047042012215
+  },
+  {
+    "step": 470,
+    "loss": 2.1968369483947754,
+    "diagonal": 2.18564510345459,
+    "finite": 0.01119174249470234
+  },
+  {
+    "step": 471,
+    "loss": 1.6801989078521729,
+    "diagonal": 1.6725550889968872,
+    "finite": 0.007643820717930794
+  },
+  {
+    "step": 472,
+    "loss": 1.513404369354248,
+    "diagonal": 1.5085033178329468,
+    "finite": 0.004901111125946045
+  },
+  {
+    "step": 473,
+    "loss": 1.4767038822174072,
+    "diagonal": 1.4684622287750244,
+    "finite": 0.008241633884608746
+  },
+  {
+    "step": 474,
+    "loss": 1.7553141117095947,
+    "diagonal": 1.7492468357086182,
+    "finite": 0.006067250855267048
+  },
+  {
+    "step": 475,
+    "loss": 1.5373713970184326,
+    "diagonal": 1.5285812616348267,
+    "finite": 0.008790107443928719
+  },
+  {
+    "step": 476,
+    "loss": 1.2843176126480103,
+    "diagonal": 1.277164340019226,
+    "finite": 0.0071532586589455605
+  },
+  {
+    "step": 477,
+    "loss": 1.5852911472320557,
+    "diagonal": 1.5758845806121826,
+    "finite": 0.009406572207808495
+  },
+  {
+    "step": 478,
+    "loss": 1.6395976543426514,
+    "diagonal": 1.6293379068374634,
+    "finite": 0.01025973167270422
+  },
+  {
+    "step": 479,
+    "loss": 1.4781956672668457,
+    "diagonal": 1.4708842039108276,
+    "finite": 0.007311480585485697
+  },
+  {
+    "step": 480,
+    "loss": 1.6312546730041504,
+    "diagonal": 1.6231378316879272,
+    "finite": 0.008116858080029488
+  },
+  {
+    "step": 481,
+    "loss": 1.4912846088409424,
+    "diagonal": 1.484320878982544,
+    "finite": 0.006963789463043213
+  },
+  {
+    "step": 482,
+    "loss": 1.5627849102020264,
+    "diagonal": 1.5542782545089722,
+    "finite": 0.008506705053150654
+  },
+  {
+    "step": 483,
+    "loss": 1.4101707935333252,
+    "diagonal": 1.4034422636032104,
+    "finite": 0.006728526204824448
+  },
+  {
+    "step": 484,
+    "loss": 1.5490633249282837,
+    "diagonal": 1.5405155420303345,
+    "finite": 0.008547726087272167
+  },
+  {
+    "step": 485,
+    "loss": 1.8861279487609863,
+    "diagonal": 1.8786147832870483,
+    "finite": 0.007513207849115133
+  },
+  {
+    "step": 486,
+    "loss": 1.5884257555007935,
+    "diagonal": 1.5842602252960205,
+    "finite": 0.0041655260138213634
+  },
+  {
+    "step": 487,
+    "loss": 1.6990324258804321,
+    "diagonal": 1.6942640542984009,
+    "finite": 0.00476833526045084
+  },
+  {
+    "step": 488,
+    "loss": 1.634716510772705,
+    "diagonal": 1.627953052520752,
+    "finite": 0.00676340376958251
+  },
+  {
+    "step": 489,
+    "loss": 1.6029220819473267,
+    "diagonal": 1.5965403318405151,
+    "finite": 0.00638170912861824
+  },
+  {
+    "step": 490,
+    "loss": 1.5020360946655273,
+    "diagonal": 1.4947580099105835,
+    "finite": 0.007278135512024164
+  },
+  {
+    "step": 491,
+    "loss": 1.4671380519866943,
+    "diagonal": 1.460399866104126,
+    "finite": 0.00673824455589056
+  },
+  {
+    "step": 492,
+    "loss": 1.6058040857315063,
+    "diagonal": 1.595529317855835,
+    "finite": 0.010274821892380714
+  },
+  {
+    "step": 493,
+    "loss": 1.793786883354187,
+    "diagonal": 1.7892131805419922,
+    "finite": 0.004573673941195011
+  },
+  {
+    "step": 494,
+    "loss": 1.8426876068115234,
+    "diagonal": 1.8328758478164673,
+    "finite": 0.00981170404702425
+  },
+  {
+    "step": 495,
+    "loss": 1.281847596168518,
+    "diagonal": 1.2708245515823364,
+    "finite": 0.011023065075278282
+  },
+  {
+    "step": 496,
+    "loss": 1.5557433366775513,
+    "diagonal": 1.5503194332122803,
+    "finite": 0.005423934664577246
+  },
+  {
+    "step": 497,
+    "loss": 1.3686662912368774,
+    "diagonal": 1.360887050628662,
+    "finite": 0.007779212668538094
+  },
+  {
+    "step": 498,
+    "loss": 1.4732388257980347,
+    "diagonal": 1.4627721309661865,
+    "finite": 0.010466640815138817
+  },
+  {
+    "step": 499,
+    "loss": 1.738410472869873,
+    "diagonal": 1.7337138652801514,
+    "finite": 0.00469661271199584
+  },
+  {
+    "step": 500,
+    "loss": 1.6087766885757446,
+    "diagonal": 1.6013485193252563,
+    "finite": 0.007428144104778767
+  },
+  {
+    "step": 501,
+    "loss": 1.8345439434051514,
+    "diagonal": 1.8236027956008911,
+    "finite": 0.010941116139292717
+  },
+  {
+    "step": 502,
+    "loss": 1.5058038234710693,
+    "diagonal": 1.4945584535598755,
+    "finite": 0.01124531589448452
+  },
+  {
+    "step": 503,
+    "loss": 1.3556439876556396,
+    "diagonal": 1.3473365306854248,
+    "finite": 0.008307416923344135
+  },
+  {
+    "step": 504,
+    "loss": 1.5124781131744385,
+    "diagonal": 1.4986681938171387,
+    "finite": 0.013809902593493462
+  },
+  {
+    "step": 505,
+    "loss": 1.486616849899292,
+    "diagonal": 1.477988362312317,
+    "finite": 0.008628485724329948
+  },
+  {
+    "step": 506,
+    "loss": 1.30099356174469,
+    "diagonal": 1.2934181690216064,
+    "finite": 0.007575356401503086
+  },
+  {
+    "step": 507,
+    "loss": 1.7687920331954956,
+    "diagonal": 1.7608418464660645,
+    "finite": 0.007950191386044025
+  },
+  {
+    "step": 508,
+    "loss": 1.4809584617614746,
+    "diagonal": 1.474562168121338,
+    "finite": 0.0063962629064917564
+  },
+  {
+    "step": 509,
+    "loss": 1.9484474658966064,
+    "diagonal": 1.9381053447723389,
+    "finite": 0.010342136025428772
+  },
+  {
+    "step": 510,
+    "loss": 1.4984240531921387,
+    "diagonal": 1.4855189323425293,
+    "finite": 0.012905163690447807
+  },
+  {
+    "step": 511,
+    "loss": 1.5544371604919434,
+    "diagonal": 1.5425200462341309,
+    "finite": 0.011917095631361008
+  },
+  {
+    "step": 512,
+    "loss": 1.4787490367889404,
+    "diagonal": 1.4706058502197266,
+    "finite": 0.008143165148794651
+  },
+  {
+    "step": 513,
+    "loss": 1.622570276260376,
+    "diagonal": 1.6169439554214478,
+    "finite": 0.005626380443572998
+  },
+  {
+    "step": 514,
+    "loss": 1.5616828203201294,
+    "diagonal": 1.5521471500396729,
+    "finite": 0.009535699151456356
+  },
+  {
+    "step": 515,
+    "loss": 1.579546332359314,
+    "diagonal": 1.5720610618591309,
+    "finite": 0.007485230453312397
+  },
+  {
+    "step": 516,
+    "loss": 1.742993950843811,
+    "diagonal": 1.7371447086334229,
+    "finite": 0.005849294830113649
+  },
+  {
+    "step": 517,
+    "loss": 1.1754586696624756,
+    "diagonal": 1.1669896841049194,
+    "finite": 0.008468973450362682
+  },
+  {
+    "step": 518,
+    "loss": 1.5608184337615967,
+    "diagonal": 1.554221272468567,
+    "finite": 0.006597153842449188
+  },
+  {
+    "step": 519,
+    "loss": 1.3506629467010498,
+    "diagonal": 1.3426930904388428,
+    "finite": 0.007969865575432777
+  },
+  {
+    "step": 520,
+    "loss": 1.5403646230697632,
+    "diagonal": 1.535651683807373,
+    "finite": 0.004712994676083326
+  },
+  {
+    "step": 521,
+    "loss": 1.762054204940796,
+    "diagonal": 1.7567280530929565,
+    "finite": 0.005326195620000362
+  },
+  {
+    "step": 522,
+    "loss": 1.9491617679595947,
+    "diagonal": 1.9427522420883179,
+    "finite": 0.006409510038793087
+  },
+  {
+    "step": 523,
+    "loss": 1.3163894414901733,
+    "diagonal": 1.3107125759124756,
+    "finite": 0.005676819011569023
+  },
+  {
+    "step": 524,
+    "loss": 1.3784780502319336,
+    "diagonal": 1.3651514053344727,
+    "finite": 0.013326677493751049
+  },
+  {
+    "step": 525,
+    "loss": 1.871866226196289,
+    "diagonal": 1.8651303052902222,
+    "finite": 0.006735886447131634
+  },
+  {
+    "step": 526,
+    "loss": 1.6157807111740112,
+    "diagonal": 1.6093136072158813,
+    "finite": 0.006467078346759081
+  },
+  {
+    "step": 527,
+    "loss": 1.7275394201278687,
+    "diagonal": 1.721614956855774,
+    "finite": 0.005924514960497618
+  },
+  {
+    "step": 528,
+    "loss": 1.2996776103973389,
+    "diagonal": 1.291810154914856,
+    "finite": 0.007867499254643917
+  },
+  {
+    "step": 529,
+    "loss": 1.6792311668395996,
+    "diagonal": 1.6641106605529785,
+    "finite": 0.015120486728847027
+  },
+  {
+    "step": 530,
+    "loss": 1.7766884565353394,
+    "diagonal": 1.7720553874969482,
+    "finite": 0.004633081611245871
+  },
+  {
+    "step": 531,
+    "loss": 1.3168036937713623,
+    "diagonal": 1.3085030317306519,
+    "finite": 0.008300702087581158
+  },
+  {
+    "step": 532,
+    "loss": 1.2949421405792236,
+    "diagonal": 1.2871865034103394,
+    "finite": 0.00775560550391674
+  },
+  {
+    "step": 533,
+    "loss": 1.7552214860916138,
+    "diagonal": 1.7414345741271973,
+    "finite": 0.013786902651190758
+  },
+  {
+    "step": 534,
+    "loss": 1.3856403827667236,
+    "diagonal": 1.371083378791809,
+    "finite": 0.014557057060301304
+  },
+  {
+    "step": 535,
+    "loss": 1.4422119855880737,
+    "diagonal": 1.4348421096801758,
+    "finite": 0.007369886618107557
+  },
+  {
+    "step": 536,
+    "loss": 1.5462101697921753,
+    "diagonal": 1.5367892980575562,
+    "finite": 0.009420855902135372
+  },
+  {
+    "step": 537,
+    "loss": 1.7739639282226562,
+    "diagonal": 1.7669531106948853,
+    "finite": 0.007010788656771183
+  },
+  {
+    "step": 538,
+    "loss": 1.58046293258667,
+    "diagonal": 1.5753657817840576,
+    "finite": 0.0050972080789506435
+  },
+  {
+    "step": 539,
+    "loss": 1.8917160034179688,
+    "diagonal": 1.8838928937911987,
+    "finite": 0.00782315619289875
+  },
+  {
+    "step": 540,
+    "loss": 1.6861530542373657,
+    "diagonal": 1.677327275276184,
+    "finite": 0.008825739845633507
+  },
+  {
+    "step": 541,
+    "loss": 1.681182622909546,
+    "diagonal": 1.6707249879837036,
+    "finite": 0.010457645170390606
+  },
+  {
+    "step": 542,
+    "loss": 1.6442599296569824,
+    "diagonal": 1.634069800376892,
+    "finite": 0.0101900864392519
+  },
+  {
+    "step": 543,
+    "loss": 1.5211573839187622,
+    "diagonal": 1.5133795738220215,
+    "finite": 0.007777839433401823
+  },
+  {
+    "step": 544,
+    "loss": 1.5745418071746826,
+    "diagonal": 1.5596330165863037,
+    "finite": 0.014908785931766033
+  },
+  {
+    "step": 545,
+    "loss": 1.4885389804840088,
+    "diagonal": 1.4796193838119507,
+    "finite": 0.008919577114284039
+  },
+  {
+    "step": 546,
+    "loss": 1.5417975187301636,
+    "diagonal": 1.531140685081482,
+    "finite": 0.01065685786306858
+  },
+  {
+    "step": 547,
+    "loss": 1.8353328704833984,
+    "diagonal": 1.8264715671539307,
+    "finite": 0.008861294016242027
+  },
+  {
+    "step": 548,
+    "loss": 1.8554747104644775,
+    "diagonal": 1.837632656097412,
+    "finite": 0.01784210279583931
+  },
+  {
+    "step": 549,
+    "loss": 1.4859155416488647,
+    "diagonal": 1.4774765968322754,
+    "finite": 0.008438915014266968
+  },
+  {
+    "step": 550,
+    "loss": 2.0077481269836426,
+    "diagonal": 1.9968359470367432,
+    "finite": 0.01091222744435072
+  },
+  {
+    "step": 551,
+    "loss": 1.5114015340805054,
+    "diagonal": 1.5033440589904785,
+    "finite": 0.008057454600930214
+  },
+  {
+    "step": 552,
+    "loss": 1.6505643129348755,
+    "diagonal": 1.645153522491455,
+    "finite": 0.005410755053162575
+  },
+  {
+    "step": 553,
+    "loss": 1.4060720205307007,
+    "diagonal": 1.402029275894165,
+    "finite": 0.004042766522616148
+  },
+  {
+    "step": 554,
+    "loss": 1.4768993854522705,
+    "diagonal": 1.4688453674316406,
+    "finite": 0.008054064586758614
+  },
+  {
+    "step": 555,
+    "loss": 1.7543319463729858,
+    "diagonal": 1.7476963996887207,
+    "finite": 0.006635524332523346
+  },
+  {
+    "step": 556,
+    "loss": 1.5289580821990967,
+    "diagonal": 1.5199244022369385,
+    "finite": 0.009033631533384323
+  },
+  {
+    "step": 557,
+    "loss": 1.7787326574325562,
+    "diagonal": 1.7633785009384155,
+    "finite": 0.015354099683463573
+  },
+  {
+    "step": 558,
+    "loss": 1.5291694402694702,
+    "diagonal": 1.5098834037780762,
+    "finite": 0.019286030903458595
+  },
+  {
+    "step": 559,
+    "loss": 1.7178781032562256,
+    "diagonal": 1.6982920169830322,
+    "finite": 0.01958613097667694
+  },
+  {
+    "step": 560,
+    "loss": 1.5528745651245117,
+    "diagonal": 1.5317213535308838,
+    "finite": 0.021153224632143974
+  },
+  {
+    "step": 561,
+    "loss": 1.6037540435791016,
+    "diagonal": 1.588158369064331,
+    "finite": 0.01559565868228674
+  },
+  {
+    "step": 562,
+    "loss": 1.3526737689971924,
+    "diagonal": 1.3380345106124878,
+    "finite": 0.01463928259909153
+  },
+  {
+    "step": 563,
+    "loss": 1.3401203155517578,
+    "diagonal": 1.3296324014663696,
+    "finite": 0.010487951338291168
+  },
+  {
+    "step": 564,
+    "loss": 1.748970627784729,
+    "diagonal": 1.738693118095398,
+    "finite": 0.010277489200234413
+  },
+  {
+    "step": 565,
+    "loss": 1.8944662809371948,
+    "diagonal": 1.8855931758880615,
+    "finite": 0.008873051032423973
+  },
+  {
+    "step": 566,
+    "loss": 1.542682409286499,
+    "diagonal": 1.535975694656372,
+    "finite": 0.006706750951707363
+  },
+  {
+    "step": 567,
+    "loss": 1.5051511526107788,
+    "diagonal": 1.497931957244873,
+    "finite": 0.007219224236905575
+  },
+  {
+    "step": 568,
+    "loss": 1.7058358192443848,
+    "diagonal": 1.6988335847854614,
+    "finite": 0.00700219813734293
+  },
+  {
+    "step": 569,
+    "loss": 1.5828200578689575,
+    "diagonal": 1.5737390518188477,
+    "finite": 0.009080966003239155
+  },
+  {
+    "step": 570,
+    "loss": 1.380444884300232,
+    "diagonal": 1.3685468435287476,
+    "finite": 0.011898008175194263
+  },
+  {
+    "step": 571,
+    "loss": 1.475179672241211,
+    "diagonal": 1.4669169187545776,
+    "finite": 0.00826275534927845
+  },
+  {
+    "step": 572,
+    "loss": 1.2166740894317627,
+    "diagonal": 1.2010576725006104,
+    "finite": 0.015616431832313538
+  },
+  {
+    "step": 573,
+    "loss": 1.4042166471481323,
+    "diagonal": 1.3862496614456177,
+    "finite": 0.017966946586966515
+  },
+  {
+    "step": 574,
+    "loss": 1.8063596487045288,
+    "diagonal": 1.792413592338562,
+    "finite": 0.013946053571999073
+  },
+  {
+    "step": 575,
+    "loss": 1.7011886835098267,
+    "diagonal": 1.6906583309173584,
+    "finite": 0.010530330240726471
+  },
+  {
+    "step": 576,
+    "loss": 1.6389179229736328,
+    "diagonal": 1.6309285163879395,
+    "finite": 0.007989463396370411
+  },
+  {
+    "step": 577,
+    "loss": 1.7536636590957642,
+    "diagonal": 1.7480018138885498,
+    "finite": 0.005661838687956333
+  },
+  {
+    "step": 578,
+    "loss": 1.4780594110488892,
+    "diagonal": 1.4732909202575684,
+    "finite": 0.004768457263708115
+  },
+  {
+    "step": 579,
+    "loss": 1.3513448238372803,
+    "diagonal": 1.339789628982544,
+    "finite": 0.011555155739188194
+  },
+  {
+    "step": 580,
+    "loss": 1.5281944274902344,
+    "diagonal": 1.5200293064117432,
+    "finite": 0.008165176026523113
+  },
+  {
+    "step": 581,
+    "loss": 1.4163187742233276,
+    "diagonal": 1.3992810249328613,
+    "finite": 0.0170377679169178
+  },
+  {
+    "step": 582,
+    "loss": 1.4829626083374023,
+    "diagonal": 1.4685461521148682,
+    "finite": 0.0144164664670825
+  },
+  {
+    "step": 583,
+    "loss": 1.5811620950698853,
+    "diagonal": 1.5625309944152832,
+    "finite": 0.018631063401699066
+  },
+  {
+    "step": 584,
+    "loss": 1.5619689226150513,
+    "diagonal": 1.5443413257598877,
+    "finite": 0.017627563327550888
+  },
+  {
+    "step": 585,
+    "loss": 1.521131992340088,
+    "diagonal": 1.50736665725708,
+    "finite": 0.01376536674797535
+  },
+  {
+    "step": 586,
+    "loss": 1.452490210533142,
+    "diagonal": 1.4372631311416626,
+    "finite": 0.015227135270833969
+  },
+  {
+    "step": 587,
+    "loss": 1.6411211490631104,
+    "diagonal": 1.6286249160766602,
+    "finite": 0.0124962842091918
+  },
+  {
+    "step": 588,
+    "loss": 1.3790937662124634,
+    "diagonal": 1.368057370185852,
+    "finite": 0.011036369018256664
+  },
+  {
+    "step": 589,
+    "loss": 1.2333033084869385,
+    "diagonal": 1.2259242534637451,
+    "finite": 0.007379041984677315
+  },
+  {
+    "step": 590,
+    "loss": 1.1900900602340698,
+    "diagonal": 1.179022192955017,
+    "finite": 0.011067858897149563
+  },
+  {
+    "step": 591,
+    "loss": 1.42499840259552,
+    "diagonal": 1.4202957153320312,
+    "finite": 0.004702727776020765
+  },
+  {
+    "step": 592,
+    "loss": 1.5999093055725098,
+    "diagonal": 1.5862398147583008,
+    "finite": 0.013669490814208984
+  },
+  {
+    "step": 593,
+    "loss": 1.492753267288208,
+    "diagonal": 1.47871732711792,
+    "finite": 0.01403591874986887
+  },
+  {
+    "step": 594,
+    "loss": 1.420153260231018,
+    "diagonal": 1.4123518466949463,
+    "finite": 0.007801372092217207
+  },
+  {
+    "step": 595,
+    "loss": 1.5234757661819458,
+    "diagonal": 1.5167548656463623,
+    "finite": 0.006720896810293198
+  },
+  {
+    "step": 596,
+    "loss": 1.440746545791626,
+    "diagonal": 1.432586908340454,
+    "finite": 0.008159593679010868
+  },
+  {
+    "step": 597,
+    "loss": 2.053279399871826,
+    "diagonal": 2.046236038208008,
+    "finite": 0.007043470628559589
+  },
+  {
+    "step": 598,
+    "loss": 1.9643535614013672,
+    "diagonal": 1.9587482213974,
+    "finite": 0.005605383310467005
+  },
+  {
+    "step": 599,
+    "loss": 1.3094884157180786,
+    "diagonal": 1.3054808378219604,
+    "finite": 0.004007560666650534
+  },
+  {
+    "step": 600,
+    "loss": 1.5486384630203247,
+    "diagonal": 1.5386182069778442,
+    "finite": 0.010020251385867596
+  },
+  {
+    "step": 601,
+    "loss": 1.5803277492523193,
+    "diagonal": 1.5650482177734375,
+    "finite": 0.015279537066817284
+  },
+  {
+    "step": 602,
+    "loss": 1.3460227251052856,
+    "diagonal": 1.3352477550506592,
+    "finite": 0.010774948634207249
+  },
+  {
+    "step": 603,
+    "loss": 1.511629581451416,
+    "diagonal": 1.501072645187378,
+    "finite": 0.010556980036199093
+  },
+  {
+    "step": 604,
+    "loss": 1.3341917991638184,
+    "diagonal": 1.323720097541809,
+    "finite": 0.010471759364008904
+  },
+  {
+    "step": 605,
+    "loss": 1.559789776802063,
+    "diagonal": 1.5462833642959595,
+    "finite": 0.013506394810974598
+  },
+  {
+    "step": 606,
+    "loss": 1.7419724464416504,
+    "diagonal": 1.7356592416763306,
+    "finite": 0.006313163787126541
+  },
+  {
+    "step": 607,
+    "loss": 1.7374542951583862,
+    "diagonal": 1.7262283563613892,
+    "finite": 0.011225981637835503
+  },
+  {
+    "step": 608,
+    "loss": 1.719420313835144,
+    "diagonal": 1.7088245153427124,
+    "finite": 0.010595764964818954
+  },
+  {
+    "step": 609,
+    "loss": 1.5355608463287354,
+    "diagonal": 1.5253230333328247,
+    "finite": 0.01023784652352333
+  },
+  {
+    "step": 610,
+    "loss": 1.6853598356246948,
+    "diagonal": 1.676640272140503,
+    "finite": 0.008719533681869507
+  },
+  {
+    "step": 611,
+    "loss": 1.4952788352966309,
+    "diagonal": 1.4789528846740723,
+    "finite": 0.016325976699590683
+  },
+  {
+    "step": 612,
+    "loss": 1.5814062356948853,
+    "diagonal": 1.5689071416854858,
+    "finite": 0.012499071657657623
+  },
+  {
+    "step": 613,
+    "loss": 2.11563777923584,
+    "diagonal": 2.107212543487549,
+    "finite": 0.008425172418355942
+  },
+  {
+    "step": 614,
+    "loss": 1.5684701204299927,
+    "diagonal": 1.5588918924331665,
+    "finite": 0.009578169323503971
+  },
+  {
+    "step": 615,
+    "loss": 1.315200924873352,
+    "diagonal": 1.3100476264953613,
+    "finite": 0.005153322126716375
+  },
+  {
+    "step": 616,
+    "loss": 1.4447405338287354,
+    "diagonal": 1.4380892515182495,
+    "finite": 0.006651223637163639
+  },
+  {
+    "step": 617,
+    "loss": 1.745535135269165,
+    "diagonal": 1.742721676826477,
+    "finite": 0.002813456580042839
+  },
+  {
+    "step": 618,
+    "loss": 1.382994532585144,
+    "diagonal": 1.3763525485992432,
+    "finite": 0.006641996558755636
+  },
+  {
+    "step": 619,
+    "loss": 1.963487982749939,
+    "diagonal": 1.956768274307251,
+    "finite": 0.006719759665429592
+  },
+  {
+    "step": 620,
+    "loss": 1.3590971231460571,
+    "diagonal": 1.3477685451507568,
+    "finite": 0.011328581720590591
+  },
+  {
+    "step": 621,
+    "loss": 1.6249006986618042,
+    "diagonal": 1.6206218004226685,
+    "finite": 0.004278911743313074
+  },
+  {
+    "step": 622,
+    "loss": 1.7389910221099854,
+    "diagonal": 1.7322020530700684,
+    "finite": 0.0067890179343521595
+  },
+  {
+    "step": 623,
+    "loss": 1.7272803783416748,
+    "diagonal": 1.7197600603103638,
+    "finite": 0.007520359009504318
+  },
+  {
+    "step": 624,
+    "loss": 1.4310119152069092,
+    "diagonal": 1.419201374053955,
+    "finite": 0.011810528114438057
+  },
+  {
+    "step": 625,
+    "loss": 1.3337337970733643,
+    "diagonal": 1.3141264915466309,
+    "finite": 0.0196073055267334
+  },
+  {
+    "step": 626,
+    "loss": 1.483760118484497,
+    "diagonal": 1.4803043603897095,
+    "finite": 0.0034557594917714596
+  },
+  {
+    "step": 627,
+    "loss": 1.805797815322876,
+    "diagonal": 1.8015270233154297,
+    "finite": 0.0042708273977041245
+  },
+  {
+    "step": 628,
+    "loss": 1.7585656642913818,
+    "diagonal": 1.7529010772705078,
+    "finite": 0.0056645371951162815
+  },
+  {
+    "step": 629,
+    "loss": 1.6448956727981567,
+    "diagonal": 1.6351659297943115,
+    "finite": 0.009729773737490177
+  },
+  {
+    "step": 630,
+    "loss": 1.447526454925537,
+    "diagonal": 1.4417741298675537,
+    "finite": 0.005752379074692726
+  },
+  {
+    "step": 631,
+    "loss": 1.7033617496490479,
+    "diagonal": 1.6984491348266602,
+    "finite": 0.004912670236080885
+  },
+  {
+    "step": 632,
+    "loss": 1.4016239643096924,
+    "diagonal": 1.3929756879806519,
+    "finite": 0.008648241870105267
+  },
+  {
+    "step": 633,
+    "loss": 1.6097742319107056,
+    "diagonal": 1.5983086824417114,
+    "finite": 0.011465491726994514
+  },
+  {
+    "step": 634,
+    "loss": 1.7669419050216675,
+    "diagonal": 1.7616766691207886,
+    "finite": 0.0052652726881206036
+  },
+  {
+    "step": 635,
+    "loss": 1.719251275062561,
+    "diagonal": 1.7080014944076538,
+    "finite": 0.011249789968132973
+  },
+  {
+    "step": 636,
+    "loss": 1.667249321937561,
+    "diagonal": 1.6611733436584473,
+    "finite": 0.006075993180274963
+  },
+  {
+    "step": 637,
+    "loss": 1.242849349975586,
+    "diagonal": 1.2394535541534424,
+    "finite": 0.003395737148821354
+  },
+  {
+    "step": 638,
+    "loss": 1.611497163772583,
+    "diagonal": 1.6097393035888672,
+    "finite": 0.0017578712431713939
+  },
+  {
+    "step": 639,
+    "loss": 1.5157464742660522,
+    "diagonal": 1.5134414434432983,
+    "finite": 0.0023049823939800262
+  },
+  {
+    "step": 640,
+    "loss": 1.3541923761367798,
+    "diagonal": 1.3498401641845703,
+    "finite": 0.00435222452506423
+  },
+  {
+    "step": 641,
+    "loss": 1.3043136596679688,
+    "diagonal": 1.2984540462493896,
+    "finite": 0.005859600380063057
+  },
+  {
+    "step": 642,
+    "loss": 1.621449589729309,
+    "diagonal": 1.6113789081573486,
+    "finite": 0.010070707648992538
+  },
+  {
+    "step": 643,
+    "loss": 1.3347774744033813,
+    "diagonal": 1.322726845741272,
+    "finite": 0.012050596997141838
+  },
+  {
+    "step": 644,
+    "loss": 1.677016258239746,
+    "diagonal": 1.6657068729400635,
+    "finite": 0.011309406720101833
+  },
+  {
+    "step": 645,
+    "loss": 1.4617834091186523,
+    "diagonal": 1.4504331350326538,
+    "finite": 0.011350215412676334
+  },
+  {
+    "step": 646,
+    "loss": 1.4573177099227905,
+    "diagonal": 1.4489121437072754,
+    "finite": 0.008405524305999279
+  },
+  {
+    "step": 647,
+    "loss": 1.9097603559494019,
+    "diagonal": 1.895848035812378,
+    "finite": 0.013912320137023926
+  },
+  {
+    "step": 648,
+    "loss": 1.5428555011749268,
+    "diagonal": 1.534062147140503,
+    "finite": 0.008793303743004799
+  },
+  {
+    "step": 649,
+    "loss": 1.4251881837844849,
+    "diagonal": 1.4197925329208374,
+    "finite": 0.005395634099841118
+  },
+  {
+    "step": 650,
+    "loss": 1.6027148962020874,
+    "diagonal": 1.5937607288360596,
+    "finite": 0.008954120799899101
+  },
+  {
+    "step": 651,
+    "loss": 1.4675860404968262,
+    "diagonal": 1.4625134468078613,
+    "finite": 0.00507262721657753
+  },
+  {
+    "step": 652,
+    "loss": 1.550154447555542,
+    "diagonal": 1.5423588752746582,
+    "finite": 0.007795561570674181
+  },
+  {
+    "step": 653,
+    "loss": 1.5798003673553467,
+    "diagonal": 1.5718176364898682,
+    "finite": 0.007982738316059113
+  },
+  {
+    "step": 654,
+    "loss": 1.3528705835342407,
+    "diagonal": 1.3426679372787476,
+    "finite": 0.010202661156654358
+  },
+  {
+    "step": 655,
+    "loss": 1.6536433696746826,
+    "diagonal": 1.642089605331421,
+    "finite": 0.011553800664842129
+  },
+  {
+    "step": 656,
+    "loss": 1.5465975999832153,
+    "diagonal": 1.5404367446899414,
+    "finite": 0.0061608972027897835
+  },
+  {
+    "step": 657,
+    "loss": 1.487336277961731,
+    "diagonal": 1.4794809818267822,
+    "finite": 0.007855331525206566
+  },
+  {
+    "step": 658,
+    "loss": 1.7245030403137207,
+    "diagonal": 1.718804121017456,
+    "finite": 0.0056988950818777084
+  },
+  {
+    "step": 659,
+    "loss": 1.6052484512329102,
+    "diagonal": 1.5982952117919922,
+    "finite": 0.006953223142772913
+  },
+  {
+    "step": 660,
+    "loss": 1.8291465044021606,
+    "diagonal": 1.8249307870864868,
+    "finite": 0.004215744324028492
+  },
+  {
+    "step": 661,
+    "loss": 1.192564606666565,
+    "diagonal": 1.189767599105835,
+    "finite": 0.002796961460262537
+  },
+  {
+    "step": 662,
+    "loss": 1.523414134979248,
+    "diagonal": 1.5196771621704102,
+    "finite": 0.003736974438652396
+  },
+  {
+    "step": 663,
+    "loss": 1.4246788024902344,
+    "diagonal": 1.4181551933288574,
+    "finite": 0.006523648742586374
+  },
+  {
+    "step": 664,
+    "loss": 1.580452561378479,
+    "diagonal": 1.5717308521270752,
+    "finite": 0.008721663616597652
+  },
+  {
+    "step": 665,
+    "loss": 1.3893063068389893,
+    "diagonal": 1.3822364807128906,
+    "finite": 0.007069794461131096
+  },
+  {
+    "step": 666,
+    "loss": 1.4500389099121094,
+    "diagonal": 1.4451031684875488,
+    "finite": 0.004935732111334801
+  },
+  {
+    "step": 667,
+    "loss": 1.6500632762908936,
+    "diagonal": 1.6435503959655762,
+    "finite": 0.006512830499559641
+  },
+  {
+    "step": 668,
+    "loss": 1.5761141777038574,
+    "diagonal": 1.5682235956192017,
+    "finite": 0.00789057370275259
+  },
+  {
+    "step": 669,
+    "loss": 1.864647388458252,
+    "diagonal": 1.8549822568893433,
+    "finite": 0.009665131568908691
+  },
+  {
+    "step": 670,
+    "loss": 1.6136236190795898,
+    "diagonal": 1.60490882396698,
+    "finite": 0.008714761584997177
+  },
+  {
+    "step": 671,
+    "loss": 1.7029749155044556,
+    "diagonal": 1.6933155059814453,
+    "finite": 0.00965938065201044
+  },
+  {
+    "step": 672,
+    "loss": 1.9085609912872314,
+    "diagonal": 1.8990997076034546,
+    "finite": 0.009461229667067528
+  },
+  {
+    "step": 673,
+    "loss": 1.5596675872802734,
+    "diagonal": 1.5472073554992676,
+    "finite": 0.012460215017199516
+  },
+  {
+    "step": 674,
+    "loss": 1.6463323831558228,
+    "diagonal": 1.6375890970230103,
+    "finite": 0.008743343874812126
+  },
+  {
+    "step": 675,
+    "loss": 1.6906793117523193,
+    "diagonal": 1.6840124130249023,
+    "finite": 0.0066669536754488945
+  },
+  {
+    "step": 676,
+    "loss": 1.4775546789169312,
+    "diagonal": 1.4706494808197021,
+    "finite": 0.00690522650256753
+  },
+  {
+    "step": 677,
+    "loss": 1.4117953777313232,
+    "diagonal": 1.406694769859314,
+    "finite": 0.005100604612380266
+  },
+  {
+    "step": 678,
+    "loss": 1.5739541053771973,
+    "diagonal": 1.5670727491378784,
+    "finite": 0.006881336215883493
+  },
+  {
+    "step": 679,
+    "loss": 1.2720322608947754,
+    "diagonal": 1.2692103385925293,
+    "finite": 0.0028218983206897974
+  },
+  {
+    "step": 680,
+    "loss": 1.582136631011963,
+    "diagonal": 1.5789968967437744,
+    "finite": 0.003139726584777236
+  },
+  {
+    "step": 681,
+    "loss": 1.5695778131484985,
+    "diagonal": 1.5633856058120728,
+    "finite": 0.00619225949048996
+  },
+  {
+    "step": 682,
+    "loss": 1.4144551753997803,
+    "diagonal": 1.4116919040679932,
+    "finite": 0.002763239433988929
+  },
+  {
+    "step": 683,
+    "loss": 1.324973464012146,
+    "diagonal": 1.3208062648773193,
+    "finite": 0.004167160950601101
+  },
+  {
+    "step": 684,
+    "loss": 1.8119210004806519,
+    "diagonal": 1.8002233505249023,
+    "finite": 0.011697649024426937
+  },
+  {
+    "step": 685,
+    "loss": 1.3197500705718994,
+    "diagonal": 1.313185691833496,
+    "finite": 0.0065643880516290665
+  },
+  {
+    "step": 686,
+    "loss": 1.159324288368225,
+    "diagonal": 1.1501559019088745,
+    "finite": 0.009168348275125027
+  },
+  {
+    "step": 687,
+    "loss": 1.46987783908844,
+    "diagonal": 1.4637272357940674,
+    "finite": 0.006150598172098398
+  },
+  {
+    "step": 688,
+    "loss": 1.610460877418518,
+    "diagonal": 1.5996884107589722,
+    "finite": 0.010772429406642914
+  },
+  {
+    "step": 689,
+    "loss": 1.4583312273025513,
+    "diagonal": 1.4496058225631714,
+    "finite": 0.008725401014089584
+  },
+  {
+    "step": 690,
+    "loss": 1.4652193784713745,
+    "diagonal": 1.4592645168304443,
+    "finite": 0.005954831372946501
+  },
+  {
+    "step": 691,
+    "loss": 1.390750527381897,
+    "diagonal": 1.3850741386413574,
+    "finite": 0.005676336586475372
+  },
+  {
+    "step": 692,
+    "loss": 1.6580781936645508,
+    "diagonal": 1.6513090133666992,
+    "finite": 0.0067691681906580925
+  },
+  {
+    "step": 693,
+    "loss": 1.4994462728500366,
+    "diagonal": 1.492998480796814,
+    "finite": 0.00644774129614234
+  },
+  {
+    "step": 694,
+    "loss": 1.3346084356307983,
+    "diagonal": 1.3309141397476196,
+    "finite": 0.0036942504812031984
+  },
+  {
+    "step": 695,
+    "loss": 1.5683739185333252,
+    "diagonal": 1.55839204788208,
+    "finite": 0.009981893934309483
+  },
+  {
+    "step": 696,
+    "loss": 1.6727278232574463,
+    "diagonal": 1.66746985912323,
+    "finite": 0.0052579534240067005
+  },
+  {
+    "step": 697,
+    "loss": 1.334421157836914,
+    "diagonal": 1.3248217105865479,
+    "finite": 0.009599454700946808
+  },
+  {
+    "step": 698,
+    "loss": 1.550427794456482,
+    "diagonal": 1.542385220527649,
+    "finite": 0.00804258044809103
+  },
+  {
+    "step": 699,
+    "loss": 1.223953127861023,
+    "diagonal": 1.2181907892227173,
+    "finite": 0.005762315820902586
+  },
+  {
+    "step": 700,
+    "loss": 1.2464351654052734,
+    "diagonal": 1.242864727973938,
+    "finite": 0.0035704371985048056
+  },
+  {
+    "step": 701,
+    "loss": 1.5211256742477417,
+    "diagonal": 1.5180554389953613,
+    "finite": 0.0030702329240739346
+  },
+  {
+    "step": 702,
+    "loss": 1.3491379022598267,
+    "diagonal": 1.3376327753067017,
+    "finite": 0.011505180038511753
+  },
+  {
+    "step": 703,
+    "loss": 1.5091922283172607,
+    "diagonal": 1.5054537057876587,
+    "finite": 0.0037384883034974337
+  },
+  {
+    "step": 704,
+    "loss": 1.4498220682144165,
+    "diagonal": 1.4423611164093018,
+    "finite": 0.007460989523679018
+  },
+  {
+    "step": 705,
+    "loss": 1.2977426052093506,
+    "diagonal": 1.2896109819412231,
+    "finite": 0.008131586015224457
+  },
+  {
+    "step": 706,
+    "loss": 1.473293662071228,
+    "diagonal": 1.4666073322296143,
+    "finite": 0.006686272099614143
+  },
+  {
+    "step": 707,
+    "loss": 1.5628081560134888,
+    "diagonal": 1.5567426681518555,
+    "finite": 0.0060654496774077415
+  },
+  {
+    "step": 708,
+    "loss": 1.5840153694152832,
+    "diagonal": 1.5722731351852417,
+    "finite": 0.011742262169718742
+  },
+  {
+    "step": 709,
+    "loss": 1.9242783784866333,
+    "diagonal": 1.9156025648117065,
+    "finite": 0.008675779215991497
+  },
+  {
+    "step": 710,
+    "loss": 1.5279738903045654,
+    "diagonal": 1.5198613405227661,
+    "finite": 0.008112597279250622
+  },
+  {
+    "step": 711,
+    "loss": 1.5623104572296143,
+    "diagonal": 1.5548291206359863,
+    "finite": 0.007481393404304981
+  },
+  {
+    "step": 712,
+    "loss": 1.2001638412475586,
+    "diagonal": 1.1844019889831543,
+    "finite": 0.015761876478791237
+  },
+  {
+    "step": 713,
+    "loss": 1.5138468742370605,
+    "diagonal": 1.4941937923431396,
+    "finite": 0.01965312473475933
+  },
+  {
+    "step": 714,
+    "loss": 1.7950904369354248,
+    "diagonal": 1.7806921005249023,
+    "finite": 0.014398304745554924
+  },
+  {
+    "step": 715,
+    "loss": 1.331505298614502,
+    "diagonal": 1.3242589235305786,
+    "finite": 0.0072463443502783775
+  },
+  {
+    "step": 716,
+    "loss": 1.4285253286361694,
+    "diagonal": 1.423234462738037,
+    "finite": 0.0052908072248101234
+  },
+  {
+    "step": 717,
+    "loss": 1.6366299390792847,
+    "diagonal": 1.6291154623031616,
+    "finite": 0.0075144278816878796
+  },
+  {
+    "step": 718,
+    "loss": 1.514712929725647,
+    "diagonal": 1.5107966661453247,
+    "finite": 0.003916288260370493
+  },
+  {
+    "step": 719,
+    "loss": 1.7355800867080688,
+    "diagonal": 1.7294543981552124,
+    "finite": 0.006125695537775755
+  },
+  {
+    "step": 720,
+    "loss": 1.7723369598388672,
+    "diagonal": 1.7692304849624634,
+    "finite": 0.003106446238234639
+  },
+  {
+    "step": 721,
+    "loss": 1.5635565519332886,
+    "diagonal": 1.5589768886566162,
+    "finite": 0.004579661414027214
+  },
+  {
+    "step": 722,
+    "loss": 1.4042447805404663,
+    "diagonal": 1.4005579948425293,
+    "finite": 0.0036867959424853325
+  },
+  {
+    "step": 723,
+    "loss": 1.601273775100708,
+    "diagonal": 1.5945160388946533,
+    "finite": 0.006757756695151329
+  },
+  {
+    "step": 724,
+    "loss": 1.4966813325881958,
+    "diagonal": 1.4925273656845093,
+    "finite": 0.004153940360993147
+  },
+  {
+    "step": 725,
+    "loss": 1.6516300439834595,
+    "diagonal": 1.6456965208053589,
+    "finite": 0.00593355530872941
+  },
+  {
+    "step": 726,
+    "loss": 1.4843922853469849,
+    "diagonal": 1.478222370147705,
+    "finite": 0.006169936154037714
+  },
+  {
+    "step": 727,
+    "loss": 1.444123387336731,
+    "diagonal": 1.4392980337142944,
+    "finite": 0.00482539925724268
+  },
+  {
+    "step": 728,
+    "loss": 1.6280213594436646,
+    "diagonal": 1.6252634525299072,
+    "finite": 0.0027579511515796185
+  },
+  {
+    "step": 729,
+    "loss": 1.335660457611084,
+    "diagonal": 1.3308382034301758,
+    "finite": 0.004822264891117811
+  },
+  {
+    "step": 730,
+    "loss": 1.5118942260742188,
+    "diagonal": 1.5059802532196045,
+    "finite": 0.005914020352065563
+  },
+  {
+    "step": 731,
+    "loss": 1.4667304754257202,
+    "diagonal": 1.463758945465088,
+    "finite": 0.0029715143609791994
+  },
+  {
+    "step": 732,
+    "loss": 1.2189303636550903,
+    "diagonal": 1.2102429866790771,
+    "finite": 0.008687363937497139
+  },
+  {
+    "step": 733,
+    "loss": 1.2176331281661987,
+    "diagonal": 1.2146780490875244,
+    "finite": 0.0029550741892307997
+  },
+  {
+    "step": 734,
+    "loss": 1.755366563796997,
+    "diagonal": 1.7522635459899902,
+    "finite": 0.0031029810197651386
+  },
+  {
+    "step": 735,
+    "loss": 1.7316346168518066,
+    "diagonal": 1.729607343673706,
+    "finite": 0.0020273111294955015
+  },
+  {
+    "step": 736,
+    "loss": 1.38866126537323,
+    "diagonal": 1.3854546546936035,
+    "finite": 0.0032065855339169502
+  },
+  {
+    "step": 737,
+    "loss": 1.5713868141174316,
+    "diagonal": 1.5676363706588745,
+    "finite": 0.0037504241336137056
+  },
+  {
+    "step": 738,
+    "loss": 1.7555347681045532,
+    "diagonal": 1.7523692846298218,
+    "finite": 0.0031654962804168463
+  },
+  {
+    "step": 739,
+    "loss": 2.0349650382995605,
+    "diagonal": 2.0327699184417725,
+    "finite": 0.002195123117417097
+  },
+  {
+    "step": 740,
+    "loss": 1.5752655267715454,
+    "diagonal": 1.5676215887069702,
+    "finite": 0.007643980905413628
+  },
+  {
+    "step": 741,
+    "loss": 1.5629113912582397,
+    "diagonal": 1.5533796548843384,
+    "finite": 0.009531766176223755
+  },
+  {
+    "step": 742,
+    "loss": 1.3122154474258423,
+    "diagonal": 1.3079979419708252,
+    "finite": 0.004217479843646288
+  },
+  {
+    "step": 743,
+    "loss": 1.82476806640625,
+    "diagonal": 1.8181571960449219,
+    "finite": 0.0066109006293118
+  },
+  {
+    "step": 744,
+    "loss": 1.37912917137146,
+    "diagonal": 1.3736222982406616,
+    "finite": 0.005506829358637333
+  },
+  {
+    "step": 745,
+    "loss": 1.5132380723953247,
+    "diagonal": 1.509010672569275,
+    "finite": 0.004227391444146633
+  },
+  {
+    "step": 746,
+    "loss": 1.8192164897918701,
+    "diagonal": 1.8081858158111572,
+    "finite": 0.011030717752873898
+  },
+  {
+    "step": 747,
+    "loss": 1.6529914140701294,
+    "diagonal": 1.6406264305114746,
+    "finite": 0.012364967726171017
+  },
+  {
+    "step": 748,
+    "loss": 1.6064472198486328,
+    "diagonal": 1.6012234687805176,
+    "finite": 0.0052237315103411674
+  },
+  {
+    "step": 749,
+    "loss": 1.3087512254714966,
+    "diagonal": 1.3014808893203735,
+    "finite": 0.007270277943462133
+  },
+  {
+    "step": 750,
+    "loss": 1.5548479557037354,
+    "diagonal": 1.5490976572036743,
+    "finite": 0.005750254262238741
+  },
+  {
+    "step": 751,
+    "loss": 1.3868831396102905,
+    "diagonal": 1.3800747394561768,
+    "finite": 0.006808368489146233
+  },
+  {
+    "step": 752,
+    "loss": 1.6864389181137085,
+    "diagonal": 1.6765267848968506,
+    "finite": 0.009912153705954552
+  },
+  {
+    "step": 753,
+    "loss": 2.0470800399780273,
+    "diagonal": 2.0436015129089355,
+    "finite": 0.003478566650301218
+  },
+  {
+    "step": 754,
+    "loss": 1.8053693771362305,
+    "diagonal": 1.800649642944336,
+    "finite": 0.004719700664281845
+  },
+  {
+    "step": 755,
+    "loss": 1.3359349966049194,
+    "diagonal": 1.3320033550262451,
+    "finite": 0.003931636922061443
+  },
+  {
+    "step": 756,
+    "loss": 1.196877121925354,
+    "diagonal": 1.191908836364746,
+    "finite": 0.004968254826962948
+  },
+  {
+    "step": 757,
+    "loss": 1.146091341972351,
+    "diagonal": 1.1437687873840332,
+    "finite": 0.0023225077893584967
+  },
+  {
+    "step": 758,
+    "loss": 1.2836333513259888,
+    "diagonal": 1.2807306051254272,
+    "finite": 0.0029027299024164677
+  },
+  {
+    "step": 759,
+    "loss": 1.4648995399475098,
+    "diagonal": 1.4618810415267944,
+    "finite": 0.0030184665229171515
+  },
+  {
+    "step": 760,
+    "loss": 1.2096035480499268,
+    "diagonal": 1.2060271501541138,
+    "finite": 0.0035763680934906006
+  },
+  {
+    "step": 761,
+    "loss": 1.2968519926071167,
+    "diagonal": 1.289612054824829,
+    "finite": 0.00723991496488452
+  },
+  {
+    "step": 762,
+    "loss": 1.5008807182312012,
+    "diagonal": 1.4946202039718628,
+    "finite": 0.006260556168854237
+  },
+  {
+    "step": 763,
+    "loss": 1.7515579462051392,
+    "diagonal": 1.7477991580963135,
+    "finite": 0.003758754814043641
+  },
+  {
+    "step": 764,
+    "loss": 1.7435195446014404,
+    "diagonal": 1.7390735149383545,
+    "finite": 0.004446079954504967
+  },
+  {
+    "step": 765,
+    "loss": 1.7362555265426636,
+    "diagonal": 1.7294440269470215,
+    "finite": 0.006811461877077818
+  },
+  {
+    "step": 766,
+    "loss": 1.6688947677612305,
+    "diagonal": 1.6630760431289673,
+    "finite": 0.005818783305585384
+  },
+  {
+    "step": 767,
+    "loss": 1.4118144512176514,
+    "diagonal": 1.4053276777267456,
+    "finite": 0.00648683262988925
+  },
+  {
+    "step": 768,
+    "loss": 1.5332176685333252,
+    "diagonal": 1.5270589590072632,
+    "finite": 0.006158655509352684
+  },
+  {
+    "step": 769,
+    "loss": 1.5291602611541748,
+    "diagonal": 1.5213286876678467,
+    "finite": 0.007831583730876446
+  },
+  {
+    "step": 770,
+    "loss": 1.5448036193847656,
+    "diagonal": 1.5367605686187744,
+    "finite": 0.008043046109378338
+  },
+  {
+    "step": 771,
+    "loss": 1.4555662870407104,
+    "diagonal": 1.4521174430847168,
+    "finite": 0.003448875853791833
+  },
+  {
+    "step": 772,
+    "loss": 1.5502350330352783,
+    "diagonal": 1.5439541339874268,
+    "finite": 0.006280876230448484
+  },
+  {
+    "step": 773,
+    "loss": 1.07871413230896,
+    "diagonal": 1.0744304656982422,
+    "finite": 0.004283673129975796
+  },
+  {
+    "step": 774,
+    "loss": 1.688620686531067,
+    "diagonal": 1.6848491430282593,
+    "finite": 0.00377148506231606
+  },
+  {
+    "step": 775,
+    "loss": 1.7645431756973267,
+    "diagonal": 1.761549472808838,
+    "finite": 0.00299370801076293
+  },
+  {
+    "step": 776,
+    "loss": 1.5327401161193848,
+    "diagonal": 1.5222184658050537,
+    "finite": 0.010521609336137772
+  },
+  {
+    "step": 777,
+    "loss": 1.5114551782608032,
+    "diagonal": 1.4928562641143799,
+    "finite": 0.018598971888422966
+  },
+  {
+    "step": 778,
+    "loss": 1.439256191253662,
+    "diagonal": 1.4324625730514526,
+    "finite": 0.006793628446757793
+  },
+  {
+    "step": 779,
+    "loss": 1.3867837190628052,
+    "diagonal": 1.3828098773956299,
+    "finite": 0.00397378858178854
+  },
+  {
+    "step": 780,
+    "loss": 1.2741209268569946,
+    "diagonal": 1.2686231136322021,
+    "finite": 0.005497856996953487
+  },
+  {
+    "step": 781,
+    "loss": 1.590815782546997,
+    "diagonal": 1.5823291540145874,
+    "finite": 0.008486646227538586
+  },
+  {
+    "step": 782,
+    "loss": 1.5142077207565308,
+    "diagonal": 1.5069894790649414,
+    "finite": 0.0072182659059762955
+  },
+  {
+    "step": 783,
+    "loss": 1.1527917385101318,
+    "diagonal": 1.1482785940170288,
+    "finite": 0.004513116087764502
+  },
+  {
+    "step": 784,
+    "loss": 1.4317668676376343,
+    "diagonal": 1.428713083267212,
+    "finite": 0.0030538360588252544
+  },
+  {
+    "step": 785,
+    "loss": 1.5272892713546753,
+    "diagonal": 1.5233796834945679,
+    "finite": 0.003909644205123186
+  },
+  {
+    "step": 786,
+    "loss": 1.3322099447250366,
+    "diagonal": 1.3254601955413818,
+    "finite": 0.006749699357897043
+  },
+  {
+    "step": 787,
+    "loss": 1.2542647123336792,
+    "diagonal": 1.2494169473648071,
+    "finite": 0.004847721196711063
+  },
+  {
+    "step": 788,
+    "loss": 1.383207082748413,
+    "diagonal": 1.371893048286438,
+    "finite": 0.011314020492136478
+  },
+  {
+    "step": 789,
+    "loss": 1.4543627500534058,
+    "diagonal": 1.4503040313720703,
+    "finite": 0.00405868561938405
+  },
+  {
+    "step": 790,
+    "loss": 1.3853180408477783,
+    "diagonal": 1.381719708442688,
+    "finite": 0.0035983878187835217
+  },
+  {
+    "step": 791,
+    "loss": 1.4788792133331299,
+    "diagonal": 1.4742810726165771,
+    "finite": 0.0045981756411492825
+  },
+  {
+    "step": 792,
+    "loss": 1.7095677852630615,
+    "diagonal": 1.7051563262939453,
+    "finite": 0.004411504603922367
+  },
+  {
+    "step": 793,
+    "loss": 1.2674472332000732,
+    "diagonal": 1.2624704837799072,
+    "finite": 0.004976705648005009
+  },
+  {
+    "step": 794,
+    "loss": 2.031142234802246,
+    "diagonal": 2.0242650508880615,
+    "finite": 0.006877179257571697
+  },
+  {
+    "step": 795,
+    "loss": 1.6000487804412842,
+    "diagonal": 1.5867117643356323,
+    "finite": 0.013337007723748684
+  },
+  {
+    "step": 796,
+    "loss": 1.616507887840271,
+    "diagonal": 1.6106091737747192,
+    "finite": 0.0058986721560359
+  },
+  {
+    "step": 797,
+    "loss": 1.875638484954834,
+    "diagonal": 1.8727329969406128,
+    "finite": 0.002905444474890828
+  },
+  {
+    "step": 798,
+    "loss": 1.6212525367736816,
+    "diagonal": 1.6168866157531738,
+    "finite": 0.004365915898233652
+  },
+  {
+    "step": 799,
+    "loss": 1.4509044885635376,
+    "diagonal": 1.4468592405319214,
+    "finite": 0.004045227542519569
+  },
+  {
+    "step": 800,
+    "loss": 1.5660184621810913,
+    "diagonal": 1.561271071434021,
+    "finite": 0.004747403785586357
+  },
+  {
+    "step": 801,
+    "loss": 1.3778903484344482,
+    "diagonal": 1.3652431964874268,
+    "finite": 0.012647158466279507
+  },
+  {
+    "step": 802,
+    "loss": 1.6945044994354248,
+    "diagonal": 1.687487244606018,
+    "finite": 0.007017230615019798
+  },
+  {
+    "step": 803,
+    "loss": 1.561575174331665,
+    "diagonal": 1.5572969913482666,
+    "finite": 0.004278128035366535
+  },
+  {
+    "step": 804,
+    "loss": 1.3971848487854004,
+    "diagonal": 1.3934087753295898,
+    "finite": 0.003776094177737832
+  },
+  {
+    "step": 805,
+    "loss": 1.5314558744430542,
+    "diagonal": 1.5258567333221436,
+    "finite": 0.005599166266620159
+  },
+  {
+    "step": 806,
+    "loss": 1.5245988368988037,
+    "diagonal": 1.518799066543579,
+    "finite": 0.005799790378659964
+  },
+  {
+    "step": 807,
+    "loss": 1.417880654335022,
+    "diagonal": 1.408676266670227,
+    "finite": 0.00920441560447216
+  },
+  {
+    "step": 808,
+    "loss": 1.6168709993362427,
+    "diagonal": 1.607435703277588,
+    "finite": 0.009435308165848255
+  },
+  {
+    "step": 809,
+    "loss": 1.529078722000122,
+    "diagonal": 1.522498369216919,
+    "finite": 0.0065803490579128265
+  },
+  {
+    "step": 810,
+    "loss": 1.5110833644866943,
+    "diagonal": 1.503293752670288,
+    "finite": 0.007789600174874067
+  },
+  {
+    "step": 811,
+    "loss": 1.53794264793396,
+    "diagonal": 1.532349944114685,
+    "finite": 0.00559271452948451
+  },
+  {
+    "step": 812,
+    "loss": 1.4495012760162354,
+    "diagonal": 1.444162130355835,
+    "finite": 0.00533909210935235
+  },
+  {
+    "step": 813,
+    "loss": 1.6912585496902466,
+    "diagonal": 1.6863425970077515,
+    "finite": 0.004915972240269184
+  },
+  {
+    "step": 814,
+    "loss": 1.3824630975723267,
+    "diagonal": 1.3776493072509766,
+    "finite": 0.0048138233833014965
+  },
+  {
+    "step": 815,
+    "loss": 1.4599032402038574,
+    "diagonal": 1.4540945291519165,
+    "finite": 0.00580865703523159
+  },
+  {
+    "step": 816,
+    "loss": 1.7923731803894043,
+    "diagonal": 1.7847726345062256,
+    "finite": 0.007600598037242889
+  },
+  {
+    "step": 817,
+    "loss": 1.4643535614013672,
+    "diagonal": 1.4584388732910156,
+    "finite": 0.005914654582738876
+  },
+  {
+    "step": 818,
+    "loss": 1.5184659957885742,
+    "diagonal": 1.5125863552093506,
+    "finite": 0.00587969645857811
+  },
+  {
+    "step": 819,
+    "loss": 1.5217403173446655,
+    "diagonal": 1.5143674612045288,
+    "finite": 0.007372855208814144
+  },
+  {
+    "step": 820,
+    "loss": 1.5100034475326538,
+    "diagonal": 1.5018311738967896,
+    "finite": 0.008172279223799706
+  },
+  {
+    "step": 821,
+    "loss": 1.6516070365905762,
+    "diagonal": 1.6413474082946777,
+    "finite": 0.010259687900543213
+  },
+  {
+    "step": 822,
+    "loss": 1.6568655967712402,
+    "diagonal": 1.6492629051208496,
+    "finite": 0.007602653466165066
+  },
+  {
+    "step": 823,
+    "loss": 1.5949301719665527,
+    "diagonal": 1.5868711471557617,
+    "finite": 0.008059064857661724
+  },
+  {
+    "step": 824,
+    "loss": 1.6442123651504517,
+    "diagonal": 1.6312224864959717,
+    "finite": 0.012989872135221958
+  },
+  {
+    "step": 825,
+    "loss": 1.5700502395629883,
+    "diagonal": 1.5627979040145874,
+    "finite": 0.00725236302241683
+  },
+  {
+    "step": 826,
+    "loss": 1.3197499513626099,
+    "diagonal": 1.313868522644043,
+    "finite": 0.005881388671696186
+  },
+  {
+    "step": 827,
+    "loss": 1.333032250404358,
+    "diagonal": 1.324566125869751,
+    "finite": 0.008466174826025963
+  },
+  {
+    "step": 828,
+    "loss": 1.2987542152404785,
+    "diagonal": 1.2925673723220825,
+    "finite": 0.0061868345364928246
+  },
+  {
+    "step": 829,
+    "loss": 1.3074244260787964,
+    "diagonal": 1.2999179363250732,
+    "finite": 0.007506485562771559
+  },
+  {
+    "step": 830,
+    "loss": 1.9015328884124756,
+    "diagonal": 1.8949649333953857,
+    "finite": 0.006567981094121933
+  },
+  {
+    "step": 831,
+    "loss": 1.2685213088989258,
+    "diagonal": 1.2532912492752075,
+    "finite": 0.0152300288900733
+  },
+  {
+    "step": 832,
+    "loss": 1.4294227361679077,
+    "diagonal": 1.4206806421279907,
+    "finite": 0.00874203909188509
+  },
+  {
+    "step": 833,
+    "loss": 1.545538306236267,
+    "diagonal": 1.5378533601760864,
+    "finite": 0.0076849996112287045
+  },
+  {
+    "step": 834,
+    "loss": 1.6236668825149536,
+    "diagonal": 1.6142983436584473,
+    "finite": 0.009368518367409706
+  },
+  {
+    "step": 835,
+    "loss": 1.6028823852539062,
+    "diagonal": 1.5950647592544556,
+    "finite": 0.007817652076482773
+  },
+  {
+    "step": 836,
+    "loss": 1.7497519254684448,
+    "diagonal": 1.7440040111541748,
+    "finite": 0.005747918970882893
+  },
+  {
+    "step": 837,
+    "loss": 1.471675157546997,
+    "diagonal": 1.465673565864563,
+    "finite": 0.006001626141369343
+  },
+  {
+    "step": 838,
+    "loss": 1.5550168752670288,
+    "diagonal": 1.5409491062164307,
+    "finite": 0.014067775569856167
+  },
+  {
+    "step": 839,
+    "loss": 1.8915419578552246,
+    "diagonal": 1.888790488243103,
+    "finite": 0.002751502674072981
+  },
+  {
+    "step": 840,
+    "loss": 1.5329830646514893,
+    "diagonal": 1.5293253660202026,
+    "finite": 0.00365772214718163
+  },
+  {
+    "step": 841,
+    "loss": 1.2386515140533447,
+    "diagonal": 1.234345555305481,
+    "finite": 0.004306000657379627
+  },
+  {
+    "step": 842,
+    "loss": 1.4295564889907837,
+    "diagonal": 1.4205516576766968,
+    "finite": 0.009004808962345123
+  },
+  {
+    "step": 843,
+    "loss": 1.639985203742981,
+    "diagonal": 1.6314561367034912,
+    "finite": 0.008529017679393291
+  },
+  {
+    "step": 844,
+    "loss": 1.5107038021087646,
+    "diagonal": 1.5032131671905518,
+    "finite": 0.007490592543035746
+  },
+  {
+    "step": 845,
+    "loss": 1.612357258796692,
+    "diagonal": 1.5893001556396484,
+    "finite": 0.023057064041495323
+  },
+  {
+    "step": 846,
+    "loss": 1.3036293983459473,
+    "diagonal": 1.2912489175796509,
+    "finite": 0.01238048542290926
+  },
+  {
+    "step": 847,
+    "loss": 1.7494069337844849,
+    "diagonal": 1.7404881715774536,
+    "finite": 0.008918756619095802
+  },
+  {
+    "step": 848,
+    "loss": 1.5533608198165894,
+    "diagonal": 1.5394303798675537,
+    "finite": 0.013930413872003555
+  },
+  {
+    "step": 849,
+    "loss": 1.161063313484192,
+    "diagonal": 1.1526395082473755,
+    "finite": 0.008423861116170883
+  },
+  {
+    "step": 850,
+    "loss": 1.5073027610778809,
+    "diagonal": 1.4973517656326294,
+    "finite": 0.009951035492122173
+  },
+  {
+    "step": 851,
+    "loss": 1.66825270652771,
+    "diagonal": 1.664258360862732,
+    "finite": 0.003994323313236237
+  },
+  {
+    "step": 852,
+    "loss": 1.6787461042404175,
+    "diagonal": 1.674921989440918,
+    "finite": 0.0038241432048380375
+  },
+  {
+    "step": 853,
+    "loss": 1.5677342414855957,
+    "diagonal": 1.565252423286438,
+    "finite": 0.0024818233214318752
+  },
+  {
+    "step": 854,
+    "loss": 1.4997503757476807,
+    "diagonal": 1.49642014503479,
+    "finite": 0.003330221166834235
+  },
+  {
+    "step": 855,
+    "loss": 1.1693754196166992,
+    "diagonal": 1.1643354892730713,
+    "finite": 0.005039873532950878
+  },
+  {
+    "step": 856,
+    "loss": 1.2970428466796875,
+    "diagonal": 1.2940576076507568,
+    "finite": 0.0029852206353098154
+  },
+  {
+    "step": 857,
+    "loss": 1.358042597770691,
+    "diagonal": 1.3506022691726685,
+    "finite": 0.007440367713570595
+  },
+  {
+    "step": 858,
+    "loss": 1.3868926763534546,
+    "diagonal": 1.3804807662963867,
+    "finite": 0.0064119272865355015
+  },
+  {
+    "step": 859,
+    "loss": 1.5167657136917114,
+    "diagonal": 1.5113677978515625,
+    "finite": 0.0053979577496647835
+  },
+  {
+    "step": 860,
+    "loss": 1.667053461074829,
+    "diagonal": 1.6600714921951294,
+    "finite": 0.006982019171118736
+  },
+  {
+    "step": 861,
+    "loss": 1.2861682176589966,
+    "diagonal": 1.278298258781433,
+    "finite": 0.007869943976402283
+  },
+  {
+    "step": 862,
+    "loss": 1.6984909772872925,
+    "diagonal": 1.6919959783554077,
+    "finite": 0.0064949700608849525
+  },
+  {
+    "step": 863,
+    "loss": 1.4869508743286133,
+    "diagonal": 1.4831256866455078,
+    "finite": 0.0038251453079283237
+  },
+  {
+    "step": 864,
+    "loss": 1.6080799102783203,
+    "diagonal": 1.6042667627334595,
+    "finite": 0.003813154296949506
+  },
+  {
+    "step": 865,
+    "loss": 1.194663643836975,
+    "diagonal": 1.189211130142212,
+    "finite": 0.005452469456940889
+  },
+  {
+    "step": 866,
+    "loss": 1.853153944015503,
+    "diagonal": 1.8506150245666504,
+    "finite": 0.00253896857611835
+  },
+  {
+    "step": 867,
+    "loss": 1.6560649871826172,
+    "diagonal": 1.6535418033599854,
+    "finite": 0.002523188479244709
+  },
+  {
+    "step": 868,
+    "loss": 1.4827662706375122,
+    "diagonal": 1.480452299118042,
+    "finite": 0.002313947305083275
+  },
+  {
+    "step": 869,
+    "loss": 1.6527163982391357,
+    "diagonal": 1.647721767425537,
+    "finite": 0.004994662012904882
+  },
+  {
+    "step": 870,
+    "loss": 1.632307529449463,
+    "diagonal": 1.627270221710205,
+    "finite": 0.005037346854805946
+  },
+  {
+    "step": 871,
+    "loss": 1.7367726564407349,
+    "diagonal": 1.7313014268875122,
+    "finite": 0.005471203941851854
+  },
+  {
+    "step": 872,
+    "loss": 1.272294521331787,
+    "diagonal": 1.2686090469360352,
+    "finite": 0.003685509553179145
+  },
+  {
+    "step": 873,
+    "loss": 1.2557979822158813,
+    "diagonal": 1.25151789188385,
+    "finite": 0.004280063323676586
+  },
+  {
+    "step": 874,
+    "loss": 1.3226463794708252,
+    "diagonal": 1.317048192024231,
+    "finite": 0.0055982074700295925
+  },
+  {
+    "step": 875,
+    "loss": 1.5057611465454102,
+    "diagonal": 1.5009498596191406,
+    "finite": 0.004811335355043411
+  },
+  {
+    "step": 876,
+    "loss": 1.4183423519134521,
+    "diagonal": 1.4160147905349731,
+    "finite": 0.0023275031708180904
+  },
+  {
+    "step": 877,
+    "loss": 1.6745777130126953,
+    "diagonal": 1.670975685119629,
+    "finite": 0.0036019706167280674
+  },
+  {
+    "step": 878,
+    "loss": 1.3099939823150635,
+    "diagonal": 1.305485725402832,
+    "finite": 0.004508299753069878
+  },
+  {
+    "step": 879,
+    "loss": 1.6040586233139038,
+    "diagonal": 1.6000791788101196,
+    "finite": 0.003979473374783993
+  },
+  {
+    "step": 880,
+    "loss": 1.650713324546814,
+    "diagonal": 1.6402027606964111,
+    "finite": 0.010510548949241638
+  },
+  {
+    "step": 881,
+    "loss": 1.6071003675460815,
+    "diagonal": 1.597506046295166,
+    "finite": 0.009594290517270565
+  },
+  {
+    "step": 882,
+    "loss": 2.1616456508636475,
+    "diagonal": 2.158897638320923,
+    "finite": 0.00274789915420115
+  },
+  {
+    "step": 883,
+    "loss": 1.5868571996688843,
+    "diagonal": 1.5826783180236816,
+    "finite": 0.004178873263299465
+  },
+  {
+    "step": 884,
+    "loss": 1.4442238807678223,
+    "diagonal": 1.4413518905639648,
+    "finite": 0.00287200091406703
+  },
+  {
+    "step": 885,
+    "loss": 1.5416284799575806,
+    "diagonal": 1.5375200510025024,
+    "finite": 0.004108436871320009
+  },
+  {
+    "step": 886,
+    "loss": 1.4363133907318115,
+    "diagonal": 1.428629755973816,
+    "finite": 0.007683656644076109
+  },
+  {
+    "step": 887,
+    "loss": 1.5122637748718262,
+    "diagonal": 1.503092646598816,
+    "finite": 0.009171112440526485
+  },
+  {
+    "step": 888,
+    "loss": 1.4667534828186035,
+    "diagonal": 1.4639308452606201,
+    "finite": 0.0028226952999830246
+  },
+  {
+    "step": 889,
+    "loss": 1.4818240404129028,
+    "diagonal": 1.4785306453704834,
+    "finite": 0.003293367102742195
+  },
+  {
+    "step": 890,
+    "loss": 1.3904436826705933,
+    "diagonal": 1.3886123895645142,
+    "finite": 0.0018312984611839056
+  },
+  {
+    "step": 891,
+    "loss": 1.710620403289795,
+    "diagonal": 1.7042713165283203,
+    "finite": 0.0063490793108940125
+  },
+  {
+    "step": 892,
+    "loss": 1.5208630561828613,
+    "diagonal": 1.5177627801895142,
+    "finite": 0.003100276691839099
+  },
+  {
+    "step": 893,
+    "loss": 1.6105376482009888,
+    "diagonal": 1.6078462600708008,
+    "finite": 0.0026913932524621487
+  },
+  {
+    "step": 894,
+    "loss": 1.3019942045211792,
+    "diagonal": 1.2940707206726074,
+    "finite": 0.007923506200313568
+  },
+  {
+    "step": 895,
+    "loss": 1.5457030534744263,
+    "diagonal": 1.5419111251831055,
+    "finite": 0.0037919660098850727
+  },
+  {
+    "step": 896,
+    "loss": 1.8153834342956543,
+    "diagonal": 1.8086451292037964,
+    "finite": 0.006738272495567799
+  },
+  {
+    "step": 897,
+    "loss": 1.5049121379852295,
+    "diagonal": 1.4996678829193115,
+    "finite": 0.005244231317192316
+  },
+  {
+    "step": 898,
+    "loss": 1.665323257446289,
+    "diagonal": 1.660146713256836,
+    "finite": 0.005176595412194729
+  },
+  {
+    "step": 899,
+    "loss": 1.6601976156234741,
+    "diagonal": 1.6542742252349854,
+    "finite": 0.005923369899392128
+  },
+  {
+    "step": 900,
+    "loss": 1.6888351440429688,
+    "diagonal": 1.6857941150665283,
+    "finite": 0.003041028743609786
+  },
+  {
+    "step": 901,
+    "loss": 1.4285647869110107,
+    "diagonal": 1.416311264038086,
+    "finite": 0.012253517284989357
+  },
+  {
+    "step": 902,
+    "loss": 1.14337956905365,
+    "diagonal": 1.1327502727508545,
+    "finite": 0.010629243217408657
+  },
+  {
+    "step": 903,
+    "loss": 1.5120257139205933,
+    "diagonal": 1.508819818496704,
+    "finite": 0.003205948043614626
+  },
+  {
+    "step": 904,
+    "loss": 1.2951236963272095,
+    "diagonal": 1.2912706136703491,
+    "finite": 0.003853137604892254
+  },
+  {
+    "step": 905,
+    "loss": 1.4508295059204102,
+    "diagonal": 1.447066068649292,
+    "finite": 0.0037634102627635
+  },
+  {
+    "step": 906,
+    "loss": 1.703402042388916,
+    "diagonal": 1.6975022554397583,
+    "finite": 0.00589975668117404
+  },
+  {
+    "step": 907,
+    "loss": 1.9109077453613281,
+    "diagonal": 1.9069161415100098,
+    "finite": 0.003991630859673023
+  },
+  {
+    "step": 908,
+    "loss": 1.3622114658355713,
+    "diagonal": 1.355987787246704,
+    "finite": 0.006223669275641441
+  },
+  {
+    "step": 909,
+    "loss": 1.3352667093276978,
+    "diagonal": 1.3317580223083496,
+    "finite": 0.003508674679324031
+  },
+  {
+    "step": 910,
+    "loss": 1.5745525360107422,
+    "diagonal": 1.5707972049713135,
+    "finite": 0.003755356417968869
+  },
+  {
+    "step": 911,
+    "loss": 1.558245301246643,
+    "diagonal": 1.5535740852355957,
+    "finite": 0.0046712253242731094
+  },
+  {
+    "step": 912,
+    "loss": 1.7848193645477295,
+    "diagonal": 1.7792197465896606,
+    "finite": 0.005599590018391609
+  },
+  {
+    "step": 913,
+    "loss": 1.626926302909851,
+    "diagonal": 1.620924711227417,
+    "finite": 0.006001564674079418
+  },
+  {
+    "step": 914,
+    "loss": 1.6194748878479004,
+    "diagonal": 1.6132094860076904,
+    "finite": 0.006265363190323114
+  },
+  {
+    "step": 915,
+    "loss": 1.5389962196350098,
+    "diagonal": 1.534384846687317,
+    "finite": 0.004611357115209103
+  },
+  {
+    "step": 916,
+    "loss": 1.625514030456543,
+    "diagonal": 1.6199275255203247,
+    "finite": 0.005586498882621527
+  },
+  {
+    "step": 917,
+    "loss": 1.3165035247802734,
+    "diagonal": 1.305641770362854,
+    "finite": 0.010861794464290142
+  },
+  {
+    "step": 918,
+    "loss": 1.4661465883255005,
+    "diagonal": 1.4567070007324219,
+    "finite": 0.009439613670110703
+  },
+  {
+    "step": 919,
+    "loss": 1.5511534214019775,
+    "diagonal": 1.5408023595809937,
+    "finite": 0.01035105437040329
+  },
+  {
+    "step": 920,
+    "loss": 1.5113669633865356,
+    "diagonal": 1.5067627429962158,
+    "finite": 0.0046042040921747684
+  },
+  {
+    "step": 921,
+    "loss": 1.4338490962982178,
+    "diagonal": 1.4291741847991943,
+    "finite": 0.004674934782087803
+  },
+  {
+    "step": 922,
+    "loss": 1.5283502340316772,
+    "diagonal": 1.5120437145233154,
+    "finite": 0.01630655862390995
+  },
+  {
+    "step": 923,
+    "loss": 2.048530340194702,
+    "diagonal": 2.043703079223633,
+    "finite": 0.004827179480344057
+  },
+  {
+    "step": 924,
+    "loss": 1.4823237657546997,
+    "diagonal": 1.4775174856185913,
+    "finite": 0.004806234501302242
+  },
+  {
+    "step": 925,
+    "loss": 1.2096655368804932,
+    "diagonal": 1.2015289068222046,
+    "finite": 0.008136572316288948
+  },
+  {
+    "step": 926,
+    "loss": 1.442920446395874,
+    "diagonal": 1.43583345413208,
+    "finite": 0.007086988538503647
+  },
+  {
+    "step": 927,
+    "loss": 1.4986945390701294,
+    "diagonal": 1.4941378831863403,
+    "finite": 0.004556672181934118
+  },
+  {
+    "step": 928,
+    "loss": 1.675721526145935,
+    "diagonal": 1.6666821241378784,
+    "finite": 0.009039398282766342
+  },
+  {
+    "step": 929,
+    "loss": 1.2259557247161865,
+    "diagonal": 1.2192881107330322,
+    "finite": 0.006667609792202711
+  },
+  {
+    "step": 930,
+    "loss": 1.4029768705368042,
+    "diagonal": 1.3947539329528809,
+    "finite": 0.0082229133695364
+  },
+  {
+    "step": 931,
+    "loss": 1.5165371894836426,
+    "diagonal": 1.5057995319366455,
+    "finite": 0.010737677104771137
+  },
+  {
+    "step": 932,
+    "loss": 1.584824562072754,
+    "diagonal": 1.57797372341156,
+    "finite": 0.006850799545645714
+  },
+  {
+    "step": 933,
+    "loss": 1.3258769512176514,
+    "diagonal": 1.319597840309143,
+    "finite": 0.006279096007347107
+  },
+  {
+    "step": 934,
+    "loss": 1.43753182888031,
+    "diagonal": 1.4328672885894775,
+    "finite": 0.004664565436542034
+  },
+  {
+    "step": 935,
+    "loss": 1.4552052021026611,
+    "diagonal": 1.4473836421966553,
+    "finite": 0.007821524515748024
+  },
+  {
+    "step": 936,
+    "loss": 1.40804922580719,
+    "diagonal": 1.4039596319198608,
+    "finite": 0.004089553374797106
+  },
+  {
+    "step": 937,
+    "loss": 1.635512351989746,
+    "diagonal": 1.6283674240112305,
+    "finite": 0.007144900970160961
+  },
+  {
+    "step": 938,
+    "loss": 1.3218375444412231,
+    "diagonal": 1.316825032234192,
+    "finite": 0.005012550391256809
+  },
+  {
+    "step": 939,
+    "loss": 1.5915417671203613,
+    "diagonal": 1.5867880582809448,
+    "finite": 0.004753713961690664
+  },
+  {
+    "step": 940,
+    "loss": 1.7413620948791504,
+    "diagonal": 1.7369253635406494,
+    "finite": 0.004436729475855827
+  },
+  {
+    "step": 941,
+    "loss": 1.2709195613861084,
+    "diagonal": 1.2652196884155273,
+    "finite": 0.005699910689145327
+  },
+  {
+    "step": 942,
+    "loss": 1.317963719367981,
+    "diagonal": 1.314070463180542,
+    "finite": 0.003893204964697361
+  },
+  {
+    "step": 943,
+    "loss": 1.853898048400879,
+    "diagonal": 1.849865198135376,
+    "finite": 0.0040328772738575935
+  },
+  {
+    "step": 944,
+    "loss": 1.4914263486862183,
+    "diagonal": 1.4829076528549194,
+    "finite": 0.008518734015524387
+  },
+  {
+    "step": 945,
+    "loss": 1.61945641040802,
+    "diagonal": 1.6136380434036255,
+    "finite": 0.0058183204382658005
+  },
+  {
+    "step": 946,
+    "loss": 1.4452489614486694,
+    "diagonal": 1.4385926723480225,
+    "finite": 0.00665623601526022
+  },
+  {
+    "step": 947,
+    "loss": 1.6660882234573364,
+    "diagonal": 1.6582942008972168,
+    "finite": 0.007794048637151718
+  },
+  {
+    "step": 948,
+    "loss": 1.675388216972351,
+    "diagonal": 1.6662776470184326,
+    "finite": 0.009110582992434502
+  },
+  {
+    "step": 949,
+    "loss": 1.3877708911895752,
+    "diagonal": 1.380560278892517,
+    "finite": 0.007210574112832546
+  },
+  {
+    "step": 950,
+    "loss": 1.4719547033309937,
+    "diagonal": 1.4570177793502808,
+    "finite": 0.014936907216906548
+  },
+  {
+    "step": 951,
+    "loss": 1.223244547843933,
+    "diagonal": 1.2128632068634033,
+    "finite": 0.010381381958723068
+  },
+  {
+    "step": 952,
+    "loss": 1.487594723701477,
+    "diagonal": 1.4765474796295166,
+    "finite": 0.011047233827412128
+  },
+  {
+    "step": 953,
+    "loss": 1.4184041023254395,
+    "diagonal": 1.4103702306747437,
+    "finite": 0.00803383905440569
+  },
+  {
+    "step": 954,
+    "loss": 1.4692432880401611,
+    "diagonal": 1.460286021232605,
+    "finite": 0.008957314305007458
+  },
+  {
+    "step": 955,
+    "loss": 1.3887970447540283,
+    "diagonal": 1.3805409669876099,
+    "finite": 0.008256113156676292
+  },
+  {
+    "step": 956,
+    "loss": 1.3288321495056152,
+    "diagonal": 1.318350911140442,
+    "finite": 0.010481234639883041
+  },
+  {
+    "step": 957,
+    "loss": 1.5218561887741089,
+    "diagonal": 1.5125682353973389,
+    "finite": 0.009287912398576736
+  },
+  {
+    "step": 958,
+    "loss": 1.50214421749115,
+    "diagonal": 1.4977139234542847,
+    "finite": 0.004430263768881559
+  },
+  {
+    "step": 959,
+    "loss": 1.4959728717803955,
+    "diagonal": 1.492897629737854,
+    "finite": 0.0030752383172512054
+  },
+  {
+    "step": 960,
+    "loss": 1.2929033041000366,
+    "diagonal": 1.2893304824829102,
+    "finite": 0.0035727706272155046
+  },
+  {
+    "step": 961,
+    "loss": 1.5759268999099731,
+    "diagonal": 1.5716967582702637,
+    "finite": 0.00423017842695117
+  },
+  {
+    "step": 962,
+    "loss": 1.5163686275482178,
+    "diagonal": 1.5114033222198486,
+    "finite": 0.0049652825109660625
+  },
+  {
+    "step": 963,
+    "loss": 1.5264952182769775,
+    "diagonal": 1.5197713375091553,
+    "finite": 0.006723908707499504
+  },
+  {
+    "step": 964,
+    "loss": 1.595895767211914,
+    "diagonal": 1.592061996459961,
+    "finite": 0.0038337691221386194
+  },
+  {
+    "step": 965,
+    "loss": 1.5541120767593384,
+    "diagonal": 1.5497374534606934,
+    "finite": 0.004374674987047911
+  },
+  {
+    "step": 966,
+    "loss": 1.6833467483520508,
+    "diagonal": 1.6802006959915161,
+    "finite": 0.003146064467728138
+  },
+  {
+    "step": 967,
+    "loss": 1.4834764003753662,
+    "diagonal": 1.4801841974258423,
+    "finite": 0.0032921507954597473
+  },
+  {
+    "step": 968,
+    "loss": 1.5823240280151367,
+    "diagonal": 1.5794498920440674,
+    "finite": 0.002874128520488739
+  },
+  {
+    "step": 969,
+    "loss": 1.3749135732650757,
+    "diagonal": 1.3716168403625488,
+    "finite": 0.003296710317954421
+  },
+  {
+    "step": 970,
+    "loss": 1.4123260974884033,
+    "diagonal": 1.4051820039749146,
+    "finite": 0.007144093047827482
+  },
+  {
+    "step": 971,
+    "loss": 1.4922585487365723,
+    "diagonal": 1.4854621887207031,
+    "finite": 0.006796370726078749
+  },
+  {
+    "step": 972,
+    "loss": 1.6062804460525513,
+    "diagonal": 1.60109281539917,
+    "finite": 0.005187674425542355
+  },
+  {
+    "step": 973,
+    "loss": 1.377859354019165,
+    "diagonal": 1.3731598854064941,
+    "finite": 0.004699485842138529
+  },
+  {
+    "step": 974,
+    "loss": 1.919126272201538,
+    "diagonal": 1.9105393886566162,
+    "finite": 0.008586877956986427
+  },
+  {
+    "step": 975,
+    "loss": 1.2048965692520142,
+    "diagonal": 1.1989983320236206,
+    "finite": 0.00589823629707098
+  },
+  {
+    "step": 976,
+    "loss": 1.3545212745666504,
+    "diagonal": 1.347429633140564,
+    "finite": 0.007091597653925419
+  },
+  {
+    "step": 977,
+    "loss": 1.6159695386886597,
+    "diagonal": 1.6108680963516235,
+    "finite": 0.005101396702229977
+  },
+  {
+    "step": 978,
+    "loss": 1.521052360534668,
+    "diagonal": 1.50613534450531,
+    "finite": 0.014916996471583843
+  },
+  {
+    "step": 979,
+    "loss": 1.5892255306243896,
+    "diagonal": 1.5809009075164795,
+    "finite": 0.008324665948748589
+  },
+  {
+    "step": 980,
+    "loss": 1.443320393562317,
+    "diagonal": 1.4386980533599854,
+    "finite": 0.004622341133654118
+  },
+  {
+    "step": 981,
+    "loss": 1.4373018741607666,
+    "diagonal": 1.4284130334854126,
+    "finite": 0.00888884998857975
+  },
+  {
+    "step": 982,
+    "loss": 1.4822216033935547,
+    "diagonal": 1.4711061716079712,
+    "finite": 0.011115428060293198
+  },
+  {
+    "step": 983,
+    "loss": 1.3685293197631836,
+    "diagonal": 1.3574440479278564,
+    "finite": 0.011085225269198418
+  },
+  {
+    "step": 984,
+    "loss": 1.6132659912109375,
+    "diagonal": 1.6057064533233643,
+    "finite": 0.007559582125395536
+  },
+  {
+    "step": 985,
+    "loss": 1.4003525972366333,
+    "diagonal": 1.3922858238220215,
+    "finite": 0.008066822774708271
+  },
+  {
+    "step": 986,
+    "loss": 1.674411416053772,
+    "diagonal": 1.6585434675216675,
+    "finite": 0.015867890790104866
+  },
+  {
+    "step": 987,
+    "loss": 1.4167499542236328,
+    "diagonal": 1.409073829650879,
+    "finite": 0.007676064968109131
+  },
+  {
+    "step": 988,
+    "loss": 1.6382062435150146,
+    "diagonal": 1.6347017288208008,
+    "finite": 0.003504522144794464
+  },
+  {
+    "step": 989,
+    "loss": 1.6530725955963135,
+    "diagonal": 1.6454617977142334,
+    "finite": 0.007610740140080452
+  },
+  {
+    "step": 990,
+    "loss": 1.4282927513122559,
+    "diagonal": 1.4234942197799683,
+    "finite": 0.004798551090061665
+  },
+  {
+    "step": 991,
+    "loss": 1.5251253843307495,
+    "diagonal": 1.5206468105316162,
+    "finite": 0.00447857566177845
+  },
+  {
+    "step": 992,
+    "loss": 1.3248459100723267,
+    "diagonal": 1.3170117139816284,
+    "finite": 0.007834147661924362
+  },
+  {
+    "step": 993,
+    "loss": 1.558123230934143,
+    "diagonal": 1.548736572265625,
+    "finite": 0.009386667981743813
+  },
+  {
+    "step": 994,
+    "loss": 1.4386011362075806,
+    "diagonal": 1.4342553615570068,
+    "finite": 0.0043457746505737305
+  },
+  {
+    "step": 995,
+    "loss": 1.3526465892791748,
+    "diagonal": 1.3471838235855103,
+    "finite": 0.005462805740535259
+  },
+  {
+    "step": 996,
+    "loss": 1.3647257089614868,
+    "diagonal": 1.35813307762146,
+    "finite": 0.006592584773898125
+  },
+  {
+    "step": 997,
+    "loss": 1.3367044925689697,
+    "diagonal": 1.3333091735839844,
+    "finite": 0.0033952812664210796
+  },
+  {
+    "step": 998,
+    "loss": 1.5793441534042358,
+    "diagonal": 1.5752859115600586,
+    "finite": 0.00405820831656456
+  },
+  {
+    "step": 999,
+    "loss": 1.3925223350524902,
+    "diagonal": 1.388523817062378,
+    "finite": 0.003998501691967249
+  }
+]
diff --git a/lecture_6/verified_examples/latent/report.json b/lecture_6/verified_examples/latent/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..3dd933a06938af6312b2a2614e441839439a8241
--- /dev/null
+++ b/lecture_6/verified_examples/latent/report.json
@@ -0,0 +1,26 @@
+{
+  "method": "latent",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 1.9547189116477965,
+  "train_loss_last_20_mean": 1.4714181840419769,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "heldout_reconstruction_mse": 3.6775367334485054e-05,
+  "surface_residual_rmse": 0.08188722282648087,
+  "composition_rmse": 0.14069867134094238,
+  "finite_samples": true,
+  "mean_distance_to_center": 1.0243048667907715,
+  "mode_fractions": [
+    0.265625,
+    0.2734375,
+    0.21875,
+    0.2421875
+  ],
+  "mode_entropy": 1.3825867176055908,
+  "mean_target_log_density": -13.191566467285156,
+  "elapsed_seconds": 3.618038576998515
+}
diff --git a/lecture_6/verified_examples/latent/samples.txt b/lecture_6/verified_examples/latent/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..f265f45e3bfe3b790fc41b3aeb3eca3d9304259b
--- /dev/null
+++ b/lecture_6/verified_examples/latent/samples.txt
@@ -0,0 +1,128 @@
+-1.7431936 0.8015984 0.7467410
+-1.8150641 -0.2747774 1.0031961
+-0.5009301 -2.7401001 -1.9590940
+-1.0931573 -1.1172369 -0.0200038
+0.8377513 -0.1715928 0.2431680
+-1.7493097 0.1371107 0.9594265
+2.6618543 0.2355472 1.9613320
+1.7741902 -2.3604274 -0.5953388
+-0.1726417 -1.8497534 -1.0484505
+-1.4894850 1.5723594 -0.0785001
+-0.6855807 0.4631106 0.0738700
+1.6840132 1.6992203 -0.0175217
+0.7952793 1.4705800 -0.4841509
+0.0820390 0.2528635 -0.0151753
+0.6618812 -1.5311877 -0.5985638
+2.3442957 1.1855896 1.1612912
+-0.6733834 1.1253034 -0.2798117
+2.5528126 -0.5450212 1.7506171
+-0.3368605 0.3691222 -0.0139223
+1.8317014 0.5443810 0.9523489
+-1.9720640 -0.3927157 1.1355505
+-0.7216066 -1.4092954 -0.4733200
+1.3290513 -2.2619236 -0.8961464
+1.8747979 -1.9999309 -0.1192277
+1.6783897 -0.8184071 0.6711220
+-1.5200220 -1.4822170 0.0360656
+0.0910711 0.5046491 -0.0802474
+1.7575985 -1.2238203 0.4733419
+-1.7150302 -1.0445799 0.5669546
+2.0416555 -1.3552835 0.6623627
+0.1570962 -0.9852420 -0.3130867
+-1.3278784 -3.0525730 -1.8879850
+2.7752352 -1.7125885 1.1950921
+0.5380624 -1.9247141 -1.0253305
+-0.7126573 1.9277052 -0.9610271
+1.0034781 -0.6379331 0.2103170
+0.1911782 1.5393610 -0.7374601
+-1.5412782 1.1131577 0.3527777
+-1.9264728 2.4473383 -0.5420141
+0.7524263 0.9533894 -0.1074817
+-1.1152352 0.8510508 0.1581031
+-1.2080749 -1.7839741 -0.5187252
+0.5512010 -0.4667585 0.0413267
+1.2466139 1.9395870 -0.6495700
+0.0774216 -2.0929186 -1.3020192
+-1.2322811 0.5072697 0.4066897
+0.1183377 -1.3309820 -0.5720934
+2.1817071 0.4799090 1.3501030
+-1.7512472 2.0479739 -0.2949697
+-1.6134440 -1.1045378 0.4274959
+-1.1960822 1.0427178 0.0996551
+0.0138150 -0.0732224 0.0019314
+0.6928184 0.2265104 0.1594653
+-0.8623782 0.9373234 -0.0591508
+-1.7095237 1.2466475 0.4171680
+-2.1849108 -2.0152094 0.1807578
+0.8277839 0.3485343 0.2033270
+-0.7650014 0.1580316 0.1780176
+-0.7782613 -1.8715608 -0.8856555
+-2.4959791 1.1999683 1.2812150
+-1.1077639 -1.4902916 -0.3116779
+-1.2626250 1.4336672 -0.1530356
+-1.0425546 0.8690823 0.0956912
+0.8104074 1.4904174 -0.4940684
+2.5533566 1.4805146 1.1865488
+2.9560447 -0.2003218 2.3145442
+0.3638137 -0.2324168 0.0377437
+2.2068474 1.2829040 0.9260451
+0.2141680 -1.8022182 -0.9893470
+-1.2162080 -1.8980107 -0.6304286
+-0.0350700 1.2342914 -0.4985912
+0.3833498 0.9199409 -0.2276554
+-0.0653336 -0.0251779 0.0029396
+-0.8891262 0.1957146 0.2415539
+-0.7875655 1.6594106 -0.6712317
+1.9633843 -1.0243897 0.8312469
+2.5085785 0.1001348 1.7979640
+2.1232476 1.4951464 0.6518655
+-0.4107013 1.4218097 -0.6012464
+2.1120465 1.7568693 0.3937262
+-1.7674692 1.0081257 0.6484759
+0.0007924 1.1974640 -0.4705614
+-1.7041714 1.9886093 -0.2809159
+-2.5695529 2.1079946 0.5262876
+-0.3444648 -0.8369299 -0.1982802
+-1.4537346 -2.2093327 -0.7746542
+1.5065420 2.6183560 -1.1561818
+-0.8857682 0.3024786 0.2208724
+-2.2422152 -1.2046837 0.9976353
+-0.1236699 -0.1146344 0.0012435
+1.2320944 2.0217781 -0.7456770
+-2.3090570 -1.9405324 0.3967009
+2.6888490 1.9187753 0.9559928
+-0.6955940 1.2000595 -0.3250049
+-1.5353582 -1.4681991 0.0627415
+-1.0775826 0.0792818 0.3761063
+-0.7834976 0.1357254 0.1898867
+1.8123432 0.0915976 1.0362422
+-1.2393981 -1.3976585 -0.1306635
+1.6783842 -0.1570575 0.8992151
+-0.4943321 -2.3325758 -1.4989128
+-1.3369102 -0.9913579 0.2553186
+-1.6266999 0.9348469 0.5546643
+-1.5086898 -2.4825735 -1.0439394
+1.1496212 -2.1779916 -0.9464899
+-1.9865582 -0.9049193 0.9294242
+2.0500457 -0.5908714 1.1647393
+2.0717702 -0.1658918 1.3020711
+-1.1379161 -3.0887589 -2.0691471
+-1.1804321 0.0776573 0.4524936
+1.2613325 -1.1225852 0.1065665
+1.3860794 2.0530529 -0.6556746
+-0.3156521 0.5016177 -0.0576798
+1.9251705 -0.1171516 1.1511140
+2.0449491 1.4110372 0.6350938
+-0.3520295 -1.1240901 -0.3796214
+-1.6907400 2.0383985 -0.3464181
+0.4834408 2.0206003 -1.1330209
+0.5508915 0.3646566 0.0697307
+-0.5425770 -2.5152447 -1.6898116
+2.6494186 1.9788162 0.8436007
+-1.8629695 -2.1269131 -0.2856348
+-1.7898190 -0.8550941 0.7578748
+-1.5001760 2.0184410 -0.5102666
+1.9809200 -0.0484889 1.2134809
+-2.4890585 -1.8252003 0.7144562
+-1.0681661 -0.2770976 0.3468211
+2.3491211 1.3845384 1.0141287
diff --git a/lecture_6/verified_examples/latent/teacher_losses.json b/lecture_6/verified_examples/latent/teacher_losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..6f1413782430421773ef2b5d057f30c7a0f8f283
--- /dev/null
+++ b/lecture_6/verified_examples/latent/teacher_losses.json
@@ -0,0 +1,4002 @@
+[
+  {
+    "step": 0,
+    "loss": 1.565198302268982
+  },
+  {
+    "step": 1,
+    "loss": 1.4990873336791992
+  },
+  {
+    "step": 2,
+    "loss": 1.5003676414489746
+  },
+  {
+    "step": 3,
+    "loss": 1.5836844444274902
+  },
+  {
+    "step": 4,
+    "loss": 1.5731449127197266
+  },
+  {
+    "step": 5,
+    "loss": 1.5568242073059082
+  },
+  {
+    "step": 6,
+    "loss": 1.5462509393692017
+  },
+  {
+    "step": 7,
+    "loss": 1.480711579322815
+  },
+  {
+    "step": 8,
+    "loss": 1.482438087463379
+  },
+  {
+    "step": 9,
+    "loss": 1.4615511894226074
+  },
+  {
+    "step": 10,
+    "loss": 1.4737931489944458
+  },
+  {
+    "step": 11,
+    "loss": 1.4147051572799683
+  },
+  {
+    "step": 12,
+    "loss": 1.4360432624816895
+  },
+  {
+    "step": 13,
+    "loss": 1.3315953016281128
+  },
+  {
+    "step": 14,
+    "loss": 1.2643014192581177
+  },
+  {
+    "step": 15,
+    "loss": 1.3143982887268066
+  },
+  {
+    "step": 16,
+    "loss": 1.2443238496780396
+  },
+  {
+    "step": 17,
+    "loss": 1.1831334829330444
+  },
+  {
+    "step": 18,
+    "loss": 1.1966978311538696
+  },
+  {
+    "step": 19,
+    "loss": 1.1409271955490112
+  },
+  {
+    "step": 20,
+    "loss": 1.0309351682662964
+  },
+  {
+    "step": 21,
+    "loss": 1.0222169160842896
+  },
+  {
+    "step": 22,
+    "loss": 0.8745303750038147
+  },
+  {
+    "step": 23,
+    "loss": 0.8580107092857361
+  },
+  {
+    "step": 24,
+    "loss": 0.8032655715942383
+  },
+  {
+    "step": 25,
+    "loss": 0.8369045853614807
+  },
+  {
+    "step": 26,
+    "loss": 0.6826785206794739
+  },
+  {
+    "step": 27,
+    "loss": 0.5949968695640564
+  },
+  {
+    "step": 28,
+    "loss": 0.5134243369102478
+  },
+  {
+    "step": 29,
+    "loss": 0.4702216684818268
+  },
+  {
+    "step": 30,
+    "loss": 0.4035242795944214
+  },
+  {
+    "step": 31,
+    "loss": 0.40018534660339355
+  },
+  {
+    "step": 32,
+    "loss": 0.3049421012401581
+  },
+  {
+    "step": 33,
+    "loss": 0.22800636291503906
+  },
+  {
+    "step": 34,
+    "loss": 0.21115295588970184
+  },
+  {
+    "step": 35,
+    "loss": 0.16327814757823944
+  },
+  {
+    "step": 36,
+    "loss": 0.15379534661769867
+  },
+  {
+    "step": 37,
+    "loss": 0.1039055660367012
+  },
+  {
+    "step": 38,
+    "loss": 0.10752195119857788
+  },
+  {
+    "step": 39,
+    "loss": 0.0971347764134407
+  },
+  {
+    "step": 40,
+    "loss": 0.09720799326896667
+  },
+  {
+    "step": 41,
+    "loss": 0.09079276770353317
+  },
+  {
+    "step": 42,
+    "loss": 0.07957269996404648
+  },
+  {
+    "step": 43,
+    "loss": 0.0761106088757515
+  },
+  {
+    "step": 44,
+    "loss": 0.06865107268095016
+  },
+  {
+    "step": 45,
+    "loss": 0.08291389048099518
+  },
+  {
+    "step": 46,
+    "loss": 0.05185690522193909
+  },
+  {
+    "step": 47,
+    "loss": 0.06077523157000542
+  },
+  {
+    "step": 48,
+    "loss": 0.0472428984940052
+  },
+  {
+    "step": 49,
+    "loss": 0.05609244480729103
+  },
+  {
+    "step": 50,
+    "loss": 0.04997332766652107
+  },
+  {
+    "step": 51,
+    "loss": 0.04064295068383217
+  },
+  {
+    "step": 52,
+    "loss": 0.04780576750636101
+  },
+  {
+    "step": 53,
+    "loss": 0.042494941502809525
+  },
+  {
+    "step": 54,
+    "loss": 0.03928712382912636
+  },
+  {
+    "step": 55,
+    "loss": 0.050213176757097244
+  },
+  {
+    "step": 56,
+    "loss": 0.0393022783100605
+  },
+  {
+    "step": 57,
+    "loss": 0.035598594695329666
+  },
+  {
+    "step": 58,
+    "loss": 0.03862506523728371
+  },
+  {
+    "step": 59,
+    "loss": 0.04080342873930931
+  },
+  {
+    "step": 60,
+    "loss": 0.034862980246543884
+  },
+  {
+    "step": 61,
+    "loss": 0.03569038584828377
+  },
+  {
+    "step": 62,
+    "loss": 0.035230450332164764
+  },
+  {
+    "step": 63,
+    "loss": 0.033473193645477295
+  },
+  {
+    "step": 64,
+    "loss": 0.030492400750517845
+  },
+  {
+    "step": 65,
+    "loss": 0.0344146303832531
+  },
+  {
+    "step": 66,
+    "loss": 0.02580147050321102
+  },
+  {
+    "step": 67,
+    "loss": 0.023884588852524757
+  },
+  {
+    "step": 68,
+    "loss": 0.03109295479953289
+  },
+  {
+    "step": 69,
+    "loss": 0.028293700888752937
+  },
+  {
+    "step": 70,
+    "loss": 0.030962489545345306
+  },
+  {
+    "step": 71,
+    "loss": 0.01849539577960968
+  },
+  {
+    "step": 72,
+    "loss": 0.020971333608031273
+  },
+  {
+    "step": 73,
+    "loss": 0.02289312146604061
+  },
+  {
+    "step": 74,
+    "loss": 0.022466717287898064
+  },
+  {
+    "step": 75,
+    "loss": 0.02302396111190319
+  },
+  {
+    "step": 76,
+    "loss": 0.020453011617064476
+  },
+  {
+    "step": 77,
+    "loss": 0.028794726356863976
+  },
+  {
+    "step": 78,
+    "loss": 0.02048790641129017
+  },
+  {
+    "step": 79,
+    "loss": 0.021958932280540466
+  },
+  {
+    "step": 80,
+    "loss": 0.01861557923257351
+  },
+  {
+    "step": 81,
+    "loss": 0.023564642295241356
+  },
+  {
+    "step": 82,
+    "loss": 0.022232884541153908
+  },
+  {
+    "step": 83,
+    "loss": 0.02151423878967762
+  },
+  {
+    "step": 84,
+    "loss": 0.01909341849386692
+  },
+  {
+    "step": 85,
+    "loss": 0.01805828884243965
+  },
+  {
+    "step": 86,
+    "loss": 0.019433753564953804
+  },
+  {
+    "step": 87,
+    "loss": 0.01838633231818676
+  },
+  {
+    "step": 88,
+    "loss": 0.016498906537890434
+  },
+  {
+    "step": 89,
+    "loss": 0.023404350504279137
+  },
+  {
+    "step": 90,
+    "loss": 0.02065049111843109
+  },
+  {
+    "step": 91,
+    "loss": 0.016655096784234047
+  },
+  {
+    "step": 92,
+    "loss": 0.025170331820845604
+  },
+  {
+    "step": 93,
+    "loss": 0.02027951180934906
+  },
+  {
+    "step": 94,
+    "loss": 0.019226081669330597
+  },
+  {
+    "step": 95,
+    "loss": 0.019563809037208557
+  },
+  {
+    "step": 96,
+    "loss": 0.01842542551457882
+  },
+  {
+    "step": 97,
+    "loss": 0.01451999694108963
+  },
+  {
+    "step": 98,
+    "loss": 0.01399184763431549
+  },
+  {
+    "step": 99,
+    "loss": 0.0224627573043108
+  },
+  {
+    "step": 100,
+    "loss": 0.016134919598698616
+  },
+  {
+    "step": 101,
+    "loss": 0.01574801839888096
+  },
+  {
+    "step": 102,
+    "loss": 0.018330173566937447
+  },
+  {
+    "step": 103,
+    "loss": 0.013328895904123783
+  },
+  {
+    "step": 104,
+    "loss": 0.017260229215025902
+  },
+  {
+    "step": 105,
+    "loss": 0.016532938927412033
+  },
+  {
+    "step": 106,
+    "loss": 0.01568540744483471
+  },
+  {
+    "step": 107,
+    "loss": 0.015229378826916218
+  },
+  {
+    "step": 108,
+    "loss": 0.017103565856814384
+  },
+  {
+    "step": 109,
+    "loss": 0.011457097716629505
+  },
+  {
+    "step": 110,
+    "loss": 0.016650499776005745
+  },
+  {
+    "step": 111,
+    "loss": 0.009688357822597027
+  },
+  {
+    "step": 112,
+    "loss": 0.015162501484155655
+  },
+  {
+    "step": 113,
+    "loss": 0.012954764999449253
+  },
+  {
+    "step": 114,
+    "loss": 0.01445665955543518
+  },
+  {
+    "step": 115,
+    "loss": 0.015158675611019135
+  },
+  {
+    "step": 116,
+    "loss": 0.012744947336614132
+  },
+  {
+    "step": 117,
+    "loss": 0.015844091773033142
+  },
+  {
+    "step": 118,
+    "loss": 0.014114332385361195
+  },
+  {
+    "step": 119,
+    "loss": 0.012367289513349533
+  },
+  {
+    "step": 120,
+    "loss": 0.011931694112718105
+  },
+  {
+    "step": 121,
+    "loss": 0.012481982819736004
+  },
+  {
+    "step": 122,
+    "loss": 0.013323087245225906
+  },
+  {
+    "step": 123,
+    "loss": 0.012313145212829113
+  },
+  {
+    "step": 124,
+    "loss": 0.009476414881646633
+  },
+  {
+    "step": 125,
+    "loss": 0.01170080155134201
+  },
+  {
+    "step": 126,
+    "loss": 0.007890448905527592
+  },
+  {
+    "step": 127,
+    "loss": 0.013180549256503582
+  },
+  {
+    "step": 128,
+    "loss": 0.012525475583970547
+  },
+  {
+    "step": 129,
+    "loss": 0.012797602452337742
+  },
+  {
+    "step": 130,
+    "loss": 0.012242923490703106
+  },
+  {
+    "step": 131,
+    "loss": 0.007344366516917944
+  },
+  {
+    "step": 132,
+    "loss": 0.009319376200437546
+  },
+  {
+    "step": 133,
+    "loss": 0.010643881745636463
+  },
+  {
+    "step": 134,
+    "loss": 0.009799821302294731
+  },
+  {
+    "step": 135,
+    "loss": 0.00878516212105751
+  },
+  {
+    "step": 136,
+    "loss": 0.011325188912451267
+  },
+  {
+    "step": 137,
+    "loss": 0.008263896219432354
+  },
+  {
+    "step": 138,
+    "loss": 0.009395160712301731
+  },
+  {
+    "step": 139,
+    "loss": 0.008747958578169346
+  },
+  {
+    "step": 140,
+    "loss": 0.007568672765046358
+  },
+  {
+    "step": 141,
+    "loss": 0.005756713449954987
+  },
+  {
+    "step": 142,
+    "loss": 0.008413849398493767
+  },
+  {
+    "step": 143,
+    "loss": 0.0075487978756427765
+  },
+  {
+    "step": 144,
+    "loss": 0.007931594736874104
+  },
+  {
+    "step": 145,
+    "loss": 0.00819337833672762
+  },
+  {
+    "step": 146,
+    "loss": 0.007449990138411522
+  },
+  {
+    "step": 147,
+    "loss": 0.007612316403537989
+  },
+  {
+    "step": 148,
+    "loss": 0.007227935362607241
+  },
+  {
+    "step": 149,
+    "loss": 0.0071197934448719025
+  },
+  {
+    "step": 150,
+    "loss": 0.00677170604467392
+  },
+  {
+    "step": 151,
+    "loss": 0.005352795124053955
+  },
+  {
+    "step": 152,
+    "loss": 0.008046741597354412
+  },
+  {
+    "step": 153,
+    "loss": 0.0069574397057294846
+  },
+  {
+    "step": 154,
+    "loss": 0.0074499137699604034
+  },
+  {
+    "step": 155,
+    "loss": 0.0065188477747142315
+  },
+  {
+    "step": 156,
+    "loss": 0.006236440036445856
+  },
+  {
+    "step": 157,
+    "loss": 0.004468218889087439
+  },
+  {
+    "step": 158,
+    "loss": 0.005404094699770212
+  },
+  {
+    "step": 159,
+    "loss": 0.0038088709115982056
+  },
+  {
+    "step": 160,
+    "loss": 0.005542317405343056
+  },
+  {
+    "step": 161,
+    "loss": 0.003890748368576169
+  },
+  {
+    "step": 162,
+    "loss": 0.0036013571079820395
+  },
+  {
+    "step": 163,
+    "loss": 0.003315492533147335
+  },
+  {
+    "step": 164,
+    "loss": 0.004944507498294115
+  },
+  {
+    "step": 165,
+    "loss": 0.0031831401865929365
+  },
+  {
+    "step": 166,
+    "loss": 0.004459564108401537
+  },
+  {
+    "step": 167,
+    "loss": 0.003974101971834898
+  },
+  {
+    "step": 168,
+    "loss": 0.0044106668792665005
+  },
+  {
+    "step": 169,
+    "loss": 0.004772065207362175
+  },
+  {
+    "step": 170,
+    "loss": 0.003992430400103331
+  },
+  {
+    "step": 171,
+    "loss": 0.0034025628119707108
+  },
+  {
+    "step": 172,
+    "loss": 0.00374170602299273
+  },
+  {
+    "step": 173,
+    "loss": 0.0035275479312986135
+  },
+  {
+    "step": 174,
+    "loss": 0.002892975928261876
+  },
+  {
+    "step": 175,
+    "loss": 0.004288028459995985
+  },
+  {
+    "step": 176,
+    "loss": 0.004001362714916468
+  },
+  {
+    "step": 177,
+    "loss": 0.0023443822283297777
+  },
+  {
+    "step": 178,
+    "loss": 0.0034634883049875498
+  },
+  {
+    "step": 179,
+    "loss": 0.0022343462333083153
+  },
+  {
+    "step": 180,
+    "loss": 0.0028857190627604723
+  },
+  {
+    "step": 181,
+    "loss": 0.003154970007017255
+  },
+  {
+    "step": 182,
+    "loss": 0.0026680370792746544
+  },
+  {
+    "step": 183,
+    "loss": 0.0029320446774363518
+  },
+  {
+    "step": 184,
+    "loss": 0.00244133360683918
+  },
+  {
+    "step": 185,
+    "loss": 0.002337318379431963
+  },
+  {
+    "step": 186,
+    "loss": 0.0027179282624274492
+  },
+  {
+    "step": 187,
+    "loss": 0.002445364370942116
+  },
+  {
+    "step": 188,
+    "loss": 0.003178509185090661
+  },
+  {
+    "step": 189,
+    "loss": 0.0022648999001830816
+  },
+  {
+    "step": 190,
+    "loss": 0.00273115374147892
+  },
+  {
+    "step": 191,
+    "loss": 0.002206997247412801
+  },
+  {
+    "step": 192,
+    "loss": 0.0021824988070875406
+  },
+  {
+    "step": 193,
+    "loss": 0.0020267523359507322
+  },
+  {
+    "step": 194,
+    "loss": 0.0023032170720398426
+  },
+  {
+    "step": 195,
+    "loss": 0.002213298575952649
+  },
+  {
+    "step": 196,
+    "loss": 0.0023888067808002234
+  },
+  {
+    "step": 197,
+    "loss": 0.003154480829834938
+  },
+  {
+    "step": 198,
+    "loss": 0.0023221299052238464
+  },
+  {
+    "step": 199,
+    "loss": 0.002009469084441662
+  },
+  {
+    "step": 200,
+    "loss": 0.0022034395951777697
+  },
+  {
+    "step": 201,
+    "loss": 0.0020833229646086693
+  },
+  {
+    "step": 202,
+    "loss": 0.0020693803671747446
+  },
+  {
+    "step": 203,
+    "loss": 0.0029536308720707893
+  },
+  {
+    "step": 204,
+    "loss": 0.0022663853596895933
+  },
+  {
+    "step": 205,
+    "loss": 0.001668713055551052
+  },
+  {
+    "step": 206,
+    "loss": 0.001974874408915639
+  },
+  {
+    "step": 207,
+    "loss": 0.0017892895266413689
+  },
+  {
+    "step": 208,
+    "loss": 0.0019921851344406605
+  },
+  {
+    "step": 209,
+    "loss": 0.0022220946848392487
+  },
+  {
+    "step": 210,
+    "loss": 0.00212301523424685
+  },
+  {
+    "step": 211,
+    "loss": 0.0019225827418267727
+  },
+  {
+    "step": 212,
+    "loss": 0.001845910563133657
+  },
+  {
+    "step": 213,
+    "loss": 0.0012793323257938027
+  },
+  {
+    "step": 214,
+    "loss": 0.002814667299389839
+  },
+  {
+    "step": 215,
+    "loss": 0.0022479374893009663
+  },
+  {
+    "step": 216,
+    "loss": 0.0017820466309785843
+  },
+  {
+    "step": 217,
+    "loss": 0.0022311490029096603
+  },
+  {
+    "step": 218,
+    "loss": 0.0015136479632928967
+  },
+  {
+    "step": 219,
+    "loss": 0.0017007821006700397
+  },
+  {
+    "step": 220,
+    "loss": 0.0021335382480174303
+  },
+  {
+    "step": 221,
+    "loss": 0.001457633450627327
+  },
+  {
+    "step": 222,
+    "loss": 0.0015449711354449391
+  },
+  {
+    "step": 223,
+    "loss": 0.00139559805393219
+  },
+  {
+    "step": 224,
+    "loss": 0.0012912368401885033
+  },
+  {
+    "step": 225,
+    "loss": 0.002031913259997964
+  },
+  {
+    "step": 226,
+    "loss": 0.0016482508508488536
+  },
+  {
+    "step": 227,
+    "loss": 0.002025056164711714
+  },
+  {
+    "step": 228,
+    "loss": 0.001731687574647367
+  },
+  {
+    "step": 229,
+    "loss": 0.0015571699477732182
+  },
+  {
+    "step": 230,
+    "loss": 0.0013444923097267747
+  },
+  {
+    "step": 231,
+    "loss": 0.0016077711479738355
+  },
+  {
+    "step": 232,
+    "loss": 0.0011210349621251225
+  },
+  {
+    "step": 233,
+    "loss": 0.0013914001174271107
+  },
+  {
+    "step": 234,
+    "loss": 0.001756373792886734
+  },
+  {
+    "step": 235,
+    "loss": 0.001493613701313734
+  },
+  {
+    "step": 236,
+    "loss": 0.0019549524877220392
+  },
+  {
+    "step": 237,
+    "loss": 0.0016827438957989216
+  },
+  {
+    "step": 238,
+    "loss": 0.0013494706945493817
+  },
+  {
+    "step": 239,
+    "loss": 0.0011442647082731128
+  },
+  {
+    "step": 240,
+    "loss": 0.0012597477762028575
+  },
+  {
+    "step": 241,
+    "loss": 0.0012240692740306258
+  },
+  {
+    "step": 242,
+    "loss": 0.0014952830970287323
+  },
+  {
+    "step": 243,
+    "loss": 0.0014550910564139485
+  },
+  {
+    "step": 244,
+    "loss": 0.0012116695288568735
+  },
+  {
+    "step": 245,
+    "loss": 0.0017804497620090842
+  },
+  {
+    "step": 246,
+    "loss": 0.001325884717516601
+  },
+  {
+    "step": 247,
+    "loss": 0.0015715033514425159
+  },
+  {
+    "step": 248,
+    "loss": 0.0010652609635144472
+  },
+  {
+    "step": 249,
+    "loss": 0.0011240093735978007
+  },
+  {
+    "step": 250,
+    "loss": 0.0013282360741868615
+  },
+  {
+    "step": 251,
+    "loss": 0.001467771246097982
+  },
+  {
+    "step": 252,
+    "loss": 0.0012223034864291549
+  },
+  {
+    "step": 253,
+    "loss": 0.0013710862258449197
+  },
+  {
+    "step": 254,
+    "loss": 0.0010917001636698842
+  },
+  {
+    "step": 255,
+    "loss": 0.0014931022888049483
+  },
+  {
+    "step": 256,
+    "loss": 0.0010233997600153089
+  },
+  {
+    "step": 257,
+    "loss": 0.0013313713716343045
+  },
+  {
+    "step": 258,
+    "loss": 0.001593753695487976
+  },
+  {
+    "step": 259,
+    "loss": 0.0009865030879154801
+  },
+  {
+    "step": 260,
+    "loss": 0.0010643815621733665
+  },
+  {
+    "step": 261,
+    "loss": 0.0009854742093011737
+  },
+  {
+    "step": 262,
+    "loss": 0.0011112148640677333
+  },
+  {
+    "step": 263,
+    "loss": 0.0009063971810974181
+  },
+  {
+    "step": 264,
+    "loss": 0.0013087267288938165
+  },
+  {
+    "step": 265,
+    "loss": 0.0009902467718347907
+  },
+  {
+    "step": 266,
+    "loss": 0.0011539539555087686
+  },
+  {
+    "step": 267,
+    "loss": 0.0010366769274696708
+  },
+  {
+    "step": 268,
+    "loss": 0.001219153287820518
+  },
+  {
+    "step": 269,
+    "loss": 0.0012930631637573242
+  },
+  {
+    "step": 270,
+    "loss": 0.0008206015336327255
+  },
+  {
+    "step": 271,
+    "loss": 0.001050202758051455
+  },
+  {
+    "step": 272,
+    "loss": 0.0009790683398023248
+  },
+  {
+    "step": 273,
+    "loss": 0.0010265220189467072
+  },
+  {
+    "step": 274,
+    "loss": 0.00120725913438946
+  },
+  {
+    "step": 275,
+    "loss": 0.0007997837383300066
+  },
+  {
+    "step": 276,
+    "loss": 0.0008518003742210567
+  },
+  {
+    "step": 277,
+    "loss": 0.0011214641854166985
+  },
+  {
+    "step": 278,
+    "loss": 0.0010536006884649396
+  },
+  {
+    "step": 279,
+    "loss": 0.0008996180258691311
+  },
+  {
+    "step": 280,
+    "loss": 0.0011030244641005993
+  },
+  {
+    "step": 281,
+    "loss": 0.0010552604217082262
+  },
+  {
+    "step": 282,
+    "loss": 0.0009865141473710537
+  },
+  {
+    "step": 283,
+    "loss": 0.0008589082863181829
+  },
+  {
+    "step": 284,
+    "loss": 0.0008865203708410263
+  },
+  {
+    "step": 285,
+    "loss": 0.0007569474983029068
+  },
+  {
+    "step": 286,
+    "loss": 0.0010079415515065193
+  },
+  {
+    "step": 287,
+    "loss": 0.0008363560191355646
+  },
+  {
+    "step": 288,
+    "loss": 0.0006181264179758728
+  },
+  {
+    "step": 289,
+    "loss": 0.000837643863633275
+  },
+  {
+    "step": 290,
+    "loss": 0.0007996375788934529
+  },
+  {
+    "step": 291,
+    "loss": 0.0010191310429945588
+  },
+  {
+    "step": 292,
+    "loss": 0.0007310493383556604
+  },
+  {
+    "step": 293,
+    "loss": 0.0009194632875733078
+  },
+  {
+    "step": 294,
+    "loss": 0.0006659887731075287
+  },
+  {
+    "step": 295,
+    "loss": 0.0011005265405401587
+  },
+  {
+    "step": 296,
+    "loss": 0.0009538421290926635
+  },
+  {
+    "step": 297,
+    "loss": 0.0009279032237827778
+  },
+  {
+    "step": 298,
+    "loss": 0.0011456747306510806
+  },
+  {
+    "step": 299,
+    "loss": 0.0009451585938222706
+  },
+  {
+    "step": 300,
+    "loss": 0.0009246518020518124
+  },
+  {
+    "step": 301,
+    "loss": 0.0007518987986259162
+  },
+  {
+    "step": 302,
+    "loss": 0.0008375965990126133
+  },
+  {
+    "step": 303,
+    "loss": 0.0007730543147772551
+  },
+  {
+    "step": 304,
+    "loss": 0.0008059742394834757
+  },
+  {
+    "step": 305,
+    "loss": 0.0010345407063141465
+  },
+  {
+    "step": 306,
+    "loss": 0.0009002708829939365
+  },
+  {
+    "step": 307,
+    "loss": 0.0009218479972332716
+  },
+  {
+    "step": 308,
+    "loss": 0.0007007624953985214
+  },
+  {
+    "step": 309,
+    "loss": 0.0007372948457486928
+  },
+  {
+    "step": 310,
+    "loss": 0.0008348680566996336
+  },
+  {
+    "step": 311,
+    "loss": 0.0008274821448139846
+  },
+  {
+    "step": 312,
+    "loss": 0.000832360761705786
+  },
+  {
+    "step": 313,
+    "loss": 0.0007057000766508281
+  },
+  {
+    "step": 314,
+    "loss": 0.0007366537465713918
+  },
+  {
+    "step": 315,
+    "loss": 0.0006532832630909979
+  },
+  {
+    "step": 316,
+    "loss": 0.0008991734939627349
+  },
+  {
+    "step": 317,
+    "loss": 0.0005046029691584408
+  },
+  {
+    "step": 318,
+    "loss": 0.0008002921822480857
+  },
+  {
+    "step": 319,
+    "loss": 0.0008215371053665876
+  },
+  {
+    "step": 320,
+    "loss": 0.0006305122515186667
+  },
+  {
+    "step": 321,
+    "loss": 0.0008406363776884973
+  },
+  {
+    "step": 322,
+    "loss": 0.0006881277658976614
+  },
+  {
+    "step": 323,
+    "loss": 0.0005505865556187928
+  },
+  {
+    "step": 324,
+    "loss": 0.00057594059035182
+  },
+  {
+    "step": 325,
+    "loss": 0.0005553349619731307
+  },
+  {
+    "step": 326,
+    "loss": 0.0007995296618901193
+  },
+  {
+    "step": 327,
+    "loss": 0.0007338630966842175
+  },
+  {
+    "step": 328,
+    "loss": 0.0007796530262567103
+  },
+  {
+    "step": 329,
+    "loss": 0.0007001438643783331
+  },
+  {
+    "step": 330,
+    "loss": 0.0005945648881606758
+  },
+  {
+    "step": 331,
+    "loss": 0.0008346936083398759
+  },
+  {
+    "step": 332,
+    "loss": 0.0009693149477243423
+  },
+  {
+    "step": 333,
+    "loss": 0.0005387825076468289
+  },
+  {
+    "step": 334,
+    "loss": 0.0006286487332545221
+  },
+  {
+    "step": 335,
+    "loss": 0.0006100213504396379
+  },
+  {
+    "step": 336,
+    "loss": 0.0005657730507664382
+  },
+  {
+    "step": 337,
+    "loss": 0.0006567975506186485
+  },
+  {
+    "step": 338,
+    "loss": 0.0006329938187263906
+  },
+  {
+    "step": 339,
+    "loss": 0.0006876909756101668
+  },
+  {
+    "step": 340,
+    "loss": 0.00044779491145163774
+  },
+  {
+    "step": 341,
+    "loss": 0.0005386972334235907
+  },
+  {
+    "step": 342,
+    "loss": 0.000578215520363301
+  },
+  {
+    "step": 343,
+    "loss": 0.00048715434968471527
+  },
+  {
+    "step": 344,
+    "loss": 0.0003817955730482936
+  },
+  {
+    "step": 345,
+    "loss": 0.000590548210311681
+  },
+  {
+    "step": 346,
+    "loss": 0.0006267876015044749
+  },
+  {
+    "step": 347,
+    "loss": 0.0004280329158063978
+  },
+  {
+    "step": 348,
+    "loss": 0.0004342403553891927
+  },
+  {
+    "step": 349,
+    "loss": 0.0005632995744235814
+  },
+  {
+    "step": 350,
+    "loss": 0.0004993187612853944
+  },
+  {
+    "step": 351,
+    "loss": 0.0007485079113394022
+  },
+  {
+    "step": 352,
+    "loss": 0.0006860601133666933
+  },
+  {
+    "step": 353,
+    "loss": 0.0006430919165723026
+  },
+  {
+    "step": 354,
+    "loss": 0.0004038617480546236
+  },
+  {
+    "step": 355,
+    "loss": 0.00044125362182967365
+  },
+  {
+    "step": 356,
+    "loss": 0.0004582103283610195
+  },
+  {
+    "step": 357,
+    "loss": 0.00037433518446050584
+  },
+  {
+    "step": 358,
+    "loss": 0.0003966483927797526
+  },
+  {
+    "step": 359,
+    "loss": 0.0004623756685759872
+  },
+  {
+    "step": 360,
+    "loss": 0.0005189515650272369
+  },
+  {
+    "step": 361,
+    "loss": 0.0005052628112025559
+  },
+  {
+    "step": 362,
+    "loss": 0.00042616110295057297
+  },
+  {
+    "step": 363,
+    "loss": 0.00044595845974981785
+  },
+  {
+    "step": 364,
+    "loss": 0.0004779570735991001
+  },
+  {
+    "step": 365,
+    "loss": 0.0006463371682912111
+  },
+  {
+    "step": 366,
+    "loss": 0.00038464402314275503
+  },
+  {
+    "step": 367,
+    "loss": 0.0005495812511071563
+  },
+  {
+    "step": 368,
+    "loss": 0.00045028957538306713
+  },
+  {
+    "step": 369,
+    "loss": 0.00041051488369703293
+  },
+  {
+    "step": 370,
+    "loss": 0.000410671578720212
+  },
+  {
+    "step": 371,
+    "loss": 0.000437181064626202
+  },
+  {
+    "step": 372,
+    "loss": 0.0004286448238417506
+  },
+  {
+    "step": 373,
+    "loss": 0.0004196273221168667
+  },
+  {
+    "step": 374,
+    "loss": 0.0006087871151976287
+  },
+  {
+    "step": 375,
+    "loss": 0.0005772064323537052
+  },
+  {
+    "step": 376,
+    "loss": 0.0004742956953123212
+  },
+  {
+    "step": 377,
+    "loss": 0.0002967431501019746
+  },
+  {
+    "step": 378,
+    "loss": 0.0003988017560914159
+  },
+  {
+    "step": 379,
+    "loss": 0.00041872114525176585
+  },
+  {
+    "step": 380,
+    "loss": 0.0002732813882175833
+  },
+  {
+    "step": 381,
+    "loss": 0.000459450064226985
+  },
+  {
+    "step": 382,
+    "loss": 0.00038465348188765347
+  },
+  {
+    "step": 383,
+    "loss": 0.0004276007821317762
+  },
+  {
+    "step": 384,
+    "loss": 0.00040400621946901083
+  },
+  {
+    "step": 385,
+    "loss": 0.0003206937399227172
+  },
+  {
+    "step": 386,
+    "loss": 0.00038181012496352196
+  },
+  {
+    "step": 387,
+    "loss": 0.00030484076705761254
+  },
+  {
+    "step": 388,
+    "loss": 0.00027328828582540154
+  },
+  {
+    "step": 389,
+    "loss": 0.00034021574538201094
+  },
+  {
+    "step": 390,
+    "loss": 0.0003497340658213943
+  },
+  {
+    "step": 391,
+    "loss": 0.00032879054197110236
+  },
+  {
+    "step": 392,
+    "loss": 0.0003348171303514391
+  },
+  {
+    "step": 393,
+    "loss": 0.00029438058845698833
+  },
+  {
+    "step": 394,
+    "loss": 0.0002770035353023559
+  },
+  {
+    "step": 395,
+    "loss": 0.00039185440982691944
+  },
+  {
+    "step": 396,
+    "loss": 0.0003608819970395416
+  },
+  {
+    "step": 397,
+    "loss": 0.00035378106986172497
+  },
+  {
+    "step": 398,
+    "loss": 0.0002570030919741839
+  },
+  {
+    "step": 399,
+    "loss": 0.0003918066795449704
+  },
+  {
+    "step": 400,
+    "loss": 0.00035063736140727997
+  },
+  {
+    "step": 401,
+    "loss": 0.0002518893452361226
+  },
+  {
+    "step": 402,
+    "loss": 0.00021061305596958846
+  },
+  {
+    "step": 403,
+    "loss": 0.00047743984032422304
+  },
+  {
+    "step": 404,
+    "loss": 0.000213031773455441
+  },
+  {
+    "step": 405,
+    "loss": 0.00024275666510220617
+  },
+  {
+    "step": 406,
+    "loss": 0.00023732171393930912
+  },
+  {
+    "step": 407,
+    "loss": 0.000370971392840147
+  },
+  {
+    "step": 408,
+    "loss": 0.00040640527731738985
+  },
+  {
+    "step": 409,
+    "loss": 0.0002551674551796168
+  },
+  {
+    "step": 410,
+    "loss": 0.00030957357375882566
+  },
+  {
+    "step": 411,
+    "loss": 0.0003808968758676201
+  },
+  {
+    "step": 412,
+    "loss": 0.0002965713501907885
+  },
+  {
+    "step": 413,
+    "loss": 0.000272974866675213
+  },
+  {
+    "step": 414,
+    "loss": 0.0003387796168681234
+  },
+  {
+    "step": 415,
+    "loss": 0.0002773121523205191
+  },
+  {
+    "step": 416,
+    "loss": 0.00030707273981533945
+  },
+  {
+    "step": 417,
+    "loss": 0.00025744392769411206
+  },
+  {
+    "step": 418,
+    "loss": 0.0003667171113193035
+  },
+  {
+    "step": 419,
+    "loss": 0.0002811799931805581
+  },
+  {
+    "step": 420,
+    "loss": 0.00030526728369295597
+  },
+  {
+    "step": 421,
+    "loss": 0.00025126506807282567
+  },
+  {
+    "step": 422,
+    "loss": 0.00025410400121472776
+  },
+  {
+    "step": 423,
+    "loss": 0.0003070178208872676
+  },
+  {
+    "step": 424,
+    "loss": 0.00033237089519388974
+  },
+  {
+    "step": 425,
+    "loss": 0.0002713934809435159
+  },
+  {
+    "step": 426,
+    "loss": 0.000229830460739322
+  },
+  {
+    "step": 427,
+    "loss": 0.0003050958039239049
+  },
+  {
+    "step": 428,
+    "loss": 0.00032748086960054934
+  },
+  {
+    "step": 429,
+    "loss": 0.00020884578407276422
+  },
+  {
+    "step": 430,
+    "loss": 0.0002510407648514956
+  },
+  {
+    "step": 431,
+    "loss": 0.00021398045646492392
+  },
+  {
+    "step": 432,
+    "loss": 0.00027270722785033286
+  },
+  {
+    "step": 433,
+    "loss": 0.00017860514344647527
+  },
+  {
+    "step": 434,
+    "loss": 0.00042207574006170034
+  },
+  {
+    "step": 435,
+    "loss": 0.00021180970361456275
+  },
+  {
+    "step": 436,
+    "loss": 0.00027080767904408276
+  },
+  {
+    "step": 437,
+    "loss": 0.00020846050756517798
+  },
+  {
+    "step": 438,
+    "loss": 0.0002796357439365238
+  },
+  {
+    "step": 439,
+    "loss": 0.00026810436975210905
+  },
+  {
+    "step": 440,
+    "loss": 0.00021132799156475812
+  },
+  {
+    "step": 441,
+    "loss": 0.0003382606664672494
+  },
+  {
+    "step": 442,
+    "loss": 0.0002716465969569981
+  },
+  {
+    "step": 443,
+    "loss": 0.0003604925295803696
+  },
+  {
+    "step": 444,
+    "loss": 0.00023546174634248018
+  },
+  {
+    "step": 445,
+    "loss": 0.0002584270550869405
+  },
+  {
+    "step": 446,
+    "loss": 0.0002330444986000657
+  },
+  {
+    "step": 447,
+    "loss": 0.00018662672664504498
+  },
+  {
+    "step": 448,
+    "loss": 0.00014889849990140647
+  },
+  {
+    "step": 449,
+    "loss": 0.0002478655951563269
+  },
+  {
+    "step": 450,
+    "loss": 0.0002494273940101266
+  },
+  {
+    "step": 451,
+    "loss": 0.0002450370229780674
+  },
+  {
+    "step": 452,
+    "loss": 0.00020612828666344285
+  },
+  {
+    "step": 453,
+    "loss": 0.00024084420874714851
+  },
+  {
+    "step": 454,
+    "loss": 0.00033377515501342714
+  },
+  {
+    "step": 455,
+    "loss": 0.0001896448666229844
+  },
+  {
+    "step": 456,
+    "loss": 0.0002039865794358775
+  },
+  {
+    "step": 457,
+    "loss": 0.00018140200700145215
+  },
+  {
+    "step": 458,
+    "loss": 0.0001866785023594275
+  },
+  {
+    "step": 459,
+    "loss": 0.00017938739620149136
+  },
+  {
+    "step": 460,
+    "loss": 0.000257151375990361
+  },
+  {
+    "step": 461,
+    "loss": 0.00021297264902386814
+  },
+  {
+    "step": 462,
+    "loss": 0.0002493223000783473
+  },
+  {
+    "step": 463,
+    "loss": 0.00020883168326690793
+  },
+  {
+    "step": 464,
+    "loss": 0.00019197344954591244
+  },
+  {
+    "step": 465,
+    "loss": 0.00016965701070148498
+  },
+  {
+    "step": 466,
+    "loss": 0.00020368727564346045
+  },
+  {
+    "step": 467,
+    "loss": 0.00016373158723581582
+  },
+  {
+    "step": 468,
+    "loss": 0.0002459379320498556
+  },
+  {
+    "step": 469,
+    "loss": 0.0001779130398062989
+  },
+  {
+    "step": 470,
+    "loss": 0.00017303678032476455
+  },
+  {
+    "step": 471,
+    "loss": 0.00016696006059646606
+  },
+  {
+    "step": 472,
+    "loss": 0.00019900192273780704
+  },
+  {
+    "step": 473,
+    "loss": 0.00019248697208240628
+  },
+  {
+    "step": 474,
+    "loss": 0.0001806151121854782
+  },
+  {
+    "step": 475,
+    "loss": 0.000256162864388898
+  },
+  {
+    "step": 476,
+    "loss": 0.00018040038412436843
+  },
+  {
+    "step": 477,
+    "loss": 9.965026401914656e-05
+  },
+  {
+    "step": 478,
+    "loss": 0.00026595572126097977
+  },
+  {
+    "step": 479,
+    "loss": 0.00022122100926935673
+  },
+  {
+    "step": 480,
+    "loss": 0.00012412312207743526
+  },
+  {
+    "step": 481,
+    "loss": 0.00016691948985680938
+  },
+  {
+    "step": 482,
+    "loss": 0.00015765578427817672
+  },
+  {
+    "step": 483,
+    "loss": 0.00015346742293331772
+  },
+  {
+    "step": 484,
+    "loss": 0.00024739428772591054
+  },
+  {
+    "step": 485,
+    "loss": 0.0001700784923741594
+  },
+  {
+    "step": 486,
+    "loss": 0.0001731634692987427
+  },
+  {
+    "step": 487,
+    "loss": 0.00013953298912383616
+  },
+  {
+    "step": 488,
+    "loss": 0.00011803465167758986
+  },
+  {
+    "step": 489,
+    "loss": 0.00013222004054114223
+  },
+  {
+    "step": 490,
+    "loss": 0.00012440422142390162
+  },
+  {
+    "step": 491,
+    "loss": 0.00012594129657372832
+  },
+  {
+    "step": 492,
+    "loss": 0.00023525422147940844
+  },
+  {
+    "step": 493,
+    "loss": 0.00010539352660998702
+  },
+  {
+    "step": 494,
+    "loss": 0.00017443897377233952
+  },
+  {
+    "step": 495,
+    "loss": 0.0001335047563770786
+  },
+  {
+    "step": 496,
+    "loss": 0.00017437922360841185
+  },
+  {
+    "step": 497,
+    "loss": 0.0001407347444910556
+  },
+  {
+    "step": 498,
+    "loss": 0.00013917661271989346
+  },
+  {
+    "step": 499,
+    "loss": 0.00015756534412503242
+  },
+  {
+    "step": 500,
+    "loss": 0.00017192620725836605
+  },
+  {
+    "step": 501,
+    "loss": 0.00016207808221224695
+  },
+  {
+    "step": 502,
+    "loss": 0.00019332132069393992
+  },
+  {
+    "step": 503,
+    "loss": 0.00013236758240964264
+  },
+  {
+    "step": 504,
+    "loss": 0.00019344141765031964
+  },
+  {
+    "step": 505,
+    "loss": 0.00012432462244760245
+  },
+  {
+    "step": 506,
+    "loss": 0.00018062139861285686
+  },
+  {
+    "step": 507,
+    "loss": 0.0002040426479652524
+  },
+  {
+    "step": 508,
+    "loss": 0.00016633719496894628
+  },
+  {
+    "step": 509,
+    "loss": 0.00012018586858175695
+  },
+  {
+    "step": 510,
+    "loss": 0.00016165219130925834
+  },
+  {
+    "step": 511,
+    "loss": 0.00012136522127548233
+  },
+  {
+    "step": 512,
+    "loss": 0.00014335130981635302
+  },
+  {
+    "step": 513,
+    "loss": 0.00010707334877224639
+  },
+  {
+    "step": 514,
+    "loss": 0.0001557150826556608
+  },
+  {
+    "step": 515,
+    "loss": 0.00021331747120711952
+  },
+  {
+    "step": 516,
+    "loss": 0.00016026993398554623
+  },
+  {
+    "step": 517,
+    "loss": 0.00016961153596639633
+  },
+  {
+    "step": 518,
+    "loss": 0.0001843321369960904
+  },
+  {
+    "step": 519,
+    "loss": 0.00012998696183785796
+  },
+  {
+    "step": 520,
+    "loss": 0.00012902033631689847
+  },
+  {
+    "step": 521,
+    "loss": 0.00016278760449495167
+  },
+  {
+    "step": 522,
+    "loss": 0.00012060298467986286
+  },
+  {
+    "step": 523,
+    "loss": 0.0001362343318760395
+  },
+  {
+    "step": 524,
+    "loss": 0.00014551333151757717
+  },
+  {
+    "step": 525,
+    "loss": 0.00017038352962117642
+  },
+  {
+    "step": 526,
+    "loss": 0.00010621285036904737
+  },
+  {
+    "step": 527,
+    "loss": 0.00012015821266686544
+  },
+  {
+    "step": 528,
+    "loss": 0.00018133147386834025
+  },
+  {
+    "step": 529,
+    "loss": 0.00017483507690485567
+  },
+  {
+    "step": 530,
+    "loss": 0.00011044818529626355
+  },
+  {
+    "step": 531,
+    "loss": 9.428214252693579e-05
+  },
+  {
+    "step": 532,
+    "loss": 0.00010843307973118499
+  },
+  {
+    "step": 533,
+    "loss": 8.115798846120015e-05
+  },
+  {
+    "step": 534,
+    "loss": 0.00012435934331733733
+  },
+  {
+    "step": 535,
+    "loss": 0.00014280318282544613
+  },
+  {
+    "step": 536,
+    "loss": 9.947520447894931e-05
+  },
+  {
+    "step": 537,
+    "loss": 0.00010027504322351888
+  },
+  {
+    "step": 538,
+    "loss": 0.00020923609554301947
+  },
+  {
+    "step": 539,
+    "loss": 9.75533330347389e-05
+  },
+  {
+    "step": 540,
+    "loss": 0.00012557615991681814
+  },
+  {
+    "step": 541,
+    "loss": 0.0002348688431084156
+  },
+  {
+    "step": 542,
+    "loss": 0.0001626730227144435
+  },
+  {
+    "step": 543,
+    "loss": 0.00011628779611783102
+  },
+  {
+    "step": 544,
+    "loss": 0.000119633914437145
+  },
+  {
+    "step": 545,
+    "loss": 0.00013337440032046288
+  },
+  {
+    "step": 546,
+    "loss": 0.0001353192637907341
+  },
+  {
+    "step": 547,
+    "loss": 0.00012630199489649385
+  },
+  {
+    "step": 548,
+    "loss": 0.00010751744412118569
+  },
+  {
+    "step": 549,
+    "loss": 8.61966036609374e-05
+  },
+  {
+    "step": 550,
+    "loss": 0.00016346773190889508
+  },
+  {
+    "step": 551,
+    "loss": 7.430368714267388e-05
+  },
+  {
+    "step": 552,
+    "loss": 0.00011318909673718736
+  },
+  {
+    "step": 553,
+    "loss": 0.0001584015117259696
+  },
+  {
+    "step": 554,
+    "loss": 0.00012385571608319879
+  },
+  {
+    "step": 555,
+    "loss": 0.00011698518210323527
+  },
+  {
+    "step": 556,
+    "loss": 9.53805647441186e-05
+  },
+  {
+    "step": 557,
+    "loss": 0.00012744155537802726
+  },
+  {
+    "step": 558,
+    "loss": 0.00011987650213995948
+  },
+  {
+    "step": 559,
+    "loss": 0.00013968604616820812
+  },
+  {
+    "step": 560,
+    "loss": 8.258598973043263e-05
+  },
+  {
+    "step": 561,
+    "loss": 0.00010285875760018826
+  },
+  {
+    "step": 562,
+    "loss": 0.00014057931548450142
+  },
+  {
+    "step": 563,
+    "loss": 0.00011140060814796016
+  },
+  {
+    "step": 564,
+    "loss": 0.00013203671551309526
+  },
+  {
+    "step": 565,
+    "loss": 0.00016813237743917853
+  },
+  {
+    "step": 566,
+    "loss": 0.00011731698032235727
+  },
+  {
+    "step": 567,
+    "loss": 0.00010923548688879237
+  },
+  {
+    "step": 568,
+    "loss": 0.00011262848420301452
+  },
+  {
+    "step": 569,
+    "loss": 0.00011464191629784182
+  },
+  {
+    "step": 570,
+    "loss": 6.546290387632325e-05
+  },
+  {
+    "step": 571,
+    "loss": 9.010313806356862e-05
+  },
+  {
+    "step": 572,
+    "loss": 8.358415652764961e-05
+  },
+  {
+    "step": 573,
+    "loss": 0.00013546133413910866
+  },
+  {
+    "step": 574,
+    "loss": 0.0001305073528783396
+  },
+  {
+    "step": 575,
+    "loss": 0.00010514203313505277
+  },
+  {
+    "step": 576,
+    "loss": 0.00011878472287207842
+  },
+  {
+    "step": 577,
+    "loss": 8.75715704751201e-05
+  },
+  {
+    "step": 578,
+    "loss": 6.204524106578901e-05
+  },
+  {
+    "step": 579,
+    "loss": 0.00013099996431265026
+  },
+  {
+    "step": 580,
+    "loss": 0.00012643200170714408
+  },
+  {
+    "step": 581,
+    "loss": 7.279518467839807e-05
+  },
+  {
+    "step": 582,
+    "loss": 7.083259697537869e-05
+  },
+  {
+    "step": 583,
+    "loss": 0.0001259616983588785
+  },
+  {
+    "step": 584,
+    "loss": 7.268726039910689e-05
+  },
+  {
+    "step": 585,
+    "loss": 9.528159716865048e-05
+  },
+  {
+    "step": 586,
+    "loss": 0.00011390962026780471
+  },
+  {
+    "step": 587,
+    "loss": 0.00011355730384821072
+  },
+  {
+    "step": 588,
+    "loss": 7.672872015973553e-05
+  },
+  {
+    "step": 589,
+    "loss": 0.00010336452396586537
+  },
+  {
+    "step": 590,
+    "loss": 7.983711111592129e-05
+  },
+  {
+    "step": 591,
+    "loss": 8.079127292148769e-05
+  },
+  {
+    "step": 592,
+    "loss": 8.563802839489654e-05
+  },
+  {
+    "step": 593,
+    "loss": 5.129465716890991e-05
+  },
+  {
+    "step": 594,
+    "loss": 9.051559754880145e-05
+  },
+  {
+    "step": 595,
+    "loss": 0.00013328510976862162
+  },
+  {
+    "step": 596,
+    "loss": 7.226483285194263e-05
+  },
+  {
+    "step": 597,
+    "loss": 9.497960127191618e-05
+  },
+  {
+    "step": 598,
+    "loss": 7.247299799928442e-05
+  },
+  {
+    "step": 599,
+    "loss": 7.248116162372753e-05
+  },
+  {
+    "step": 600,
+    "loss": 6.73218528390862e-05
+  },
+  {
+    "step": 601,
+    "loss": 0.00013697922986466438
+  },
+  {
+    "step": 602,
+    "loss": 6.761865370208398e-05
+  },
+  {
+    "step": 603,
+    "loss": 0.000114313697849866
+  },
+  {
+    "step": 604,
+    "loss": 8.475108916172758e-05
+  },
+  {
+    "step": 605,
+    "loss": 5.625174890155904e-05
+  },
+  {
+    "step": 606,
+    "loss": 0.00010295499669155106
+  },
+  {
+    "step": 607,
+    "loss": 8.070701005635783e-05
+  },
+  {
+    "step": 608,
+    "loss": 6.785314326407388e-05
+  },
+  {
+    "step": 609,
+    "loss": 6.935095734661445e-05
+  },
+  {
+    "step": 610,
+    "loss": 9.16247590794228e-05
+  },
+  {
+    "step": 611,
+    "loss": 6.113445124356076e-05
+  },
+  {
+    "step": 612,
+    "loss": 8.006054122233763e-05
+  },
+  {
+    "step": 613,
+    "loss": 9.419117122888565e-05
+  },
+  {
+    "step": 614,
+    "loss": 7.974763138918206e-05
+  },
+  {
+    "step": 615,
+    "loss": 7.098183414200321e-05
+  },
+  {
+    "step": 616,
+    "loss": 0.00010016517626354471
+  },
+  {
+    "step": 617,
+    "loss": 8.779895870247856e-05
+  },
+  {
+    "step": 618,
+    "loss": 6.905473856022581e-05
+  },
+  {
+    "step": 619,
+    "loss": 0.00011035263742087409
+  },
+  {
+    "step": 620,
+    "loss": 7.513630407629535e-05
+  },
+  {
+    "step": 621,
+    "loss": 5.916446025366895e-05
+  },
+  {
+    "step": 622,
+    "loss": 6.115859287092462e-05
+  },
+  {
+    "step": 623,
+    "loss": 6.268815923249349e-05
+  },
+  {
+    "step": 624,
+    "loss": 0.00011177668784512207
+  },
+  {
+    "step": 625,
+    "loss": 7.581079989904538e-05
+  },
+  {
+    "step": 626,
+    "loss": 8.877614891389385e-05
+  },
+  {
+    "step": 627,
+    "loss": 7.647431630175561e-05
+  },
+  {
+    "step": 628,
+    "loss": 7.775545964250341e-05
+  },
+  {
+    "step": 629,
+    "loss": 0.00014768767869099975
+  },
+  {
+    "step": 630,
+    "loss": 7.53742569941096e-05
+  },
+  {
+    "step": 631,
+    "loss": 7.072134030750021e-05
+  },
+  {
+    "step": 632,
+    "loss": 8.389225695282221e-05
+  },
+  {
+    "step": 633,
+    "loss": 8.39108761283569e-05
+  },
+  {
+    "step": 634,
+    "loss": 6.663012754870579e-05
+  },
+  {
+    "step": 635,
+    "loss": 8.717639138922095e-05
+  },
+  {
+    "step": 636,
+    "loss": 5.996786057949066e-05
+  },
+  {
+    "step": 637,
+    "loss": 6.979103636695072e-05
+  },
+  {
+    "step": 638,
+    "loss": 6.190224667079747e-05
+  },
+  {
+    "step": 639,
+    "loss": 7.813287083990872e-05
+  },
+  {
+    "step": 640,
+    "loss": 7.93301296653226e-05
+  },
+  {
+    "step": 641,
+    "loss": 6.91664608893916e-05
+  },
+  {
+    "step": 642,
+    "loss": 9.133617277257144e-05
+  },
+  {
+    "step": 643,
+    "loss": 8.29241398605518e-05
+  },
+  {
+    "step": 644,
+    "loss": 8.593094389652833e-05
+  },
+  {
+    "step": 645,
+    "loss": 6.594815931748599e-05
+  },
+  {
+    "step": 646,
+    "loss": 6.79824806866236e-05
+  },
+  {
+    "step": 647,
+    "loss": 6.970041431486607e-05
+  },
+  {
+    "step": 648,
+    "loss": 9.847671026363969e-05
+  },
+  {
+    "step": 649,
+    "loss": 7.239603291964158e-05
+  },
+  {
+    "step": 650,
+    "loss": 0.00010341023880755529
+  },
+  {
+    "step": 651,
+    "loss": 6.301920075202361e-05
+  },
+  {
+    "step": 652,
+    "loss": 9.607273386791348e-05
+  },
+  {
+    "step": 653,
+    "loss": 5.220608727540821e-05
+  },
+  {
+    "step": 654,
+    "loss": 6.844057497801259e-05
+  },
+  {
+    "step": 655,
+    "loss": 7.627534068888053e-05
+  },
+  {
+    "step": 656,
+    "loss": 4.670541966333985e-05
+  },
+  {
+    "step": 657,
+    "loss": 6.726655556121841e-05
+  },
+  {
+    "step": 658,
+    "loss": 7.288042252184823e-05
+  },
+  {
+    "step": 659,
+    "loss": 5.193417382542975e-05
+  },
+  {
+    "step": 660,
+    "loss": 4.3492076656548306e-05
+  },
+  {
+    "step": 661,
+    "loss": 7.822782936273143e-05
+  },
+  {
+    "step": 662,
+    "loss": 7.773065590299666e-05
+  },
+  {
+    "step": 663,
+    "loss": 5.234552372712642e-05
+  },
+  {
+    "step": 664,
+    "loss": 5.6671520724194124e-05
+  },
+  {
+    "step": 665,
+    "loss": 5.064344804850407e-05
+  },
+  {
+    "step": 666,
+    "loss": 7.250627822941169e-05
+  },
+  {
+    "step": 667,
+    "loss": 9.778315870789811e-05
+  },
+  {
+    "step": 668,
+    "loss": 8.177542622433975e-05
+  },
+  {
+    "step": 669,
+    "loss": 7.258812547661364e-05
+  },
+  {
+    "step": 670,
+    "loss": 6.23580563114956e-05
+  },
+  {
+    "step": 671,
+    "loss": 7.665148586966097e-05
+  },
+  {
+    "step": 672,
+    "loss": 5.3210478654364124e-05
+  },
+  {
+    "step": 673,
+    "loss": 5.734108344768174e-05
+  },
+  {
+    "step": 674,
+    "loss": 4.754469046019949e-05
+  },
+  {
+    "step": 675,
+    "loss": 4.532705861493014e-05
+  },
+  {
+    "step": 676,
+    "loss": 7.370367529802024e-05
+  },
+  {
+    "step": 677,
+    "loss": 7.670718332519755e-05
+  },
+  {
+    "step": 678,
+    "loss": 5.8981982874684036e-05
+  },
+  {
+    "step": 679,
+    "loss": 4.8131081712199375e-05
+  },
+  {
+    "step": 680,
+    "loss": 3.8917358324397355e-05
+  },
+  {
+    "step": 681,
+    "loss": 6.147359817987308e-05
+  },
+  {
+    "step": 682,
+    "loss": 5.384144969866611e-05
+  },
+  {
+    "step": 683,
+    "loss": 7.871555135352537e-05
+  },
+  {
+    "step": 684,
+    "loss": 5.017386865802109e-05
+  },
+  {
+    "step": 685,
+    "loss": 7.721318979747593e-05
+  },
+  {
+    "step": 686,
+    "loss": 7.516440382460132e-05
+  },
+  {
+    "step": 687,
+    "loss": 5.075359877082519e-05
+  },
+  {
+    "step": 688,
+    "loss": 4.777922003995627e-05
+  },
+  {
+    "step": 689,
+    "loss": 5.930324550718069e-05
+  },
+  {
+    "step": 690,
+    "loss": 8.444973354926333e-05
+  },
+  {
+    "step": 691,
+    "loss": 4.958258068654686e-05
+  },
+  {
+    "step": 692,
+    "loss": 5.628229337162338e-05
+  },
+  {
+    "step": 693,
+    "loss": 4.9850557843456045e-05
+  },
+  {
+    "step": 694,
+    "loss": 5.847593638463877e-05
+  },
+  {
+    "step": 695,
+    "loss": 5.8600460761226714e-05
+  },
+  {
+    "step": 696,
+    "loss": 5.6509114074287936e-05
+  },
+  {
+    "step": 697,
+    "loss": 2.742746437434107e-05
+  },
+  {
+    "step": 698,
+    "loss": 7.35272842575796e-05
+  },
+  {
+    "step": 699,
+    "loss": 5.418428554548882e-05
+  },
+  {
+    "step": 700,
+    "loss": 7.754520629532635e-05
+  },
+  {
+    "step": 701,
+    "loss": 5.2107759984210134e-05
+  },
+  {
+    "step": 702,
+    "loss": 5.144680108060129e-05
+  },
+  {
+    "step": 703,
+    "loss": 3.5951561585534364e-05
+  },
+  {
+    "step": 704,
+    "loss": 7.065308454912156e-05
+  },
+  {
+    "step": 705,
+    "loss": 7.688086770940572e-05
+  },
+  {
+    "step": 706,
+    "loss": 5.224721462582238e-05
+  },
+  {
+    "step": 707,
+    "loss": 6.141869380371645e-05
+  },
+  {
+    "step": 708,
+    "loss": 6.94100817781873e-05
+  },
+  {
+    "step": 709,
+    "loss": 5.13303566549439e-05
+  },
+  {
+    "step": 710,
+    "loss": 5.0170638132840395e-05
+  },
+  {
+    "step": 711,
+    "loss": 8.088144386420026e-05
+  },
+  {
+    "step": 712,
+    "loss": 5.964167939964682e-05
+  },
+  {
+    "step": 713,
+    "loss": 5.04600175190717e-05
+  },
+  {
+    "step": 714,
+    "loss": 4.955663825967349e-05
+  },
+  {
+    "step": 715,
+    "loss": 4.5502525608753785e-05
+  },
+  {
+    "step": 716,
+    "loss": 6.89330481691286e-05
+  },
+  {
+    "step": 717,
+    "loss": 5.139392669661902e-05
+  },
+  {
+    "step": 718,
+    "loss": 3.8748210499761626e-05
+  },
+  {
+    "step": 719,
+    "loss": 4.350653398432769e-05
+  },
+  {
+    "step": 720,
+    "loss": 3.8589721953030676e-05
+  },
+  {
+    "step": 721,
+    "loss": 4.1507675632601604e-05
+  },
+  {
+    "step": 722,
+    "loss": 5.905623038415797e-05
+  },
+  {
+    "step": 723,
+    "loss": 4.880460983258672e-05
+  },
+  {
+    "step": 724,
+    "loss": 7.85744414315559e-05
+  },
+  {
+    "step": 725,
+    "loss": 4.867996904067695e-05
+  },
+  {
+    "step": 726,
+    "loss": 4.558531509246677e-05
+  },
+  {
+    "step": 727,
+    "loss": 7.785687921568751e-05
+  },
+  {
+    "step": 728,
+    "loss": 5.31146397406701e-05
+  },
+  {
+    "step": 729,
+    "loss": 4.320524385548197e-05
+  },
+  {
+    "step": 730,
+    "loss": 5.161629451322369e-05
+  },
+  {
+    "step": 731,
+    "loss": 7.457525498466566e-05
+  },
+  {
+    "step": 732,
+    "loss": 3.784098589676432e-05
+  },
+  {
+    "step": 733,
+    "loss": 3.9997397834667936e-05
+  },
+  {
+    "step": 734,
+    "loss": 4.800429451279342e-05
+  },
+  {
+    "step": 735,
+    "loss": 3.912579995812848e-05
+  },
+  {
+    "step": 736,
+    "loss": 5.138700362294912e-05
+  },
+  {
+    "step": 737,
+    "loss": 3.875792390317656e-05
+  },
+  {
+    "step": 738,
+    "loss": 3.255242700106464e-05
+  },
+  {
+    "step": 739,
+    "loss": 8.03593939053826e-05
+  },
+  {
+    "step": 740,
+    "loss": 7.85413576522842e-05
+  },
+  {
+    "step": 741,
+    "loss": 5.013379268348217e-05
+  },
+  {
+    "step": 742,
+    "loss": 3.360456685186364e-05
+  },
+  {
+    "step": 743,
+    "loss": 7.5185474997852e-05
+  },
+  {
+    "step": 744,
+    "loss": 5.446956129162572e-05
+  },
+  {
+    "step": 745,
+    "loss": 6.278049841057509e-05
+  },
+  {
+    "step": 746,
+    "loss": 2.857193430827465e-05
+  },
+  {
+    "step": 747,
+    "loss": 4.426307350513525e-05
+  },
+  {
+    "step": 748,
+    "loss": 9.235256584361196e-05
+  },
+  {
+    "step": 749,
+    "loss": 4.217204332235269e-05
+  },
+  {
+    "step": 750,
+    "loss": 0.00011152686784043908
+  },
+  {
+    "step": 751,
+    "loss": 5.2723466069437563e-05
+  },
+  {
+    "step": 752,
+    "loss": 3.8620721170445904e-05
+  },
+  {
+    "step": 753,
+    "loss": 4.1139370296150446e-05
+  },
+  {
+    "step": 754,
+    "loss": 5.118903936818242e-05
+  },
+  {
+    "step": 755,
+    "loss": 3.725053102243692e-05
+  },
+  {
+    "step": 756,
+    "loss": 3.868778367177583e-05
+  },
+  {
+    "step": 757,
+    "loss": 4.965986227034591e-05
+  },
+  {
+    "step": 758,
+    "loss": 6.0765203670598567e-05
+  },
+  {
+    "step": 759,
+    "loss": 5.0804781494662166e-05
+  },
+  {
+    "step": 760,
+    "loss": 6.778082752134651e-05
+  },
+  {
+    "step": 761,
+    "loss": 4.478632763493806e-05
+  },
+  {
+    "step": 762,
+    "loss": 4.290972356102429e-05
+  },
+  {
+    "step": 763,
+    "loss": 6.032783494447358e-05
+  },
+  {
+    "step": 764,
+    "loss": 3.991456105723046e-05
+  },
+  {
+    "step": 765,
+    "loss": 3.520770769682713e-05
+  },
+  {
+    "step": 766,
+    "loss": 4.938886559102684e-05
+  },
+  {
+    "step": 767,
+    "loss": 4.683554652729072e-05
+  },
+  {
+    "step": 768,
+    "loss": 5.009514279663563e-05
+  },
+  {
+    "step": 769,
+    "loss": 6.396450771717355e-05
+  },
+  {
+    "step": 770,
+    "loss": 3.1041538022691384e-05
+  },
+  {
+    "step": 771,
+    "loss": 3.481450767139904e-05
+  },
+  {
+    "step": 772,
+    "loss": 5.589434294961393e-05
+  },
+  {
+    "step": 773,
+    "loss": 5.8833553339354694e-05
+  },
+  {
+    "step": 774,
+    "loss": 5.430680175777525e-05
+  },
+  {
+    "step": 775,
+    "loss": 7.677223038626835e-05
+  },
+  {
+    "step": 776,
+    "loss": 5.7799421483650804e-05
+  },
+  {
+    "step": 777,
+    "loss": 4.483397424337454e-05
+  },
+  {
+    "step": 778,
+    "loss": 5.022974801249802e-05
+  },
+  {
+    "step": 779,
+    "loss": 3.389180710655637e-05
+  },
+  {
+    "step": 780,
+    "loss": 6.573680002475157e-05
+  },
+  {
+    "step": 781,
+    "loss": 4.3133408325957134e-05
+  },
+  {
+    "step": 782,
+    "loss": 3.9081915019778535e-05
+  },
+  {
+    "step": 783,
+    "loss": 5.957396570011042e-05
+  },
+  {
+    "step": 784,
+    "loss": 3.2760111935203895e-05
+  },
+  {
+    "step": 785,
+    "loss": 3.9164937334135175e-05
+  },
+  {
+    "step": 786,
+    "loss": 3.3731575967976823e-05
+  },
+  {
+    "step": 787,
+    "loss": 4.178464223514311e-05
+  },
+  {
+    "step": 788,
+    "loss": 5.0953112804563716e-05
+  },
+  {
+    "step": 789,
+    "loss": 6.073104668757878e-05
+  },
+  {
+    "step": 790,
+    "loss": 3.55787888111081e-05
+  },
+  {
+    "step": 791,
+    "loss": 3.6389788874657825e-05
+  },
+  {
+    "step": 792,
+    "loss": 4.405791696626693e-05
+  },
+  {
+    "step": 793,
+    "loss": 5.134267485118471e-05
+  },
+  {
+    "step": 794,
+    "loss": 5.064508877694607e-05
+  },
+  {
+    "step": 795,
+    "loss": 4.6394619857892394e-05
+  },
+  {
+    "step": 796,
+    "loss": 4.283888847567141e-05
+  },
+  {
+    "step": 797,
+    "loss": 3.128914613625966e-05
+  },
+  {
+    "step": 798,
+    "loss": 4.0514019929105416e-05
+  },
+  {
+    "step": 799,
+    "loss": 3.17574231303297e-05
+  },
+  {
+    "step": 800,
+    "loss": 3.831305366475135e-05
+  },
+  {
+    "step": 801,
+    "loss": 3.380465568625368e-05
+  },
+  {
+    "step": 802,
+    "loss": 4.1747483919607475e-05
+  },
+  {
+    "step": 803,
+    "loss": 5.209569644648582e-05
+  },
+  {
+    "step": 804,
+    "loss": 4.0938815800473094e-05
+  },
+  {
+    "step": 805,
+    "loss": 3.6975146940676495e-05
+  },
+  {
+    "step": 806,
+    "loss": 5.969242556602694e-05
+  },
+  {
+    "step": 807,
+    "loss": 4.881088898400776e-05
+  },
+  {
+    "step": 808,
+    "loss": 5.488819442689419e-05
+  },
+  {
+    "step": 809,
+    "loss": 3.620257120928727e-05
+  },
+  {
+    "step": 810,
+    "loss": 3.38389327225741e-05
+  },
+  {
+    "step": 811,
+    "loss": 4.1072460589930415e-05
+  },
+  {
+    "step": 812,
+    "loss": 3.015481161128264e-05
+  },
+  {
+    "step": 813,
+    "loss": 3.81503596145194e-05
+  },
+  {
+    "step": 814,
+    "loss": 3.950657628593035e-05
+  },
+  {
+    "step": 815,
+    "loss": 6.626908725593239e-05
+  },
+  {
+    "step": 816,
+    "loss": 3.733333505806513e-05
+  },
+  {
+    "step": 817,
+    "loss": 3.75039380742237e-05
+  },
+  {
+    "step": 818,
+    "loss": 2.3193149900180288e-05
+  },
+  {
+    "step": 819,
+    "loss": 2.903567838075105e-05
+  },
+  {
+    "step": 820,
+    "loss": 3.4161370422225446e-05
+  },
+  {
+    "step": 821,
+    "loss": 3.6673391150543466e-05
+  },
+  {
+    "step": 822,
+    "loss": 3.4213757317047566e-05
+  },
+  {
+    "step": 823,
+    "loss": 5.179776417207904e-05
+  },
+  {
+    "step": 824,
+    "loss": 6.150371336843818e-05
+  },
+  {
+    "step": 825,
+    "loss": 4.257526597939432e-05
+  },
+  {
+    "step": 826,
+    "loss": 4.460889977053739e-05
+  },
+  {
+    "step": 827,
+    "loss": 2.52907721005613e-05
+  },
+  {
+    "step": 828,
+    "loss": 3.197701880708337e-05
+  },
+  {
+    "step": 829,
+    "loss": 6.140270852483809e-05
+  },
+  {
+    "step": 830,
+    "loss": 3.240482692490332e-05
+  },
+  {
+    "step": 831,
+    "loss": 5.1292357966303825e-05
+  },
+  {
+    "step": 832,
+    "loss": 5.093583240523003e-05
+  },
+  {
+    "step": 833,
+    "loss": 4.850427285418846e-05
+  },
+  {
+    "step": 834,
+    "loss": 6.960558675928041e-05
+  },
+  {
+    "step": 835,
+    "loss": 7.678593101445585e-05
+  },
+  {
+    "step": 836,
+    "loss": 8.32404984976165e-05
+  },
+  {
+    "step": 837,
+    "loss": 7.615869253640994e-05
+  },
+  {
+    "step": 838,
+    "loss": 5.3464445954887196e-05
+  },
+  {
+    "step": 839,
+    "loss": 3.770905823330395e-05
+  },
+  {
+    "step": 840,
+    "loss": 3.921347524737939e-05
+  },
+  {
+    "step": 841,
+    "loss": 6.033069803379476e-05
+  },
+  {
+    "step": 842,
+    "loss": 2.9334230930544436e-05
+  },
+  {
+    "step": 843,
+    "loss": 2.4360822862945497e-05
+  },
+  {
+    "step": 844,
+    "loss": 3.2663767342455685e-05
+  },
+  {
+    "step": 845,
+    "loss": 6.436731200665236e-05
+  },
+  {
+    "step": 846,
+    "loss": 3.339327304274775e-05
+  },
+  {
+    "step": 847,
+    "loss": 4.318403443903662e-05
+  },
+  {
+    "step": 848,
+    "loss": 5.380488801165484e-05
+  },
+  {
+    "step": 849,
+    "loss": 4.5536977268056944e-05
+  },
+  {
+    "step": 850,
+    "loss": 4.814259227714501e-05
+  },
+  {
+    "step": 851,
+    "loss": 3.36906268785242e-05
+  },
+  {
+    "step": 852,
+    "loss": 4.7770623496035114e-05
+  },
+  {
+    "step": 853,
+    "loss": 2.67600789811695e-05
+  },
+  {
+    "step": 854,
+    "loss": 4.417241507326253e-05
+  },
+  {
+    "step": 855,
+    "loss": 2.7567404686124064e-05
+  },
+  {
+    "step": 856,
+    "loss": 3.541396290529519e-05
+  },
+  {
+    "step": 857,
+    "loss": 5.021237666369416e-05
+  },
+  {
+    "step": 858,
+    "loss": 4.059194543515332e-05
+  },
+  {
+    "step": 859,
+    "loss": 6.508460501208901e-05
+  },
+  {
+    "step": 860,
+    "loss": 4.6092114644125104e-05
+  },
+  {
+    "step": 861,
+    "loss": 3.945984281017445e-05
+  },
+  {
+    "step": 862,
+    "loss": 5.2890496590407565e-05
+  },
+  {
+    "step": 863,
+    "loss": 4.0571325371274725e-05
+  },
+  {
+    "step": 864,
+    "loss": 4.2774074245244265e-05
+  },
+  {
+    "step": 865,
+    "loss": 4.8873829655349255e-05
+  },
+  {
+    "step": 866,
+    "loss": 3.2655887480359524e-05
+  },
+  {
+    "step": 867,
+    "loss": 3.8124500861158594e-05
+  },
+  {
+    "step": 868,
+    "loss": 5.483811764861457e-05
+  },
+  {
+    "step": 869,
+    "loss": 6.175784074002877e-05
+  },
+  {
+    "step": 870,
+    "loss": 7.230093615362421e-05
+  },
+  {
+    "step": 871,
+    "loss": 3.9530001231469214e-05
+  },
+  {
+    "step": 872,
+    "loss": 5.225742643233389e-05
+  },
+  {
+    "step": 873,
+    "loss": 2.7709093046723865e-05
+  },
+  {
+    "step": 874,
+    "loss": 3.840391946141608e-05
+  },
+  {
+    "step": 875,
+    "loss": 5.421943205874413e-05
+  },
+  {
+    "step": 876,
+    "loss": 3.348307654960081e-05
+  },
+  {
+    "step": 877,
+    "loss": 2.5930790798156522e-05
+  },
+  {
+    "step": 878,
+    "loss": 2.2811376766185276e-05
+  },
+  {
+    "step": 879,
+    "loss": 3.48653738910798e-05
+  },
+  {
+    "step": 880,
+    "loss": 2.9580040063592605e-05
+  },
+  {
+    "step": 881,
+    "loss": 3.9384107367368415e-05
+  },
+  {
+    "step": 882,
+    "loss": 7.168584852479398e-05
+  },
+  {
+    "step": 883,
+    "loss": 6.887059862492606e-05
+  },
+  {
+    "step": 884,
+    "loss": 7.204034773167223e-05
+  },
+  {
+    "step": 885,
+    "loss": 4.8855126806301996e-05
+  },
+  {
+    "step": 886,
+    "loss": 4.0932045521913096e-05
+  },
+  {
+    "step": 887,
+    "loss": 3.6146051570540294e-05
+  },
+  {
+    "step": 888,
+    "loss": 2.9431743314489722e-05
+  },
+  {
+    "step": 889,
+    "loss": 3.917128196917474e-05
+  },
+  {
+    "step": 890,
+    "loss": 3.353999272803776e-05
+  },
+  {
+    "step": 891,
+    "loss": 3.9634287531953305e-05
+  },
+  {
+    "step": 892,
+    "loss": 4.521043229033239e-05
+  },
+  {
+    "step": 893,
+    "loss": 3.914851913577877e-05
+  },
+  {
+    "step": 894,
+    "loss": 3.273681068094447e-05
+  },
+  {
+    "step": 895,
+    "loss": 4.8501049604965374e-05
+  },
+  {
+    "step": 896,
+    "loss": 2.9001372240600176e-05
+  },
+  {
+    "step": 897,
+    "loss": 4.581235407385975e-05
+  },
+  {
+    "step": 898,
+    "loss": 3.5908618883695453e-05
+  },
+  {
+    "step": 899,
+    "loss": 3.369492696947418e-05
+  },
+  {
+    "step": 900,
+    "loss": 3.6820234527112916e-05
+  },
+  {
+    "step": 901,
+    "loss": 2.9454646210069768e-05
+  },
+  {
+    "step": 902,
+    "loss": 2.057087294815574e-05
+  },
+  {
+    "step": 903,
+    "loss": 5.590774890151806e-05
+  },
+  {
+    "step": 904,
+    "loss": 5.386623161030002e-05
+  },
+  {
+    "step": 905,
+    "loss": 4.019307380076498e-05
+  },
+  {
+    "step": 906,
+    "loss": 4.264774906914681e-05
+  },
+  {
+    "step": 907,
+    "loss": 3.0193754355423152e-05
+  },
+  {
+    "step": 908,
+    "loss": 4.047010952490382e-05
+  },
+  {
+    "step": 909,
+    "loss": 2.7253045118413866e-05
+  },
+  {
+    "step": 910,
+    "loss": 4.412211637827568e-05
+  },
+  {
+    "step": 911,
+    "loss": 4.2576080886647105e-05
+  },
+  {
+    "step": 912,
+    "loss": 5.2380190027179196e-05
+  },
+  {
+    "step": 913,
+    "loss": 5.072293060948141e-05
+  },
+  {
+    "step": 914,
+    "loss": 4.44481847807765e-05
+  },
+  {
+    "step": 915,
+    "loss": 3.6995836126152426e-05
+  },
+  {
+    "step": 916,
+    "loss": 3.489855953375809e-05
+  },
+  {
+    "step": 917,
+    "loss": 2.8581869628396817e-05
+  },
+  {
+    "step": 918,
+    "loss": 4.2091396608157083e-05
+  },
+  {
+    "step": 919,
+    "loss": 3.62262871931307e-05
+  },
+  {
+    "step": 920,
+    "loss": 3.481099338387139e-05
+  },
+  {
+    "step": 921,
+    "loss": 1.97001045307843e-05
+  },
+  {
+    "step": 922,
+    "loss": 8.956357487477362e-05
+  },
+  {
+    "step": 923,
+    "loss": 3.339766408316791e-05
+  },
+  {
+    "step": 924,
+    "loss": 2.9916904168203473e-05
+  },
+  {
+    "step": 925,
+    "loss": 5.436725405161269e-05
+  },
+  {
+    "step": 926,
+    "loss": 5.154693280928768e-05
+  },
+  {
+    "step": 927,
+    "loss": 2.060957376670558e-05
+  },
+  {
+    "step": 928,
+    "loss": 2.60735450865468e-05
+  },
+  {
+    "step": 929,
+    "loss": 3.3344145776936784e-05
+  },
+  {
+    "step": 930,
+    "loss": 3.738240047823638e-05
+  },
+  {
+    "step": 931,
+    "loss": 2.0977262465748936e-05
+  },
+  {
+    "step": 932,
+    "loss": 3.7641613744199276e-05
+  },
+  {
+    "step": 933,
+    "loss": 4.38827155448962e-05
+  },
+  {
+    "step": 934,
+    "loss": 3.208504858775996e-05
+  },
+  {
+    "step": 935,
+    "loss": 4.779608570970595e-05
+  },
+  {
+    "step": 936,
+    "loss": 3.210781142115593e-05
+  },
+  {
+    "step": 937,
+    "loss": 4.263381924829446e-05
+  },
+  {
+    "step": 938,
+    "loss": 3.417470361455344e-05
+  },
+  {
+    "step": 939,
+    "loss": 5.1342056394787505e-05
+  },
+  {
+    "step": 940,
+    "loss": 4.140641613048501e-05
+  },
+  {
+    "step": 941,
+    "loss": 5.946300007053651e-05
+  },
+  {
+    "step": 942,
+    "loss": 3.752993143280037e-05
+  },
+  {
+    "step": 943,
+    "loss": 3.4755910746753216e-05
+  },
+  {
+    "step": 944,
+    "loss": 4.9219492211705074e-05
+  },
+  {
+    "step": 945,
+    "loss": 6.879289139760658e-05
+  },
+  {
+    "step": 946,
+    "loss": 5.401618909672834e-05
+  },
+  {
+    "step": 947,
+    "loss": 4.2125218897126615e-05
+  },
+  {
+    "step": 948,
+    "loss": 2.372314156673383e-05
+  },
+  {
+    "step": 949,
+    "loss": 5.179044455871917e-05
+  },
+  {
+    "step": 950,
+    "loss": 3.851362635032274e-05
+  },
+  {
+    "step": 951,
+    "loss": 4.2687650420702994e-05
+  },
+  {
+    "step": 952,
+    "loss": 4.797130895894952e-05
+  },
+  {
+    "step": 953,
+    "loss": 3.6229925171937793e-05
+  },
+  {
+    "step": 954,
+    "loss": 4.384322892292403e-05
+  },
+  {
+    "step": 955,
+    "loss": 3.458386709098704e-05
+  },
+  {
+    "step": 956,
+    "loss": 3.076700886595063e-05
+  },
+  {
+    "step": 957,
+    "loss": 5.302367208059877e-05
+  },
+  {
+    "step": 958,
+    "loss": 4.840013571083546e-05
+  },
+  {
+    "step": 959,
+    "loss": 2.611352101666853e-05
+  },
+  {
+    "step": 960,
+    "loss": 5.0977843784494326e-05
+  },
+  {
+    "step": 961,
+    "loss": 2.325777313672006e-05
+  },
+  {
+    "step": 962,
+    "loss": 2.9607332180603407e-05
+  },
+  {
+    "step": 963,
+    "loss": 3.782792191486806e-05
+  },
+  {
+    "step": 964,
+    "loss": 3.496675344649702e-05
+  },
+  {
+    "step": 965,
+    "loss": 4.206917583360337e-05
+  },
+  {
+    "step": 966,
+    "loss": 4.2345691326772794e-05
+  },
+  {
+    "step": 967,
+    "loss": 3.156326783937402e-05
+  },
+  {
+    "step": 968,
+    "loss": 4.864210859523155e-05
+  },
+  {
+    "step": 969,
+    "loss": 3.356820889166556e-05
+  },
+  {
+    "step": 970,
+    "loss": 4.501901275943965e-05
+  },
+  {
+    "step": 971,
+    "loss": 4.334497862146236e-05
+  },
+  {
+    "step": 972,
+    "loss": 5.5575092119397596e-05
+  },
+  {
+    "step": 973,
+    "loss": 5.53276295249816e-05
+  },
+  {
+    "step": 974,
+    "loss": 2.4033723093452863e-05
+  },
+  {
+    "step": 975,
+    "loss": 3.949943493353203e-05
+  },
+  {
+    "step": 976,
+    "loss": 3.442060187808238e-05
+  },
+  {
+    "step": 977,
+    "loss": 3.445038237259723e-05
+  },
+  {
+    "step": 978,
+    "loss": 5.340079587767832e-05
+  },
+  {
+    "step": 979,
+    "loss": 3.611030479078181e-05
+  },
+  {
+    "step": 980,
+    "loss": 4.4861462811240926e-05
+  },
+  {
+    "step": 981,
+    "loss": 3.090294558205642e-05
+  },
+  {
+    "step": 982,
+    "loss": 2.6695357519201934e-05
+  },
+  {
+    "step": 983,
+    "loss": 2.939527439593803e-05
+  },
+  {
+    "step": 984,
+    "loss": 2.1784499040222727e-05
+  },
+  {
+    "step": 985,
+    "loss": 2.7834381398861296e-05
+  },
+  {
+    "step": 986,
+    "loss": 2.9360509870457463e-05
+  },
+  {
+    "step": 987,
+    "loss": 2.870480966521427e-05
+  },
+  {
+    "step": 988,
+    "loss": 1.7829193893703632e-05
+  },
+  {
+    "step": 989,
+    "loss": 2.9651933800778352e-05
+  },
+  {
+    "step": 990,
+    "loss": 4.10648608522024e-05
+  },
+  {
+    "step": 991,
+    "loss": 2.1995336282998323e-05
+  },
+  {
+    "step": 992,
+    "loss": 3.601106072892435e-05
+  },
+  {
+    "step": 993,
+    "loss": 2.6211551812593825e-05
+  },
+  {
+    "step": 994,
+    "loss": 3.3496718970127404e-05
+  },
+  {
+    "step": 995,
+    "loss": 4.816209548152983e-05
+  },
+  {
+    "step": 996,
+    "loss": 2.461912481521722e-05
+  },
+  {
+    "step": 997,
+    "loss": 3.0271634386735968e-05
+  },
+  {
+    "step": 998,
+    "loss": 3.877824929077178e-05
+  },
+  {
+    "step": 999,
+    "loss": 2.6559528123470955e-05
+  }
+]
diff --git a/lecture_6/verified_examples/mathematics_test_log.txt b/lecture_6/verified_examples/mathematics_test_log.txt
new file mode 100644
index 0000000000000000000000000000000000000000..c0ea09e8b493aff4fddf7068fd5b4766dfc85f91
--- /dev/null
+++ b/lecture_6/verified_examples/mathematics_test_log.txt
@@ -0,0 +1,31 @@
+test_analytic_mixture_velocity (test_mathematics.MathematicsTests.test_analytic_mixture_velocity) ... ok
+test_categorical_numerical_step (test_mathematics.MathematicsTests.test_categorical_numerical_step) ... ok
+test_chen_arithmetic_and_covariance (test_mathematics.MathematicsTests.test_chen_arithmetic_and_covariance) ... ok
+test_chen_tree_matches_increment_sum (test_mathematics.MathematicsTests.test_chen_tree_matches_increment_sum) ... ok
+test_composition_alone_does_not_identify_motion (test_mathematics.MathematicsTests.test_composition_alone_does_not_identify_motion) ... /workspace/scratch/e1464e1e4960/cis6270-code/lecture_6/tests/test_mathematics.py:65: UserWarning: Converting a tensor with requires_grad=True to a scalar may lead to unexpected behavior.
+Consider using tensor.detach() first. (Triggered internally at /pytorch/torch/csrc/autograd/generated/python_variable_methods.cpp:836.)
+  self.assertEqual(float(semigroup_loss(m,m,x,s,t)),0.)
+ok
+test_count_divergence_minimizes_conditional_mean (test_mathematics.MathematicsTests.test_count_divergence_minimizes_conditional_mean) ... ok
+test_decoding_clock_inverse (test_mathematics.MathematicsTests.test_decoding_clock_inverse) ... ok
+test_detached_kl_gradient (test_mathematics.MathematicsTests.test_detached_kl_gradient) ... ok
+test_discrete_teachers_with_zero_derivative (test_mathematics.MathematicsTests.test_discrete_teachers_with_zero_derivative) ... ok
+test_endpoint_match_does_not_remove_temporal_residual (test_mathematics.MathematicsTests.test_endpoint_match_does_not_remove_temporal_residual) ... ok
+test_exact_identity_and_semigroup (test_mathematics.MathematicsTests.test_exact_identity_and_semigroup) ... ok
+test_gap_labels_and_global_budget (test_mathematics.MathematicsTests.test_gap_labels_and_global_budget) ... ok
+test_glass_matches_two_observation_bayes_rule (test_mathematics.MathematicsTests.test_glass_matches_two_observation_bayes_rule) ... ok
+test_glass_no_inner_observation (test_mathematics.MathematicsTests.test_glass_no_inner_observation) ... ok
+test_importance_weights_recover_posterior_mean (test_mathematics.MathematicsTests.test_importance_weights_recover_posterior_mean) ... ok
+test_insertion_interval_zero_and_terminal (test_mathematics.MathematicsTests.test_insertion_interval_zero_and_terminal) ... ok
+test_insertion_preserves_order_and_clocks (test_mathematics.MathematicsTests.test_insertion_preserves_order_and_clocks) ... ok
+test_jvp_losses_reach_parameters (test_mathematics.MathematicsTests.test_jvp_losses_reach_parameters) ... ok
+test_lagrangian_and_eulerian_jvp (test_mathematics.MathematicsTests.test_lagrangian_and_eulerian_jvp) ... ok
+test_meanflow_backward_identity (test_mathematics.MathematicsTests.test_meanflow_backward_identity) ... ok
+test_meta_surrogate_gradient (test_mathematics.MathematicsTests.test_meta_surrogate_gradient) ... ok
+test_same_noise_constant_sde_and_wrong_noise_counterexample (test_mathematics.MathematicsTests.test_same_noise_constant_sde_and_wrong_noise_counterexample) ... ok
+test_weighted_probability_composition_matches_maps (test_mathematics.MathematicsTests.test_weighted_probability_composition_matches_maps) ... ok
+
+----------------------------------------------------------------------
+Ran 23 tests in 0.844s
+
+OK
diff --git a/lecture_6/verified_examples/meanflow/config.json b/lecture_6/verified_examples/meanflow/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..1d2df6f244e8f63ef02b947b37b9633e8bd71299
--- /dev/null
+++ b/lecture_6/verified_examples/meanflow/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "meanflow",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/meanflow"
+}
diff --git a/lecture_6/verified_examples/meanflow/losses.json b/lecture_6/verified_examples/meanflow/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..e384f66651158d3259ec5e560140675072fdcda8
--- /dev/null
+++ b/lecture_6/verified_examples/meanflow/losses.json
@@ -0,0 +1,5002 @@
+[
+  {
+    "step": 0,
+    "loss": 1.6053749322891235,
+    "mse": 2.8584091663360596
+  },
+  {
+    "step": 1,
+    "loss": 1.7924103736877441,
+    "mse": 3.6196768283843994
+  },
+  {
+    "step": 2,
+    "loss": 1.7159883975982666,
+    "mse": 3.272211790084839
+  },
+  {
+    "step": 3,
+    "loss": 1.7537931203842163,
+    "mse": 3.551158905029297
+  },
+  {
+    "step": 4,
+    "loss": 1.7740769386291504,
+    "mse": 3.6103639602661133
+  },
+  {
+    "step": 5,
+    "loss": 1.863503336906433,
+    "mse": 3.9762144088745117
+  },
+  {
+    "step": 6,
+    "loss": 1.6016359329223633,
+    "mse": 2.9058477878570557
+  },
+  {
+    "step": 7,
+    "loss": 1.6479381322860718,
+    "mse": 3.2896695137023926
+  },
+  {
+    "step": 8,
+    "loss": 1.6553840637207031,
+    "mse": 3.2440340518951416
+  },
+  {
+    "step": 9,
+    "loss": 1.5789602994918823,
+    "mse": 3.0235345363616943
+  },
+  {
+    "step": 10,
+    "loss": 1.7013393640518188,
+    "mse": 3.3315019607543945
+  },
+  {
+    "step": 11,
+    "loss": 1.686378002166748,
+    "mse": 3.187070369720459
+  },
+  {
+    "step": 12,
+    "loss": 1.681528091430664,
+    "mse": 3.4189093112945557
+  },
+  {
+    "step": 13,
+    "loss": 1.665783166885376,
+    "mse": 3.350489377975464
+  },
+  {
+    "step": 14,
+    "loss": 1.5697541236877441,
+    "mse": 2.77695894241333
+  },
+  {
+    "step": 15,
+    "loss": 1.5235928297042847,
+    "mse": 2.7044641971588135
+  },
+  {
+    "step": 16,
+    "loss": 1.8676869869232178,
+    "mse": 4.307152271270752
+  },
+  {
+    "step": 17,
+    "loss": 1.5348237752914429,
+    "mse": 2.812380313873291
+  },
+  {
+    "step": 18,
+    "loss": 1.6133053302764893,
+    "mse": 3.0845367908477783
+  },
+  {
+    "step": 19,
+    "loss": 1.7072616815567017,
+    "mse": 3.623814105987549
+  },
+  {
+    "step": 20,
+    "loss": 1.5434868335723877,
+    "mse": 2.9424948692321777
+  },
+  {
+    "step": 21,
+    "loss": 1.7288719415664673,
+    "mse": 3.5407462120056152
+  },
+  {
+    "step": 22,
+    "loss": 1.6760687828063965,
+    "mse": 3.412296772003174
+  },
+  {
+    "step": 23,
+    "loss": 1.5364078283309937,
+    "mse": 2.912407398223877
+  },
+  {
+    "step": 24,
+    "loss": 1.732844591140747,
+    "mse": 3.486128568649292
+  },
+  {
+    "step": 25,
+    "loss": 1.7099653482437134,
+    "mse": 3.400740146636963
+  },
+  {
+    "step": 26,
+    "loss": 1.636652946472168,
+    "mse": 3.4242472648620605
+  },
+  {
+    "step": 27,
+    "loss": 1.5824445486068726,
+    "mse": 3.0331571102142334
+  },
+  {
+    "step": 28,
+    "loss": 1.7869123220443726,
+    "mse": 3.6152546405792236
+  },
+  {
+    "step": 29,
+    "loss": 1.7652018070220947,
+    "mse": 3.963174343109131
+  },
+  {
+    "step": 30,
+    "loss": 1.811381459236145,
+    "mse": 3.808326482772827
+  },
+  {
+    "step": 31,
+    "loss": 1.5239322185516357,
+    "mse": 2.7033188343048096
+  },
+  {
+    "step": 32,
+    "loss": 1.7309805154800415,
+    "mse": 3.6950249671936035
+  },
+  {
+    "step": 33,
+    "loss": 1.6964192390441895,
+    "mse": 3.4841296672821045
+  },
+  {
+    "step": 34,
+    "loss": 1.6155728101730347,
+    "mse": 3.138540506362915
+  },
+  {
+    "step": 35,
+    "loss": 1.8541157245635986,
+    "mse": 3.9295921325683594
+  },
+  {
+    "step": 36,
+    "loss": 1.8357256650924683,
+    "mse": 4.1331787109375
+  },
+  {
+    "step": 37,
+    "loss": 1.5920798778533936,
+    "mse": 3.131016731262207
+  },
+  {
+    "step": 38,
+    "loss": 1.7548376321792603,
+    "mse": 3.5385706424713135
+  },
+  {
+    "step": 39,
+    "loss": 1.5738190412521362,
+    "mse": 3.0962414741516113
+  },
+  {
+    "step": 40,
+    "loss": 1.7604038715362549,
+    "mse": 3.695167064666748
+  },
+  {
+    "step": 41,
+    "loss": 1.726511836051941,
+    "mse": 3.778463840484619
+  },
+  {
+    "step": 42,
+    "loss": 1.6991214752197266,
+    "mse": 3.5590896606445312
+  },
+  {
+    "step": 43,
+    "loss": 1.8262892961502075,
+    "mse": 4.141878128051758
+  },
+  {
+    "step": 44,
+    "loss": 1.7380225658416748,
+    "mse": 3.5990681648254395
+  },
+  {
+    "step": 45,
+    "loss": 1.5552624464035034,
+    "mse": 3.0163986682891846
+  },
+  {
+    "step": 46,
+    "loss": 1.7066020965576172,
+    "mse": 3.90818452835083
+  },
+  {
+    "step": 47,
+    "loss": 1.5611376762390137,
+    "mse": 3.07151198387146
+  },
+  {
+    "step": 48,
+    "loss": 1.8391292095184326,
+    "mse": 4.047858715057373
+  },
+  {
+    "step": 49,
+    "loss": 1.6590399742126465,
+    "mse": 3.2434401512145996
+  },
+  {
+    "step": 50,
+    "loss": 1.7871320247650146,
+    "mse": 4.04345178604126
+  },
+  {
+    "step": 51,
+    "loss": 1.6220920085906982,
+    "mse": 3.305112838745117
+  },
+  {
+    "step": 52,
+    "loss": 1.6179759502410889,
+    "mse": 3.2397093772888184
+  },
+  {
+    "step": 53,
+    "loss": 1.7001527547836304,
+    "mse": 3.5972931385040283
+  },
+  {
+    "step": 54,
+    "loss": 1.7472341060638428,
+    "mse": 3.5964205265045166
+  },
+  {
+    "step": 55,
+    "loss": 1.6036547422409058,
+    "mse": 3.131028652191162
+  },
+  {
+    "step": 56,
+    "loss": 1.7913376092910767,
+    "mse": 4.025057792663574
+  },
+  {
+    "step": 57,
+    "loss": 1.783491611480713,
+    "mse": 4.034745216369629
+  },
+  {
+    "step": 58,
+    "loss": 1.7308157682418823,
+    "mse": 3.8262200355529785
+  },
+  {
+    "step": 59,
+    "loss": 1.6829293966293335,
+    "mse": 3.5402936935424805
+  },
+  {
+    "step": 60,
+    "loss": 1.5365837812423706,
+    "mse": 3.0623254776000977
+  },
+  {
+    "step": 61,
+    "loss": 1.468181848526001,
+    "mse": 2.7798824310302734
+  },
+  {
+    "step": 62,
+    "loss": 1.7073019742965698,
+    "mse": 3.469137668609619
+  },
+  {
+    "step": 63,
+    "loss": 1.699753999710083,
+    "mse": 3.5518195629119873
+  },
+  {
+    "step": 64,
+    "loss": 1.7980308532714844,
+    "mse": 4.114584445953369
+  },
+  {
+    "step": 65,
+    "loss": 1.7215616703033447,
+    "mse": 3.8233752250671387
+  },
+  {
+    "step": 66,
+    "loss": 1.763513207435608,
+    "mse": 3.821525812149048
+  },
+  {
+    "step": 67,
+    "loss": 1.789453148841858,
+    "mse": 3.8578484058380127
+  },
+  {
+    "step": 68,
+    "loss": 1.6816215515136719,
+    "mse": 3.5144951343536377
+  },
+  {
+    "step": 69,
+    "loss": 1.625112771987915,
+    "mse": 3.2925679683685303
+  },
+  {
+    "step": 70,
+    "loss": 1.7974380254745483,
+    "mse": 3.9793198108673096
+  },
+  {
+    "step": 71,
+    "loss": 1.3919739723205566,
+    "mse": 2.605584144592285
+  },
+  {
+    "step": 72,
+    "loss": 1.5578275918960571,
+    "mse": 3.018174886703491
+  },
+  {
+    "step": 73,
+    "loss": 1.8478070497512817,
+    "mse": 4.15772819519043
+  },
+  {
+    "step": 74,
+    "loss": 1.56838059425354,
+    "mse": 3.0443925857543945
+  },
+  {
+    "step": 75,
+    "loss": 1.9148496389389038,
+    "mse": 4.344592571258545
+  },
+  {
+    "step": 76,
+    "loss": 1.7448506355285645,
+    "mse": 3.665372848510742
+  },
+  {
+    "step": 77,
+    "loss": 1.702041745185852,
+    "mse": 3.4721126556396484
+  },
+  {
+    "step": 78,
+    "loss": 1.625977873802185,
+    "mse": 3.187403440475464
+  },
+  {
+    "step": 79,
+    "loss": 1.6379365921020508,
+    "mse": 3.171806812286377
+  },
+  {
+    "step": 80,
+    "loss": 1.6260840892791748,
+    "mse": 3.225770950317383
+  },
+  {
+    "step": 81,
+    "loss": 1.698047399520874,
+    "mse": 3.407583475112915
+  },
+  {
+    "step": 82,
+    "loss": 1.5546565055847168,
+    "mse": 3.0509986877441406
+  },
+  {
+    "step": 83,
+    "loss": 1.8059468269348145,
+    "mse": 4.00703239440918
+  },
+  {
+    "step": 84,
+    "loss": 1.7377837896347046,
+    "mse": 3.6460483074188232
+  },
+  {
+    "step": 85,
+    "loss": 1.7764464616775513,
+    "mse": 3.8778133392333984
+  },
+  {
+    "step": 86,
+    "loss": 1.8427355289459229,
+    "mse": 4.26108455657959
+  },
+  {
+    "step": 87,
+    "loss": 1.8146846294403076,
+    "mse": 4.200072765350342
+  },
+  {
+    "step": 88,
+    "loss": 1.5978293418884277,
+    "mse": 3.20017671585083
+  },
+  {
+    "step": 89,
+    "loss": 1.6570779085159302,
+    "mse": 3.3367807865142822
+  },
+  {
+    "step": 90,
+    "loss": 1.808613896369934,
+    "mse": 4.158984184265137
+  },
+  {
+    "step": 91,
+    "loss": 1.8789336681365967,
+    "mse": 4.2099175453186035
+  },
+  {
+    "step": 92,
+    "loss": 1.7390267848968506,
+    "mse": 3.7862532138824463
+  },
+  {
+    "step": 93,
+    "loss": 1.7493473291397095,
+    "mse": 3.8721823692321777
+  },
+  {
+    "step": 94,
+    "loss": 1.712317705154419,
+    "mse": 3.456031322479248
+  },
+  {
+    "step": 95,
+    "loss": 1.6383851766586304,
+    "mse": 3.1960248947143555
+  },
+  {
+    "step": 96,
+    "loss": 1.7407408952713013,
+    "mse": 3.6370577812194824
+  },
+  {
+    "step": 97,
+    "loss": 1.7568145990371704,
+    "mse": 3.742431402206421
+  },
+  {
+    "step": 98,
+    "loss": 1.7645114660263062,
+    "mse": 3.918205976486206
+  },
+  {
+    "step": 99,
+    "loss": 1.8301196098327637,
+    "mse": 4.067030429840088
+  },
+  {
+    "step": 100,
+    "loss": 1.8291189670562744,
+    "mse": 3.8379716873168945
+  },
+  {
+    "step": 101,
+    "loss": 1.6776041984558105,
+    "mse": 3.4130563735961914
+  },
+  {
+    "step": 102,
+    "loss": 1.8054041862487793,
+    "mse": 3.934325933456421
+  },
+  {
+    "step": 103,
+    "loss": 1.6220808029174805,
+    "mse": 3.3011691570281982
+  },
+  {
+    "step": 104,
+    "loss": 1.5497592687606812,
+    "mse": 2.932450532913208
+  },
+  {
+    "step": 105,
+    "loss": 1.846063256263733,
+    "mse": 3.926940679550171
+  },
+  {
+    "step": 106,
+    "loss": 1.8526053428649902,
+    "mse": 4.315218925476074
+  },
+  {
+    "step": 107,
+    "loss": 1.736297369003296,
+    "mse": 3.7567968368530273
+  },
+  {
+    "step": 108,
+    "loss": 1.8222160339355469,
+    "mse": 3.977785348892212
+  },
+  {
+    "step": 109,
+    "loss": 1.861116647720337,
+    "mse": 4.152575492858887
+  },
+  {
+    "step": 110,
+    "loss": 1.550690770149231,
+    "mse": 2.873138427734375
+  },
+  {
+    "step": 111,
+    "loss": 1.920639991760254,
+    "mse": 4.302429676055908
+  },
+  {
+    "step": 112,
+    "loss": 1.674151062965393,
+    "mse": 3.38369083404541
+  },
+  {
+    "step": 113,
+    "loss": 1.7113964557647705,
+    "mse": 3.6172854900360107
+  },
+  {
+    "step": 114,
+    "loss": 1.7167354822158813,
+    "mse": 3.4921493530273438
+  },
+  {
+    "step": 115,
+    "loss": 1.5221004486083984,
+    "mse": 2.8727967739105225
+  },
+  {
+    "step": 116,
+    "loss": 1.610121726989746,
+    "mse": 3.1317765712738037
+  },
+  {
+    "step": 117,
+    "loss": 1.752515435218811,
+    "mse": 3.581007480621338
+  },
+  {
+    "step": 118,
+    "loss": 1.7255263328552246,
+    "mse": 3.4911415576934814
+  },
+  {
+    "step": 119,
+    "loss": 1.6198835372924805,
+    "mse": 3.2336254119873047
+  },
+  {
+    "step": 120,
+    "loss": 1.6560274362564087,
+    "mse": 3.2830941677093506
+  },
+  {
+    "step": 121,
+    "loss": 1.7624808549880981,
+    "mse": 3.726226329803467
+  },
+  {
+    "step": 122,
+    "loss": 1.6229757070541382,
+    "mse": 3.20517635345459
+  },
+  {
+    "step": 123,
+    "loss": 1.7494736909866333,
+    "mse": 3.8160834312438965
+  },
+  {
+    "step": 124,
+    "loss": 1.6002585887908936,
+    "mse": 3.1800901889801025
+  },
+  {
+    "step": 125,
+    "loss": 1.521545171737671,
+    "mse": 2.865056276321411
+  },
+  {
+    "step": 126,
+    "loss": 1.6607774496078491,
+    "mse": 3.5878114700317383
+  },
+  {
+    "step": 127,
+    "loss": 1.7461543083190918,
+    "mse": 3.69264817237854
+  },
+  {
+    "step": 128,
+    "loss": 1.9002418518066406,
+    "mse": 4.359968662261963
+  },
+  {
+    "step": 129,
+    "loss": 1.6749513149261475,
+    "mse": 3.4636318683624268
+  },
+  {
+    "step": 130,
+    "loss": 1.6545159816741943,
+    "mse": 3.345637798309326
+  },
+  {
+    "step": 131,
+    "loss": 1.8660578727722168,
+    "mse": 4.032535552978516
+  },
+  {
+    "step": 132,
+    "loss": 1.7297114133834839,
+    "mse": 3.5354669094085693
+  },
+  {
+    "step": 133,
+    "loss": 1.7829434871673584,
+    "mse": 3.7944130897521973
+  },
+  {
+    "step": 134,
+    "loss": 1.568981647491455,
+    "mse": 2.8635029792785645
+  },
+  {
+    "step": 135,
+    "loss": 1.7311031818389893,
+    "mse": 3.8013978004455566
+  },
+  {
+    "step": 136,
+    "loss": 1.839755892753601,
+    "mse": 3.848860740661621
+  },
+  {
+    "step": 137,
+    "loss": 1.9285252094268799,
+    "mse": 4.556584358215332
+  },
+  {
+    "step": 138,
+    "loss": 1.6650911569595337,
+    "mse": 3.4472484588623047
+  },
+  {
+    "step": 139,
+    "loss": 1.7301276922225952,
+    "mse": 3.6778178215026855
+  },
+  {
+    "step": 140,
+    "loss": 1.5584856271743774,
+    "mse": 3.063760995864868
+  },
+  {
+    "step": 141,
+    "loss": 1.653031349182129,
+    "mse": 3.4679436683654785
+  },
+  {
+    "step": 142,
+    "loss": 1.7371420860290527,
+    "mse": 3.5567378997802734
+  },
+  {
+    "step": 143,
+    "loss": 1.6198911666870117,
+    "mse": 3.152945041656494
+  },
+  {
+    "step": 144,
+    "loss": 1.736039161682129,
+    "mse": 3.608597755432129
+  },
+  {
+    "step": 145,
+    "loss": 1.7158489227294922,
+    "mse": 3.558333158493042
+  },
+  {
+    "step": 146,
+    "loss": 1.8154250383377075,
+    "mse": 4.255399703979492
+  },
+  {
+    "step": 147,
+    "loss": 1.6412572860717773,
+    "mse": 3.1973934173583984
+  },
+  {
+    "step": 148,
+    "loss": 1.8864874839782715,
+    "mse": 4.235466957092285
+  },
+  {
+    "step": 149,
+    "loss": 1.6180142164230347,
+    "mse": 3.2845754623413086
+  },
+  {
+    "step": 150,
+    "loss": 1.7563174962997437,
+    "mse": 3.9844536781311035
+  },
+  {
+    "step": 151,
+    "loss": 1.6606961488723755,
+    "mse": 3.452012538909912
+  },
+  {
+    "step": 152,
+    "loss": 1.6897655725479126,
+    "mse": 3.4298882484436035
+  },
+  {
+    "step": 153,
+    "loss": 1.670474648475647,
+    "mse": 3.3895435333251953
+  },
+  {
+    "step": 154,
+    "loss": 1.4089744091033936,
+    "mse": 2.5726165771484375
+  },
+  {
+    "step": 155,
+    "loss": 1.7086524963378906,
+    "mse": 3.503706455230713
+  },
+  {
+    "step": 156,
+    "loss": 1.7323285341262817,
+    "mse": 3.740344524383545
+  },
+  {
+    "step": 157,
+    "loss": 1.7397754192352295,
+    "mse": 3.718932628631592
+  },
+  {
+    "step": 158,
+    "loss": 1.7825753688812256,
+    "mse": 3.777846574783325
+  },
+  {
+    "step": 159,
+    "loss": 1.7282778024673462,
+    "mse": 3.8370368480682373
+  },
+  {
+    "step": 160,
+    "loss": 1.8001776933670044,
+    "mse": 3.881175994873047
+  },
+  {
+    "step": 161,
+    "loss": 1.7198121547698975,
+    "mse": 3.5659143924713135
+  },
+  {
+    "step": 162,
+    "loss": 1.7772748470306396,
+    "mse": 3.8029708862304688
+  },
+  {
+    "step": 163,
+    "loss": 1.5692591667175293,
+    "mse": 3.072553873062134
+  },
+  {
+    "step": 164,
+    "loss": 1.669154405593872,
+    "mse": 3.575345516204834
+  },
+  {
+    "step": 165,
+    "loss": 1.6692289113998413,
+    "mse": 3.2980175018310547
+  },
+  {
+    "step": 166,
+    "loss": 1.8288251161575317,
+    "mse": 4.107916831970215
+  },
+  {
+    "step": 167,
+    "loss": 1.8071961402893066,
+    "mse": 4.058838367462158
+  },
+  {
+    "step": 168,
+    "loss": 1.680084466934204,
+    "mse": 3.53385329246521
+  },
+  {
+    "step": 169,
+    "loss": 1.4882748126983643,
+    "mse": 2.79848051071167
+  },
+  {
+    "step": 170,
+    "loss": 1.7850301265716553,
+    "mse": 3.7629427909851074
+  },
+  {
+    "step": 171,
+    "loss": 1.6635911464691162,
+    "mse": 3.3807730674743652
+  },
+  {
+    "step": 172,
+    "loss": 1.5872448682785034,
+    "mse": 3.067723512649536
+  },
+  {
+    "step": 173,
+    "loss": 1.7141788005828857,
+    "mse": 3.875894784927368
+  },
+  {
+    "step": 174,
+    "loss": 1.62225341796875,
+    "mse": 3.1791887283325195
+  },
+  {
+    "step": 175,
+    "loss": 1.696534514427185,
+    "mse": 3.392183780670166
+  },
+  {
+    "step": 176,
+    "loss": 1.7257601022720337,
+    "mse": 3.713315010070801
+  },
+  {
+    "step": 177,
+    "loss": 1.5025712251663208,
+    "mse": 2.860830307006836
+  },
+  {
+    "step": 178,
+    "loss": 1.8120157718658447,
+    "mse": 3.9087753295898438
+  },
+  {
+    "step": 179,
+    "loss": 1.8293348550796509,
+    "mse": 4.186764717102051
+  },
+  {
+    "step": 180,
+    "loss": 1.7681999206542969,
+    "mse": 3.799160957336426
+  },
+  {
+    "step": 181,
+    "loss": 1.4998500347137451,
+    "mse": 2.778380870819092
+  },
+  {
+    "step": 182,
+    "loss": 1.700790286064148,
+    "mse": 3.619656562805176
+  },
+  {
+    "step": 183,
+    "loss": 1.6253459453582764,
+    "mse": 3.48789119720459
+  },
+  {
+    "step": 184,
+    "loss": 1.8011261224746704,
+    "mse": 3.9588239192962646
+  },
+  {
+    "step": 185,
+    "loss": 1.7140225172042847,
+    "mse": 3.446683168411255
+  },
+  {
+    "step": 186,
+    "loss": 1.720245122909546,
+    "mse": 3.768588066101074
+  },
+  {
+    "step": 187,
+    "loss": 1.7045860290527344,
+    "mse": 3.4135007858276367
+  },
+  {
+    "step": 188,
+    "loss": 1.7027148008346558,
+    "mse": 3.648007869720459
+  },
+  {
+    "step": 189,
+    "loss": 1.7572917938232422,
+    "mse": 3.7222890853881836
+  },
+  {
+    "step": 190,
+    "loss": 1.7032899856567383,
+    "mse": 3.497501850128174
+  },
+  {
+    "step": 191,
+    "loss": 1.5743329524993896,
+    "mse": 3.269117832183838
+  },
+  {
+    "step": 192,
+    "loss": 1.6797661781311035,
+    "mse": 3.3332676887512207
+  },
+  {
+    "step": 193,
+    "loss": 1.727526307106018,
+    "mse": 3.5606470108032227
+  },
+  {
+    "step": 194,
+    "loss": 1.5114097595214844,
+    "mse": 2.8258767127990723
+  },
+  {
+    "step": 195,
+    "loss": 1.612460732460022,
+    "mse": 3.4097094535827637
+  },
+  {
+    "step": 196,
+    "loss": 1.6875542402267456,
+    "mse": 3.551121711730957
+  },
+  {
+    "step": 197,
+    "loss": 1.6554001569747925,
+    "mse": 3.3616647720336914
+  },
+  {
+    "step": 198,
+    "loss": 1.6796516180038452,
+    "mse": 3.387218952178955
+  },
+  {
+    "step": 199,
+    "loss": 1.850563406944275,
+    "mse": 4.13185977935791
+  },
+  {
+    "step": 200,
+    "loss": 1.6201539039611816,
+    "mse": 3.1348280906677246
+  },
+  {
+    "step": 201,
+    "loss": 1.6469123363494873,
+    "mse": 3.261448860168457
+  },
+  {
+    "step": 202,
+    "loss": 1.755317211151123,
+    "mse": 3.8108925819396973
+  },
+  {
+    "step": 203,
+    "loss": 1.8110685348510742,
+    "mse": 3.8405847549438477
+  },
+  {
+    "step": 204,
+    "loss": 1.5987515449523926,
+    "mse": 3.136439800262451
+  },
+  {
+    "step": 205,
+    "loss": 1.7091827392578125,
+    "mse": 3.622054100036621
+  },
+  {
+    "step": 206,
+    "loss": 1.502089023590088,
+    "mse": 2.7981910705566406
+  },
+  {
+    "step": 207,
+    "loss": 1.618241310119629,
+    "mse": 3.245137929916382
+  },
+  {
+    "step": 208,
+    "loss": 1.7225842475891113,
+    "mse": 3.7094533443450928
+  },
+  {
+    "step": 209,
+    "loss": 1.7418034076690674,
+    "mse": 3.532562732696533
+  },
+  {
+    "step": 210,
+    "loss": 1.7605526447296143,
+    "mse": 4.017018795013428
+  },
+  {
+    "step": 211,
+    "loss": 1.7745548486709595,
+    "mse": 3.8539791107177734
+  },
+  {
+    "step": 212,
+    "loss": 1.5834615230560303,
+    "mse": 3.228864908218384
+  },
+  {
+    "step": 213,
+    "loss": 1.6212944984436035,
+    "mse": 3.2532742023468018
+  },
+  {
+    "step": 214,
+    "loss": 1.4999791383743286,
+    "mse": 2.779078483581543
+  },
+  {
+    "step": 215,
+    "loss": 1.7492176294326782,
+    "mse": 3.617424249649048
+  },
+  {
+    "step": 216,
+    "loss": 1.4640202522277832,
+    "mse": 2.777336359024048
+  },
+  {
+    "step": 217,
+    "loss": 1.8520450592041016,
+    "mse": 3.9831855297088623
+  },
+  {
+    "step": 218,
+    "loss": 1.4937351942062378,
+    "mse": 2.727924346923828
+  },
+  {
+    "step": 219,
+    "loss": 1.5845667123794556,
+    "mse": 3.0800998210906982
+  },
+  {
+    "step": 220,
+    "loss": 1.7391986846923828,
+    "mse": 3.830888271331787
+  },
+  {
+    "step": 221,
+    "loss": 1.6203436851501465,
+    "mse": 3.1293249130249023
+  },
+  {
+    "step": 222,
+    "loss": 1.615435004234314,
+    "mse": 3.283015489578247
+  },
+  {
+    "step": 223,
+    "loss": 1.6768871545791626,
+    "mse": 3.605848789215088
+  },
+  {
+    "step": 224,
+    "loss": 1.7523785829544067,
+    "mse": 3.8782036304473877
+  },
+  {
+    "step": 225,
+    "loss": 1.7936275005340576,
+    "mse": 3.9647583961486816
+  },
+  {
+    "step": 226,
+    "loss": 1.712793231010437,
+    "mse": 3.464628219604492
+  },
+  {
+    "step": 227,
+    "loss": 1.6470534801483154,
+    "mse": 3.301339864730835
+  },
+  {
+    "step": 228,
+    "loss": 1.7552999258041382,
+    "mse": 3.6145074367523193
+  },
+  {
+    "step": 229,
+    "loss": 1.6493748426437378,
+    "mse": 3.5575382709503174
+  },
+  {
+    "step": 230,
+    "loss": 1.577078938484192,
+    "mse": 3.179166555404663
+  },
+  {
+    "step": 231,
+    "loss": 1.7154024839401245,
+    "mse": 3.8511555194854736
+  },
+  {
+    "step": 232,
+    "loss": 1.5913816690444946,
+    "mse": 3.127439022064209
+  },
+  {
+    "step": 233,
+    "loss": 1.6886217594146729,
+    "mse": 3.6537251472473145
+  },
+  {
+    "step": 234,
+    "loss": 1.6681156158447266,
+    "mse": 3.3660027980804443
+  },
+  {
+    "step": 235,
+    "loss": 1.5969383716583252,
+    "mse": 3.241894245147705
+  },
+  {
+    "step": 236,
+    "loss": 1.7909390926361084,
+    "mse": 3.9558746814727783
+  },
+  {
+    "step": 237,
+    "loss": 1.4477230310440063,
+    "mse": 2.4739513397216797
+  },
+  {
+    "step": 238,
+    "loss": 1.5046324729919434,
+    "mse": 2.8146839141845703
+  },
+  {
+    "step": 239,
+    "loss": 1.8543838262557983,
+    "mse": 4.290772914886475
+  },
+  {
+    "step": 240,
+    "loss": 1.5438742637634277,
+    "mse": 2.934574604034424
+  },
+  {
+    "step": 241,
+    "loss": 1.7494854927062988,
+    "mse": 3.8723831176757812
+  },
+  {
+    "step": 242,
+    "loss": 1.6622141599655151,
+    "mse": 3.6227779388427734
+  },
+  {
+    "step": 243,
+    "loss": 1.7210791110992432,
+    "mse": 3.6577723026275635
+  },
+  {
+    "step": 244,
+    "loss": 1.7382519245147705,
+    "mse": 3.829282283782959
+  },
+  {
+    "step": 245,
+    "loss": 1.7183805704116821,
+    "mse": 3.5406270027160645
+  },
+  {
+    "step": 246,
+    "loss": 1.756324291229248,
+    "mse": 3.7764508724212646
+  },
+  {
+    "step": 247,
+    "loss": 1.5779169797897339,
+    "mse": 3.0091395378112793
+  },
+  {
+    "step": 248,
+    "loss": 1.5648057460784912,
+    "mse": 3.2274880409240723
+  },
+  {
+    "step": 249,
+    "loss": 1.8353474140167236,
+    "mse": 3.996230125427246
+  },
+  {
+    "step": 250,
+    "loss": 1.568111777305603,
+    "mse": 3.368832588195801
+  },
+  {
+    "step": 251,
+    "loss": 1.7513511180877686,
+    "mse": 3.826967477798462
+  },
+  {
+    "step": 252,
+    "loss": 1.7308456897735596,
+    "mse": 3.820141553878784
+  },
+  {
+    "step": 253,
+    "loss": 1.6679762601852417,
+    "mse": 3.463618040084839
+  },
+  {
+    "step": 254,
+    "loss": 1.6627761125564575,
+    "mse": 3.436943292617798
+  },
+  {
+    "step": 255,
+    "loss": 1.8237122297286987,
+    "mse": 4.106089115142822
+  },
+  {
+    "step": 256,
+    "loss": 1.665236473083496,
+    "mse": 3.5552005767822266
+  },
+  {
+    "step": 257,
+    "loss": 1.6676061153411865,
+    "mse": 3.5213701725006104
+  },
+  {
+    "step": 258,
+    "loss": 1.658430576324463,
+    "mse": 3.367121696472168
+  },
+  {
+    "step": 259,
+    "loss": 1.7229514122009277,
+    "mse": 3.765712261199951
+  },
+  {
+    "step": 260,
+    "loss": 1.715353012084961,
+    "mse": 3.5764012336730957
+  },
+  {
+    "step": 261,
+    "loss": 1.6308966875076294,
+    "mse": 3.2384703159332275
+  },
+  {
+    "step": 262,
+    "loss": 1.6303670406341553,
+    "mse": 3.4956488609313965
+  },
+  {
+    "step": 263,
+    "loss": 1.549837589263916,
+    "mse": 2.863232374191284
+  },
+  {
+    "step": 264,
+    "loss": 1.6858340501785278,
+    "mse": 3.5860836505889893
+  },
+  {
+    "step": 265,
+    "loss": 1.868354082107544,
+    "mse": 4.113136291503906
+  },
+  {
+    "step": 266,
+    "loss": 1.698941707611084,
+    "mse": 3.4777727127075195
+  },
+  {
+    "step": 267,
+    "loss": 1.7984437942504883,
+    "mse": 4.103818893432617
+  },
+  {
+    "step": 268,
+    "loss": 1.7508056163787842,
+    "mse": 3.7068216800689697
+  },
+  {
+    "step": 269,
+    "loss": 1.4737401008605957,
+    "mse": 2.884828567504883
+  },
+  {
+    "step": 270,
+    "loss": 1.7092061042785645,
+    "mse": 3.5264110565185547
+  },
+  {
+    "step": 271,
+    "loss": 1.6241142749786377,
+    "mse": 3.2754733562469482
+  },
+  {
+    "step": 272,
+    "loss": 1.760284662246704,
+    "mse": 3.7521207332611084
+  },
+  {
+    "step": 273,
+    "loss": 1.7455674409866333,
+    "mse": 3.963545083999634
+  },
+  {
+    "step": 274,
+    "loss": 1.6144747734069824,
+    "mse": 3.3099095821380615
+  },
+  {
+    "step": 275,
+    "loss": 1.4564459323883057,
+    "mse": 2.584902763366699
+  },
+  {
+    "step": 276,
+    "loss": 1.6518666744232178,
+    "mse": 3.309438705444336
+  },
+  {
+    "step": 277,
+    "loss": 1.800580620765686,
+    "mse": 4.0474066734313965
+  },
+  {
+    "step": 278,
+    "loss": 1.7994866371154785,
+    "mse": 3.8120815753936768
+  },
+  {
+    "step": 279,
+    "loss": 1.7055113315582275,
+    "mse": 3.4190726280212402
+  },
+  {
+    "step": 280,
+    "loss": 1.5648603439331055,
+    "mse": 3.012223720550537
+  },
+  {
+    "step": 281,
+    "loss": 1.5655410289764404,
+    "mse": 2.8969743251800537
+  },
+  {
+    "step": 282,
+    "loss": 1.528604507446289,
+    "mse": 2.904611349105835
+  },
+  {
+    "step": 283,
+    "loss": 1.5367975234985352,
+    "mse": 3.0331521034240723
+  },
+  {
+    "step": 284,
+    "loss": 1.6196630001068115,
+    "mse": 3.1737263202667236
+  },
+  {
+    "step": 285,
+    "loss": 1.6868488788604736,
+    "mse": 3.5997889041900635
+  },
+  {
+    "step": 286,
+    "loss": 1.5028201341629028,
+    "mse": 2.8907618522644043
+  },
+  {
+    "step": 287,
+    "loss": 1.7933075428009033,
+    "mse": 3.8735923767089844
+  },
+  {
+    "step": 288,
+    "loss": 1.7486212253570557,
+    "mse": 3.688586711883545
+  },
+  {
+    "step": 289,
+    "loss": 1.7676732540130615,
+    "mse": 3.8556594848632812
+  },
+  {
+    "step": 290,
+    "loss": 1.6518182754516602,
+    "mse": 3.3059253692626953
+  },
+  {
+    "step": 291,
+    "loss": 1.7462050914764404,
+    "mse": 3.9171676635742188
+  },
+  {
+    "step": 292,
+    "loss": 1.7214792966842651,
+    "mse": 3.605201244354248
+  },
+  {
+    "step": 293,
+    "loss": 1.6360547542572021,
+    "mse": 3.2289748191833496
+  },
+  {
+    "step": 294,
+    "loss": 1.623451828956604,
+    "mse": 3.177119731903076
+  },
+  {
+    "step": 295,
+    "loss": 1.6500228643417358,
+    "mse": 3.549931764602661
+  },
+  {
+    "step": 296,
+    "loss": 1.6059882640838623,
+    "mse": 3.384618043899536
+  },
+  {
+    "step": 297,
+    "loss": 1.6099885702133179,
+    "mse": 3.1954450607299805
+  },
+  {
+    "step": 298,
+    "loss": 1.72853684425354,
+    "mse": 3.5499491691589355
+  },
+  {
+    "step": 299,
+    "loss": 1.6799026727676392,
+    "mse": 3.469562530517578
+  },
+  {
+    "step": 300,
+    "loss": 1.830480694770813,
+    "mse": 3.87321138381958
+  },
+  {
+    "step": 301,
+    "loss": 1.613208293914795,
+    "mse": 3.178966760635376
+  },
+  {
+    "step": 302,
+    "loss": 1.6194093227386475,
+    "mse": 3.0753493309020996
+  },
+  {
+    "step": 303,
+    "loss": 1.5330179929733276,
+    "mse": 2.828899383544922
+  },
+  {
+    "step": 304,
+    "loss": 1.576894998550415,
+    "mse": 3.1492433547973633
+  },
+  {
+    "step": 305,
+    "loss": 1.595539927482605,
+    "mse": 3.061298370361328
+  },
+  {
+    "step": 306,
+    "loss": 1.722991704940796,
+    "mse": 3.630650758743286
+  },
+  {
+    "step": 307,
+    "loss": 1.6152889728546143,
+    "mse": 3.4726181030273438
+  },
+  {
+    "step": 308,
+    "loss": 1.631595253944397,
+    "mse": 3.2096645832061768
+  },
+  {
+    "step": 309,
+    "loss": 1.4234782457351685,
+    "mse": 2.581658363342285
+  },
+  {
+    "step": 310,
+    "loss": 1.6840077638626099,
+    "mse": 3.5127313137054443
+  },
+  {
+    "step": 311,
+    "loss": 1.7281410694122314,
+    "mse": 3.4465696811676025
+  },
+  {
+    "step": 312,
+    "loss": 1.6268765926361084,
+    "mse": 3.4795467853546143
+  },
+  {
+    "step": 313,
+    "loss": 1.8171350955963135,
+    "mse": 3.982187271118164
+  },
+  {
+    "step": 314,
+    "loss": 1.6029739379882812,
+    "mse": 2.9979987144470215
+  },
+  {
+    "step": 315,
+    "loss": 1.4663983583450317,
+    "mse": 2.693530559539795
+  },
+  {
+    "step": 316,
+    "loss": 1.6392053365707397,
+    "mse": 3.52577543258667
+  },
+  {
+    "step": 317,
+    "loss": 1.7330455780029297,
+    "mse": 3.477327346801758
+  },
+  {
+    "step": 318,
+    "loss": 1.5986435413360596,
+    "mse": 3.048689365386963
+  },
+  {
+    "step": 319,
+    "loss": 1.898714303970337,
+    "mse": 4.208587646484375
+  },
+  {
+    "step": 320,
+    "loss": 1.741457462310791,
+    "mse": 3.608241319656372
+  },
+  {
+    "step": 321,
+    "loss": 1.4496512413024902,
+    "mse": 2.5847058296203613
+  },
+  {
+    "step": 322,
+    "loss": 1.5960670709609985,
+    "mse": 3.1684091091156006
+  },
+  {
+    "step": 323,
+    "loss": 1.6212624311447144,
+    "mse": 3.116938829421997
+  },
+  {
+    "step": 324,
+    "loss": 1.7118208408355713,
+    "mse": 3.437429189682007
+  },
+  {
+    "step": 325,
+    "loss": 1.5075575113296509,
+    "mse": 2.744462251663208
+  },
+  {
+    "step": 326,
+    "loss": 1.7113311290740967,
+    "mse": 3.486039400100708
+  },
+  {
+    "step": 327,
+    "loss": 1.6201777458190918,
+    "mse": 3.0555567741394043
+  },
+  {
+    "step": 328,
+    "loss": 1.69254469871521,
+    "mse": 3.4138500690460205
+  },
+  {
+    "step": 329,
+    "loss": 1.7932519912719727,
+    "mse": 3.790724039077759
+  },
+  {
+    "step": 330,
+    "loss": 1.655493974685669,
+    "mse": 3.393683910369873
+  },
+  {
+    "step": 331,
+    "loss": 1.5609670877456665,
+    "mse": 3.005380392074585
+  },
+  {
+    "step": 332,
+    "loss": 1.6896746158599854,
+    "mse": 3.5294582843780518
+  },
+  {
+    "step": 333,
+    "loss": 1.6784831285476685,
+    "mse": 3.5143556594848633
+  },
+  {
+    "step": 334,
+    "loss": 1.797501802444458,
+    "mse": 3.7925257682800293
+  },
+  {
+    "step": 335,
+    "loss": 1.5744552612304688,
+    "mse": 3.0617690086364746
+  },
+  {
+    "step": 336,
+    "loss": 1.706326961517334,
+    "mse": 3.493314743041992
+  },
+  {
+    "step": 337,
+    "loss": 1.536884069442749,
+    "mse": 2.8954241275787354
+  },
+  {
+    "step": 338,
+    "loss": 1.6286687850952148,
+    "mse": 3.2393534183502197
+  },
+  {
+    "step": 339,
+    "loss": 1.4945393800735474,
+    "mse": 2.693845510482788
+  },
+  {
+    "step": 340,
+    "loss": 1.5829604864120483,
+    "mse": 3.0233757495880127
+  },
+  {
+    "step": 341,
+    "loss": 1.7708261013031006,
+    "mse": 3.6889657974243164
+  },
+  {
+    "step": 342,
+    "loss": 1.575240135192871,
+    "mse": 3.043954849243164
+  },
+  {
+    "step": 343,
+    "loss": 1.6186354160308838,
+    "mse": 3.2320258617401123
+  },
+  {
+    "step": 344,
+    "loss": 1.5156679153442383,
+    "mse": 3.0130910873413086
+  },
+  {
+    "step": 345,
+    "loss": 1.6627410650253296,
+    "mse": 3.398935556411743
+  },
+  {
+    "step": 346,
+    "loss": 1.5928646326065063,
+    "mse": 3.1592941284179688
+  },
+  {
+    "step": 347,
+    "loss": 1.6412241458892822,
+    "mse": 3.36578369140625
+  },
+  {
+    "step": 348,
+    "loss": 1.7472583055496216,
+    "mse": 3.6222705841064453
+  },
+  {
+    "step": 349,
+    "loss": 1.6518464088439941,
+    "mse": 3.2976701259613037
+  },
+  {
+    "step": 350,
+    "loss": 1.4140242338180542,
+    "mse": 2.705899715423584
+  },
+  {
+    "step": 351,
+    "loss": 1.6162633895874023,
+    "mse": 3.3426318168640137
+  },
+  {
+    "step": 352,
+    "loss": 1.723038673400879,
+    "mse": 3.521207094192505
+  },
+  {
+    "step": 353,
+    "loss": 1.7737338542938232,
+    "mse": 3.698728561401367
+  },
+  {
+    "step": 354,
+    "loss": 1.7561156749725342,
+    "mse": 3.7866768836975098
+  },
+  {
+    "step": 355,
+    "loss": 1.681186318397522,
+    "mse": 3.2871713638305664
+  },
+  {
+    "step": 356,
+    "loss": 1.415901780128479,
+    "mse": 2.674121379852295
+  },
+  {
+    "step": 357,
+    "loss": 1.577843427658081,
+    "mse": 3.1352124214172363
+  },
+  {
+    "step": 358,
+    "loss": 1.5618526935577393,
+    "mse": 3.0680737495422363
+  },
+  {
+    "step": 359,
+    "loss": 1.589369773864746,
+    "mse": 3.0333330631256104
+  },
+  {
+    "step": 360,
+    "loss": 1.5723634958267212,
+    "mse": 3.2113962173461914
+  },
+  {
+    "step": 361,
+    "loss": 1.5846753120422363,
+    "mse": 3.1640467643737793
+  },
+  {
+    "step": 362,
+    "loss": 1.5566500425338745,
+    "mse": 3.0130090713500977
+  },
+  {
+    "step": 363,
+    "loss": 1.6000055074691772,
+    "mse": 3.1572837829589844
+  },
+  {
+    "step": 364,
+    "loss": 1.5808954238891602,
+    "mse": 3.10260272026062
+  },
+  {
+    "step": 365,
+    "loss": 1.5715022087097168,
+    "mse": 3.0538601875305176
+  },
+  {
+    "step": 366,
+    "loss": 1.7041168212890625,
+    "mse": 3.4748129844665527
+  },
+  {
+    "step": 367,
+    "loss": 1.7370110750198364,
+    "mse": 3.680121898651123
+  },
+  {
+    "step": 368,
+    "loss": 1.711241602897644,
+    "mse": 3.584429979324341
+  },
+  {
+    "step": 369,
+    "loss": 1.5326895713806152,
+    "mse": 2.992486000061035
+  },
+  {
+    "step": 370,
+    "loss": 1.6979361772537231,
+    "mse": 3.438983917236328
+  },
+  {
+    "step": 371,
+    "loss": 1.5537117719650269,
+    "mse": 2.919485330581665
+  },
+  {
+    "step": 372,
+    "loss": 1.5619477033615112,
+    "mse": 2.9399611949920654
+  },
+  {
+    "step": 373,
+    "loss": 1.6273558139801025,
+    "mse": 3.2354698181152344
+  },
+  {
+    "step": 374,
+    "loss": 1.5584983825683594,
+    "mse": 3.2379860877990723
+  },
+  {
+    "step": 375,
+    "loss": 1.6270310878753662,
+    "mse": 3.339768648147583
+  },
+  {
+    "step": 376,
+    "loss": 1.5572799444198608,
+    "mse": 3.0091090202331543
+  },
+  {
+    "step": 377,
+    "loss": 1.4273066520690918,
+    "mse": 2.6927313804626465
+  },
+  {
+    "step": 378,
+    "loss": 1.6571375131607056,
+    "mse": 3.279125690460205
+  },
+  {
+    "step": 379,
+    "loss": 1.6170761585235596,
+    "mse": 3.070554494857788
+  },
+  {
+    "step": 380,
+    "loss": 1.6264617443084717,
+    "mse": 3.328120708465576
+  },
+  {
+    "step": 381,
+    "loss": 1.5594210624694824,
+    "mse": 3.129329204559326
+  },
+  {
+    "step": 382,
+    "loss": 1.4862319231033325,
+    "mse": 2.7167530059814453
+  },
+  {
+    "step": 383,
+    "loss": 1.6425315141677856,
+    "mse": 3.1443843841552734
+  },
+  {
+    "step": 384,
+    "loss": 1.4055196046829224,
+    "mse": 2.4829206466674805
+  },
+  {
+    "step": 385,
+    "loss": 1.5657176971435547,
+    "mse": 2.9412949085235596
+  },
+  {
+    "step": 386,
+    "loss": 1.6440507173538208,
+    "mse": 3.389307975769043
+  },
+  {
+    "step": 387,
+    "loss": 1.6124212741851807,
+    "mse": 3.177506923675537
+  },
+  {
+    "step": 388,
+    "loss": 1.5411789417266846,
+    "mse": 2.895106792449951
+  },
+  {
+    "step": 389,
+    "loss": 1.5939725637435913,
+    "mse": 3.1101529598236084
+  },
+  {
+    "step": 390,
+    "loss": 1.4716662168502808,
+    "mse": 2.7171971797943115
+  },
+  {
+    "step": 391,
+    "loss": 1.6909973621368408,
+    "mse": 3.488798141479492
+  },
+  {
+    "step": 392,
+    "loss": 1.4850091934204102,
+    "mse": 2.8174688816070557
+  },
+  {
+    "step": 393,
+    "loss": 1.7090479135513306,
+    "mse": 3.5707812309265137
+  },
+  {
+    "step": 394,
+    "loss": 1.5905447006225586,
+    "mse": 3.2296462059020996
+  },
+  {
+    "step": 395,
+    "loss": 1.6602799892425537,
+    "mse": 3.383653163909912
+  },
+  {
+    "step": 396,
+    "loss": 1.6075483560562134,
+    "mse": 3.03639554977417
+  },
+  {
+    "step": 397,
+    "loss": 1.714215636253357,
+    "mse": 3.5753750801086426
+  },
+  {
+    "step": 398,
+    "loss": 1.4635313749313354,
+    "mse": 2.633826494216919
+  },
+  {
+    "step": 399,
+    "loss": 1.653334140777588,
+    "mse": 3.131497621536255
+  },
+  {
+    "step": 400,
+    "loss": 1.4310522079467773,
+    "mse": 2.524181604385376
+  },
+  {
+    "step": 401,
+    "loss": 1.7044470310211182,
+    "mse": 3.6197690963745117
+  },
+  {
+    "step": 402,
+    "loss": 1.8099634647369385,
+    "mse": 4.15251350402832
+  },
+  {
+    "step": 403,
+    "loss": 1.5883440971374512,
+    "mse": 3.0018229484558105
+  },
+  {
+    "step": 404,
+    "loss": 1.4325965642929077,
+    "mse": 2.650768756866455
+  },
+  {
+    "step": 405,
+    "loss": 1.5435082912445068,
+    "mse": 2.928391456604004
+  },
+  {
+    "step": 406,
+    "loss": 1.6737924814224243,
+    "mse": 3.5223705768585205
+  },
+  {
+    "step": 407,
+    "loss": 1.51060152053833,
+    "mse": 2.7762351036071777
+  },
+  {
+    "step": 408,
+    "loss": 1.6588802337646484,
+    "mse": 3.337334156036377
+  },
+  {
+    "step": 409,
+    "loss": 1.696329116821289,
+    "mse": 3.432158946990967
+  },
+  {
+    "step": 410,
+    "loss": 1.6269769668579102,
+    "mse": 3.403306007385254
+  },
+  {
+    "step": 411,
+    "loss": 1.6999233961105347,
+    "mse": 3.524519681930542
+  },
+  {
+    "step": 412,
+    "loss": 1.5102505683898926,
+    "mse": 2.91646671295166
+  },
+  {
+    "step": 413,
+    "loss": 1.4949818849563599,
+    "mse": 2.7693090438842773
+  },
+  {
+    "step": 414,
+    "loss": 1.6915605068206787,
+    "mse": 3.5685081481933594
+  },
+  {
+    "step": 415,
+    "loss": 1.7457821369171143,
+    "mse": 3.9933109283447266
+  },
+  {
+    "step": 416,
+    "loss": 1.7953757047653198,
+    "mse": 3.830329179763794
+  },
+  {
+    "step": 417,
+    "loss": 1.8021206855773926,
+    "mse": 4.1358795166015625
+  },
+  {
+    "step": 418,
+    "loss": 1.6844793558120728,
+    "mse": 3.7422356605529785
+  },
+  {
+    "step": 419,
+    "loss": 1.589270830154419,
+    "mse": 3.091212272644043
+  },
+  {
+    "step": 420,
+    "loss": 1.513454794883728,
+    "mse": 2.9725453853607178
+  },
+  {
+    "step": 421,
+    "loss": 1.5027272701263428,
+    "mse": 2.8467609882354736
+  },
+  {
+    "step": 422,
+    "loss": 1.5649956464767456,
+    "mse": 3.2473177909851074
+  },
+  {
+    "step": 423,
+    "loss": 1.5333012342453003,
+    "mse": 3.1362695693969727
+  },
+  {
+    "step": 424,
+    "loss": 1.6015558242797852,
+    "mse": 2.923281669616699
+  },
+  {
+    "step": 425,
+    "loss": 1.4774718284606934,
+    "mse": 2.779419183731079
+  },
+  {
+    "step": 426,
+    "loss": 1.6607556343078613,
+    "mse": 3.297402858734131
+  },
+  {
+    "step": 427,
+    "loss": 1.5985918045043945,
+    "mse": 3.1281754970550537
+  },
+  {
+    "step": 428,
+    "loss": 1.5692096948623657,
+    "mse": 2.9544448852539062
+  },
+  {
+    "step": 429,
+    "loss": 1.632509708404541,
+    "mse": 3.2444756031036377
+  },
+  {
+    "step": 430,
+    "loss": 1.6534323692321777,
+    "mse": 3.2466399669647217
+  },
+  {
+    "step": 431,
+    "loss": 1.5259982347488403,
+    "mse": 2.9952962398529053
+  },
+  {
+    "step": 432,
+    "loss": 1.5026435852050781,
+    "mse": 2.949413776397705
+  },
+  {
+    "step": 433,
+    "loss": 1.5142704248428345,
+    "mse": 2.9918136596679688
+  },
+  {
+    "step": 434,
+    "loss": 1.6278071403503418,
+    "mse": 3.299257755279541
+  },
+  {
+    "step": 435,
+    "loss": 1.5958257913589478,
+    "mse": 3.197171688079834
+  },
+  {
+    "step": 436,
+    "loss": 1.6791483163833618,
+    "mse": 3.489262104034424
+  },
+  {
+    "step": 437,
+    "loss": 1.602030634880066,
+    "mse": 3.2063307762145996
+  },
+  {
+    "step": 438,
+    "loss": 1.458173394203186,
+    "mse": 2.670243501663208
+  },
+  {
+    "step": 439,
+    "loss": 1.522525429725647,
+    "mse": 2.880662202835083
+  },
+  {
+    "step": 440,
+    "loss": 1.5403790473937988,
+    "mse": 3.0704689025878906
+  },
+  {
+    "step": 441,
+    "loss": 1.5558652877807617,
+    "mse": 3.1212174892425537
+  },
+  {
+    "step": 442,
+    "loss": 1.4696791172027588,
+    "mse": 2.7328624725341797
+  },
+  {
+    "step": 443,
+    "loss": 1.6097935438156128,
+    "mse": 3.3149142265319824
+  },
+  {
+    "step": 444,
+    "loss": 1.4693506956100464,
+    "mse": 2.8524222373962402
+  },
+  {
+    "step": 445,
+    "loss": 1.5887103080749512,
+    "mse": 3.105895757675171
+  },
+  {
+    "step": 446,
+    "loss": 1.4717895984649658,
+    "mse": 2.630192279815674
+  },
+  {
+    "step": 447,
+    "loss": 1.7292609214782715,
+    "mse": 3.803363800048828
+  },
+  {
+    "step": 448,
+    "loss": 1.6589279174804688,
+    "mse": 3.385481357574463
+  },
+  {
+    "step": 449,
+    "loss": 1.5481789112091064,
+    "mse": 2.9107391834259033
+  },
+  {
+    "step": 450,
+    "loss": 1.5576200485229492,
+    "mse": 2.8821773529052734
+  },
+  {
+    "step": 451,
+    "loss": 1.7927336692810059,
+    "mse": 4.179947853088379
+  },
+  {
+    "step": 452,
+    "loss": 1.423137903213501,
+    "mse": 2.4974915981292725
+  },
+  {
+    "step": 453,
+    "loss": 1.5295212268829346,
+    "mse": 2.846710443496704
+  },
+  {
+    "step": 454,
+    "loss": 1.5627453327178955,
+    "mse": 3.16569447517395
+  },
+  {
+    "step": 455,
+    "loss": 1.672788381576538,
+    "mse": 3.5907185077667236
+  },
+  {
+    "step": 456,
+    "loss": 1.5130664110183716,
+    "mse": 2.9178247451782227
+  },
+  {
+    "step": 457,
+    "loss": 1.6807589530944824,
+    "mse": 3.5408763885498047
+  },
+  {
+    "step": 458,
+    "loss": 1.4892295598983765,
+    "mse": 2.711304187774658
+  },
+  {
+    "step": 459,
+    "loss": 1.3360036611557007,
+    "mse": 2.261157512664795
+  },
+  {
+    "step": 460,
+    "loss": 1.6237657070159912,
+    "mse": 3.3053691387176514
+  },
+  {
+    "step": 461,
+    "loss": 1.3924343585968018,
+    "mse": 2.519495964050293
+  },
+  {
+    "step": 462,
+    "loss": 1.446824073791504,
+    "mse": 2.6916468143463135
+  },
+  {
+    "step": 463,
+    "loss": 1.4600887298583984,
+    "mse": 2.7565906047821045
+  },
+  {
+    "step": 464,
+    "loss": 1.810404658317566,
+    "mse": 3.994213104248047
+  },
+  {
+    "step": 465,
+    "loss": 1.6389508247375488,
+    "mse": 3.3708183765411377
+  },
+  {
+    "step": 466,
+    "loss": 1.5122241973876953,
+    "mse": 2.8989224433898926
+  },
+  {
+    "step": 467,
+    "loss": 1.636605978012085,
+    "mse": 3.469228506088257
+  },
+  {
+    "step": 468,
+    "loss": 1.571743130683899,
+    "mse": 3.3342525959014893
+  },
+  {
+    "step": 469,
+    "loss": 1.4015451669692993,
+    "mse": 2.435537338256836
+  },
+  {
+    "step": 470,
+    "loss": 1.6132155656814575,
+    "mse": 3.303086280822754
+  },
+  {
+    "step": 471,
+    "loss": 1.5359135866165161,
+    "mse": 3.2314064502716064
+  },
+  {
+    "step": 472,
+    "loss": 1.5801135301589966,
+    "mse": 3.2736830711364746
+  },
+  {
+    "step": 473,
+    "loss": 1.5527186393737793,
+    "mse": 3.096989870071411
+  },
+  {
+    "step": 474,
+    "loss": 1.706296443939209,
+    "mse": 3.6090564727783203
+  },
+  {
+    "step": 475,
+    "loss": 1.5864416360855103,
+    "mse": 3.142824649810791
+  },
+  {
+    "step": 476,
+    "loss": 1.4863395690917969,
+    "mse": 2.741921901702881
+  },
+  {
+    "step": 477,
+    "loss": 1.5466701984405518,
+    "mse": 3.0498697757720947
+  },
+  {
+    "step": 478,
+    "loss": 1.5648704767227173,
+    "mse": 3.065540313720703
+  },
+  {
+    "step": 479,
+    "loss": 1.6231213808059692,
+    "mse": 3.3602752685546875
+  },
+  {
+    "step": 480,
+    "loss": 1.5678142309188843,
+    "mse": 3.057427167892456
+  },
+  {
+    "step": 481,
+    "loss": 1.475575566291809,
+    "mse": 2.8845276832580566
+  },
+  {
+    "step": 482,
+    "loss": 1.5609887838363647,
+    "mse": 3.088836908340454
+  },
+  {
+    "step": 483,
+    "loss": 1.5894732475280762,
+    "mse": 3.266741991043091
+  },
+  {
+    "step": 484,
+    "loss": 1.6336030960083008,
+    "mse": 3.6403589248657227
+  },
+  {
+    "step": 485,
+    "loss": 1.564131498336792,
+    "mse": 3.070358991622925
+  },
+  {
+    "step": 486,
+    "loss": 1.5336167812347412,
+    "mse": 3.316255807876587
+  },
+  {
+    "step": 487,
+    "loss": 1.5189049243927002,
+    "mse": 3.092653512954712
+  },
+  {
+    "step": 488,
+    "loss": 1.6546341180801392,
+    "mse": 3.6129543781280518
+  },
+  {
+    "step": 489,
+    "loss": 1.573622465133667,
+    "mse": 3.4019789695739746
+  },
+  {
+    "step": 490,
+    "loss": 1.595599889755249,
+    "mse": 3.2842860221862793
+  },
+  {
+    "step": 491,
+    "loss": 1.5801196098327637,
+    "mse": 3.2289276123046875
+  },
+  {
+    "step": 492,
+    "loss": 1.7125532627105713,
+    "mse": 3.6461310386657715
+  },
+  {
+    "step": 493,
+    "loss": 1.5702970027923584,
+    "mse": 3.1609652042388916
+  },
+  {
+    "step": 494,
+    "loss": 1.293412446975708,
+    "mse": 2.51737380027771
+  },
+  {
+    "step": 495,
+    "loss": 1.5731531381607056,
+    "mse": 3.2248330116271973
+  },
+  {
+    "step": 496,
+    "loss": 1.5312937498092651,
+    "mse": 3.080176591873169
+  },
+  {
+    "step": 497,
+    "loss": 1.5817883014678955,
+    "mse": 3.5173840522766113
+  },
+  {
+    "step": 498,
+    "loss": 1.6390726566314697,
+    "mse": 3.602442741394043
+  },
+  {
+    "step": 499,
+    "loss": 1.5551717281341553,
+    "mse": 3.355379581451416
+  },
+  {
+    "step": 500,
+    "loss": 1.5905659198760986,
+    "mse": 3.2138118743896484
+  },
+  {
+    "step": 501,
+    "loss": 1.745385766029358,
+    "mse": 3.947096347808838
+  },
+  {
+    "step": 502,
+    "loss": 1.5553157329559326,
+    "mse": 3.4634461402893066
+  },
+  {
+    "step": 503,
+    "loss": 1.7673025131225586,
+    "mse": 3.89383602142334
+  },
+  {
+    "step": 504,
+    "loss": 1.8632758855819702,
+    "mse": 4.5066447257995605
+  },
+  {
+    "step": 505,
+    "loss": 1.4802656173706055,
+    "mse": 3.1052560806274414
+  },
+  {
+    "step": 506,
+    "loss": 1.3584197759628296,
+    "mse": 2.502840280532837
+  },
+  {
+    "step": 507,
+    "loss": 1.4785057306289673,
+    "mse": 2.9900131225585938
+  },
+  {
+    "step": 508,
+    "loss": 1.4650018215179443,
+    "mse": 2.755682945251465
+  },
+  {
+    "step": 509,
+    "loss": 1.5285754203796387,
+    "mse": 3.198394298553467
+  },
+  {
+    "step": 510,
+    "loss": 1.4735438823699951,
+    "mse": 2.9873600006103516
+  },
+  {
+    "step": 511,
+    "loss": 1.4027210474014282,
+    "mse": 2.701885223388672
+  },
+  {
+    "step": 512,
+    "loss": 1.5254769325256348,
+    "mse": 3.146226167678833
+  },
+  {
+    "step": 513,
+    "loss": 1.6552168130874634,
+    "mse": 3.4634196758270264
+  },
+  {
+    "step": 514,
+    "loss": 1.5114288330078125,
+    "mse": 2.8045730590820312
+  },
+  {
+    "step": 515,
+    "loss": 1.5508702993392944,
+    "mse": 3.148228406906128
+  },
+  {
+    "step": 516,
+    "loss": 1.575939416885376,
+    "mse": 3.2963178157806396
+  },
+  {
+    "step": 517,
+    "loss": 1.3630281686782837,
+    "mse": 2.388549566268921
+  },
+  {
+    "step": 518,
+    "loss": 1.6089235544204712,
+    "mse": 3.3888344764709473
+  },
+  {
+    "step": 519,
+    "loss": 1.6326282024383545,
+    "mse": 3.499483823776245
+  },
+  {
+    "step": 520,
+    "loss": 1.5836164951324463,
+    "mse": 3.2425343990325928
+  },
+  {
+    "step": 521,
+    "loss": 1.488706350326538,
+    "mse": 3.0916640758514404
+  },
+  {
+    "step": 522,
+    "loss": 1.4546935558319092,
+    "mse": 3.0323619842529297
+  },
+  {
+    "step": 523,
+    "loss": 1.5743331909179688,
+    "mse": 3.236783981323242
+  },
+  {
+    "step": 524,
+    "loss": 1.430780291557312,
+    "mse": 2.9178524017333984
+  },
+  {
+    "step": 525,
+    "loss": 1.6027086973190308,
+    "mse": 3.2393643856048584
+  },
+  {
+    "step": 526,
+    "loss": 1.4245103597640991,
+    "mse": 2.977811336517334
+  },
+  {
+    "step": 527,
+    "loss": 1.5109305381774902,
+    "mse": 3.261605739593506
+  },
+  {
+    "step": 528,
+    "loss": 1.3756136894226074,
+    "mse": 2.82912015914917
+  },
+  {
+    "step": 529,
+    "loss": 1.437029242515564,
+    "mse": 2.890413284301758
+  },
+  {
+    "step": 530,
+    "loss": 1.7286717891693115,
+    "mse": 3.777132511138916
+  },
+  {
+    "step": 531,
+    "loss": 1.3726338148117065,
+    "mse": 2.425668716430664
+  },
+  {
+    "step": 532,
+    "loss": 1.7507320642471313,
+    "mse": 4.080982685089111
+  },
+  {
+    "step": 533,
+    "loss": 1.621896505355835,
+    "mse": 3.5152602195739746
+  },
+  {
+    "step": 534,
+    "loss": 1.4056249856948853,
+    "mse": 2.7940287590026855
+  },
+  {
+    "step": 535,
+    "loss": 1.5811822414398193,
+    "mse": 3.23713755607605
+  },
+  {
+    "step": 536,
+    "loss": 1.5482999086380005,
+    "mse": 3.011152505874634
+  },
+  {
+    "step": 537,
+    "loss": 1.406850814819336,
+    "mse": 2.6611313819885254
+  },
+  {
+    "step": 538,
+    "loss": 1.5374433994293213,
+    "mse": 3.1577749252319336
+  },
+  {
+    "step": 539,
+    "loss": 1.312813401222229,
+    "mse": 2.2982335090637207
+  },
+  {
+    "step": 540,
+    "loss": 1.8759467601776123,
+    "mse": 4.369658470153809
+  },
+  {
+    "step": 541,
+    "loss": 1.4922698736190796,
+    "mse": 2.874767780303955
+  },
+  {
+    "step": 542,
+    "loss": 1.7112025022506714,
+    "mse": 4.054537773132324
+  },
+  {
+    "step": 543,
+    "loss": 1.7041070461273193,
+    "mse": 4.288031578063965
+  },
+  {
+    "step": 544,
+    "loss": 1.6315503120422363,
+    "mse": 3.6964778900146484
+  },
+  {
+    "step": 545,
+    "loss": 1.6609288454055786,
+    "mse": 3.8526575565338135
+  },
+  {
+    "step": 546,
+    "loss": 1.749688982963562,
+    "mse": 4.0690083503723145
+  },
+  {
+    "step": 547,
+    "loss": 1.685937762260437,
+    "mse": 3.8636622428894043
+  },
+  {
+    "step": 548,
+    "loss": 1.5760270357131958,
+    "mse": 3.5032379627227783
+  },
+  {
+    "step": 549,
+    "loss": 1.5887901782989502,
+    "mse": 3.3128950595855713
+  },
+  {
+    "step": 550,
+    "loss": 1.480893611907959,
+    "mse": 3.05729341506958
+  },
+  {
+    "step": 551,
+    "loss": 1.4034404754638672,
+    "mse": 2.673321485519409
+  },
+  {
+    "step": 552,
+    "loss": 1.4541834592819214,
+    "mse": 3.219259262084961
+  },
+  {
+    "step": 553,
+    "loss": 1.4041097164154053,
+    "mse": 3.033220052719116
+  },
+  {
+    "step": 554,
+    "loss": 1.6376821994781494,
+    "mse": 3.840592861175537
+  },
+  {
+    "step": 555,
+    "loss": 1.5224707126617432,
+    "mse": 3.119629144668579
+  },
+  {
+    "step": 556,
+    "loss": 1.618607759475708,
+    "mse": 3.834101915359497
+  },
+  {
+    "step": 557,
+    "loss": 1.6920562982559204,
+    "mse": 3.675541877746582
+  },
+  {
+    "step": 558,
+    "loss": 1.4793999195098877,
+    "mse": 3.0981833934783936
+  },
+  {
+    "step": 559,
+    "loss": 1.5471500158309937,
+    "mse": 3.399089813232422
+  },
+  {
+    "step": 560,
+    "loss": 1.6995218992233276,
+    "mse": 3.9801769256591797
+  },
+  {
+    "step": 561,
+    "loss": 1.548148274421692,
+    "mse": 3.1831634044647217
+  },
+  {
+    "step": 562,
+    "loss": 1.3319237232208252,
+    "mse": 2.4405758380889893
+  },
+  {
+    "step": 563,
+    "loss": 1.5944464206695557,
+    "mse": 3.5699307918548584
+  },
+  {
+    "step": 564,
+    "loss": 1.5212386846542358,
+    "mse": 3.2981646060943604
+  },
+  {
+    "step": 565,
+    "loss": 1.6939518451690674,
+    "mse": 3.8140242099761963
+  },
+  {
+    "step": 566,
+    "loss": 1.6923836469650269,
+    "mse": 4.10267448425293
+  },
+  {
+    "step": 567,
+    "loss": 1.664621114730835,
+    "mse": 3.9501333236694336
+  },
+  {
+    "step": 568,
+    "loss": 1.830121636390686,
+    "mse": 4.753537178039551
+  },
+  {
+    "step": 569,
+    "loss": 1.5165070295333862,
+    "mse": 3.0204708576202393
+  },
+  {
+    "step": 570,
+    "loss": 1.5283033847808838,
+    "mse": 2.978384017944336
+  },
+  {
+    "step": 571,
+    "loss": 1.4589754343032837,
+    "mse": 3.3567731380462646
+  },
+  {
+    "step": 572,
+    "loss": 1.46580970287323,
+    "mse": 3.2419357299804688
+  },
+  {
+    "step": 573,
+    "loss": 1.483337640762329,
+    "mse": 2.845813035964966
+  },
+  {
+    "step": 574,
+    "loss": 1.57007896900177,
+    "mse": 3.4849092960357666
+  },
+  {
+    "step": 575,
+    "loss": 1.7324023246765137,
+    "mse": 3.8350112438201904
+  },
+  {
+    "step": 576,
+    "loss": 1.6346218585968018,
+    "mse": 3.604078531265259
+  },
+  {
+    "step": 577,
+    "loss": 1.642499566078186,
+    "mse": 3.72788667678833
+  },
+  {
+    "step": 578,
+    "loss": 1.6999846696853638,
+    "mse": 3.7341487407684326
+  },
+  {
+    "step": 579,
+    "loss": 1.5282554626464844,
+    "mse": 3.3719053268432617
+  },
+  {
+    "step": 580,
+    "loss": 1.7107263803482056,
+    "mse": 3.5727102756500244
+  },
+  {
+    "step": 581,
+    "loss": 1.7862627506256104,
+    "mse": 4.517049312591553
+  },
+  {
+    "step": 582,
+    "loss": 1.5424447059631348,
+    "mse": 3.20566987991333
+  },
+  {
+    "step": 583,
+    "loss": 1.8263020515441895,
+    "mse": 4.32109260559082
+  },
+  {
+    "step": 584,
+    "loss": 1.626776933670044,
+    "mse": 3.427691698074341
+  },
+  {
+    "step": 585,
+    "loss": 1.4766871929168701,
+    "mse": 2.804640054702759
+  },
+  {
+    "step": 586,
+    "loss": 1.594004511833191,
+    "mse": 3.379082679748535
+  },
+  {
+    "step": 587,
+    "loss": 1.69381582736969,
+    "mse": 4.124393939971924
+  },
+  {
+    "step": 588,
+    "loss": 1.5665283203125,
+    "mse": 3.2342569828033447
+  },
+  {
+    "step": 589,
+    "loss": 1.6773205995559692,
+    "mse": 3.969660758972168
+  },
+  {
+    "step": 590,
+    "loss": 1.4152076244354248,
+    "mse": 2.7429680824279785
+  },
+  {
+    "step": 591,
+    "loss": 1.5265990495681763,
+    "mse": 3.45017409324646
+  },
+  {
+    "step": 592,
+    "loss": 1.5651723146438599,
+    "mse": 3.544994592666626
+  },
+  {
+    "step": 593,
+    "loss": 1.760155439376831,
+    "mse": 4.51138162612915
+  },
+  {
+    "step": 594,
+    "loss": 1.2893083095550537,
+    "mse": 2.425333261489868
+  },
+  {
+    "step": 595,
+    "loss": 1.637568712234497,
+    "mse": 3.5535199642181396
+  },
+  {
+    "step": 596,
+    "loss": 1.5777831077575684,
+    "mse": 3.7866265773773193
+  },
+  {
+    "step": 597,
+    "loss": 1.5077955722808838,
+    "mse": 3.26857852935791
+  },
+  {
+    "step": 598,
+    "loss": 1.5641100406646729,
+    "mse": 3.898758888244629
+  },
+  {
+    "step": 599,
+    "loss": 1.6652158498764038,
+    "mse": 3.7859904766082764
+  },
+  {
+    "step": 600,
+    "loss": 1.7693475484848022,
+    "mse": 4.3655290603637695
+  },
+  {
+    "step": 601,
+    "loss": 1.5895416736602783,
+    "mse": 3.6898107528686523
+  },
+  {
+    "step": 602,
+    "loss": 1.5396113395690918,
+    "mse": 3.3077499866485596
+  },
+  {
+    "step": 603,
+    "loss": 1.7380379438400269,
+    "mse": 4.386752605438232
+  },
+  {
+    "step": 604,
+    "loss": 1.4187804460525513,
+    "mse": 3.0976078510284424
+  },
+  {
+    "step": 605,
+    "loss": 1.4182374477386475,
+    "mse": 2.8004512786865234
+  },
+  {
+    "step": 606,
+    "loss": 1.450671672821045,
+    "mse": 3.0839366912841797
+  },
+  {
+    "step": 607,
+    "loss": 1.3670450448989868,
+    "mse": 2.7000253200531006
+  },
+  {
+    "step": 608,
+    "loss": 1.6898409128189087,
+    "mse": 4.260972023010254
+  },
+  {
+    "step": 609,
+    "loss": 1.7547317743301392,
+    "mse": 4.033355712890625
+  },
+  {
+    "step": 610,
+    "loss": 1.4757184982299805,
+    "mse": 3.0809006690979004
+  },
+  {
+    "step": 611,
+    "loss": 1.6534533500671387,
+    "mse": 4.105370044708252
+  },
+  {
+    "step": 612,
+    "loss": 1.5338456630706787,
+    "mse": 3.0794920921325684
+  },
+  {
+    "step": 613,
+    "loss": 1.8082891702651978,
+    "mse": 4.719211101531982
+  },
+  {
+    "step": 614,
+    "loss": 1.4890259504318237,
+    "mse": 3.1537234783172607
+  },
+  {
+    "step": 615,
+    "loss": 1.6990931034088135,
+    "mse": 3.799473762512207
+  },
+  {
+    "step": 616,
+    "loss": 1.3614118099212646,
+    "mse": 2.4613888263702393
+  },
+  {
+    "step": 617,
+    "loss": 1.5640406608581543,
+    "mse": 3.5319254398345947
+  },
+  {
+    "step": 618,
+    "loss": 1.7166008949279785,
+    "mse": 3.7486398220062256
+  },
+  {
+    "step": 619,
+    "loss": 1.5312063694000244,
+    "mse": 3.326458215713501
+  },
+  {
+    "step": 620,
+    "loss": 1.5136414766311646,
+    "mse": 2.9679040908813477
+  },
+  {
+    "step": 621,
+    "loss": 1.4940624237060547,
+    "mse": 3.708556652069092
+  },
+  {
+    "step": 622,
+    "loss": 1.5661022663116455,
+    "mse": 3.27781081199646
+  },
+  {
+    "step": 623,
+    "loss": 1.6336479187011719,
+    "mse": 3.7569100856781006
+  },
+  {
+    "step": 624,
+    "loss": 1.459814190864563,
+    "mse": 3.09033203125
+  },
+  {
+    "step": 625,
+    "loss": 1.4975143671035767,
+    "mse": 3.2325870990753174
+  },
+  {
+    "step": 626,
+    "loss": 1.4443999528884888,
+    "mse": 2.9001471996307373
+  },
+  {
+    "step": 627,
+    "loss": 1.3962571620941162,
+    "mse": 3.239901542663574
+  },
+  {
+    "step": 628,
+    "loss": 1.6644309759140015,
+    "mse": 4.132995128631592
+  },
+  {
+    "step": 629,
+    "loss": 1.6347421407699585,
+    "mse": 3.495776653289795
+  },
+  {
+    "step": 630,
+    "loss": 1.694747805595398,
+    "mse": 4.030592441558838
+  },
+  {
+    "step": 631,
+    "loss": 1.522402048110962,
+    "mse": 3.1503632068634033
+  },
+  {
+    "step": 632,
+    "loss": 1.4697644710540771,
+    "mse": 3.031489849090576
+  },
+  {
+    "step": 633,
+    "loss": 1.787922739982605,
+    "mse": 4.384559154510498
+  },
+  {
+    "step": 634,
+    "loss": 1.583243489265442,
+    "mse": 3.6429479122161865
+  },
+  {
+    "step": 635,
+    "loss": 1.6372953653335571,
+    "mse": 4.019174575805664
+  },
+  {
+    "step": 636,
+    "loss": 1.6823534965515137,
+    "mse": 4.124603748321533
+  },
+  {
+    "step": 637,
+    "loss": 1.7027511596679688,
+    "mse": 4.29568338394165
+  },
+  {
+    "step": 638,
+    "loss": 1.5799906253814697,
+    "mse": 3.2726714611053467
+  },
+  {
+    "step": 639,
+    "loss": 1.4221810102462769,
+    "mse": 2.920229196548462
+  },
+  {
+    "step": 640,
+    "loss": 1.5739753246307373,
+    "mse": 3.790522575378418
+  },
+  {
+    "step": 641,
+    "loss": 1.8982592821121216,
+    "mse": 5.283847332000732
+  },
+  {
+    "step": 642,
+    "loss": 1.8187980651855469,
+    "mse": 4.5542473793029785
+  },
+  {
+    "step": 643,
+    "loss": 1.42177414894104,
+    "mse": 3.193674087524414
+  },
+  {
+    "step": 644,
+    "loss": 1.6476802825927734,
+    "mse": 3.7104828357696533
+  },
+  {
+    "step": 645,
+    "loss": 1.557651400566101,
+    "mse": 3.712219715118408
+  },
+  {
+    "step": 646,
+    "loss": 1.7373082637786865,
+    "mse": 4.554323196411133
+  },
+  {
+    "step": 647,
+    "loss": 1.5310354232788086,
+    "mse": 3.266557455062866
+  },
+  {
+    "step": 648,
+    "loss": 1.3610670566558838,
+    "mse": 2.701850414276123
+  },
+  {
+    "step": 649,
+    "loss": 1.4862388372421265,
+    "mse": 3.571345567703247
+  },
+  {
+    "step": 650,
+    "loss": 1.6248793601989746,
+    "mse": 4.1149420738220215
+  },
+  {
+    "step": 651,
+    "loss": 1.4250258207321167,
+    "mse": 2.804126739501953
+  },
+  {
+    "step": 652,
+    "loss": 1.6964373588562012,
+    "mse": 4.12851619720459
+  },
+  {
+    "step": 653,
+    "loss": 1.6658782958984375,
+    "mse": 4.003403186798096
+  },
+  {
+    "step": 654,
+    "loss": 1.4976155757904053,
+    "mse": 3.3243038654327393
+  },
+  {
+    "step": 655,
+    "loss": 1.6361839771270752,
+    "mse": 3.712533712387085
+  },
+  {
+    "step": 656,
+    "loss": 1.37026846408844,
+    "mse": 2.9693853855133057
+  },
+  {
+    "step": 657,
+    "loss": 1.3400579690933228,
+    "mse": 2.4787213802337646
+  },
+  {
+    "step": 658,
+    "loss": 1.664128303527832,
+    "mse": 4.012454509735107
+  },
+  {
+    "step": 659,
+    "loss": 1.3459115028381348,
+    "mse": 2.4290785789489746
+  },
+  {
+    "step": 660,
+    "loss": 1.6416411399841309,
+    "mse": 4.042295932769775
+  },
+  {
+    "step": 661,
+    "loss": 1.4325555562973022,
+    "mse": 2.902252674102783
+  },
+  {
+    "step": 662,
+    "loss": 1.6788984537124634,
+    "mse": 4.148648738861084
+  },
+  {
+    "step": 663,
+    "loss": 1.6180827617645264,
+    "mse": 3.5419206619262695
+  },
+  {
+    "step": 664,
+    "loss": 1.6140371561050415,
+    "mse": 4.1048903465271
+  },
+  {
+    "step": 665,
+    "loss": 1.7012604475021362,
+    "mse": 3.913243293762207
+  },
+  {
+    "step": 666,
+    "loss": 1.4312047958374023,
+    "mse": 3.1777007579803467
+  },
+  {
+    "step": 667,
+    "loss": 1.728169560432434,
+    "mse": 4.325051784515381
+  },
+  {
+    "step": 668,
+    "loss": 1.456350564956665,
+    "mse": 3.1795668601989746
+  },
+  {
+    "step": 669,
+    "loss": 1.6560394763946533,
+    "mse": 4.0038299560546875
+  },
+  {
+    "step": 670,
+    "loss": 1.598200798034668,
+    "mse": 3.8798980712890625
+  },
+  {
+    "step": 671,
+    "loss": 1.5903139114379883,
+    "mse": 3.4211599826812744
+  },
+  {
+    "step": 672,
+    "loss": 1.5519421100616455,
+    "mse": 3.049705982208252
+  },
+  {
+    "step": 673,
+    "loss": 1.5964609384536743,
+    "mse": 3.699594736099243
+  },
+  {
+    "step": 674,
+    "loss": 1.4974689483642578,
+    "mse": 3.021038293838501
+  },
+  {
+    "step": 675,
+    "loss": 1.8133444786071777,
+    "mse": 4.265471935272217
+  },
+  {
+    "step": 676,
+    "loss": 1.3936328887939453,
+    "mse": 2.744870901107788
+  },
+  {
+    "step": 677,
+    "loss": 1.690657138824463,
+    "mse": 3.8077638149261475
+  },
+  {
+    "step": 678,
+    "loss": 1.6688193082809448,
+    "mse": 4.294571876525879
+  },
+  {
+    "step": 679,
+    "loss": 1.5745820999145508,
+    "mse": 3.5430712699890137
+  },
+  {
+    "step": 680,
+    "loss": 1.6556100845336914,
+    "mse": 3.7853260040283203
+  },
+  {
+    "step": 681,
+    "loss": 1.6929281949996948,
+    "mse": 3.915788173675537
+  },
+  {
+    "step": 682,
+    "loss": 1.7269271612167358,
+    "mse": 4.562770366668701
+  },
+  {
+    "step": 683,
+    "loss": 1.76576566696167,
+    "mse": 5.372347354888916
+  },
+  {
+    "step": 684,
+    "loss": 1.5879707336425781,
+    "mse": 3.3929033279418945
+  },
+  {
+    "step": 685,
+    "loss": 1.6612939834594727,
+    "mse": 4.0090203285217285
+  },
+  {
+    "step": 686,
+    "loss": 1.6302199363708496,
+    "mse": 4.244150638580322
+  },
+  {
+    "step": 687,
+    "loss": 1.7698695659637451,
+    "mse": 4.399194240570068
+  },
+  {
+    "step": 688,
+    "loss": 1.6980056762695312,
+    "mse": 3.9201905727386475
+  },
+  {
+    "step": 689,
+    "loss": 1.4546856880187988,
+    "mse": 2.827911376953125
+  },
+  {
+    "step": 690,
+    "loss": 1.5768619775772095,
+    "mse": 3.8421971797943115
+  },
+  {
+    "step": 691,
+    "loss": 1.5210459232330322,
+    "mse": 3.133856773376465
+  },
+  {
+    "step": 692,
+    "loss": 1.781602382659912,
+    "mse": 4.035821914672852
+  },
+  {
+    "step": 693,
+    "loss": 1.5792415142059326,
+    "mse": 3.3663740158081055
+  },
+  {
+    "step": 694,
+    "loss": 1.6323041915893555,
+    "mse": 4.2150983810424805
+  },
+  {
+    "step": 695,
+    "loss": 1.6687185764312744,
+    "mse": 4.570199966430664
+  },
+  {
+    "step": 696,
+    "loss": 1.9103972911834717,
+    "mse": 5.272554874420166
+  },
+  {
+    "step": 697,
+    "loss": 1.9184308052062988,
+    "mse": 5.194389820098877
+  },
+  {
+    "step": 698,
+    "loss": 1.5498383045196533,
+    "mse": 3.392328977584839
+  },
+  {
+    "step": 699,
+    "loss": 1.722190260887146,
+    "mse": 4.605947017669678
+  },
+  {
+    "step": 700,
+    "loss": 1.6867334842681885,
+    "mse": 4.138726234436035
+  },
+  {
+    "step": 701,
+    "loss": 1.563169002532959,
+    "mse": 3.4583547115325928
+  },
+  {
+    "step": 702,
+    "loss": 1.5976879596710205,
+    "mse": 4.433415412902832
+  },
+  {
+    "step": 703,
+    "loss": 1.434194564819336,
+    "mse": 2.66310977935791
+  },
+  {
+    "step": 704,
+    "loss": 1.6862504482269287,
+    "mse": 4.190390586853027
+  },
+  {
+    "step": 705,
+    "loss": 1.281304121017456,
+    "mse": 2.4046506881713867
+  },
+  {
+    "step": 706,
+    "loss": 1.5507278442382812,
+    "mse": 3.0588648319244385
+  },
+  {
+    "step": 707,
+    "loss": 1.5915930271148682,
+    "mse": 3.6709372997283936
+  },
+  {
+    "step": 708,
+    "loss": 1.7592778205871582,
+    "mse": 4.390506744384766
+  },
+  {
+    "step": 709,
+    "loss": 1.5280083417892456,
+    "mse": 3.290750026702881
+  },
+  {
+    "step": 710,
+    "loss": 1.4542704820632935,
+    "mse": 3.2029690742492676
+  },
+  {
+    "step": 711,
+    "loss": 1.430001974105835,
+    "mse": 3.263706922531128
+  },
+  {
+    "step": 712,
+    "loss": 1.6852020025253296,
+    "mse": 4.27518367767334
+  },
+  {
+    "step": 713,
+    "loss": 1.4384602308273315,
+    "mse": 2.9417076110839844
+  },
+  {
+    "step": 714,
+    "loss": 2.0591952800750732,
+    "mse": 6.155002593994141
+  },
+  {
+    "step": 715,
+    "loss": 1.6099321842193604,
+    "mse": 3.557957887649536
+  },
+  {
+    "step": 716,
+    "loss": 1.7186791896820068,
+    "mse": 4.614316940307617
+  },
+  {
+    "step": 717,
+    "loss": 1.723191261291504,
+    "mse": 4.400258541107178
+  },
+  {
+    "step": 718,
+    "loss": 1.7409281730651855,
+    "mse": 4.984875679016113
+  },
+  {
+    "step": 719,
+    "loss": 1.6696854829788208,
+    "mse": 3.5482709407806396
+  },
+  {
+    "step": 720,
+    "loss": 1.3049355745315552,
+    "mse": 2.4579737186431885
+  },
+  {
+    "step": 721,
+    "loss": 1.4407901763916016,
+    "mse": 3.034120559692383
+  },
+  {
+    "step": 722,
+    "loss": 1.4170057773590088,
+    "mse": 2.9167094230651855
+  },
+  {
+    "step": 723,
+    "loss": 1.5106948614120483,
+    "mse": 3.2088286876678467
+  },
+  {
+    "step": 724,
+    "loss": 1.490492582321167,
+    "mse": 3.3002963066101074
+  },
+  {
+    "step": 725,
+    "loss": 1.3325320482254028,
+    "mse": 2.6254215240478516
+  },
+  {
+    "step": 726,
+    "loss": 1.339335322380066,
+    "mse": 2.5918993949890137
+  },
+  {
+    "step": 727,
+    "loss": 1.4007337093353271,
+    "mse": 3.1603803634643555
+  },
+  {
+    "step": 728,
+    "loss": 1.551997423171997,
+    "mse": 3.585296154022217
+  },
+  {
+    "step": 729,
+    "loss": 1.557359218597412,
+    "mse": 3.5385079383850098
+  },
+  {
+    "step": 730,
+    "loss": 1.6959559917449951,
+    "mse": 4.0348920822143555
+  },
+  {
+    "step": 731,
+    "loss": 1.6785327196121216,
+    "mse": 4.369668006896973
+  },
+  {
+    "step": 732,
+    "loss": 1.5009315013885498,
+    "mse": 3.157768964767456
+  },
+  {
+    "step": 733,
+    "loss": 1.6122260093688965,
+    "mse": 4.533418655395508
+  },
+  {
+    "step": 734,
+    "loss": 1.5051517486572266,
+    "mse": 3.162198066711426
+  },
+  {
+    "step": 735,
+    "loss": 1.7440446615219116,
+    "mse": 5.002204418182373
+  },
+  {
+    "step": 736,
+    "loss": 1.297730565071106,
+    "mse": 2.3275973796844482
+  },
+  {
+    "step": 737,
+    "loss": 1.7008700370788574,
+    "mse": 3.862105131149292
+  },
+  {
+    "step": 738,
+    "loss": 1.6158926486968994,
+    "mse": 3.6981606483459473
+  },
+  {
+    "step": 739,
+    "loss": 1.6085689067840576,
+    "mse": 3.67635440826416
+  },
+  {
+    "step": 740,
+    "loss": 1.5568032264709473,
+    "mse": 3.5799732208251953
+  },
+  {
+    "step": 741,
+    "loss": 1.5018142461776733,
+    "mse": 3.6853671073913574
+  },
+  {
+    "step": 742,
+    "loss": 1.6244378089904785,
+    "mse": 3.4283084869384766
+  },
+  {
+    "step": 743,
+    "loss": 1.621797800064087,
+    "mse": 3.389556407928467
+  },
+  {
+    "step": 744,
+    "loss": 1.6910316944122314,
+    "mse": 3.987536907196045
+  },
+  {
+    "step": 745,
+    "loss": 1.5264735221862793,
+    "mse": 3.2748610973358154
+  },
+  {
+    "step": 746,
+    "loss": 1.7770003080368042,
+    "mse": 5.166696548461914
+  },
+  {
+    "step": 747,
+    "loss": 1.4177801609039307,
+    "mse": 3.0344929695129395
+  },
+  {
+    "step": 748,
+    "loss": 1.595269799232483,
+    "mse": 4.052142143249512
+  },
+  {
+    "step": 749,
+    "loss": 1.405724287033081,
+    "mse": 3.202176570892334
+  },
+  {
+    "step": 750,
+    "loss": 1.4989349842071533,
+    "mse": 3.2409324645996094
+  },
+  {
+    "step": 751,
+    "loss": 1.4752742052078247,
+    "mse": 3.362913131713867
+  },
+  {
+    "step": 752,
+    "loss": 1.6235697269439697,
+    "mse": 3.755258798599243
+  },
+  {
+    "step": 753,
+    "loss": 1.4647103548049927,
+    "mse": 3.6227033138275146
+  },
+  {
+    "step": 754,
+    "loss": 1.7102034091949463,
+    "mse": 4.487405300140381
+  },
+  {
+    "step": 755,
+    "loss": 1.738478660583496,
+    "mse": 4.900706768035889
+  },
+  {
+    "step": 756,
+    "loss": 1.4708740711212158,
+    "mse": 3.49526309967041
+  },
+  {
+    "step": 757,
+    "loss": 1.6678370237350464,
+    "mse": 4.279773712158203
+  },
+  {
+    "step": 758,
+    "loss": 1.6692415475845337,
+    "mse": 3.9405832290649414
+  },
+  {
+    "step": 759,
+    "loss": 1.670623540878296,
+    "mse": 4.004560470581055
+  },
+  {
+    "step": 760,
+    "loss": 1.7395180463790894,
+    "mse": 4.768226623535156
+  },
+  {
+    "step": 761,
+    "loss": 1.5303051471710205,
+    "mse": 3.4215168952941895
+  },
+  {
+    "step": 762,
+    "loss": 1.7438441514968872,
+    "mse": 4.366518020629883
+  },
+  {
+    "step": 763,
+    "loss": 1.5094935894012451,
+    "mse": 3.3261325359344482
+  },
+  {
+    "step": 764,
+    "loss": 1.4075828790664673,
+    "mse": 3.004434108734131
+  },
+  {
+    "step": 765,
+    "loss": 1.4096887111663818,
+    "mse": 3.548292875289917
+  },
+  {
+    "step": 766,
+    "loss": 1.4799718856811523,
+    "mse": 3.415276527404785
+  },
+  {
+    "step": 767,
+    "loss": 1.6626492738723755,
+    "mse": 4.314199447631836
+  },
+  {
+    "step": 768,
+    "loss": 1.6983952522277832,
+    "mse": 4.505494117736816
+  },
+  {
+    "step": 769,
+    "loss": 1.8021368980407715,
+    "mse": 5.2588911056518555
+  },
+  {
+    "step": 770,
+    "loss": 1.5277175903320312,
+    "mse": 3.10577130317688
+  },
+  {
+    "step": 771,
+    "loss": 1.4820500612258911,
+    "mse": 3.552797555923462
+  },
+  {
+    "step": 772,
+    "loss": 1.7902463674545288,
+    "mse": 5.312524318695068
+  },
+  {
+    "step": 773,
+    "loss": 1.6238150596618652,
+    "mse": 3.867095708847046
+  },
+  {
+    "step": 774,
+    "loss": 1.8415714502334595,
+    "mse": 5.0388102531433105
+  },
+  {
+    "step": 775,
+    "loss": 1.6023120880126953,
+    "mse": 3.414834499359131
+  },
+  {
+    "step": 776,
+    "loss": 1.4211885929107666,
+    "mse": 2.8377811908721924
+  },
+  {
+    "step": 777,
+    "loss": 1.528463363647461,
+    "mse": 3.3029706478118896
+  },
+  {
+    "step": 778,
+    "loss": 1.705994725227356,
+    "mse": 4.082733631134033
+  },
+  {
+    "step": 779,
+    "loss": 1.5014121532440186,
+    "mse": 3.3054380416870117
+  },
+  {
+    "step": 780,
+    "loss": 1.4618383646011353,
+    "mse": 3.5931999683380127
+  },
+  {
+    "step": 781,
+    "loss": 1.589346170425415,
+    "mse": 3.564814329147339
+  },
+  {
+    "step": 782,
+    "loss": 1.6855549812316895,
+    "mse": 4.580367088317871
+  },
+  {
+    "step": 783,
+    "loss": 1.6092722415924072,
+    "mse": 3.676182508468628
+  },
+  {
+    "step": 784,
+    "loss": 1.4726016521453857,
+    "mse": 3.509425401687622
+  },
+  {
+    "step": 785,
+    "loss": 1.452117681503296,
+    "mse": 3.127882957458496
+  },
+  {
+    "step": 786,
+    "loss": 1.3377255201339722,
+    "mse": 2.785639524459839
+  },
+  {
+    "step": 787,
+    "loss": 1.547603964805603,
+    "mse": 3.160978317260742
+  },
+  {
+    "step": 788,
+    "loss": 1.4117910861968994,
+    "mse": 2.870698928833008
+  },
+  {
+    "step": 789,
+    "loss": 1.4716098308563232,
+    "mse": 3.111790657043457
+  },
+  {
+    "step": 790,
+    "loss": 1.9206148386001587,
+    "mse": 5.775315761566162
+  },
+  {
+    "step": 791,
+    "loss": 1.7113019227981567,
+    "mse": 4.244504928588867
+  },
+  {
+    "step": 792,
+    "loss": 1.651306390762329,
+    "mse": 4.653195858001709
+  },
+  {
+    "step": 793,
+    "loss": 1.7002363204956055,
+    "mse": 4.451324939727783
+  },
+  {
+    "step": 794,
+    "loss": 1.8022401332855225,
+    "mse": 5.277995586395264
+  },
+  {
+    "step": 795,
+    "loss": 1.5088346004486084,
+    "mse": 3.1432793140411377
+  },
+  {
+    "step": 796,
+    "loss": 1.7649247646331787,
+    "mse": 4.93526554107666
+  },
+  {
+    "step": 797,
+    "loss": 1.6367876529693604,
+    "mse": 3.6323323249816895
+  },
+  {
+    "step": 798,
+    "loss": 1.8431520462036133,
+    "mse": 4.849212169647217
+  },
+  {
+    "step": 799,
+    "loss": 1.7582087516784668,
+    "mse": 4.476820945739746
+  },
+  {
+    "step": 800,
+    "loss": 1.5865838527679443,
+    "mse": 3.4349589347839355
+  },
+  {
+    "step": 801,
+    "loss": 1.70338773727417,
+    "mse": 4.149443626403809
+  },
+  {
+    "step": 802,
+    "loss": 1.8147599697113037,
+    "mse": 5.078677654266357
+  },
+  {
+    "step": 803,
+    "loss": 1.498096227645874,
+    "mse": 3.2899723052978516
+  },
+  {
+    "step": 804,
+    "loss": 1.4401018619537354,
+    "mse": 2.93731951713562
+  },
+  {
+    "step": 805,
+    "loss": 1.7940865755081177,
+    "mse": 4.53560733795166
+  },
+  {
+    "step": 806,
+    "loss": 1.4920763969421387,
+    "mse": 3.1086511611938477
+  },
+  {
+    "step": 807,
+    "loss": 1.3124396800994873,
+    "mse": 2.703507900238037
+  },
+  {
+    "step": 808,
+    "loss": 1.4606436491012573,
+    "mse": 3.1544289588928223
+  },
+  {
+    "step": 809,
+    "loss": 1.6315042972564697,
+    "mse": 3.643622875213623
+  },
+  {
+    "step": 810,
+    "loss": 1.500109076499939,
+    "mse": 2.953584671020508
+  },
+  {
+    "step": 811,
+    "loss": 1.4484598636627197,
+    "mse": 2.8465209007263184
+  },
+  {
+    "step": 812,
+    "loss": 1.4846272468566895,
+    "mse": 2.939250946044922
+  },
+  {
+    "step": 813,
+    "loss": 1.678034782409668,
+    "mse": 3.804274082183838
+  },
+  {
+    "step": 814,
+    "loss": 1.4661675691604614,
+    "mse": 3.1785922050476074
+  },
+  {
+    "step": 815,
+    "loss": 1.3612793684005737,
+    "mse": 2.64363956451416
+  },
+  {
+    "step": 816,
+    "loss": 1.3804640769958496,
+    "mse": 2.617598056793213
+  },
+  {
+    "step": 817,
+    "loss": 1.6713082790374756,
+    "mse": 4.184730529785156
+  },
+  {
+    "step": 818,
+    "loss": 1.487377405166626,
+    "mse": 3.0652332305908203
+  },
+  {
+    "step": 819,
+    "loss": 1.6481455564498901,
+    "mse": 3.5813956260681152
+  },
+  {
+    "step": 820,
+    "loss": 1.4313552379608154,
+    "mse": 3.2495131492614746
+  },
+  {
+    "step": 821,
+    "loss": 1.4876434803009033,
+    "mse": 3.0587618350982666
+  },
+  {
+    "step": 822,
+    "loss": 1.6697313785552979,
+    "mse": 4.042583465576172
+  },
+  {
+    "step": 823,
+    "loss": 1.4108803272247314,
+    "mse": 2.9815969467163086
+  },
+  {
+    "step": 824,
+    "loss": 1.5908186435699463,
+    "mse": 3.921299934387207
+  },
+  {
+    "step": 825,
+    "loss": 1.3829329013824463,
+    "mse": 2.6630795001983643
+  },
+  {
+    "step": 826,
+    "loss": 1.355548620223999,
+    "mse": 3.077016592025757
+  },
+  {
+    "step": 827,
+    "loss": 1.7455142736434937,
+    "mse": 4.5102410316467285
+  },
+  {
+    "step": 828,
+    "loss": 1.6656720638275146,
+    "mse": 4.594099521636963
+  },
+  {
+    "step": 829,
+    "loss": 1.5744011402130127,
+    "mse": 3.444138526916504
+  },
+  {
+    "step": 830,
+    "loss": 1.4146409034729004,
+    "mse": 2.860675811767578
+  },
+  {
+    "step": 831,
+    "loss": 1.4971296787261963,
+    "mse": 3.3794972896575928
+  },
+  {
+    "step": 832,
+    "loss": 1.5687402486801147,
+    "mse": 3.975220203399658
+  },
+  {
+    "step": 833,
+    "loss": 1.7867085933685303,
+    "mse": 4.714566230773926
+  },
+  {
+    "step": 834,
+    "loss": 1.6261427402496338,
+    "mse": 3.720705032348633
+  },
+  {
+    "step": 835,
+    "loss": 1.6648818254470825,
+    "mse": 4.135499954223633
+  },
+  {
+    "step": 836,
+    "loss": 1.549574613571167,
+    "mse": 3.187563896179199
+  },
+  {
+    "step": 837,
+    "loss": 1.6144810914993286,
+    "mse": 3.661221981048584
+  },
+  {
+    "step": 838,
+    "loss": 1.4106327295303345,
+    "mse": 2.830742597579956
+  },
+  {
+    "step": 839,
+    "loss": 1.4305939674377441,
+    "mse": 3.145167589187622
+  },
+  {
+    "step": 840,
+    "loss": 1.479239821434021,
+    "mse": 3.5426976680755615
+  },
+  {
+    "step": 841,
+    "loss": 1.5946292877197266,
+    "mse": 3.641139507293701
+  },
+  {
+    "step": 842,
+    "loss": 1.6576448678970337,
+    "mse": 4.220160961151123
+  },
+  {
+    "step": 843,
+    "loss": 1.4730446338653564,
+    "mse": 3.148550033569336
+  },
+  {
+    "step": 844,
+    "loss": 1.3872796297073364,
+    "mse": 2.697183847427368
+  },
+  {
+    "step": 845,
+    "loss": 1.7884188890457153,
+    "mse": 4.4819769859313965
+  },
+  {
+    "step": 846,
+    "loss": 1.5600961446762085,
+    "mse": 3.541170835494995
+  },
+  {
+    "step": 847,
+    "loss": 1.7251663208007812,
+    "mse": 4.15450382232666
+  },
+  {
+    "step": 848,
+    "loss": 1.385209321975708,
+    "mse": 3.315207004547119
+  },
+  {
+    "step": 849,
+    "loss": 1.8295613527297974,
+    "mse": 5.516055107116699
+  },
+  {
+    "step": 850,
+    "loss": 1.5297683477401733,
+    "mse": 3.388807773590088
+  },
+  {
+    "step": 851,
+    "loss": 1.5611165761947632,
+    "mse": 3.317992925643921
+  },
+  {
+    "step": 852,
+    "loss": 1.8829108476638794,
+    "mse": 5.998419284820557
+  },
+  {
+    "step": 853,
+    "loss": 1.5732226371765137,
+    "mse": 3.6501808166503906
+  },
+  {
+    "step": 854,
+    "loss": 1.4592152833938599,
+    "mse": 3.2397234439849854
+  },
+  {
+    "step": 855,
+    "loss": 1.1195801496505737,
+    "mse": 1.8191046714782715
+  },
+  {
+    "step": 856,
+    "loss": 1.462445855140686,
+    "mse": 2.9905619621276855
+  },
+  {
+    "step": 857,
+    "loss": 1.5804299116134644,
+    "mse": 4.314901351928711
+  },
+  {
+    "step": 858,
+    "loss": 1.4439913034439087,
+    "mse": 2.883749008178711
+  },
+  {
+    "step": 859,
+    "loss": 1.5696829557418823,
+    "mse": 3.3587236404418945
+  },
+  {
+    "step": 860,
+    "loss": 1.4481087923049927,
+    "mse": 3.4148216247558594
+  },
+  {
+    "step": 861,
+    "loss": 1.5751659870147705,
+    "mse": 4.724013328552246
+  },
+  {
+    "step": 862,
+    "loss": 1.3240183591842651,
+    "mse": 2.3754310607910156
+  },
+  {
+    "step": 863,
+    "loss": 1.6095268726348877,
+    "mse": 4.320369243621826
+  },
+  {
+    "step": 864,
+    "loss": 1.259145975112915,
+    "mse": 2.216269016265869
+  },
+  {
+    "step": 865,
+    "loss": 1.4792451858520508,
+    "mse": 3.0622925758361816
+  },
+  {
+    "step": 866,
+    "loss": 1.7147753238677979,
+    "mse": 4.747116565704346
+  },
+  {
+    "step": 867,
+    "loss": 1.9228627681732178,
+    "mse": 5.4321699142456055
+  },
+  {
+    "step": 868,
+    "loss": 1.6608052253723145,
+    "mse": 4.364002227783203
+  },
+  {
+    "step": 869,
+    "loss": 1.6090397834777832,
+    "mse": 4.066481590270996
+  },
+  {
+    "step": 870,
+    "loss": 1.4829051494598389,
+    "mse": 3.1398632526397705
+  },
+  {
+    "step": 871,
+    "loss": 1.8535535335540771,
+    "mse": 5.564328670501709
+  },
+  {
+    "step": 872,
+    "loss": 1.5960893630981445,
+    "mse": 4.027083873748779
+  },
+  {
+    "step": 873,
+    "loss": 1.4865813255310059,
+    "mse": 3.4703361988067627
+  },
+  {
+    "step": 874,
+    "loss": 1.60288405418396,
+    "mse": 4.04107666015625
+  },
+  {
+    "step": 875,
+    "loss": 1.6381070613861084,
+    "mse": 3.8505966663360596
+  },
+  {
+    "step": 876,
+    "loss": 1.5307350158691406,
+    "mse": 3.399656295776367
+  },
+  {
+    "step": 877,
+    "loss": 1.7711310386657715,
+    "mse": 4.955594062805176
+  },
+  {
+    "step": 878,
+    "loss": 1.8380885124206543,
+    "mse": 5.234629154205322
+  },
+  {
+    "step": 879,
+    "loss": 1.5382654666900635,
+    "mse": 4.163975238800049
+  },
+  {
+    "step": 880,
+    "loss": 1.6685898303985596,
+    "mse": 3.7298898696899414
+  },
+  {
+    "step": 881,
+    "loss": 1.591536283493042,
+    "mse": 3.876051902770996
+  },
+  {
+    "step": 882,
+    "loss": 1.4706604480743408,
+    "mse": 2.793887138366699
+  },
+  {
+    "step": 883,
+    "loss": 1.6739342212677002,
+    "mse": 3.7610373497009277
+  },
+  {
+    "step": 884,
+    "loss": 1.6865389347076416,
+    "mse": 4.049519062042236
+  },
+  {
+    "step": 885,
+    "loss": 1.8907876014709473,
+    "mse": 5.693615436553955
+  },
+  {
+    "step": 886,
+    "loss": 1.8898640871047974,
+    "mse": 5.6486616134643555
+  },
+  {
+    "step": 887,
+    "loss": 1.5763700008392334,
+    "mse": 3.5276005268096924
+  },
+  {
+    "step": 888,
+    "loss": 1.5082108974456787,
+    "mse": 3.347689628601074
+  },
+  {
+    "step": 889,
+    "loss": 1.5141736268997192,
+    "mse": 3.65962290763855
+  },
+  {
+    "step": 890,
+    "loss": 1.5597116947174072,
+    "mse": 3.7881057262420654
+  },
+  {
+    "step": 891,
+    "loss": 1.393860101699829,
+    "mse": 2.780118703842163
+  },
+  {
+    "step": 892,
+    "loss": 1.6357285976409912,
+    "mse": 3.7923130989074707
+  },
+  {
+    "step": 893,
+    "loss": 1.7574474811553955,
+    "mse": 4.431279182434082
+  },
+  {
+    "step": 894,
+    "loss": 1.5332703590393066,
+    "mse": 3.2842893600463867
+  },
+  {
+    "step": 895,
+    "loss": 1.8232234716415405,
+    "mse": 5.150796890258789
+  },
+  {
+    "step": 896,
+    "loss": 1.522979736328125,
+    "mse": 3.7109813690185547
+  },
+  {
+    "step": 897,
+    "loss": 1.5512654781341553,
+    "mse": 3.818133592605591
+  },
+  {
+    "step": 898,
+    "loss": 1.3729832172393799,
+    "mse": 2.6474852561950684
+  },
+  {
+    "step": 899,
+    "loss": 1.6321889162063599,
+    "mse": 4.151179313659668
+  },
+  {
+    "step": 900,
+    "loss": 1.3854628801345825,
+    "mse": 2.577157974243164
+  },
+  {
+    "step": 901,
+    "loss": 1.5728429555892944,
+    "mse": 3.4839560985565186
+  },
+  {
+    "step": 902,
+    "loss": 1.7689374685287476,
+    "mse": 4.964974403381348
+  },
+  {
+    "step": 903,
+    "loss": 1.5005667209625244,
+    "mse": 3.1781058311462402
+  },
+  {
+    "step": 904,
+    "loss": 1.496736764907837,
+    "mse": 3.1574366092681885
+  },
+  {
+    "step": 905,
+    "loss": 1.5534788370132446,
+    "mse": 3.7275660037994385
+  },
+  {
+    "step": 906,
+    "loss": 1.4135490655899048,
+    "mse": 3.1257617473602295
+  },
+  {
+    "step": 907,
+    "loss": 1.5569860935211182,
+    "mse": 3.2674574851989746
+  },
+  {
+    "step": 908,
+    "loss": 1.8392747640609741,
+    "mse": 4.664363384246826
+  },
+  {
+    "step": 909,
+    "loss": 1.5546602010726929,
+    "mse": 3.3779296875
+  },
+  {
+    "step": 910,
+    "loss": 1.251349687576294,
+    "mse": 2.270434617996216
+  },
+  {
+    "step": 911,
+    "loss": 1.7017102241516113,
+    "mse": 5.203685283660889
+  },
+  {
+    "step": 912,
+    "loss": 1.3686069250106812,
+    "mse": 2.5587263107299805
+  },
+  {
+    "step": 913,
+    "loss": 1.409635305404663,
+    "mse": 2.638819694519043
+  },
+  {
+    "step": 914,
+    "loss": 1.4978187084197998,
+    "mse": 3.0666885375976562
+  },
+  {
+    "step": 915,
+    "loss": 1.5002288818359375,
+    "mse": 3.6608927249908447
+  },
+  {
+    "step": 916,
+    "loss": 1.6072496175765991,
+    "mse": 4.084261894226074
+  },
+  {
+    "step": 917,
+    "loss": 1.6275737285614014,
+    "mse": 4.333851337432861
+  },
+  {
+    "step": 918,
+    "loss": 1.6242544651031494,
+    "mse": 3.6866295337677
+  },
+  {
+    "step": 919,
+    "loss": 1.793237566947937,
+    "mse": 4.609906196594238
+  },
+  {
+    "step": 920,
+    "loss": 1.4657135009765625,
+    "mse": 3.0781702995300293
+  },
+  {
+    "step": 921,
+    "loss": 1.5428531169891357,
+    "mse": 3.404733419418335
+  },
+  {
+    "step": 922,
+    "loss": 1.6030174493789673,
+    "mse": 3.852841377258301
+  },
+  {
+    "step": 923,
+    "loss": 1.5739814043045044,
+    "mse": 3.415605068206787
+  },
+  {
+    "step": 924,
+    "loss": 1.252058744430542,
+    "mse": 2.36150860786438
+  },
+  {
+    "step": 925,
+    "loss": 1.540076732635498,
+    "mse": 3.293117046356201
+  },
+  {
+    "step": 926,
+    "loss": 1.8226338624954224,
+    "mse": 5.098268508911133
+  },
+  {
+    "step": 927,
+    "loss": 1.8417075872421265,
+    "mse": 5.385749816894531
+  },
+  {
+    "step": 928,
+    "loss": 1.764506459236145,
+    "mse": 4.769143104553223
+  },
+  {
+    "step": 929,
+    "loss": 1.407942295074463,
+    "mse": 2.8094868659973145
+  },
+  {
+    "step": 930,
+    "loss": 1.6360704898834229,
+    "mse": 3.6072089672088623
+  },
+  {
+    "step": 931,
+    "loss": 1.6481220722198486,
+    "mse": 4.4822611808776855
+  },
+  {
+    "step": 932,
+    "loss": 1.4114733934402466,
+    "mse": 3.3167691230773926
+  },
+  {
+    "step": 933,
+    "loss": 1.5308306217193604,
+    "mse": 3.6808371543884277
+  },
+  {
+    "step": 934,
+    "loss": 1.4700891971588135,
+    "mse": 3.4668853282928467
+  },
+  {
+    "step": 935,
+    "loss": 1.6023863554000854,
+    "mse": 3.664287805557251
+  },
+  {
+    "step": 936,
+    "loss": 1.4988303184509277,
+    "mse": 3.4591803550720215
+  },
+  {
+    "step": 937,
+    "loss": 1.4334330558776855,
+    "mse": 3.027486801147461
+  },
+  {
+    "step": 938,
+    "loss": 1.7516489028930664,
+    "mse": 4.4701361656188965
+  },
+  {
+    "step": 939,
+    "loss": 1.577765941619873,
+    "mse": 3.536599636077881
+  },
+  {
+    "step": 940,
+    "loss": 1.8438959121704102,
+    "mse": 5.102540493011475
+  },
+  {
+    "step": 941,
+    "loss": 1.7318123579025269,
+    "mse": 5.656600475311279
+  },
+  {
+    "step": 942,
+    "loss": 1.535987138748169,
+    "mse": 3.7806396484375
+  },
+  {
+    "step": 943,
+    "loss": 1.5016043186187744,
+    "mse": 3.44732403755188
+  },
+  {
+    "step": 944,
+    "loss": 1.4625680446624756,
+    "mse": 2.920645236968994
+  },
+  {
+    "step": 945,
+    "loss": 1.5871055126190186,
+    "mse": 3.6914725303649902
+  },
+  {
+    "step": 946,
+    "loss": 1.5228962898254395,
+    "mse": 3.3388190269470215
+  },
+  {
+    "step": 947,
+    "loss": 1.7238088846206665,
+    "mse": 4.761301040649414
+  },
+  {
+    "step": 948,
+    "loss": 1.8182456493377686,
+    "mse": 5.655738353729248
+  },
+  {
+    "step": 949,
+    "loss": 1.463150143623352,
+    "mse": 3.0045390129089355
+  },
+  {
+    "step": 950,
+    "loss": 1.6689749956130981,
+    "mse": 4.059864044189453
+  },
+  {
+    "step": 951,
+    "loss": 1.6139168739318848,
+    "mse": 4.5386576652526855
+  },
+  {
+    "step": 952,
+    "loss": 1.5952835083007812,
+    "mse": 3.724822521209717
+  },
+  {
+    "step": 953,
+    "loss": 1.4063525199890137,
+    "mse": 2.933051586151123
+  },
+  {
+    "step": 954,
+    "loss": 1.704020380973816,
+    "mse": 5.806723117828369
+  },
+  {
+    "step": 955,
+    "loss": 1.3044440746307373,
+    "mse": 2.3806934356689453
+  },
+  {
+    "step": 956,
+    "loss": 1.439878225326538,
+    "mse": 2.8410286903381348
+  },
+  {
+    "step": 957,
+    "loss": 1.7523199319839478,
+    "mse": 4.909740924835205
+  },
+  {
+    "step": 958,
+    "loss": 1.6244958639144897,
+    "mse": 4.4113993644714355
+  },
+  {
+    "step": 959,
+    "loss": 1.4660985469818115,
+    "mse": 2.964139461517334
+  },
+  {
+    "step": 960,
+    "loss": 1.5074166059494019,
+    "mse": 3.438417911529541
+  },
+  {
+    "step": 961,
+    "loss": 1.6893861293792725,
+    "mse": 4.616686820983887
+  },
+  {
+    "step": 962,
+    "loss": 1.561514139175415,
+    "mse": 3.6536948680877686
+  },
+  {
+    "step": 963,
+    "loss": 1.375945806503296,
+    "mse": 2.55376935005188
+  },
+  {
+    "step": 964,
+    "loss": 1.8115366697311401,
+    "mse": 4.9432268142700195
+  },
+  {
+    "step": 965,
+    "loss": 1.5780011415481567,
+    "mse": 4.011441707611084
+  },
+  {
+    "step": 966,
+    "loss": 1.5536442995071411,
+    "mse": 3.9732766151428223
+  },
+  {
+    "step": 967,
+    "loss": 1.5904909372329712,
+    "mse": 4.329539775848389
+  },
+  {
+    "step": 968,
+    "loss": 1.6203515529632568,
+    "mse": 4.440728187561035
+  },
+  {
+    "step": 969,
+    "loss": 1.4700310230255127,
+    "mse": 3.413315534591675
+  },
+  {
+    "step": 970,
+    "loss": 1.737122654914856,
+    "mse": 4.400886535644531
+  },
+  {
+    "step": 971,
+    "loss": 1.4258503913879395,
+    "mse": 3.1405563354492188
+  },
+  {
+    "step": 972,
+    "loss": 1.3599356412887573,
+    "mse": 2.6042842864990234
+  },
+  {
+    "step": 973,
+    "loss": 1.458399772644043,
+    "mse": 3.998964548110962
+  },
+  {
+    "step": 974,
+    "loss": 1.5889482498168945,
+    "mse": 3.5370547771453857
+  },
+  {
+    "step": 975,
+    "loss": 1.5545401573181152,
+    "mse": 4.541438102722168
+  },
+  {
+    "step": 976,
+    "loss": 1.6418874263763428,
+    "mse": 4.634406566619873
+  },
+  {
+    "step": 977,
+    "loss": 1.6757311820983887,
+    "mse": 3.9853224754333496
+  },
+  {
+    "step": 978,
+    "loss": 1.7086265087127686,
+    "mse": 3.9676103591918945
+  },
+  {
+    "step": 979,
+    "loss": 1.5308549404144287,
+    "mse": 3.5174458026885986
+  },
+  {
+    "step": 980,
+    "loss": 1.5783997774124146,
+    "mse": 3.740737199783325
+  },
+  {
+    "step": 981,
+    "loss": 1.3367525339126587,
+    "mse": 3.0315656661987305
+  },
+  {
+    "step": 982,
+    "loss": 1.6644363403320312,
+    "mse": 4.001317024230957
+  },
+  {
+    "step": 983,
+    "loss": 1.4795842170715332,
+    "mse": 3.893979787826538
+  },
+  {
+    "step": 984,
+    "loss": 1.490999460220337,
+    "mse": 3.966977834701538
+  },
+  {
+    "step": 985,
+    "loss": 1.7067826986312866,
+    "mse": 4.670455455780029
+  },
+  {
+    "step": 986,
+    "loss": 1.7076469659805298,
+    "mse": 4.911923408508301
+  },
+  {
+    "step": 987,
+    "loss": 1.376427412033081,
+    "mse": 2.8661439418792725
+  },
+  {
+    "step": 988,
+    "loss": 1.6110203266143799,
+    "mse": 4.2251691818237305
+  },
+  {
+    "step": 989,
+    "loss": 1.6378527879714966,
+    "mse": 4.114132881164551
+  },
+  {
+    "step": 990,
+    "loss": 1.3957679271697998,
+    "mse": 3.024470806121826
+  },
+  {
+    "step": 991,
+    "loss": 1.6604561805725098,
+    "mse": 4.672807693481445
+  },
+  {
+    "step": 992,
+    "loss": 1.7672537565231323,
+    "mse": 4.987368106842041
+  },
+  {
+    "step": 993,
+    "loss": 1.740788459777832,
+    "mse": 4.561925411224365
+  },
+  {
+    "step": 994,
+    "loss": 1.7126497030258179,
+    "mse": 4.8838276863098145
+  },
+  {
+    "step": 995,
+    "loss": 1.4443284273147583,
+    "mse": 2.947889804840088
+  },
+  {
+    "step": 996,
+    "loss": 1.5063813924789429,
+    "mse": 3.3201589584350586
+  },
+  {
+    "step": 997,
+    "loss": 1.4388056993484497,
+    "mse": 3.084688186645508
+  },
+  {
+    "step": 998,
+    "loss": 1.653106451034546,
+    "mse": 4.469257354736328
+  },
+  {
+    "step": 999,
+    "loss": 1.5863953828811646,
+    "mse": 3.6539206504821777
+  }
+]
diff --git a/lecture_6/verified_examples/meanflow/report.json b/lecture_6/verified_examples/meanflow/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..bba10ca730d751e2cb4228bd02687a59f2f3944b
--- /dev/null
+++ b/lecture_6/verified_examples/meanflow/report.json
@@ -0,0 +1,23 @@
+{
+  "method": "meanflow",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 1.677025943994522,
+  "train_loss_last_20_mean": 1.5747917950153352,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "finite_samples": true,
+  "mean_distance_to_center": 0.47996535897254944,
+  "mode_fractions": [
+    0.2890625,
+    0.234375,
+    0.25,
+    0.2265625
+  ],
+  "mode_entropy": 1.3817566633224487,
+  "mean_target_log_density": -3.539360284805298,
+  "elapsed_seconds": 2.9319772759990883
+}
diff --git a/lecture_6/verified_examples/meanflow/samples.txt b/lecture_6/verified_examples/meanflow/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..95e3b79f74f1c09839987a53070dc5fb04d5d4d9
--- /dev/null
+++ b/lecture_6/verified_examples/meanflow/samples.txt
@@ -0,0 +1,128 @@
+-1.6168433 1.8113170
+-1.8257630 1.7942218
+-1.7553961 -1.7726475
+-1.7278720 -0.1402336
+0.7404909 -1.6124864
+-1.7740517 1.8013877
+1.8837631 -1.9043067
+-1.6446652 -1.8705313
+-1.6568446 -1.6956809
+1.5520326 1.6264997
+0.5978045 1.5060596
+1.8711952 -1.4637150
+1.8592113 0.4623761
+1.0726261 -1.0816824
+-1.5597910 -1.7320404
+1.9372044 -1.8152422
+1.6641371 1.5199904
+1.6962073 -1.8553253
+1.0900464 0.9525614
+1.7701665 -1.7369184
+-1.8706564 1.8238128
+-1.6518104 -1.5037420
+-1.6556188 -1.8293155
+-1.5513680 -1.8361921
+0.0744689 -1.7157705
+-1.7819602 1.0343893
+1.4937820 -0.5414944
+-1.0408798 -1.7583272
+-1.8277520 1.6707718
+-0.9434090 -1.7767272
+-1.4785380 -1.6417937
+-1.8142295 -1.7517004
+-0.0285403 -1.8357674
+-1.6378531 -1.7534232
+1.8453879 1.6300129
+-0.6716729 -1.6815443
+1.8513401 1.4229832
+-0.4613375 1.7331799
+1.7854437 1.7278363
+1.7057817 -1.2550726
+0.7144060 1.6210121
+-1.7035043 -1.3839070
+-0.8172854 -1.6311299
+1.9409157 1.1784488
+-1.6745789 -1.7388406
+-1.2334789 1.7190127
+-1.5678272 -1.6728828
+1.8203889 -1.7955734
+1.6990738 1.6660963
+-1.8071421 1.5909133
+1.1404327 1.6048925
+-0.4646640 -1.3667134
+1.3696822 -1.5372577
+1.4445953 1.5460073
+-0.8461871 1.7635798
+-1.9187131 1.6550348
+1.5107685 -1.5563085
+-1.0420306 1.5059710
+-1.6840175 -1.6152707
+-1.8951005 2.0829079
+-1.6935042 -1.1999385
+1.5938752 1.6089997
+1.0407811 1.5905578
+1.8635933 0.5077038
+2.0163558 -1.8573637
+1.8877624 -1.9996305
+-0.4060650 -1.5650702
+1.9241484 -1.7780162
+-1.6347667 -1.7226952
+-1.7067313 -1.4589516
+1.7997051 1.3309028
+1.7152213 -0.3889502
+-0.4283219 -1.2426679
+-1.1654201 1.5902020
+1.7881463 1.5983961
+0.0223927 -1.7394873
+1.8291242 -1.8607733
+1.9327085 -1.7370851
+1.7862077 1.5232348
+1.9531294 -1.6788540
+-1.5112094 1.8087327
+1.7985153 1.2787831
+1.6919308 1.6595906
+-1.3061094 2.0090437
+-1.5395508 -1.4797852
+-1.7294056 -1.4925284
+2.1128938 1.6326296
+-0.9121710 1.6165861
+-1.9615332 1.8379304
+-0.8488172 -1.2555573
+1.9510641 1.3497391
+-1.9718320 1.7508987
+2.1092892 -1.8474426
+1.6861730 1.5332448
+-1.7842318 1.1249402
+-1.4846963 1.6335975
+-1.1216853 1.5064713
+1.6578484 -1.7386417
+-1.7375718 -0.4190060
+1.4962635 -1.7170517
+-1.7118446 -1.7216556
+-1.7549412 1.3342297
+-1.3670063 1.7826977
+-1.7473868 -1.5943984
+-1.6506917 -1.8100014
+-1.8871683 1.7900361
+1.3823994 -1.7530526
+1.6489199 -1.7735637
+-1.8177938 -1.7769924
+-1.5493492 1.6676786
+-1.2525064 -1.7353148
+1.9605285 1.2540072
+1.3922775 1.0502484
+1.6166143 -1.7524143
+1.9118236 -1.7276351
+-1.5864952 -1.5586003
+1.7173873 1.6642412
+1.9211864 1.5733932
+1.4454161 -1.4495682
+-1.7304637 -1.7402420
+2.1033633 -1.8157048
+-1.8103498 0.4404701
+-1.8412393 1.7345146
+1.7632682 1.6592586
+1.6600931 -1.7617502
+-2.0616674 1.8471392
+-1.6269023 1.5063756
+1.9609976 -1.8055263
diff --git a/lecture_6/verified_examples/meta-finetune/config.json b/lecture_6/verified_examples/meta-finetune/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..e0a10b1206aee1ca86471900403c9fdae50ecf7e
--- /dev/null
+++ b/lecture_6/verified_examples/meta-finetune/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "meta",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 300,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/meta-finetune-verified"
+}
diff --git a/lecture_6/verified_examples/meta-finetune/finetune_losses.json b/lecture_6/verified_examples/meta-finetune/finetune_losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..49ebdd955464dc8f598e52bb9cfacb7a833d2638
--- /dev/null
+++ b/lecture_6/verified_examples/meta-finetune/finetune_losses.json
@@ -0,0 +1,1502 @@
+[
+  {
+    "step": 0,
+    "loss": 6.375628471374512,
+    "mean_weight": 1.396344542503357
+  },
+  {
+    "step": 1,
+    "loss": 13.329913139343262,
+    "mean_weight": 1.3880460262298584
+  },
+  {
+    "step": 2,
+    "loss": 5.2801361083984375,
+    "mean_weight": 0.9616769552230835
+  },
+  {
+    "step": 3,
+    "loss": 8.773133277893066,
+    "mean_weight": 1.2972267866134644
+  },
+  {
+    "step": 4,
+    "loss": 5.463064193725586,
+    "mean_weight": 1.2585978507995605
+  },
+  {
+    "step": 5,
+    "loss": 5.669670104980469,
+    "mean_weight": 1.3568416833877563
+  },
+  {
+    "step": 6,
+    "loss": 11.368059158325195,
+    "mean_weight": 1.5376527309417725
+  },
+  {
+    "step": 7,
+    "loss": 5.712992191314697,
+    "mean_weight": 1.3007582426071167
+  },
+  {
+    "step": 8,
+    "loss": 7.002514839172363,
+    "mean_weight": 1.4939136505126953
+  },
+  {
+    "step": 9,
+    "loss": 10.317174911499023,
+    "mean_weight": 1.3290646076202393
+  },
+  {
+    "step": 10,
+    "loss": 8.815329551696777,
+    "mean_weight": 1.3616752624511719
+  },
+  {
+    "step": 11,
+    "loss": 7.655701160430908,
+    "mean_weight": 1.355889081954956
+  },
+  {
+    "step": 12,
+    "loss": 6.283907413482666,
+    "mean_weight": 1.2503325939178467
+  },
+  {
+    "step": 13,
+    "loss": 4.193900108337402,
+    "mean_weight": 1.1564664840698242
+  },
+  {
+    "step": 14,
+    "loss": 4.563027381896973,
+    "mean_weight": 1.2540059089660645
+  },
+  {
+    "step": 15,
+    "loss": 7.12403678894043,
+    "mean_weight": 1.2590389251708984
+  },
+  {
+    "step": 16,
+    "loss": 9.634148597717285,
+    "mean_weight": 1.203626036643982
+  },
+  {
+    "step": 17,
+    "loss": 13.767010688781738,
+    "mean_weight": 1.340369462966919
+  },
+  {
+    "step": 18,
+    "loss": 6.1448516845703125,
+    "mean_weight": 1.3670389652252197
+  },
+  {
+    "step": 19,
+    "loss": 9.040580749511719,
+    "mean_weight": 1.3623485565185547
+  },
+  {
+    "step": 20,
+    "loss": 12.426997184753418,
+    "mean_weight": 1.4033169746398926
+  },
+  {
+    "step": 21,
+    "loss": 9.852396011352539,
+    "mean_weight": 1.3268686532974243
+  },
+  {
+    "step": 22,
+    "loss": 6.9293670654296875,
+    "mean_weight": 1.4393413066864014
+  },
+  {
+    "step": 23,
+    "loss": 10.662487983703613,
+    "mean_weight": 1.444283366203308
+  },
+  {
+    "step": 24,
+    "loss": 7.594470500946045,
+    "mean_weight": 1.5731498003005981
+  },
+  {
+    "step": 25,
+    "loss": 9.724088668823242,
+    "mean_weight": 1.1354297399520874
+  },
+  {
+    "step": 26,
+    "loss": 2.254751205444336,
+    "mean_weight": 1.2275694608688354
+  },
+  {
+    "step": 27,
+    "loss": 4.042566299438477,
+    "mean_weight": 1.1597685813903809
+  },
+  {
+    "step": 28,
+    "loss": 3.935643434524536,
+    "mean_weight": 1.2190444469451904
+  },
+  {
+    "step": 29,
+    "loss": 8.110097885131836,
+    "mean_weight": 1.5041548013687134
+  },
+  {
+    "step": 30,
+    "loss": 8.247655868530273,
+    "mean_weight": 1.2206547260284424
+  },
+  {
+    "step": 31,
+    "loss": 4.718675136566162,
+    "mean_weight": 1.3403770923614502
+  },
+  {
+    "step": 32,
+    "loss": 4.086951732635498,
+    "mean_weight": 1.3499014377593994
+  },
+  {
+    "step": 33,
+    "loss": 3.4790444374084473,
+    "mean_weight": 1.3644124269485474
+  },
+  {
+    "step": 34,
+    "loss": 6.280873775482178,
+    "mean_weight": 1.3844045400619507
+  },
+  {
+    "step": 35,
+    "loss": 3.9831202030181885,
+    "mean_weight": 1.4380574226379395
+  },
+  {
+    "step": 36,
+    "loss": 8.28381061553955,
+    "mean_weight": 1.3432484865188599
+  },
+  {
+    "step": 37,
+    "loss": 5.788904190063477,
+    "mean_weight": 1.5628968477249146
+  },
+  {
+    "step": 38,
+    "loss": 7.090703964233398,
+    "mean_weight": 1.4335445165634155
+  },
+  {
+    "step": 39,
+    "loss": 4.388059616088867,
+    "mean_weight": 1.4708378314971924
+  },
+  {
+    "step": 40,
+    "loss": 6.28809928894043,
+    "mean_weight": 1.2867779731750488
+  },
+  {
+    "step": 41,
+    "loss": 4.928945064544678,
+    "mean_weight": 1.3735694885253906
+  },
+  {
+    "step": 42,
+    "loss": 4.8976335525512695,
+    "mean_weight": 1.5227580070495605
+  },
+  {
+    "step": 43,
+    "loss": 7.0597639083862305,
+    "mean_weight": 1.311765193939209
+  },
+  {
+    "step": 44,
+    "loss": 9.02861499786377,
+    "mean_weight": 1.3939869403839111
+  },
+  {
+    "step": 45,
+    "loss": 6.580217361450195,
+    "mean_weight": 1.2586119174957275
+  },
+  {
+    "step": 46,
+    "loss": 2.6750521659851074,
+    "mean_weight": 1.2232760190963745
+  },
+  {
+    "step": 47,
+    "loss": 5.163072109222412,
+    "mean_weight": 1.3888649940490723
+  },
+  {
+    "step": 48,
+    "loss": 6.474499702453613,
+    "mean_weight": 1.4615477323532104
+  },
+  {
+    "step": 49,
+    "loss": 4.862241744995117,
+    "mean_weight": 1.4964351654052734
+  },
+  {
+    "step": 50,
+    "loss": 3.409599781036377,
+    "mean_weight": 1.4610340595245361
+  },
+  {
+    "step": 51,
+    "loss": 6.232663154602051,
+    "mean_weight": 1.4779713153839111
+  },
+  {
+    "step": 52,
+    "loss": 8.145143508911133,
+    "mean_weight": 1.2352187633514404
+  },
+  {
+    "step": 53,
+    "loss": 8.349056243896484,
+    "mean_weight": 1.1761562824249268
+  },
+  {
+    "step": 54,
+    "loss": 5.033302307128906,
+    "mean_weight": 1.4075771570205688
+  },
+  {
+    "step": 55,
+    "loss": 5.6579413414001465,
+    "mean_weight": 1.2834131717681885
+  },
+  {
+    "step": 56,
+    "loss": 7.144984245300293,
+    "mean_weight": 1.1945995092391968
+  },
+  {
+    "step": 57,
+    "loss": 4.466156959533691,
+    "mean_weight": 1.3515862226486206
+  },
+  {
+    "step": 58,
+    "loss": 4.047029495239258,
+    "mean_weight": 1.3139182329177856
+  },
+  {
+    "step": 59,
+    "loss": 3.030702590942383,
+    "mean_weight": 1.2629570960998535
+  },
+  {
+    "step": 60,
+    "loss": 7.699456691741943,
+    "mean_weight": 1.3729453086853027
+  },
+  {
+    "step": 61,
+    "loss": 9.006407737731934,
+    "mean_weight": 1.144875168800354
+  },
+  {
+    "step": 62,
+    "loss": 2.890955924987793,
+    "mean_weight": 1.3090932369232178
+  },
+  {
+    "step": 63,
+    "loss": 3.117238759994507,
+    "mean_weight": 1.2987644672393799
+  },
+  {
+    "step": 64,
+    "loss": 6.573086738586426,
+    "mean_weight": 1.3316224813461304
+  },
+  {
+    "step": 65,
+    "loss": 8.078710556030273,
+    "mean_weight": 1.3040785789489746
+  },
+  {
+    "step": 66,
+    "loss": 4.310054302215576,
+    "mean_weight": 1.4656895399093628
+  },
+  {
+    "step": 67,
+    "loss": 7.688079833984375,
+    "mean_weight": 1.375672698020935
+  },
+  {
+    "step": 68,
+    "loss": 3.7605276107788086,
+    "mean_weight": 1.6216344833374023
+  },
+  {
+    "step": 69,
+    "loss": 3.5167131423950195,
+    "mean_weight": 1.4182050228118896
+  },
+  {
+    "step": 70,
+    "loss": 3.5188345909118652,
+    "mean_weight": 1.3236353397369385
+  },
+  {
+    "step": 71,
+    "loss": 4.147039413452148,
+    "mean_weight": 1.415121078491211
+  },
+  {
+    "step": 72,
+    "loss": 8.772176742553711,
+    "mean_weight": 1.0980583429336548
+  },
+  {
+    "step": 73,
+    "loss": 4.903366565704346,
+    "mean_weight": 1.364033579826355
+  },
+  {
+    "step": 74,
+    "loss": 7.525172710418701,
+    "mean_weight": 1.3702943325042725
+  },
+  {
+    "step": 75,
+    "loss": 3.6712350845336914,
+    "mean_weight": 1.3568506240844727
+  },
+  {
+    "step": 76,
+    "loss": 3.2970104217529297,
+    "mean_weight": 1.3763697147369385
+  },
+  {
+    "step": 77,
+    "loss": 5.417691230773926,
+    "mean_weight": 1.3175628185272217
+  },
+  {
+    "step": 78,
+    "loss": 5.479363441467285,
+    "mean_weight": 1.409628987312317
+  },
+  {
+    "step": 79,
+    "loss": 4.312094688415527,
+    "mean_weight": 1.4730511903762817
+  },
+  {
+    "step": 80,
+    "loss": 4.977014541625977,
+    "mean_weight": 1.4134521484375
+  },
+  {
+    "step": 81,
+    "loss": 8.801984786987305,
+    "mean_weight": 1.5597803592681885
+  },
+  {
+    "step": 82,
+    "loss": 4.2811665534973145,
+    "mean_weight": 1.3326486349105835
+  },
+  {
+    "step": 83,
+    "loss": 7.1173996925354,
+    "mean_weight": 1.3778679370880127
+  },
+  {
+    "step": 84,
+    "loss": 6.9525251388549805,
+    "mean_weight": 1.410611629486084
+  },
+  {
+    "step": 85,
+    "loss": 5.291553974151611,
+    "mean_weight": 1.393357753753662
+  },
+  {
+    "step": 86,
+    "loss": 7.626803874969482,
+    "mean_weight": 1.350528359413147
+  },
+  {
+    "step": 87,
+    "loss": 7.94483757019043,
+    "mean_weight": 1.3736859560012817
+  },
+  {
+    "step": 88,
+    "loss": 12.768390655517578,
+    "mean_weight": 1.3849393129348755
+  },
+  {
+    "step": 89,
+    "loss": 3.478504180908203,
+    "mean_weight": 1.4547287225723267
+  },
+  {
+    "step": 90,
+    "loss": 3.686051607131958,
+    "mean_weight": 1.3641046285629272
+  },
+  {
+    "step": 91,
+    "loss": 5.7921905517578125,
+    "mean_weight": 1.3390634059906006
+  },
+  {
+    "step": 92,
+    "loss": 3.5908327102661133,
+    "mean_weight": 1.244884967803955
+  },
+  {
+    "step": 93,
+    "loss": 5.542403221130371,
+    "mean_weight": 1.3724422454833984
+  },
+  {
+    "step": 94,
+    "loss": 5.649711608886719,
+    "mean_weight": 1.2809817790985107
+  },
+  {
+    "step": 95,
+    "loss": 4.832424640655518,
+    "mean_weight": 1.39649498462677
+  },
+  {
+    "step": 96,
+    "loss": 3.0337700843811035,
+    "mean_weight": 1.3828532695770264
+  },
+  {
+    "step": 97,
+    "loss": 6.480713367462158,
+    "mean_weight": 1.52901291847229
+  },
+  {
+    "step": 98,
+    "loss": 6.261553764343262,
+    "mean_weight": 1.3284412622451782
+  },
+  {
+    "step": 99,
+    "loss": 6.154868125915527,
+    "mean_weight": 1.5510410070419312
+  },
+  {
+    "step": 100,
+    "loss": 10.361504554748535,
+    "mean_weight": 1.4712291955947876
+  },
+  {
+    "step": 101,
+    "loss": 3.6466526985168457,
+    "mean_weight": 1.4051517248153687
+  },
+  {
+    "step": 102,
+    "loss": 9.56380844116211,
+    "mean_weight": 1.3433219194412231
+  },
+  {
+    "step": 103,
+    "loss": 5.128721237182617,
+    "mean_weight": 1.3007761240005493
+  },
+  {
+    "step": 104,
+    "loss": 4.080266952514648,
+    "mean_weight": 1.4279595613479614
+  },
+  {
+    "step": 105,
+    "loss": 4.497377395629883,
+    "mean_weight": 1.468996286392212
+  },
+  {
+    "step": 106,
+    "loss": 3.1826324462890625,
+    "mean_weight": 1.1851896047592163
+  },
+  {
+    "step": 107,
+    "loss": 4.115413665771484,
+    "mean_weight": 1.3699471950531006
+  },
+  {
+    "step": 108,
+    "loss": 5.743589401245117,
+    "mean_weight": 1.4252209663391113
+  },
+  {
+    "step": 109,
+    "loss": 5.4291253089904785,
+    "mean_weight": 1.218482494354248
+  },
+  {
+    "step": 110,
+    "loss": 4.910030364990234,
+    "mean_weight": 1.2218869924545288
+  },
+  {
+    "step": 111,
+    "loss": 3.4378786087036133,
+    "mean_weight": 1.4603914022445679
+  },
+  {
+    "step": 112,
+    "loss": 4.675978183746338,
+    "mean_weight": 1.2613697052001953
+  },
+  {
+    "step": 113,
+    "loss": 4.061026573181152,
+    "mean_weight": 1.3992127180099487
+  },
+  {
+    "step": 114,
+    "loss": 5.290436744689941,
+    "mean_weight": 1.4462751150131226
+  },
+  {
+    "step": 115,
+    "loss": 5.003042221069336,
+    "mean_weight": 1.2802233695983887
+  },
+  {
+    "step": 116,
+    "loss": 2.544694423675537,
+    "mean_weight": 1.1917918920516968
+  },
+  {
+    "step": 117,
+    "loss": 3.0671539306640625,
+    "mean_weight": 1.2830268144607544
+  },
+  {
+    "step": 118,
+    "loss": 6.881054878234863,
+    "mean_weight": 1.210460901260376
+  },
+  {
+    "step": 119,
+    "loss": 3.7351458072662354,
+    "mean_weight": 1.486568570137024
+  },
+  {
+    "step": 120,
+    "loss": 7.863762855529785,
+    "mean_weight": 1.358375072479248
+  },
+  {
+    "step": 121,
+    "loss": 5.061007976531982,
+    "mean_weight": 1.3691399097442627
+  },
+  {
+    "step": 122,
+    "loss": 6.038214206695557,
+    "mean_weight": 1.368248462677002
+  },
+  {
+    "step": 123,
+    "loss": 4.611867427825928,
+    "mean_weight": 1.3117024898529053
+  },
+  {
+    "step": 124,
+    "loss": 7.67642068862915,
+    "mean_weight": 1.3651496171951294
+  },
+  {
+    "step": 125,
+    "loss": 3.8459713459014893,
+    "mean_weight": 1.3077268600463867
+  },
+  {
+    "step": 126,
+    "loss": 5.74439811706543,
+    "mean_weight": 1.3363547325134277
+  },
+  {
+    "step": 127,
+    "loss": 4.789732933044434,
+    "mean_weight": 1.3775559663772583
+  },
+  {
+    "step": 128,
+    "loss": 4.6981587409973145,
+    "mean_weight": 1.422492265701294
+  },
+  {
+    "step": 129,
+    "loss": 2.737875461578369,
+    "mean_weight": 1.4072436094284058
+  },
+  {
+    "step": 130,
+    "loss": 3.0522561073303223,
+    "mean_weight": 1.1013867855072021
+  },
+  {
+    "step": 131,
+    "loss": 7.570102214813232,
+    "mean_weight": 1.3494480848312378
+  },
+  {
+    "step": 132,
+    "loss": 5.350284576416016,
+    "mean_weight": 1.305682897567749
+  },
+  {
+    "step": 133,
+    "loss": 13.323113441467285,
+    "mean_weight": 1.1588490009307861
+  },
+  {
+    "step": 134,
+    "loss": 7.09473180770874,
+    "mean_weight": 1.3516231775283813
+  },
+  {
+    "step": 135,
+    "loss": 5.620741367340088,
+    "mean_weight": 1.5225915908813477
+  },
+  {
+    "step": 136,
+    "loss": 9.409870147705078,
+    "mean_weight": 1.364885687828064
+  },
+  {
+    "step": 137,
+    "loss": 3.6684162616729736,
+    "mean_weight": 1.1534335613250732
+  },
+  {
+    "step": 138,
+    "loss": 9.769087791442871,
+    "mean_weight": 1.523177146911621
+  },
+  {
+    "step": 139,
+    "loss": 3.6564760208129883,
+    "mean_weight": 1.3450294733047485
+  },
+  {
+    "step": 140,
+    "loss": 3.7049105167388916,
+    "mean_weight": 1.274112582206726
+  },
+  {
+    "step": 141,
+    "loss": 2.7018883228302,
+    "mean_weight": 1.3181891441345215
+  },
+  {
+    "step": 142,
+    "loss": 6.6108269691467285,
+    "mean_weight": 1.3657909631729126
+  },
+  {
+    "step": 143,
+    "loss": 6.624133586883545,
+    "mean_weight": 1.1238441467285156
+  },
+  {
+    "step": 144,
+    "loss": 3.6361474990844727,
+    "mean_weight": 1.397057056427002
+  },
+  {
+    "step": 145,
+    "loss": 7.111917972564697,
+    "mean_weight": 1.27284574508667
+  },
+  {
+    "step": 146,
+    "loss": 6.994001388549805,
+    "mean_weight": 1.4018293619155884
+  },
+  {
+    "step": 147,
+    "loss": 4.2191009521484375,
+    "mean_weight": 1.4729211330413818
+  },
+  {
+    "step": 148,
+    "loss": 3.9293999671936035,
+    "mean_weight": 1.3833528757095337
+  },
+  {
+    "step": 149,
+    "loss": 2.995209217071533,
+    "mean_weight": 1.2565460205078125
+  },
+  {
+    "step": 150,
+    "loss": 5.506957054138184,
+    "mean_weight": 1.2297309637069702
+  },
+  {
+    "step": 151,
+    "loss": 3.1374716758728027,
+    "mean_weight": 1.3104007244110107
+  },
+  {
+    "step": 152,
+    "loss": 4.772933006286621,
+    "mean_weight": 1.5536139011383057
+  },
+  {
+    "step": 153,
+    "loss": 4.951756954193115,
+    "mean_weight": 1.319305419921875
+  },
+  {
+    "step": 154,
+    "loss": 5.067905426025391,
+    "mean_weight": 1.2911466360092163
+  },
+  {
+    "step": 155,
+    "loss": 2.9401609897613525,
+    "mean_weight": 1.2356619834899902
+  },
+  {
+    "step": 156,
+    "loss": 10.786925315856934,
+    "mean_weight": 1.4495903253555298
+  },
+  {
+    "step": 157,
+    "loss": 4.426312446594238,
+    "mean_weight": 1.3021057844161987
+  },
+  {
+    "step": 158,
+    "loss": 4.839422225952148,
+    "mean_weight": 1.2132534980773926
+  },
+  {
+    "step": 159,
+    "loss": 8.445652961730957,
+    "mean_weight": 1.20108962059021
+  },
+  {
+    "step": 160,
+    "loss": 6.251461982727051,
+    "mean_weight": 0.9801608324050903
+  },
+  {
+    "step": 161,
+    "loss": 7.607839584350586,
+    "mean_weight": 1.3031926155090332
+  },
+  {
+    "step": 162,
+    "loss": 3.250433921813965,
+    "mean_weight": 1.3973671197891235
+  },
+  {
+    "step": 163,
+    "loss": 6.637189865112305,
+    "mean_weight": 1.3451170921325684
+  },
+  {
+    "step": 164,
+    "loss": 2.6514885425567627,
+    "mean_weight": 1.2165473699569702
+  },
+  {
+    "step": 165,
+    "loss": 4.4162702560424805,
+    "mean_weight": 1.319758653640747
+  },
+  {
+    "step": 166,
+    "loss": 6.331765651702881,
+    "mean_weight": 1.3336739540100098
+  },
+  {
+    "step": 167,
+    "loss": 3.4055700302124023,
+    "mean_weight": 1.3539378643035889
+  },
+  {
+    "step": 168,
+    "loss": 4.733250617980957,
+    "mean_weight": 1.4203319549560547
+  },
+  {
+    "step": 169,
+    "loss": 4.503002643585205,
+    "mean_weight": 1.2012943029403687
+  },
+  {
+    "step": 170,
+    "loss": 5.271406650543213,
+    "mean_weight": 1.3155406713485718
+  },
+  {
+    "step": 171,
+    "loss": 8.493550300598145,
+    "mean_weight": 1.4391231536865234
+  },
+  {
+    "step": 172,
+    "loss": 3.387223720550537,
+    "mean_weight": 1.37305748462677
+  },
+  {
+    "step": 173,
+    "loss": 5.780370712280273,
+    "mean_weight": 1.3928515911102295
+  },
+  {
+    "step": 174,
+    "loss": 8.00147819519043,
+    "mean_weight": 1.3663301467895508
+  },
+  {
+    "step": 175,
+    "loss": 5.2564377784729,
+    "mean_weight": 1.444944143295288
+  },
+  {
+    "step": 176,
+    "loss": 3.469104528427124,
+    "mean_weight": 1.1973880529403687
+  },
+  {
+    "step": 177,
+    "loss": 7.50346040725708,
+    "mean_weight": 1.3263360261917114
+  },
+  {
+    "step": 178,
+    "loss": 6.384315013885498,
+    "mean_weight": 1.2401790618896484
+  },
+  {
+    "step": 179,
+    "loss": 4.957299709320068,
+    "mean_weight": 1.3869179487228394
+  },
+  {
+    "step": 180,
+    "loss": 3.377105474472046,
+    "mean_weight": 1.3485071659088135
+  },
+  {
+    "step": 181,
+    "loss": 5.262981414794922,
+    "mean_weight": 1.5212793350219727
+  },
+  {
+    "step": 182,
+    "loss": 5.192004203796387,
+    "mean_weight": 1.3183561563491821
+  },
+  {
+    "step": 183,
+    "loss": 8.665095329284668,
+    "mean_weight": 1.5244736671447754
+  },
+  {
+    "step": 184,
+    "loss": 4.484638214111328,
+    "mean_weight": 1.3007888793945312
+  },
+  {
+    "step": 185,
+    "loss": 3.1625938415527344,
+    "mean_weight": 1.3447195291519165
+  },
+  {
+    "step": 186,
+    "loss": 5.101550102233887,
+    "mean_weight": 1.333066463470459
+  },
+  {
+    "step": 187,
+    "loss": 4.519186496734619,
+    "mean_weight": 1.3798418045043945
+  },
+  {
+    "step": 188,
+    "loss": 3.4380664825439453,
+    "mean_weight": 1.339970350265503
+  },
+  {
+    "step": 189,
+    "loss": 4.744290351867676,
+    "mean_weight": 1.3918309211730957
+  },
+  {
+    "step": 190,
+    "loss": 4.846887588500977,
+    "mean_weight": 1.2161556482315063
+  },
+  {
+    "step": 191,
+    "loss": 4.249350070953369,
+    "mean_weight": 1.3257838487625122
+  },
+  {
+    "step": 192,
+    "loss": 4.216062545776367,
+    "mean_weight": 1.2125438451766968
+  },
+  {
+    "step": 193,
+    "loss": 4.456841468811035,
+    "mean_weight": 1.2365525960922241
+  },
+  {
+    "step": 194,
+    "loss": 4.809590816497803,
+    "mean_weight": 1.3822335004806519
+  },
+  {
+    "step": 195,
+    "loss": 6.254526138305664,
+    "mean_weight": 1.2446738481521606
+  },
+  {
+    "step": 196,
+    "loss": 8.14011001586914,
+    "mean_weight": 1.2580444812774658
+  },
+  {
+    "step": 197,
+    "loss": 6.7905378341674805,
+    "mean_weight": 1.6464229822158813
+  },
+  {
+    "step": 198,
+    "loss": 4.926604270935059,
+    "mean_weight": 1.3612152338027954
+  },
+  {
+    "step": 199,
+    "loss": 3.5800960063934326,
+    "mean_weight": 1.434230923652649
+  },
+  {
+    "step": 200,
+    "loss": 5.655712604522705,
+    "mean_weight": 1.2443057298660278
+  },
+  {
+    "step": 201,
+    "loss": 7.57064151763916,
+    "mean_weight": 1.3540284633636475
+  },
+  {
+    "step": 202,
+    "loss": 4.434896469116211,
+    "mean_weight": 1.3769007921218872
+  },
+  {
+    "step": 203,
+    "loss": 5.959853649139404,
+    "mean_weight": 1.472852349281311
+  },
+  {
+    "step": 204,
+    "loss": 4.6129584312438965,
+    "mean_weight": 1.2835988998413086
+  },
+  {
+    "step": 205,
+    "loss": 5.449717998504639,
+    "mean_weight": 1.1834688186645508
+  },
+  {
+    "step": 206,
+    "loss": 5.193328857421875,
+    "mean_weight": 1.3773365020751953
+  },
+  {
+    "step": 207,
+    "loss": 4.215370178222656,
+    "mean_weight": 1.3149785995483398
+  },
+  {
+    "step": 208,
+    "loss": 4.274880409240723,
+    "mean_weight": 1.3541563749313354
+  },
+  {
+    "step": 209,
+    "loss": 3.752650737762451,
+    "mean_weight": 1.3261959552764893
+  },
+  {
+    "step": 210,
+    "loss": 4.591540813446045,
+    "mean_weight": 1.2854729890823364
+  },
+  {
+    "step": 211,
+    "loss": 3.36464262008667,
+    "mean_weight": 1.3538506031036377
+  },
+  {
+    "step": 212,
+    "loss": 4.2986860275268555,
+    "mean_weight": 1.2921000719070435
+  },
+  {
+    "step": 213,
+    "loss": 4.57991886138916,
+    "mean_weight": 1.0262048244476318
+  },
+  {
+    "step": 214,
+    "loss": 4.241262435913086,
+    "mean_weight": 1.2576770782470703
+  },
+  {
+    "step": 215,
+    "loss": 3.441063165664673,
+    "mean_weight": 1.4218156337738037
+  },
+  {
+    "step": 216,
+    "loss": 8.770064353942871,
+    "mean_weight": 1.438416838645935
+  },
+  {
+    "step": 217,
+    "loss": 5.280104160308838,
+    "mean_weight": 1.391042947769165
+  },
+  {
+    "step": 218,
+    "loss": 3.6691575050354004,
+    "mean_weight": 1.41523277759552
+  },
+  {
+    "step": 219,
+    "loss": 3.6355741024017334,
+    "mean_weight": 1.31693434715271
+  },
+  {
+    "step": 220,
+    "loss": 5.906452655792236,
+    "mean_weight": 1.35539972782135
+  },
+  {
+    "step": 221,
+    "loss": 2.5579915046691895,
+    "mean_weight": 1.306166648864746
+  },
+  {
+    "step": 222,
+    "loss": 4.899624347686768,
+    "mean_weight": 1.5395344495773315
+  },
+  {
+    "step": 223,
+    "loss": 4.0969672203063965,
+    "mean_weight": 1.020778775215149
+  },
+  {
+    "step": 224,
+    "loss": 4.148714542388916,
+    "mean_weight": 1.3903061151504517
+  },
+  {
+    "step": 225,
+    "loss": 3.726888418197632,
+    "mean_weight": 1.1881920099258423
+  },
+  {
+    "step": 226,
+    "loss": 10.065069198608398,
+    "mean_weight": 1.5944952964782715
+  },
+  {
+    "step": 227,
+    "loss": 4.551443576812744,
+    "mean_weight": 1.4834864139556885
+  },
+  {
+    "step": 228,
+    "loss": 5.979852199554443,
+    "mean_weight": 1.164061188697815
+  },
+  {
+    "step": 229,
+    "loss": 4.156274795532227,
+    "mean_weight": 1.289402723312378
+  },
+  {
+    "step": 230,
+    "loss": 4.184372901916504,
+    "mean_weight": 1.4410254955291748
+  },
+  {
+    "step": 231,
+    "loss": 4.099974155426025,
+    "mean_weight": 1.4584519863128662
+  },
+  {
+    "step": 232,
+    "loss": 4.900723457336426,
+    "mean_weight": 1.2983925342559814
+  },
+  {
+    "step": 233,
+    "loss": 5.121147632598877,
+    "mean_weight": 1.4107708930969238
+  },
+  {
+    "step": 234,
+    "loss": 3.3571062088012695,
+    "mean_weight": 1.4190406799316406
+  },
+  {
+    "step": 235,
+    "loss": 5.082603931427002,
+    "mean_weight": 1.2417685985565186
+  },
+  {
+    "step": 236,
+    "loss": 5.340324401855469,
+    "mean_weight": 1.3234460353851318
+  },
+  {
+    "step": 237,
+    "loss": 3.974660634994507,
+    "mean_weight": 1.4386587142944336
+  },
+  {
+    "step": 238,
+    "loss": 5.64084005355835,
+    "mean_weight": 1.357642412185669
+  },
+  {
+    "step": 239,
+    "loss": 3.76045560836792,
+    "mean_weight": 1.1370849609375
+  },
+  {
+    "step": 240,
+    "loss": 3.7410037517547607,
+    "mean_weight": 1.4136238098144531
+  },
+  {
+    "step": 241,
+    "loss": 3.63261342048645,
+    "mean_weight": 1.515724778175354
+  },
+  {
+    "step": 242,
+    "loss": 4.23609733581543,
+    "mean_weight": 1.2139865159988403
+  },
+  {
+    "step": 243,
+    "loss": 3.35227370262146,
+    "mean_weight": 1.378454327583313
+  },
+  {
+    "step": 244,
+    "loss": 7.81702995300293,
+    "mean_weight": 1.2506593465805054
+  },
+  {
+    "step": 245,
+    "loss": 3.927747964859009,
+    "mean_weight": 1.5400203466415405
+  },
+  {
+    "step": 246,
+    "loss": 2.8700695037841797,
+    "mean_weight": 1.2296643257141113
+  },
+  {
+    "step": 247,
+    "loss": 2.744385004043579,
+    "mean_weight": 1.2848947048187256
+  },
+  {
+    "step": 248,
+    "loss": 4.961742877960205,
+    "mean_weight": 1.498602271080017
+  },
+  {
+    "step": 249,
+    "loss": 5.071030616760254,
+    "mean_weight": 1.328439474105835
+  },
+  {
+    "step": 250,
+    "loss": 4.042326927185059,
+    "mean_weight": 1.4874080419540405
+  },
+  {
+    "step": 251,
+    "loss": 3.3413472175598145,
+    "mean_weight": 1.283243179321289
+  },
+  {
+    "step": 252,
+    "loss": 10.892928123474121,
+    "mean_weight": 1.4299943447113037
+  },
+  {
+    "step": 253,
+    "loss": 7.397110939025879,
+    "mean_weight": 1.1673351526260376
+  },
+  {
+    "step": 254,
+    "loss": 5.1170525550842285,
+    "mean_weight": 1.2326586246490479
+  },
+  {
+    "step": 255,
+    "loss": 3.2969396114349365,
+    "mean_weight": 1.1141728162765503
+  },
+  {
+    "step": 256,
+    "loss": 6.239606857299805,
+    "mean_weight": 1.4976961612701416
+  },
+  {
+    "step": 257,
+    "loss": 6.112105846405029,
+    "mean_weight": 1.3558743000030518
+  },
+  {
+    "step": 258,
+    "loss": 7.725228309631348,
+    "mean_weight": 1.5074249505996704
+  },
+  {
+    "step": 259,
+    "loss": 6.134561538696289,
+    "mean_weight": 1.4044890403747559
+  },
+  {
+    "step": 260,
+    "loss": 5.3169169425964355,
+    "mean_weight": 1.555579662322998
+  },
+  {
+    "step": 261,
+    "loss": 2.4865195751190186,
+    "mean_weight": 1.2956552505493164
+  },
+  {
+    "step": 262,
+    "loss": 4.231276512145996,
+    "mean_weight": 1.4168633222579956
+  },
+  {
+    "step": 263,
+    "loss": 1.873328685760498,
+    "mean_weight": 1.2315473556518555
+  },
+  {
+    "step": 264,
+    "loss": 2.3931045532226562,
+    "mean_weight": 1.1942362785339355
+  },
+  {
+    "step": 265,
+    "loss": 3.840367317199707,
+    "mean_weight": 1.5120269060134888
+  },
+  {
+    "step": 266,
+    "loss": 5.163942813873291,
+    "mean_weight": 1.349888801574707
+  },
+  {
+    "step": 267,
+    "loss": 7.142092704772949,
+    "mean_weight": 1.312070608139038
+  },
+  {
+    "step": 268,
+    "loss": 5.216920375823975,
+    "mean_weight": 1.4565094709396362
+  },
+  {
+    "step": 269,
+    "loss": 4.112502574920654,
+    "mean_weight": 1.479714035987854
+  },
+  {
+    "step": 270,
+    "loss": 3.443908929824829,
+    "mean_weight": 1.2290029525756836
+  },
+  {
+    "step": 271,
+    "loss": 3.98429274559021,
+    "mean_weight": 1.299731969833374
+  },
+  {
+    "step": 272,
+    "loss": 3.652705192565918,
+    "mean_weight": 1.1791813373565674
+  },
+  {
+    "step": 273,
+    "loss": 4.331203937530518,
+    "mean_weight": 1.505979061126709
+  },
+  {
+    "step": 274,
+    "loss": 3.777735471725464,
+    "mean_weight": 1.3194812536239624
+  },
+  {
+    "step": 275,
+    "loss": 4.310670852661133,
+    "mean_weight": 1.2622363567352295
+  },
+  {
+    "step": 276,
+    "loss": 5.072968482971191,
+    "mean_weight": 1.2193727493286133
+  },
+  {
+    "step": 277,
+    "loss": 7.279438495635986,
+    "mean_weight": 1.4999065399169922
+  },
+  {
+    "step": 278,
+    "loss": 5.483262538909912,
+    "mean_weight": 1.3902099132537842
+  },
+  {
+    "step": 279,
+    "loss": 4.3032732009887695,
+    "mean_weight": 1.397688388824463
+  },
+  {
+    "step": 280,
+    "loss": 7.577721118927002,
+    "mean_weight": 1.5520801544189453
+  },
+  {
+    "step": 281,
+    "loss": 3.7373106479644775,
+    "mean_weight": 1.2066185474395752
+  },
+  {
+    "step": 282,
+    "loss": 3.9513373374938965,
+    "mean_weight": 1.0251184701919556
+  },
+  {
+    "step": 283,
+    "loss": 4.027817726135254,
+    "mean_weight": 1.4080702066421509
+  },
+  {
+    "step": 284,
+    "loss": 2.928424835205078,
+    "mean_weight": 1.4815598726272583
+  },
+  {
+    "step": 285,
+    "loss": 2.768540620803833,
+    "mean_weight": 1.2011375427246094
+  },
+  {
+    "step": 286,
+    "loss": 7.0615034103393555,
+    "mean_weight": 1.2606642246246338
+  },
+  {
+    "step": 287,
+    "loss": 5.650871753692627,
+    "mean_weight": 1.2973030805587769
+  },
+  {
+    "step": 288,
+    "loss": 3.288677930831909,
+    "mean_weight": 1.1977896690368652
+  },
+  {
+    "step": 289,
+    "loss": 3.4555552005767822,
+    "mean_weight": 1.5564028024673462
+  },
+  {
+    "step": 290,
+    "loss": 3.275550127029419,
+    "mean_weight": 1.3860114812850952
+  },
+  {
+    "step": 291,
+    "loss": 6.231123924255371,
+    "mean_weight": 1.26936936378479
+  },
+  {
+    "step": 292,
+    "loss": 2.90748929977417,
+    "mean_weight": 1.2650172710418701
+  },
+  {
+    "step": 293,
+    "loss": 1.8462189435958862,
+    "mean_weight": 1.1988303661346436
+  },
+  {
+    "step": 294,
+    "loss": 3.0204968452453613,
+    "mean_weight": 1.324163794517517
+  },
+  {
+    "step": 295,
+    "loss": 4.5104193687438965,
+    "mean_weight": 1.2294756174087524
+  },
+  {
+    "step": 296,
+    "loss": 3.4144039154052734,
+    "mean_weight": 1.497225046157837
+  },
+  {
+    "step": 297,
+    "loss": 5.031682014465332,
+    "mean_weight": 1.1187820434570312
+  },
+  {
+    "step": 298,
+    "loss": 2.7490627765655518,
+    "mean_weight": 1.1412782669067383
+  },
+  {
+    "step": 299,
+    "loss": 5.167834281921387,
+    "mean_weight": 1.4804631471633911
+  }
+]
diff --git a/lecture_6/verified_examples/meta-finetune/losses.json b/lecture_6/verified_examples/meta-finetune/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..ef69f0381758edd1b433af47bd7f433dfb295ff1
--- /dev/null
+++ b/lecture_6/verified_examples/meta-finetune/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.8069956302642822,
+    "diagonal": 2.8069956302642822,
+    "finite": 1.6036477973102592e-05
+  },
+  {
+    "step": 1,
+    "loss": 3.074927568435669,
+    "diagonal": 3.0749261379241943,
+    "finite": 0.00017141597345471382
+  },
+  {
+    "step": 2,
+    "loss": 4.215892791748047,
+    "diagonal": 4.215885162353516,
+    "finite": 0.0006397111574187875
+  },
+  {
+    "step": 3,
+    "loss": 2.811654806137085,
+    "diagonal": 2.8116350173950195,
+    "finite": 0.0012350926408544183
+  },
+  {
+    "step": 4,
+    "loss": 2.7368509769439697,
+    "diagonal": 2.7368104457855225,
+    "finite": 0.0020273281261324883
+  },
+  {
+    "step": 5,
+    "loss": 2.609227180480957,
+    "diagonal": 2.6091418266296387,
+    "finite": 0.003557848045602441
+  },
+  {
+    "step": 6,
+    "loss": 2.785521984100342,
+    "diagonal": 2.7853894233703613,
+    "finite": 0.004734779242426157
+  },
+  {
+    "step": 7,
+    "loss": 2.833909511566162,
+    "diagonal": 2.833706855773926,
+    "finite": 0.006330839823931456
+  },
+  {
+    "step": 8,
+    "loss": 3.8368701934814453,
+    "diagonal": 3.836601495742798,
+    "finite": 0.007462475448846817
+  },
+  {
+    "step": 9,
+    "loss": 3.3032782077789307,
+    "diagonal": 3.3029003143310547,
+    "finite": 0.009446321986615658
+  },
+  {
+    "step": 10,
+    "loss": 3.144731283187866,
+    "diagonal": 3.1443347930908203,
+    "finite": 0.0090120704844594
+  },
+  {
+    "step": 11,
+    "loss": 3.2948248386383057,
+    "diagonal": 3.2942471504211426,
+    "finite": 0.012035545893013477
+  },
+  {
+    "step": 12,
+    "loss": 3.2986042499542236,
+    "diagonal": 3.2978270053863525,
+    "finite": 0.014945673756301403
+  },
+  {
+    "step": 13,
+    "loss": 2.9874086380004883,
+    "diagonal": 2.986298084259033,
+    "finite": 0.019831398501992226
+  },
+  {
+    "step": 14,
+    "loss": 3.091095209121704,
+    "diagonal": 3.089963436126709,
+    "finite": 0.018863970413804054
+  },
+  {
+    "step": 15,
+    "loss": 3.0512516498565674,
+    "diagonal": 3.0496177673339844,
+    "finite": 0.025528477504849434
+  },
+  {
+    "step": 16,
+    "loss": 2.4063239097595215,
+    "diagonal": 2.4044957160949707,
+    "finite": 0.026885831728577614
+  },
+  {
+    "step": 17,
+    "loss": 3.043684720993042,
+    "diagonal": 3.041342258453369,
+    "finite": 0.032533951103687286
+  },
+  {
+    "step": 18,
+    "loss": 3.0211808681488037,
+    "diagonal": 3.018683433532715,
+    "finite": 0.03286237269639969
+  },
+  {
+    "step": 19,
+    "loss": 2.5626344680786133,
+    "diagonal": 2.5590932369232178,
+    "finite": 0.04426520690321922
+  },
+  {
+    "step": 20,
+    "loss": 2.6786863803863525,
+    "diagonal": 2.675204277038574,
+    "finite": 0.041452556848526
+  },
+  {
+    "step": 21,
+    "loss": 3.380387306213379,
+    "diagonal": 3.3762152194976807,
+    "finite": 0.04740891233086586
+  },
+  {
+    "step": 22,
+    "loss": 2.74570369720459,
+    "diagonal": 2.740696907043457,
+    "finite": 0.05442281439900398
+  },
+  {
+    "step": 23,
+    "loss": 3.0334250926971436,
+    "diagonal": 3.028674840927124,
+    "finite": 0.04948138818144798
+  },
+  {
+    "step": 24,
+    "loss": 2.9872004985809326,
+    "diagonal": 2.9803104400634766,
+    "finite": 0.06889992952346802
+  },
+  {
+    "step": 25,
+    "loss": 2.677898406982422,
+    "diagonal": 2.668539047241211,
+    "finite": 0.08999381214380264
+  },
+  {
+    "step": 26,
+    "loss": 2.6587164402008057,
+    "diagonal": 2.650024890899658,
+    "finite": 0.0804772675037384
+  },
+  {
+    "step": 27,
+    "loss": 2.4385454654693604,
+    "diagonal": 2.4287936687469482,
+    "finite": 0.08707059174776077
+  },
+  {
+    "step": 28,
+    "loss": 2.8749330043792725,
+    "diagonal": 2.863264322280884,
+    "finite": 0.10059255361557007
+  },
+  {
+    "step": 29,
+    "loss": 2.1367387771606445,
+    "diagonal": 2.123899221420288,
+    "finite": 0.10699589550495148
+  },
+  {
+    "step": 30,
+    "loss": 2.65293550491333,
+    "diagonal": 2.6400434970855713,
+    "finite": 0.1039675772190094
+  },
+  {
+    "step": 31,
+    "loss": 2.357799768447876,
+    "diagonal": 2.3455002307891846,
+    "finite": 0.0960906594991684
+  },
+  {
+    "step": 32,
+    "loss": 2.4420056343078613,
+    "diagonal": 2.424644947052002,
+    "finite": 0.13151966035366058
+  },
+  {
+    "step": 33,
+    "loss": 2.202800989151001,
+    "diagonal": 2.182314157485962,
+    "finite": 0.150638148188591
+  },
+  {
+    "step": 34,
+    "loss": 2.683154582977295,
+    "diagonal": 2.664757013320923,
+    "finite": 0.13141125440597534
+  },
+  {
+    "step": 35,
+    "loss": 2.338933229446411,
+    "diagonal": 2.319424867630005,
+    "finite": 0.13547508418560028
+  },
+  {
+    "step": 36,
+    "loss": 2.67002272605896,
+    "diagonal": 2.648465633392334,
+    "finite": 0.1456553190946579
+  },
+  {
+    "step": 37,
+    "loss": 2.197976589202881,
+    "diagonal": 2.1697375774383545,
+    "finite": 0.18578247725963593
+  },
+  {
+    "step": 38,
+    "loss": 2.657768487930298,
+    "diagonal": 2.6316158771514893,
+    "finite": 0.1676454097032547
+  },
+  {
+    "step": 39,
+    "loss": 2.198908567428589,
+    "diagonal": 2.166872501373291,
+    "finite": 0.20022545754909515
+  },
+  {
+    "step": 40,
+    "loss": 2.584825277328491,
+    "diagonal": 2.5535237789154053,
+    "finite": 0.190862774848938
+  },
+  {
+    "step": 41,
+    "loss": 2.5395636558532715,
+    "diagonal": 2.4971184730529785,
+    "finite": 0.25264933705329895
+  },
+  {
+    "step": 42,
+    "loss": 2.593226432800293,
+    "diagonal": 2.5474636554718018,
+    "finite": 0.26606234908103943
+  },
+  {
+    "step": 43,
+    "loss": 3.0073838233947754,
+    "diagonal": 2.9613521099090576,
+    "finite": 0.2615443766117096
+  },
+  {
+    "step": 44,
+    "loss": 2.072784423828125,
+    "diagonal": 2.0204131603240967,
+    "finite": 0.29095104336738586
+  },
+  {
+    "step": 45,
+    "loss": 2.7881054878234863,
+    "diagonal": 2.738741874694824,
+    "finite": 0.2682799994945526
+  },
+  {
+    "step": 46,
+    "loss": 2.482635259628296,
+    "diagonal": 2.433072090148926,
+    "finite": 0.2636339068412781
+  },
+  {
+    "step": 47,
+    "loss": 2.578479290008545,
+    "diagonal": 2.517843008041382,
+    "finite": 0.3158145248889923
+  },
+  {
+    "step": 48,
+    "loss": 2.498321771621704,
+    "diagonal": 2.4290664196014404,
+    "finite": 0.35334375500679016
+  },
+  {
+    "step": 49,
+    "loss": 2.3608524799346924,
+    "diagonal": 2.284632444381714,
+    "finite": 0.3810998797416687
+  },
+  {
+    "step": 50,
+    "loss": 2.5263426303863525,
+    "diagonal": 2.4523825645446777,
+    "finite": 0.36254939436912537
+  },
+  {
+    "step": 51,
+    "loss": 2.1986684799194336,
+    "diagonal": 2.112879753112793,
+    "finite": 0.4124453365802765
+  },
+  {
+    "step": 52,
+    "loss": 2.2526793479919434,
+    "diagonal": 2.1839661598205566,
+    "finite": 0.3241192698478699
+  },
+  {
+    "step": 53,
+    "loss": 1.8461322784423828,
+    "diagonal": 1.7619132995605469,
+    "finite": 0.3899025022983551
+  },
+  {
+    "step": 54,
+    "loss": 2.260822057723999,
+    "diagonal": 2.177457571029663,
+    "finite": 0.3789299726486206
+  },
+  {
+    "step": 55,
+    "loss": 2.3174147605895996,
+    "diagonal": 2.243345260620117,
+    "finite": 0.3306679427623749
+  },
+  {
+    "step": 56,
+    "loss": 2.490051031112671,
+    "diagonal": 2.391594886779785,
+    "finite": 0.43182507157325745
+  },
+  {
+    "step": 57,
+    "loss": 2.1433324813842773,
+    "diagonal": 2.030001640319824,
+    "finite": 0.4884951710700989
+  },
+  {
+    "step": 58,
+    "loss": 1.999982476234436,
+    "diagonal": 1.900361180305481,
+    "finite": 0.42212432622909546
+  },
+  {
+    "step": 59,
+    "loss": 1.9598116874694824,
+    "diagonal": 1.8363806009292603,
+    "finite": 0.5142963528633118
+  },
+  {
+    "step": 60,
+    "loss": 1.9787441492080688,
+    "diagonal": 1.8620755672454834,
+    "finite": 0.47814998030662537
+  },
+  {
+    "step": 61,
+    "loss": 1.9809156656265259,
+    "diagonal": 1.8368520736694336,
+    "finite": 0.5809016227722168
+  },
+  {
+    "step": 62,
+    "loss": 1.8451629877090454,
+    "diagonal": 1.7161004543304443,
+    "finite": 0.512152910232544
+  },
+  {
+    "step": 63,
+    "loss": 2.2742111682891846,
+    "diagonal": 2.136435031890869,
+    "finite": 0.5381883382797241
+  },
+  {
+    "step": 64,
+    "loss": 2.273287773132324,
+    "diagonal": 2.1227102279663086,
+    "finite": 0.5791442394256592
+  },
+  {
+    "step": 65,
+    "loss": 2.0214521884918213,
+    "diagonal": 1.8821924924850464,
+    "finite": 0.527498722076416
+  },
+  {
+    "step": 66,
+    "loss": 2.1416900157928467,
+    "diagonal": 2.0069210529327393,
+    "finite": 0.5028693079948425
+  },
+  {
+    "step": 67,
+    "loss": 1.9526633024215698,
+    "diagonal": 1.8053311109542847,
+    "finite": 0.5416625738143921
+  },
+  {
+    "step": 68,
+    "loss": 2.0982513427734375,
+    "diagonal": 1.9491933584213257,
+    "finite": 0.5400649905204773
+  },
+  {
+    "step": 69,
+    "loss": 2.4140124320983887,
+    "diagonal": 2.2468209266662598,
+    "finite": 0.5971121788024902
+  },
+  {
+    "step": 70,
+    "loss": 2.7674405574798584,
+    "diagonal": 2.628884792327881,
+    "finite": 0.4878724217414856
+  },
+  {
+    "step": 71,
+    "loss": 1.7945780754089355,
+    "diagonal": 1.6316888332366943,
+    "finite": 0.5655876398086548
+  },
+  {
+    "step": 72,
+    "loss": 1.957055926322937,
+    "diagonal": 1.8002420663833618,
+    "finite": 0.5370339155197144
+  },
+  {
+    "step": 73,
+    "loss": 2.16245174407959,
+    "diagonal": 2.0112602710723877,
+    "finite": 0.5107817053794861
+  },
+  {
+    "step": 74,
+    "loss": 2.5562222003936768,
+    "diagonal": 2.345935821533203,
+    "finite": 0.7009545564651489
+  },
+  {
+    "step": 75,
+    "loss": 2.5723955631256104,
+    "diagonal": 2.447998523712158,
+    "finite": 0.4092004895210266
+  },
+  {
+    "step": 76,
+    "loss": 2.3991355895996094,
+    "diagonal": 2.230273723602295,
+    "finite": 0.5482527017593384
+  },
+  {
+    "step": 77,
+    "loss": 2.9962761402130127,
+    "diagonal": 2.8370022773742676,
+    "finite": 0.5104934573173523
+  },
+  {
+    "step": 78,
+    "loss": 2.148745536804199,
+    "diagonal": 2.001556396484375,
+    "finite": 0.4657882750034332
+  },
+  {
+    "step": 79,
+    "loss": 2.9647417068481445,
+    "diagonal": 2.8199596405029297,
+    "finite": 0.45244383811950684
+  },
+  {
+    "step": 80,
+    "loss": 2.131894826889038,
+    "diagonal": 1.9787249565124512,
+    "finite": 0.47274649143218994
+  },
+  {
+    "step": 81,
+    "loss": 1.92849862575531,
+    "diagonal": 1.7544363737106323,
+    "finite": 0.5306777358055115
+  },
+  {
+    "step": 82,
+    "loss": 1.9041979312896729,
+    "diagonal": 1.7558454275131226,
+    "finite": 0.44684484601020813
+  },
+  {
+    "step": 83,
+    "loss": 2.5239899158477783,
+    "diagonal": 2.3480224609375,
+    "finite": 0.5237123966217041
+  },
+  {
+    "step": 84,
+    "loss": 2.747459888458252,
+    "diagonal": 2.5952112674713135,
+    "finite": 0.44779038429260254
+  },
+  {
+    "step": 85,
+    "loss": 2.1410231590270996,
+    "diagonal": 1.9963871240615845,
+    "finite": 0.4204533100128174
+  },
+  {
+    "step": 86,
+    "loss": 2.331653594970703,
+    "diagonal": 2.2119762897491455,
+    "finite": 0.343900203704834
+  },
+  {
+    "step": 87,
+    "loss": 2.1430771350860596,
+    "diagonal": 2.0016021728515625,
+    "finite": 0.40191739797592163
+  },
+  {
+    "step": 88,
+    "loss": 2.33323335647583,
+    "diagonal": 2.209773063659668,
+    "finite": 0.34679850935935974
+  },
+  {
+    "step": 89,
+    "loss": 2.2590832710266113,
+    "diagonal": 2.1292953491210938,
+    "finite": 0.3605222702026367
+  },
+  {
+    "step": 90,
+    "loss": 2.796050786972046,
+    "diagonal": 2.654806613922119,
+    "finite": 0.3880334794521332
+  },
+  {
+    "step": 91,
+    "loss": 1.9963884353637695,
+    "diagonal": 1.8662071228027344,
+    "finite": 0.3537536859512329
+  },
+  {
+    "step": 92,
+    "loss": 1.8122411966323853,
+    "diagonal": 1.6868007183074951,
+    "finite": 0.33720552921295166
+  },
+  {
+    "step": 93,
+    "loss": 2.1467721462249756,
+    "diagonal": 2.027082681655884,
+    "finite": 0.3183228373527527
+  },
+  {
+    "step": 94,
+    "loss": 1.9436217546463013,
+    "diagonal": 1.813447117805481,
+    "finite": 0.3425649404525757
+  },
+  {
+    "step": 95,
+    "loss": 2.0724563598632812,
+    "diagonal": 1.9633373022079468,
+    "finite": 0.2841643691062927
+  },
+  {
+    "step": 96,
+    "loss": 2.502373456954956,
+    "diagonal": 2.376674175262451,
+    "finite": 0.3239673972129822
+  },
+  {
+    "step": 97,
+    "loss": 2.0256662368774414,
+    "diagonal": 1.91057288646698,
+    "finite": 0.2936052978038788
+  },
+  {
+    "step": 98,
+    "loss": 2.304405689239502,
+    "diagonal": 2.1902389526367188,
+    "finite": 0.28829991817474365
+  },
+  {
+    "step": 99,
+    "loss": 2.2231202125549316,
+    "diagonal": 2.1297054290771484,
+    "finite": 0.23353707790374756
+  },
+  {
+    "step": 100,
+    "loss": 2.3900058269500732,
+    "diagonal": 2.280395984649658,
+    "finite": 0.27131152153015137
+  },
+  {
+    "step": 101,
+    "loss": 2.222144365310669,
+    "diagonal": 2.1052801609039307,
+    "finite": 0.28643208742141724
+  },
+  {
+    "step": 102,
+    "loss": 1.9896074533462524,
+    "diagonal": 1.8901219367980957,
+    "finite": 0.2414698302745819
+  },
+  {
+    "step": 103,
+    "loss": 1.871809482574463,
+    "diagonal": 1.7712239027023315,
+    "finite": 0.24179218709468842
+  },
+  {
+    "step": 104,
+    "loss": 2.043701410293579,
+    "diagonal": 1.9242724180221558,
+    "finite": 0.28435465693473816
+  },
+  {
+    "step": 105,
+    "loss": 2.157493829727173,
+    "diagonal": 2.060941696166992,
+    "finite": 0.22771744430065155
+  },
+  {
+    "step": 106,
+    "loss": 2.499375581741333,
+    "diagonal": 2.3960726261138916,
+    "finite": 0.24136187136173248
+  },
+  {
+    "step": 107,
+    "loss": 2.0208675861358643,
+    "diagonal": 1.8846811056137085,
+    "finite": 0.3152465224266052
+  },
+  {
+    "step": 108,
+    "loss": 2.109743595123291,
+    "diagonal": 1.9780733585357666,
+    "finite": 0.3019959032535553
+  },
+  {
+    "step": 109,
+    "loss": 1.9172190427780151,
+    "diagonal": 1.7733116149902344,
+    "finite": 0.3270624279975891
+  },
+  {
+    "step": 110,
+    "loss": 2.3048458099365234,
+    "diagonal": 2.1840691566467285,
+    "finite": 0.2720196545124054
+  },
+  {
+    "step": 111,
+    "loss": 1.860410213470459,
+    "diagonal": 1.739485502243042,
+    "finite": 0.26992133259773254
+  },
+  {
+    "step": 112,
+    "loss": 1.9445315599441528,
+    "diagonal": 1.7984614372253418,
+    "finite": 0.32316404581069946
+  },
+  {
+    "step": 113,
+    "loss": 1.9957644939422607,
+    "diagonal": 1.8693773746490479,
+    "finite": 0.27716466784477234
+  },
+  {
+    "step": 114,
+    "loss": 2.5679242610931396,
+    "diagonal": 2.4746296405792236,
+    "finite": 0.20281456410884857
+  },
+  {
+    "step": 115,
+    "loss": 2.012930154800415,
+    "diagonal": 1.9060156345367432,
+    "finite": 0.23041920363903046
+  },
+  {
+    "step": 116,
+    "loss": 2.0834295749664307,
+    "diagonal": 1.9413065910339355,
+    "finite": 0.3036816120147705
+  },
+  {
+    "step": 117,
+    "loss": 2.1906919479370117,
+    "diagonal": 2.0746982097625732,
+    "finite": 0.2457493543624878
+  },
+  {
+    "step": 118,
+    "loss": 2.0832247734069824,
+    "diagonal": 1.9549760818481445,
+    "finite": 0.2694302499294281
+  },
+  {
+    "step": 119,
+    "loss": 1.84365713596344,
+    "diagonal": 1.7086366415023804,
+    "finite": 0.2812926769256592
+  },
+  {
+    "step": 120,
+    "loss": 2.004087209701538,
+    "diagonal": 1.90079927444458,
+    "finite": 0.21340490877628326
+  },
+  {
+    "step": 121,
+    "loss": 2.183072566986084,
+    "diagonal": 2.059546709060669,
+    "finite": 0.25312697887420654
+  },
+  {
+    "step": 122,
+    "loss": 2.490384578704834,
+    "diagonal": 2.3526134490966797,
+    "finite": 0.2800227403640747
+  },
+  {
+    "step": 123,
+    "loss": 2.1781089305877686,
+    "diagonal": 2.0633580684661865,
+    "finite": 0.23135235905647278
+  },
+  {
+    "step": 124,
+    "loss": 1.904137134552002,
+    "diagonal": 1.7821152210235596,
+    "finite": 0.24404381215572357
+  },
+  {
+    "step": 125,
+    "loss": 1.9962619543075562,
+    "diagonal": 1.8794349431991577,
+    "finite": 0.2317996770143509
+  },
+  {
+    "step": 126,
+    "loss": 2.0796122550964355,
+    "diagonal": 1.9457615613937378,
+    "finite": 0.26348572969436646
+  },
+  {
+    "step": 127,
+    "loss": 1.841684103012085,
+    "diagonal": 1.7245681285858154,
+    "finite": 0.22874212265014648
+  },
+  {
+    "step": 128,
+    "loss": 2.5640225410461426,
+    "diagonal": 2.483609199523926,
+    "finite": 0.15583983063697815
+  },
+  {
+    "step": 129,
+    "loss": 2.2295827865600586,
+    "diagonal": 2.104253053665161,
+    "finite": 0.24101877212524414
+  },
+  {
+    "step": 130,
+    "loss": 2.5307633876800537,
+    "diagonal": 2.417215347290039,
+    "finite": 0.21669483184814453
+  },
+  {
+    "step": 131,
+    "loss": 2.222733736038208,
+    "diagonal": 2.093357801437378,
+    "finite": 0.24503017961978912
+  },
+  {
+    "step": 132,
+    "loss": 1.6210848093032837,
+    "diagonal": 1.4765903949737549,
+    "finite": 0.2716060280799866
+  },
+  {
+    "step": 133,
+    "loss": 2.3227756023406982,
+    "diagonal": 2.1930606365203857,
+    "finite": 0.24200549721717834
+  },
+  {
+    "step": 134,
+    "loss": 2.1980209350585938,
+    "diagonal": 2.089439868927002,
+    "finite": 0.20107614994049072
+  },
+  {
+    "step": 135,
+    "loss": 2.380324363708496,
+    "diagonal": 2.263733386993408,
+    "finite": 0.21432146430015564
+  },
+  {
+    "step": 136,
+    "loss": 2.0976505279541016,
+    "diagonal": 1.9866433143615723,
+    "finite": 0.20256781578063965
+  },
+  {
+    "step": 137,
+    "loss": 2.010584592819214,
+    "diagonal": 1.913210153579712,
+    "finite": 0.1764029562473297
+  },
+  {
+    "step": 138,
+    "loss": 1.8779820203781128,
+    "diagonal": 1.7705926895141602,
+    "finite": 0.19314631819725037
+  },
+  {
+    "step": 139,
+    "loss": 2.293182373046875,
+    "diagonal": 2.197294235229492,
+    "finite": 0.17122891545295715
+  },
+  {
+    "step": 140,
+    "loss": 2.132535457611084,
+    "diagonal": 2.0426650047302246,
+    "finite": 0.15934468805789948
+  },
+  {
+    "step": 141,
+    "loss": 2.4095253944396973,
+    "diagonal": 2.3261170387268066,
+    "finite": 0.14684557914733887
+  },
+  {
+    "step": 142,
+    "loss": 1.6516996622085571,
+    "diagonal": 1.5539089441299438,
+    "finite": 0.1709628403186798
+  },
+  {
+    "step": 143,
+    "loss": 1.6047625541687012,
+    "diagonal": 1.5230770111083984,
+    "finite": 0.14181508123874664
+  },
+  {
+    "step": 144,
+    "loss": 2.016681432723999,
+    "diagonal": 1.9115709066390991,
+    "finite": 0.18122485280036926
+  },
+  {
+    "step": 145,
+    "loss": 1.8062777519226074,
+    "diagonal": 1.7213449478149414,
+    "finite": 0.14543291926383972
+  },
+  {
+    "step": 146,
+    "loss": 2.2902865409851074,
+    "diagonal": 2.179062843322754,
+    "finite": 0.18915587663650513
+  },
+  {
+    "step": 147,
+    "loss": 1.5230062007904053,
+    "diagonal": 1.4351425170898438,
+    "finite": 0.1484183818101883
+  },
+  {
+    "step": 148,
+    "loss": 2.3276078701019287,
+    "diagonal": 2.2428388595581055,
+    "finite": 0.14223003387451172
+  },
+  {
+    "step": 149,
+    "loss": 2.1051108837127686,
+    "diagonal": 2.018260955810547,
+    "finite": 0.1447499841451645
+  },
+  {
+    "step": 150,
+    "loss": 2.4256529808044434,
+    "diagonal": 2.3336920738220215,
+    "finite": 0.1522531807422638
+  },
+  {
+    "step": 151,
+    "loss": 2.4502639770507812,
+    "diagonal": 2.3619132041931152,
+    "finite": 0.14531363546848297
+  },
+  {
+    "step": 152,
+    "loss": 1.730540156364441,
+    "diagonal": 1.6364164352416992,
+    "finite": 0.15379685163497925
+  },
+  {
+    "step": 153,
+    "loss": 2.0666725635528564,
+    "diagonal": 1.9441198110580444,
+    "finite": 0.19894936680793762
+  },
+  {
+    "step": 154,
+    "loss": 1.8268301486968994,
+    "diagonal": 1.730872392654419,
+    "finite": 0.15477067232131958
+  },
+  {
+    "step": 155,
+    "loss": 2.0642054080963135,
+    "diagonal": 1.9638025760650635,
+    "finite": 0.1609020233154297
+  },
+  {
+    "step": 156,
+    "loss": 2.1084938049316406,
+    "diagonal": 2.0301146507263184,
+    "finite": 0.12480773776769638
+  },
+  {
+    "step": 157,
+    "loss": 1.933156967163086,
+    "diagonal": 1.8388713598251343,
+    "finite": 0.14918604493141174
+  },
+  {
+    "step": 158,
+    "loss": 1.9536149501800537,
+    "diagonal": 1.8733445405960083,
+    "finite": 0.1262112557888031
+  },
+  {
+    "step": 159,
+    "loss": 2.13521409034729,
+    "diagonal": 2.0308666229248047,
+    "finite": 0.16304302215576172
+  },
+  {
+    "step": 160,
+    "loss": 2.208540439605713,
+    "diagonal": 2.1323187351226807,
+    "finite": 0.1183566153049469
+  },
+  {
+    "step": 161,
+    "loss": 2.4211337566375732,
+    "diagonal": 2.3476202487945557,
+    "finite": 0.11344694346189499
+  },
+  {
+    "step": 162,
+    "loss": 2.3214051723480225,
+    "diagonal": 2.238259792327881,
+    "finite": 0.12752357125282288
+  },
+  {
+    "step": 163,
+    "loss": 1.9746627807617188,
+    "diagonal": 1.9096887111663818,
+    "finite": 0.09904581308364868
+  },
+  {
+    "step": 164,
+    "loss": 2.270169973373413,
+    "diagonal": 2.199767589569092,
+    "finite": 0.10667039453983307
+  },
+  {
+    "step": 165,
+    "loss": 1.729362964630127,
+    "diagonal": 1.667038083076477,
+    "finite": 0.09386276453733444
+  },
+  {
+    "step": 166,
+    "loss": 2.608980655670166,
+    "diagonal": 2.5391414165496826,
+    "finite": 0.1045498177409172
+  },
+  {
+    "step": 167,
+    "loss": 1.5363596677780151,
+    "diagonal": 1.4725825786590576,
+    "finite": 0.09490633755922318
+  },
+  {
+    "step": 168,
+    "loss": 2.44164776802063,
+    "diagonal": 2.3970112800598145,
+    "finite": 0.0660303458571434
+  },
+  {
+    "step": 169,
+    "loss": 2.3490889072418213,
+    "diagonal": 2.292508363723755,
+    "finite": 0.08320675045251846
+  },
+  {
+    "step": 170,
+    "loss": 1.8020596504211426,
+    "diagonal": 1.7606887817382812,
+    "finite": 0.06048371642827988
+  },
+  {
+    "step": 171,
+    "loss": 2.218090534210205,
+    "diagonal": 2.156571865081787,
+    "finite": 0.08941683918237686
+  },
+  {
+    "step": 172,
+    "loss": 2.7719860076904297,
+    "diagonal": 2.727123737335205,
+    "finite": 0.06482991576194763
+  },
+  {
+    "step": 173,
+    "loss": 2.082286834716797,
+    "diagonal": 2.027414083480835,
+    "finite": 0.07884006947278976
+  },
+  {
+    "step": 174,
+    "loss": 2.514464855194092,
+    "diagonal": 2.4541497230529785,
+    "finite": 0.08616442233324051
+  },
+  {
+    "step": 175,
+    "loss": 2.2662837505340576,
+    "diagonal": 2.2095587253570557,
+    "finite": 0.08057522773742676
+  },
+  {
+    "step": 176,
+    "loss": 2.4205398559570312,
+    "diagonal": 2.3541336059570312,
+    "finite": 0.09379418939352036
+  },
+  {
+    "step": 177,
+    "loss": 2.0207252502441406,
+    "diagonal": 1.9578076601028442,
+    "finite": 0.0883672833442688
+  },
+  {
+    "step": 178,
+    "loss": 2.2394704818725586,
+    "diagonal": 2.179797410964966,
+    "finite": 0.08334222435951233
+  },
+  {
+    "step": 179,
+    "loss": 1.8233113288879395,
+    "diagonal": 1.7812083959579468,
+    "finite": 0.0584762878715992
+  },
+  {
+    "step": 180,
+    "loss": 1.6253275871276855,
+    "diagonal": 1.5774526596069336,
+    "finite": 0.06612558662891388
+  },
+  {
+    "step": 181,
+    "loss": 2.0593743324279785,
+    "diagonal": 1.9983770847320557,
+    "finite": 0.08378733694553375
+  },
+  {
+    "step": 182,
+    "loss": 2.2712109088897705,
+    "diagonal": 2.2053539752960205,
+    "finite": 0.08996845781803131
+  },
+  {
+    "step": 183,
+    "loss": 1.5357122421264648,
+    "diagonal": 1.4699699878692627,
+    "finite": 0.08932369947433472
+  },
+  {
+    "step": 184,
+    "loss": 1.893786907196045,
+    "diagonal": 1.8230135440826416,
+    "finite": 0.09563969075679779
+  },
+  {
+    "step": 185,
+    "loss": 1.7431282997131348,
+    "diagonal": 1.6639055013656616,
+    "finite": 0.10648225992918015
+  },
+  {
+    "step": 186,
+    "loss": 1.997130274772644,
+    "diagonal": 1.9406439065933228,
+    "finite": 0.07551658898591995
+  },
+  {
+    "step": 187,
+    "loss": 1.9818059206008911,
+    "diagonal": 1.9064946174621582,
+    "finite": 0.10014798492193222
+  },
+  {
+    "step": 188,
+    "loss": 1.5912482738494873,
+    "diagonal": 1.4960319995880127,
+    "finite": 0.125947505235672
+  },
+  {
+    "step": 189,
+    "loss": 1.7336565256118774,
+    "diagonal": 1.6655168533325195,
+    "finite": 0.08965742588043213
+  },
+  {
+    "step": 190,
+    "loss": 1.8539012670516968,
+    "diagonal": 1.7754770517349243,
+    "finite": 0.10264953225851059
+  },
+  {
+    "step": 191,
+    "loss": 2.089449644088745,
+    "diagonal": 2.0108325481414795,
+    "finite": 0.10236594080924988
+  },
+  {
+    "step": 192,
+    "loss": 2.031237840652466,
+    "diagonal": 1.9547410011291504,
+    "finite": 0.09908915311098099
+  },
+  {
+    "step": 193,
+    "loss": 2.031200885772705,
+    "diagonal": 1.951714038848877,
+    "finite": 0.10243144631385803
+  },
+  {
+    "step": 194,
+    "loss": 1.873511791229248,
+    "diagonal": 1.775068759918213,
+    "finite": 0.1262090653181076
+  },
+  {
+    "step": 195,
+    "loss": 1.8691495656967163,
+    "diagonal": 1.8014435768127441,
+    "finite": 0.08635968714952469
+  },
+  {
+    "step": 196,
+    "loss": 1.4754770994186401,
+    "diagonal": 1.3958293199539185,
+    "finite": 0.1010759174823761
+  },
+  {
+    "step": 197,
+    "loss": 2.356457471847534,
+    "diagonal": 2.2828476428985596,
+    "finite": 0.09294171631336212
+  },
+  {
+    "step": 198,
+    "loss": 2.2736315727233887,
+    "diagonal": 2.1905598640441895,
+    "finite": 0.10436130315065384
+  },
+  {
+    "step": 199,
+    "loss": 2.076889753341675,
+    "diagonal": 2.0064890384674072,
+    "finite": 0.0880008190870285
+  },
+  {
+    "step": 200,
+    "loss": 1.6903513669967651,
+    "diagonal": 1.6146129369735718,
+    "finite": 0.09420205652713776
+  },
+  {
+    "step": 201,
+    "loss": 1.9987441301345825,
+    "diagonal": 1.9344618320465088,
+    "finite": 0.07955724000930786
+  },
+  {
+    "step": 202,
+    "loss": 2.245645761489868,
+    "diagonal": 2.165066719055176,
+    "finite": 0.09923534840345383
+  },
+  {
+    "step": 203,
+    "loss": 1.888670563697815,
+    "diagonal": 1.8245550394058228,
+    "finite": 0.07857292145490646
+  },
+  {
+    "step": 204,
+    "loss": 1.7394587993621826,
+    "diagonal": 1.6733709573745728,
+    "finite": 0.08059488236904144
+  },
+  {
+    "step": 205,
+    "loss": 1.885148286819458,
+    "diagonal": 1.826545000076294,
+    "finite": 0.0711205005645752
+  },
+  {
+    "step": 206,
+    "loss": 2.223264217376709,
+    "diagonal": 2.17152738571167,
+    "finite": 0.062484219670295715
+  },
+  {
+    "step": 207,
+    "loss": 1.8486287593841553,
+    "diagonal": 1.7979668378829956,
+    "finite": 0.06089172884821892
+  },
+  {
+    "step": 208,
+    "loss": 1.9386283159255981,
+    "diagonal": 1.8751920461654663,
+    "finite": 0.07588066160678864
+  },
+  {
+    "step": 209,
+    "loss": 1.9663594961166382,
+    "diagonal": 1.9205195903778076,
+    "finite": 0.05457127466797829
+  },
+  {
+    "step": 210,
+    "loss": 2.0101068019866943,
+    "diagonal": 1.959944725036621,
+    "finite": 0.05943366140127182
+  },
+  {
+    "step": 211,
+    "loss": 1.6317325830459595,
+    "diagonal": 1.5879364013671875,
+    "finite": 0.051646508276462555
+  },
+  {
+    "step": 212,
+    "loss": 1.8718904256820679,
+    "diagonal": 1.8264172077178955,
+    "finite": 0.053372304886579514
+  },
+  {
+    "step": 213,
+    "loss": 2.5029215812683105,
+    "diagonal": 2.4653947353363037,
+    "finite": 0.043839722871780396
+  },
+  {
+    "step": 214,
+    "loss": 1.8221086263656616,
+    "diagonal": 1.7749488353729248,
+    "finite": 0.0548369474709034
+  },
+  {
+    "step": 215,
+    "loss": 1.727908968925476,
+    "diagonal": 1.679458737373352,
+    "finite": 0.05607660114765167
+  },
+  {
+    "step": 216,
+    "loss": 2.300417423248291,
+    "diagonal": 2.2631287574768066,
+    "finite": 0.04295920580625534
+  },
+  {
+    "step": 217,
+    "loss": 1.8669801950454712,
+    "diagonal": 1.8196654319763184,
+    "finite": 0.0542600080370903
+  },
+  {
+    "step": 218,
+    "loss": 1.602734923362732,
+    "diagonal": 1.5558807849884033,
+    "finite": 0.05348648875951767
+  },
+  {
+    "step": 219,
+    "loss": 1.9647927284240723,
+    "diagonal": 1.9155025482177734,
+    "finite": 0.05601150542497635
+  },
+  {
+    "step": 220,
+    "loss": 2.7248616218566895,
+    "diagonal": 2.685730218887329,
+    "finite": 0.04426629841327667
+  },
+  {
+    "step": 221,
+    "loss": 2.270888090133667,
+    "diagonal": 2.235211133956909,
+    "finite": 0.0401768684387207
+  },
+  {
+    "step": 222,
+    "loss": 2.0561683177948,
+    "diagonal": 2.010991096496582,
+    "finite": 0.050646983087062836
+  },
+  {
+    "step": 223,
+    "loss": 1.6903284788131714,
+    "diagonal": 1.6542526483535767,
+    "finite": 0.04026314988732338
+  },
+  {
+    "step": 224,
+    "loss": 2.3613672256469727,
+    "diagonal": 2.3108742237091064,
+    "finite": 0.056103240698575974
+  },
+  {
+    "step": 225,
+    "loss": 1.9709348678588867,
+    "diagonal": 1.9315900802612305,
+    "finite": 0.04352305084466934
+  },
+  {
+    "step": 226,
+    "loss": 2.088736057281494,
+    "diagonal": 2.0568480491638184,
+    "finite": 0.0351189523935318
+  },
+  {
+    "step": 227,
+    "loss": 2.1878669261932373,
+    "diagonal": 2.1490020751953125,
+    "finite": 0.042615074664354324
+  },
+  {
+    "step": 228,
+    "loss": 2.2044014930725098,
+    "diagonal": 2.1760013103485107,
+    "finite": 0.031004637479782104
+  },
+  {
+    "step": 229,
+    "loss": 1.922195315361023,
+    "diagonal": 1.8848859071731567,
+    "finite": 0.04055371508002281
+  },
+  {
+    "step": 230,
+    "loss": 1.8687944412231445,
+    "diagonal": 1.8067421913146973,
+    "finite": 0.0671560987830162
+  },
+  {
+    "step": 231,
+    "loss": 2.2623629570007324,
+    "diagonal": 2.2134037017822266,
+    "finite": 0.052757877856492996
+  },
+  {
+    "step": 232,
+    "loss": 1.5316085815429688,
+    "diagonal": 1.4799643754959106,
+    "finite": 0.055412303656339645
+  },
+  {
+    "step": 233,
+    "loss": 2.22627329826355,
+    "diagonal": 2.176429510116577,
+    "finite": 0.05325182154774666
+  },
+  {
+    "step": 234,
+    "loss": 2.2628681659698486,
+    "diagonal": 2.2256858348846436,
+    "finite": 0.03955565020442009
+  },
+  {
+    "step": 235,
+    "loss": 1.8694965839385986,
+    "diagonal": 1.8224231004714966,
+    "finite": 0.04986591637134552
+  },
+  {
+    "step": 236,
+    "loss": 1.9650882482528687,
+    "diagonal": 1.9213237762451172,
+    "finite": 0.04616502672433853
+  },
+  {
+    "step": 237,
+    "loss": 2.227184534072876,
+    "diagonal": 2.1949729919433594,
+    "finite": 0.03383561596274376
+  },
+  {
+    "step": 238,
+    "loss": 2.0806243419647217,
+    "diagonal": 2.0544321537017822,
+    "finite": 0.02739771455526352
+  },
+  {
+    "step": 239,
+    "loss": 2.3886377811431885,
+    "diagonal": 2.3570146560668945,
+    "finite": 0.03294084966182709
+  },
+  {
+    "step": 240,
+    "loss": 2.181165933609009,
+    "diagonal": 2.1430630683898926,
+    "finite": 0.03952575474977493
+  },
+  {
+    "step": 241,
+    "loss": 2.1715087890625,
+    "diagonal": 2.1412718296051025,
+    "finite": 0.031236479058861732
+  },
+  {
+    "step": 242,
+    "loss": 2.1539409160614014,
+    "diagonal": 2.119779109954834,
+    "finite": 0.03514578193426132
+  },
+  {
+    "step": 243,
+    "loss": 2.216517448425293,
+    "diagonal": 2.184361219406128,
+    "finite": 0.0329468660056591
+  },
+  {
+    "step": 244,
+    "loss": 1.4684416055679321,
+    "diagonal": 1.4281387329101562,
+    "finite": 0.04112541675567627
+  },
+  {
+    "step": 245,
+    "loss": 2.825486421585083,
+    "diagonal": 2.799715280532837,
+    "finite": 0.02619015797972679
+  },
+  {
+    "step": 246,
+    "loss": 2.0740058422088623,
+    "diagonal": 2.0440993309020996,
+    "finite": 0.03026975691318512
+  },
+  {
+    "step": 247,
+    "loss": 2.114283561706543,
+    "diagonal": 2.0637316703796387,
+    "finite": 0.05095953494310379
+  },
+  {
+    "step": 248,
+    "loss": 2.3214914798736572,
+    "diagonal": 2.2757444381713867,
+    "finite": 0.04593082144856453
+  },
+  {
+    "step": 249,
+    "loss": 1.9425827264785767,
+    "diagonal": 1.9145402908325195,
+    "finite": 0.02804248034954071
+  },
+  {
+    "step": 250,
+    "loss": 1.406104564666748,
+    "diagonal": 1.3755356073379517,
+    "finite": 0.030569002032279968
+  },
+  {
+    "step": 251,
+    "loss": 2.1082828044891357,
+    "diagonal": 2.073557138442993,
+    "finite": 0.03472557291388512
+  },
+  {
+    "step": 252,
+    "loss": 2.1348612308502197,
+    "diagonal": 2.0950658321380615,
+    "finite": 0.03979530185461044
+  },
+  {
+    "step": 253,
+    "loss": 2.0051257610321045,
+    "diagonal": 1.9663031101226807,
+    "finite": 0.03882255405187607
+  },
+  {
+    "step": 254,
+    "loss": 2.1237218379974365,
+    "diagonal": 2.094088077545166,
+    "finite": 0.02963387407362461
+  },
+  {
+    "step": 255,
+    "loss": 2.0755276679992676,
+    "diagonal": 2.041965961456299,
+    "finite": 0.033561822026968
+  },
+  {
+    "step": 256,
+    "loss": 2.320681095123291,
+    "diagonal": 2.300344944000244,
+    "finite": 0.02033613622188568
+  },
+  {
+    "step": 257,
+    "loss": 2.080225706100464,
+    "diagonal": 2.0565500259399414,
+    "finite": 0.023675721138715744
+  },
+  {
+    "step": 258,
+    "loss": 1.5418667793273926,
+    "diagonal": 1.5185283422470093,
+    "finite": 0.0233384370803833
+  },
+  {
+    "step": 259,
+    "loss": 2.062347888946533,
+    "diagonal": 2.0232791900634766,
+    "finite": 0.03906877338886261
+  },
+  {
+    "step": 260,
+    "loss": 1.8982014656066895,
+    "diagonal": 1.860461950302124,
+    "finite": 0.03773954510688782
+  },
+  {
+    "step": 261,
+    "loss": 1.7912278175354004,
+    "diagonal": 1.7647114992141724,
+    "finite": 0.026516273617744446
+  },
+  {
+    "step": 262,
+    "loss": 1.8843300342559814,
+    "diagonal": 1.8494856357574463,
+    "finite": 0.034844376146793365
+  },
+  {
+    "step": 263,
+    "loss": 1.8188772201538086,
+    "diagonal": 1.778801441192627,
+    "finite": 0.040075819939374924
+  },
+  {
+    "step": 264,
+    "loss": 2.6515579223632812,
+    "diagonal": 2.6269309520721436,
+    "finite": 0.024626977741718292
+  },
+  {
+    "step": 265,
+    "loss": 1.6450417041778564,
+    "diagonal": 1.5928881168365479,
+    "finite": 0.05215361714363098
+  },
+  {
+    "step": 266,
+    "loss": 2.4666566848754883,
+    "diagonal": 2.4252679347991943,
+    "finite": 0.04138883203268051
+  },
+  {
+    "step": 267,
+    "loss": 1.7819013595581055,
+    "diagonal": 1.750922441482544,
+    "finite": 0.030978916212916374
+  },
+  {
+    "step": 268,
+    "loss": 2.4275662899017334,
+    "diagonal": 2.3979012966156006,
+    "finite": 0.029664993286132812
+  },
+  {
+    "step": 269,
+    "loss": 2.43058180809021,
+    "diagonal": 2.3952813148498535,
+    "finite": 0.03530057519674301
+  },
+  {
+    "step": 270,
+    "loss": 1.832322359085083,
+    "diagonal": 1.801027774810791,
+    "finite": 0.03129463642835617
+  },
+  {
+    "step": 271,
+    "loss": 2.1613287925720215,
+    "diagonal": 2.128067970275879,
+    "finite": 0.033260710537433624
+  },
+  {
+    "step": 272,
+    "loss": 1.7390553951263428,
+    "diagonal": 1.7071161270141602,
+    "finite": 0.0319393090903759
+  },
+  {
+    "step": 273,
+    "loss": 2.266911745071411,
+    "diagonal": 2.243784189224243,
+    "finite": 0.0231276024132967
+  },
+  {
+    "step": 274,
+    "loss": 1.9413201808929443,
+    "diagonal": 1.9169832468032837,
+    "finite": 0.0243369247764349
+  },
+  {
+    "step": 275,
+    "loss": 2.242924690246582,
+    "diagonal": 2.2106263637542725,
+    "finite": 0.03229837119579315
+  },
+  {
+    "step": 276,
+    "loss": 1.8790273666381836,
+    "diagonal": 1.8479371070861816,
+    "finite": 0.03109027072787285
+  },
+  {
+    "step": 277,
+    "loss": 1.9806472063064575,
+    "diagonal": 1.959965467453003,
+    "finite": 0.02068176306784153
+  },
+  {
+    "step": 278,
+    "loss": 2.187643527984619,
+    "diagonal": 2.167612075805664,
+    "finite": 0.020031409338116646
+  },
+  {
+    "step": 279,
+    "loss": 2.1006133556365967,
+    "diagonal": 2.069202423095703,
+    "finite": 0.031410835683345795
+  },
+  {
+    "step": 280,
+    "loss": 1.8129628896713257,
+    "diagonal": 1.7779757976531982,
+    "finite": 0.034987132996320724
+  },
+  {
+    "step": 281,
+    "loss": 1.758211374282837,
+    "diagonal": 1.7363767623901367,
+    "finite": 0.021834593266248703
+  },
+  {
+    "step": 282,
+    "loss": 1.4546831846237183,
+    "diagonal": 1.428152084350586,
+    "finite": 0.026531120762228966
+  },
+  {
+    "step": 283,
+    "loss": 1.704819917678833,
+    "diagonal": 1.678199052810669,
+    "finite": 0.02662082016468048
+  },
+  {
+    "step": 284,
+    "loss": 2.044806957244873,
+    "diagonal": 2.0260491371154785,
+    "finite": 0.018757887184619904
+  },
+  {
+    "step": 285,
+    "loss": 2.3847084045410156,
+    "diagonal": 2.368010997772217,
+    "finite": 0.016697511076927185
+  },
+  {
+    "step": 286,
+    "loss": 1.7563261985778809,
+    "diagonal": 1.7415153980255127,
+    "finite": 0.014810758642852306
+  },
+  {
+    "step": 287,
+    "loss": 2.2866365909576416,
+    "diagonal": 2.272786855697632,
+    "finite": 0.013849832117557526
+  },
+  {
+    "step": 288,
+    "loss": 2.0277981758117676,
+    "diagonal": 2.013637065887451,
+    "finite": 0.014161060564219952
+  },
+  {
+    "step": 289,
+    "loss": 1.7158563137054443,
+    "diagonal": 1.6931947469711304,
+    "finite": 0.02266162633895874
+  },
+  {
+    "step": 290,
+    "loss": 2.0967955589294434,
+    "diagonal": 2.07952880859375,
+    "finite": 0.017266739159822464
+  },
+  {
+    "step": 291,
+    "loss": 1.9385111331939697,
+    "diagonal": 1.9200310707092285,
+    "finite": 0.018480075523257256
+  },
+  {
+    "step": 292,
+    "loss": 1.9855412244796753,
+    "diagonal": 1.9660089015960693,
+    "finite": 0.019532358273863792
+  },
+  {
+    "step": 293,
+    "loss": 1.9170671701431274,
+    "diagonal": 1.8998185396194458,
+    "finite": 0.017248667776584625
+  },
+  {
+    "step": 294,
+    "loss": 1.9487576484680176,
+    "diagonal": 1.9323173761367798,
+    "finite": 0.016440274193882942
+  },
+  {
+    "step": 295,
+    "loss": 1.9172013998031616,
+    "diagonal": 1.8987491130828857,
+    "finite": 0.018452297896146774
+  },
+  {
+    "step": 296,
+    "loss": 1.6105247735977173,
+    "diagonal": 1.5847824811935425,
+    "finite": 0.025742268189787865
+  },
+  {
+    "step": 297,
+    "loss": 1.3603827953338623,
+    "diagonal": 1.3424701690673828,
+    "finite": 0.017912669107317924
+  },
+  {
+    "step": 298,
+    "loss": 1.908563494682312,
+    "diagonal": 1.8899139165878296,
+    "finite": 0.018649587407708168
+  },
+  {
+    "step": 299,
+    "loss": 1.8579691648483276,
+    "diagonal": 1.838334321975708,
+    "finite": 0.0196347925812006
+  },
+  {
+    "step": 300,
+    "loss": 1.691026210784912,
+    "diagonal": 1.6662322282791138,
+    "finite": 0.02479400672018528
+  },
+  {
+    "step": 301,
+    "loss": 1.642730712890625,
+    "diagonal": 1.6180410385131836,
+    "finite": 0.02468966692686081
+  },
+  {
+    "step": 302,
+    "loss": 2.1253788471221924,
+    "diagonal": 2.100823402404785,
+    "finite": 0.024555400013923645
+  },
+  {
+    "step": 303,
+    "loss": 1.7303402423858643,
+    "diagonal": 1.700392723083496,
+    "finite": 0.02994748391211033
+  },
+  {
+    "step": 304,
+    "loss": 1.890867829322815,
+    "diagonal": 1.8678243160247803,
+    "finite": 0.023043472319841385
+  },
+  {
+    "step": 305,
+    "loss": 2.0961763858795166,
+    "diagonal": 2.073366165161133,
+    "finite": 0.022810157388448715
+  },
+  {
+    "step": 306,
+    "loss": 1.6316323280334473,
+    "diagonal": 1.6112468242645264,
+    "finite": 0.020385537296533585
+  },
+  {
+    "step": 307,
+    "loss": 1.920278787612915,
+    "diagonal": 1.8911492824554443,
+    "finite": 0.02912953309714794
+  },
+  {
+    "step": 308,
+    "loss": 1.5359190702438354,
+    "diagonal": 1.5068180561065674,
+    "finite": 0.029100965708494186
+  },
+  {
+    "step": 309,
+    "loss": 2.0687263011932373,
+    "diagonal": 2.038215398788452,
+    "finite": 0.03051082231104374
+  },
+  {
+    "step": 310,
+    "loss": 1.545199990272522,
+    "diagonal": 1.51276695728302,
+    "finite": 0.03243301436305046
+  },
+  {
+    "step": 311,
+    "loss": 2.048870325088501,
+    "diagonal": 2.0161542892456055,
+    "finite": 0.03271612897515297
+  },
+  {
+    "step": 312,
+    "loss": 1.8847750425338745,
+    "diagonal": 1.8569656610488892,
+    "finite": 0.02780935727059841
+  },
+  {
+    "step": 313,
+    "loss": 1.8253170251846313,
+    "diagonal": 1.7856987714767456,
+    "finite": 0.03961825370788574
+  },
+  {
+    "step": 314,
+    "loss": 1.872559666633606,
+    "diagonal": 1.8370872735977173,
+    "finite": 0.035472359508275986
+  },
+  {
+    "step": 315,
+    "loss": 2.4801323413848877,
+    "diagonal": 2.445617198944092,
+    "finite": 0.0345151424407959
+  },
+  {
+    "step": 316,
+    "loss": 2.1275947093963623,
+    "diagonal": 2.1005001068115234,
+    "finite": 0.027094505727291107
+  },
+  {
+    "step": 317,
+    "loss": 1.8966058492660522,
+    "diagonal": 1.8611125946044922,
+    "finite": 0.03549320250749588
+  },
+  {
+    "step": 318,
+    "loss": 1.7196754217147827,
+    "diagonal": 1.6900124549865723,
+    "finite": 0.029662981629371643
+  },
+  {
+    "step": 319,
+    "loss": 2.042512893676758,
+    "diagonal": 2.013547658920288,
+    "finite": 0.028965158388018608
+  },
+  {
+    "step": 320,
+    "loss": 1.4823201894760132,
+    "diagonal": 1.4618916511535645,
+    "finite": 0.02042854204773903
+  },
+  {
+    "step": 321,
+    "loss": 1.712527871131897,
+    "diagonal": 1.6850392818450928,
+    "finite": 0.027488579973578453
+  },
+  {
+    "step": 322,
+    "loss": 1.8335270881652832,
+    "diagonal": 1.809629201889038,
+    "finite": 0.02389787696301937
+  },
+  {
+    "step": 323,
+    "loss": 2.096860885620117,
+    "diagonal": 2.077906608581543,
+    "finite": 0.018954278901219368
+  },
+  {
+    "step": 324,
+    "loss": 1.5656304359436035,
+    "diagonal": 1.5392653942108154,
+    "finite": 0.026365000754594803
+  },
+  {
+    "step": 325,
+    "loss": 1.7136554718017578,
+    "diagonal": 1.6913139820098877,
+    "finite": 0.022341500967741013
+  },
+  {
+    "step": 326,
+    "loss": 1.7504949569702148,
+    "diagonal": 1.7281008958816528,
+    "finite": 0.022394025698304176
+  },
+  {
+    "step": 327,
+    "loss": 2.1703598499298096,
+    "diagonal": 2.1439781188964844,
+    "finite": 0.026381665840744972
+  },
+  {
+    "step": 328,
+    "loss": 1.8423864841461182,
+    "diagonal": 1.8144571781158447,
+    "finite": 0.027929261326789856
+  },
+  {
+    "step": 329,
+    "loss": 1.8668917417526245,
+    "diagonal": 1.8389630317687988,
+    "finite": 0.027928750962018967
+  },
+  {
+    "step": 330,
+    "loss": 1.7927954196929932,
+    "diagonal": 1.7657561302185059,
+    "finite": 0.027039285749197006
+  },
+  {
+    "step": 331,
+    "loss": 1.879345178604126,
+    "diagonal": 1.8570542335510254,
+    "finite": 0.022290971130132675
+  },
+  {
+    "step": 332,
+    "loss": 1.7886712551116943,
+    "diagonal": 1.758418083190918,
+    "finite": 0.0302532110363245
+  },
+  {
+    "step": 333,
+    "loss": 1.6257297992706299,
+    "diagonal": 1.5986994504928589,
+    "finite": 0.027030354365706444
+  },
+  {
+    "step": 334,
+    "loss": 1.6718615293502808,
+    "diagonal": 1.6352946758270264,
+    "finite": 0.036566827446222305
+  },
+  {
+    "step": 335,
+    "loss": 1.9163155555725098,
+    "diagonal": 1.8800626993179321,
+    "finite": 0.03625291585922241
+  },
+  {
+    "step": 336,
+    "loss": 2.013146162033081,
+    "diagonal": 1.9844328165054321,
+    "finite": 0.02871345542371273
+  },
+  {
+    "step": 337,
+    "loss": 1.9184991121292114,
+    "diagonal": 1.8893691301345825,
+    "finite": 0.029129981994628906
+  },
+  {
+    "step": 338,
+    "loss": 1.7268346548080444,
+    "diagonal": 1.7015750408172607,
+    "finite": 0.025259610265493393
+  },
+  {
+    "step": 339,
+    "loss": 1.666633129119873,
+    "diagonal": 1.6390658617019653,
+    "finite": 0.027567220851778984
+  },
+  {
+    "step": 340,
+    "loss": 1.9236456155776978,
+    "diagonal": 1.8965709209442139,
+    "finite": 0.027074677869677544
+  },
+  {
+    "step": 341,
+    "loss": 1.5050039291381836,
+    "diagonal": 1.4743871688842773,
+    "finite": 0.030616816133260727
+  },
+  {
+    "step": 342,
+    "loss": 1.9077388048171997,
+    "diagonal": 1.8926113843917847,
+    "finite": 0.015127448365092278
+  },
+  {
+    "step": 343,
+    "loss": 1.630030870437622,
+    "diagonal": 1.5972713232040405,
+    "finite": 0.032759569585323334
+  },
+  {
+    "step": 344,
+    "loss": 1.5799787044525146,
+    "diagonal": 1.5565741062164307,
+    "finite": 0.02340463362634182
+  },
+  {
+    "step": 345,
+    "loss": 2.2474920749664307,
+    "diagonal": 2.2247891426086426,
+    "finite": 0.022703006863594055
+  },
+  {
+    "step": 346,
+    "loss": 2.00061297416687,
+    "diagonal": 1.9691717624664307,
+    "finite": 0.03144119307398796
+  },
+  {
+    "step": 347,
+    "loss": 1.6077390909194946,
+    "diagonal": 1.5820380449295044,
+    "finite": 0.02570107951760292
+  },
+  {
+    "step": 348,
+    "loss": 2.0926222801208496,
+    "diagonal": 2.065934181213379,
+    "finite": 0.026688024401664734
+  },
+  {
+    "step": 349,
+    "loss": 1.7756085395812988,
+    "diagonal": 1.7474286556243896,
+    "finite": 0.028179902583360672
+  },
+  {
+    "step": 350,
+    "loss": 2.3619959354400635,
+    "diagonal": 2.347045660018921,
+    "finite": 0.014950281009078026
+  },
+  {
+    "step": 351,
+    "loss": 1.4942024946212769,
+    "diagonal": 1.4723730087280273,
+    "finite": 0.02182946167886257
+  },
+  {
+    "step": 352,
+    "loss": 2.5016562938690186,
+    "diagonal": 2.4856410026550293,
+    "finite": 0.01601537875831127
+  },
+  {
+    "step": 353,
+    "loss": 1.7269998788833618,
+    "diagonal": 1.7117674350738525,
+    "finite": 0.015232405625283718
+  },
+  {
+    "step": 354,
+    "loss": 2.2018239498138428,
+    "diagonal": 2.1883347034454346,
+    "finite": 0.01348913460969925
+  },
+  {
+    "step": 355,
+    "loss": 2.1073122024536133,
+    "diagonal": 2.0987441539764404,
+    "finite": 0.008567990735173225
+  },
+  {
+    "step": 356,
+    "loss": 2.0898971557617188,
+    "diagonal": 2.0775012969970703,
+    "finite": 0.012395824305713177
+  },
+  {
+    "step": 357,
+    "loss": 1.8917887210845947,
+    "diagonal": 1.8852639198303223,
+    "finite": 0.006524786818772554
+  },
+  {
+    "step": 358,
+    "loss": 2.3465416431427,
+    "diagonal": 2.336360454559326,
+    "finite": 0.010181175544857979
+  },
+  {
+    "step": 359,
+    "loss": 2.088637113571167,
+    "diagonal": 2.079961061477661,
+    "finite": 0.008676045574247837
+  },
+  {
+    "step": 360,
+    "loss": 1.3698760271072388,
+    "diagonal": 1.3611383438110352,
+    "finite": 0.008737646974623203
+  },
+  {
+    "step": 361,
+    "loss": 2.1454405784606934,
+    "diagonal": 2.137662887573242,
+    "finite": 0.007777648977935314
+  },
+  {
+    "step": 362,
+    "loss": 1.9260913133621216,
+    "diagonal": 1.9183531999588013,
+    "finite": 0.007738153450191021
+  },
+  {
+    "step": 363,
+    "loss": 1.8385021686553955,
+    "diagonal": 1.8240501880645752,
+    "finite": 0.014451945200562477
+  },
+  {
+    "step": 364,
+    "loss": 1.7952848672866821,
+    "diagonal": 1.7853150367736816,
+    "finite": 0.009969867765903473
+  },
+  {
+    "step": 365,
+    "loss": 1.4760568141937256,
+    "diagonal": 1.466833472251892,
+    "finite": 0.009223326109349728
+  },
+  {
+    "step": 366,
+    "loss": 1.7250452041625977,
+    "diagonal": 1.716025471687317,
+    "finite": 0.009019733406603336
+  },
+  {
+    "step": 367,
+    "loss": 1.770246148109436,
+    "diagonal": 1.7602287530899048,
+    "finite": 0.010017422959208488
+  },
+  {
+    "step": 368,
+    "loss": 1.7885668277740479,
+    "diagonal": 1.7795456647872925,
+    "finite": 0.009021175093948841
+  },
+  {
+    "step": 369,
+    "loss": 1.7253466844558716,
+    "diagonal": 1.713741421699524,
+    "finite": 0.011605272069573402
+  },
+  {
+    "step": 370,
+    "loss": 1.8780698776245117,
+    "diagonal": 1.8654499053955078,
+    "finite": 0.012619927525520325
+  },
+  {
+    "step": 371,
+    "loss": 1.6627390384674072,
+    "diagonal": 1.6514348983764648,
+    "finite": 0.011304178275167942
+  },
+  {
+    "step": 372,
+    "loss": 1.3543939590454102,
+    "diagonal": 1.3384294509887695,
+    "finite": 0.015964463353157043
+  },
+  {
+    "step": 373,
+    "loss": 1.5771633386611938,
+    "diagonal": 1.5625824928283691,
+    "finite": 0.014580883085727692
+  },
+  {
+    "step": 374,
+    "loss": 1.4662600755691528,
+    "diagonal": 1.4455749988555908,
+    "finite": 0.020685063675045967
+  },
+  {
+    "step": 375,
+    "loss": 1.6633213758468628,
+    "diagonal": 1.6427630186080933,
+    "finite": 0.02055835723876953
+  },
+  {
+    "step": 376,
+    "loss": 2.079577922821045,
+    "diagonal": 2.061753034591675,
+    "finite": 0.01782488077878952
+  },
+  {
+    "step": 377,
+    "loss": 1.9897124767303467,
+    "diagonal": 1.9674385786056519,
+    "finite": 0.02227390930056572
+  },
+  {
+    "step": 378,
+    "loss": 1.5603539943695068,
+    "diagonal": 1.5392773151397705,
+    "finite": 0.02107665315270424
+  },
+  {
+    "step": 379,
+    "loss": 2.014587163925171,
+    "diagonal": 1.9917469024658203,
+    "finite": 0.022840339690446854
+  },
+  {
+    "step": 380,
+    "loss": 1.7777585983276367,
+    "diagonal": 1.7575045824050903,
+    "finite": 0.020253997296094894
+  },
+  {
+    "step": 381,
+    "loss": 1.7587379217147827,
+    "diagonal": 1.7333403825759888,
+    "finite": 0.025397520512342453
+  },
+  {
+    "step": 382,
+    "loss": 1.5109093189239502,
+    "diagonal": 1.4863896369934082,
+    "finite": 0.024519655853509903
+  },
+  {
+    "step": 383,
+    "loss": 1.6548292636871338,
+    "diagonal": 1.6306689977645874,
+    "finite": 0.024160314351320267
+  },
+  {
+    "step": 384,
+    "loss": 1.3850369453430176,
+    "diagonal": 1.3651071786880493,
+    "finite": 0.01992972195148468
+  },
+  {
+    "step": 385,
+    "loss": 2.0595767498016357,
+    "diagonal": 2.03635835647583,
+    "finite": 0.023218391463160515
+  },
+  {
+    "step": 386,
+    "loss": 2.0172927379608154,
+    "diagonal": 2.001457452774048,
+    "finite": 0.015835218131542206
+  },
+  {
+    "step": 387,
+    "loss": 1.6215540170669556,
+    "diagonal": 1.605270266532898,
+    "finite": 0.016283780336380005
+  },
+  {
+    "step": 388,
+    "loss": 1.9802972078323364,
+    "diagonal": 1.9609620571136475,
+    "finite": 0.019335193559527397
+  },
+  {
+    "step": 389,
+    "loss": 1.9518041610717773,
+    "diagonal": 1.924487829208374,
+    "finite": 0.027316303923726082
+  },
+  {
+    "step": 390,
+    "loss": 1.8146222829818726,
+    "diagonal": 1.793002963066101,
+    "finite": 0.021619286388158798
+  },
+  {
+    "step": 391,
+    "loss": 1.4565643072128296,
+    "diagonal": 1.4376680850982666,
+    "finite": 0.018896201625466347
+  },
+  {
+    "step": 392,
+    "loss": 1.8595579862594604,
+    "diagonal": 1.839372158050537,
+    "finite": 0.020185792818665504
+  },
+  {
+    "step": 393,
+    "loss": 2.0853376388549805,
+    "diagonal": 2.0691373348236084,
+    "finite": 0.01620025932788849
+  },
+  {
+    "step": 394,
+    "loss": 2.4211018085479736,
+    "diagonal": 2.398886203765869,
+    "finite": 0.02221549302339554
+  },
+  {
+    "step": 395,
+    "loss": 1.7628061771392822,
+    "diagonal": 1.7444310188293457,
+    "finite": 0.018375111743807793
+  },
+  {
+    "step": 396,
+    "loss": 1.811918020248413,
+    "diagonal": 1.796628713607788,
+    "finite": 0.015289254486560822
+  },
+  {
+    "step": 397,
+    "loss": 1.5841381549835205,
+    "diagonal": 1.5713849067687988,
+    "finite": 0.01275329478085041
+  },
+  {
+    "step": 398,
+    "loss": 1.706868052482605,
+    "diagonal": 1.6885963678359985,
+    "finite": 0.01827165111899376
+  },
+  {
+    "step": 399,
+    "loss": 1.6498562097549438,
+    "diagonal": 1.6360052824020386,
+    "finite": 0.013850885443389416
+  },
+  {
+    "step": 400,
+    "loss": 2.0032942295074463,
+    "diagonal": 1.9898861646652222,
+    "finite": 0.013408025726675987
+  },
+  {
+    "step": 401,
+    "loss": 1.6432347297668457,
+    "diagonal": 1.6288270950317383,
+    "finite": 0.014407583512365818
+  },
+  {
+    "step": 402,
+    "loss": 2.689664125442505,
+    "diagonal": 2.6762382984161377,
+    "finite": 0.013425740413367748
+  },
+  {
+    "step": 403,
+    "loss": 2.0090372562408447,
+    "diagonal": 1.9949887990951538,
+    "finite": 0.01404853630810976
+  },
+  {
+    "step": 404,
+    "loss": 1.6102319955825806,
+    "diagonal": 1.5975435972213745,
+    "finite": 0.0126884113997221
+  },
+  {
+    "step": 405,
+    "loss": 2.0218496322631836,
+    "diagonal": 2.0081863403320312,
+    "finite": 0.013663189485669136
+  },
+  {
+    "step": 406,
+    "loss": 1.9332354068756104,
+    "diagonal": 1.9176825284957886,
+    "finite": 0.015552891418337822
+  },
+  {
+    "step": 407,
+    "loss": 2.359863042831421,
+    "diagonal": 2.3448760509490967,
+    "finite": 0.014987049624323845
+  },
+  {
+    "step": 408,
+    "loss": 1.417462944984436,
+    "diagonal": 1.4066506624221802,
+    "finite": 0.010812317952513695
+  },
+  {
+    "step": 409,
+    "loss": 1.8806287050247192,
+    "diagonal": 1.86482834815979,
+    "finite": 0.015800345689058304
+  },
+  {
+    "step": 410,
+    "loss": 1.9515138864517212,
+    "diagonal": 1.9407603740692139,
+    "finite": 0.01075354777276516
+  },
+  {
+    "step": 411,
+    "loss": 1.3720762729644775,
+    "diagonal": 1.3580541610717773,
+    "finite": 0.014022169634699821
+  },
+  {
+    "step": 412,
+    "loss": 1.7042838335037231,
+    "diagonal": 1.6917182207107544,
+    "finite": 0.012565605342388153
+  },
+  {
+    "step": 413,
+    "loss": 1.6423488855361938,
+    "diagonal": 1.6266065835952759,
+    "finite": 0.015742257237434387
+  },
+  {
+    "step": 414,
+    "loss": 1.863547921180725,
+    "diagonal": 1.8517036437988281,
+    "finite": 0.011844250373542309
+  },
+  {
+    "step": 415,
+    "loss": 1.9553471803665161,
+    "diagonal": 1.939273476600647,
+    "finite": 0.01607367768883705
+  },
+  {
+    "step": 416,
+    "loss": 1.3925600051879883,
+    "diagonal": 1.37058424949646,
+    "finite": 0.021975701674818993
+  },
+  {
+    "step": 417,
+    "loss": 1.7455933094024658,
+    "diagonal": 1.7295262813568115,
+    "finite": 0.016066987067461014
+  },
+  {
+    "step": 418,
+    "loss": 1.8469963073730469,
+    "diagonal": 1.8309684991836548,
+    "finite": 0.016027765348553658
+  },
+  {
+    "step": 419,
+    "loss": 1.4337815046310425,
+    "diagonal": 1.4203014373779297,
+    "finite": 0.013480061665177345
+  },
+  {
+    "step": 420,
+    "loss": 1.8237301111221313,
+    "diagonal": 1.803928256034851,
+    "finite": 0.019801853224635124
+  },
+  {
+    "step": 421,
+    "loss": 1.9891539812088013,
+    "diagonal": 1.9747052192687988,
+    "finite": 0.014448723755776882
+  },
+  {
+    "step": 422,
+    "loss": 1.3700501918792725,
+    "diagonal": 1.353859782218933,
+    "finite": 0.01619040220975876
+  },
+  {
+    "step": 423,
+    "loss": 1.8715592622756958,
+    "diagonal": 1.8571643829345703,
+    "finite": 0.014394833706319332
+  },
+  {
+    "step": 424,
+    "loss": 1.9183491468429565,
+    "diagonal": 1.9062989950180054,
+    "finite": 0.012050099670886993
+  },
+  {
+    "step": 425,
+    "loss": 1.8856592178344727,
+    "diagonal": 1.8643925189971924,
+    "finite": 0.02126671001315117
+  },
+  {
+    "step": 426,
+    "loss": 1.669751763343811,
+    "diagonal": 1.648770809173584,
+    "finite": 0.020980937406420708
+  },
+  {
+    "step": 427,
+    "loss": 1.5149682760238647,
+    "diagonal": 1.5011776685714722,
+    "finite": 0.013790549710392952
+  },
+  {
+    "step": 428,
+    "loss": 1.607776165008545,
+    "diagonal": 1.586631417274475,
+    "finite": 0.021144773811101913
+  },
+  {
+    "step": 429,
+    "loss": 1.9960016012191772,
+    "diagonal": 1.982361912727356,
+    "finite": 0.013639742508530617
+  },
+  {
+    "step": 430,
+    "loss": 2.056750535964966,
+    "diagonal": 2.0429654121398926,
+    "finite": 0.013785144314169884
+  },
+  {
+    "step": 431,
+    "loss": 1.787246823310852,
+    "diagonal": 1.761165738105774,
+    "finite": 0.02608112245798111
+  },
+  {
+    "step": 432,
+    "loss": 1.8680545091629028,
+    "diagonal": 1.8543812036514282,
+    "finite": 0.013673307374119759
+  },
+  {
+    "step": 433,
+    "loss": 1.977349042892456,
+    "diagonal": 1.9586948156356812,
+    "finite": 0.018654190003871918
+  },
+  {
+    "step": 434,
+    "loss": 1.884043574333191,
+    "diagonal": 1.8676608800888062,
+    "finite": 0.016382649540901184
+  },
+  {
+    "step": 435,
+    "loss": 1.816213607788086,
+    "diagonal": 1.7971287965774536,
+    "finite": 0.01908479444682598
+  },
+  {
+    "step": 436,
+    "loss": 1.5485708713531494,
+    "diagonal": 1.530983328819275,
+    "finite": 0.017587585374712944
+  },
+  {
+    "step": 437,
+    "loss": 2.221130847930908,
+    "diagonal": 2.205498456954956,
+    "finite": 0.015632357448339462
+  },
+  {
+    "step": 438,
+    "loss": 1.793428659439087,
+    "diagonal": 1.7727664709091187,
+    "finite": 0.02066216617822647
+  },
+  {
+    "step": 439,
+    "loss": 1.5013816356658936,
+    "diagonal": 1.4816796779632568,
+    "finite": 0.01970195770263672
+  },
+  {
+    "step": 440,
+    "loss": 1.65483820438385,
+    "diagonal": 1.6298526525497437,
+    "finite": 0.02498551458120346
+  },
+  {
+    "step": 441,
+    "loss": 1.662293791770935,
+    "diagonal": 1.6418797969818115,
+    "finite": 0.020413963124155998
+  },
+  {
+    "step": 442,
+    "loss": 1.5198974609375,
+    "diagonal": 1.505827784538269,
+    "finite": 0.014069723896682262
+  },
+  {
+    "step": 443,
+    "loss": 1.4982551336288452,
+    "diagonal": 1.4852629899978638,
+    "finite": 0.0129921343177557
+  },
+  {
+    "step": 444,
+    "loss": 1.6090474128723145,
+    "diagonal": 1.5945565700531006,
+    "finite": 0.01449085958302021
+  },
+  {
+    "step": 445,
+    "loss": 1.9210293292999268,
+    "diagonal": 1.9062777757644653,
+    "finite": 0.014751567505300045
+  },
+  {
+    "step": 446,
+    "loss": 1.559322714805603,
+    "diagonal": 1.5449278354644775,
+    "finite": 0.014394853264093399
+  },
+  {
+    "step": 447,
+    "loss": 1.603129267692566,
+    "diagonal": 1.5841972827911377,
+    "finite": 0.018931973725557327
+  },
+  {
+    "step": 448,
+    "loss": 2.166700839996338,
+    "diagonal": 2.152177095413208,
+    "finite": 0.014523759484291077
+  },
+  {
+    "step": 449,
+    "loss": 1.9977422952651978,
+    "diagonal": 1.979684591293335,
+    "finite": 0.018057746812701225
+  },
+  {
+    "step": 450,
+    "loss": 2.1294684410095215,
+    "diagonal": 2.1126413345336914,
+    "finite": 0.0168270505964756
+  },
+  {
+    "step": 451,
+    "loss": 2.0014240741729736,
+    "diagonal": 1.9862418174743652,
+    "finite": 0.015182207338511944
+  },
+  {
+    "step": 452,
+    "loss": 1.8143056631088257,
+    "diagonal": 1.7999379634857178,
+    "finite": 0.014367684721946716
+  },
+  {
+    "step": 453,
+    "loss": 1.8474098443984985,
+    "diagonal": 1.837052822113037,
+    "finite": 0.010356989689171314
+  },
+  {
+    "step": 454,
+    "loss": 2.1326637268066406,
+    "diagonal": 2.120084524154663,
+    "finite": 0.012579116970300674
+  },
+  {
+    "step": 455,
+    "loss": 1.8975690603256226,
+    "diagonal": 1.8882743120193481,
+    "finite": 0.009294692426919937
+  },
+  {
+    "step": 456,
+    "loss": 1.8145760297775269,
+    "diagonal": 1.8021399974822998,
+    "finite": 0.012436013668775558
+  },
+  {
+    "step": 457,
+    "loss": 1.8537362813949585,
+    "diagonal": 1.8436611890792847,
+    "finite": 0.010075142607092857
+  },
+  {
+    "step": 458,
+    "loss": 1.7638099193572998,
+    "diagonal": 1.7485188245773315,
+    "finite": 0.015291087329387665
+  },
+  {
+    "step": 459,
+    "loss": 1.5446655750274658,
+    "diagonal": 1.531954288482666,
+    "finite": 0.012711303308606148
+  },
+  {
+    "step": 460,
+    "loss": 1.4927403926849365,
+    "diagonal": 1.4810981750488281,
+    "finite": 0.011642210185527802
+  },
+  {
+    "step": 461,
+    "loss": 2.1057984828948975,
+    "diagonal": 2.09745454788208,
+    "finite": 0.008343898691236973
+  },
+  {
+    "step": 462,
+    "loss": 1.5220681428909302,
+    "diagonal": 1.5078799724578857,
+    "finite": 0.01418820396065712
+  },
+  {
+    "step": 463,
+    "loss": 1.6919630765914917,
+    "diagonal": 1.673121452331543,
+    "finite": 0.01884157583117485
+  },
+  {
+    "step": 464,
+    "loss": 1.5150575637817383,
+    "diagonal": 1.5037696361541748,
+    "finite": 0.011287896893918514
+  },
+  {
+    "step": 465,
+    "loss": 1.5454072952270508,
+    "diagonal": 1.5291612148284912,
+    "finite": 0.01624603569507599
+  },
+  {
+    "step": 466,
+    "loss": 2.1819472312927246,
+    "diagonal": 2.151939630508423,
+    "finite": 0.030007652938365936
+  },
+  {
+    "step": 467,
+    "loss": 2.053743600845337,
+    "diagonal": 2.0282905101776123,
+    "finite": 0.0254531130194664
+  },
+  {
+    "step": 468,
+    "loss": 1.5603269338607788,
+    "diagonal": 1.5382195711135864,
+    "finite": 0.022107325494289398
+  },
+  {
+    "step": 469,
+    "loss": 2.127823829650879,
+    "diagonal": 2.0983474254608154,
+    "finite": 0.02947636879980564
+  },
+  {
+    "step": 470,
+    "loss": 2.2036783695220947,
+    "diagonal": 2.182344675064087,
+    "finite": 0.0213335994631052
+  },
+  {
+    "step": 471,
+    "loss": 1.8247839212417603,
+    "diagonal": 1.805643916130066,
+    "finite": 0.019140057265758514
+  },
+  {
+    "step": 472,
+    "loss": 1.8318018913269043,
+    "diagonal": 1.811866283416748,
+    "finite": 0.019935596734285355
+  },
+  {
+    "step": 473,
+    "loss": 1.4445381164550781,
+    "diagonal": 1.4232046604156494,
+    "finite": 0.0213334821164608
+  },
+  {
+    "step": 474,
+    "loss": 1.7002651691436768,
+    "diagonal": 1.6800999641418457,
+    "finite": 0.020165201276540756
+  },
+  {
+    "step": 475,
+    "loss": 1.9954302310943604,
+    "diagonal": 1.9830092191696167,
+    "finite": 0.01242106780409813
+  },
+  {
+    "step": 476,
+    "loss": 1.9752812385559082,
+    "diagonal": 1.9566750526428223,
+    "finite": 0.018606217578053474
+  },
+  {
+    "step": 477,
+    "loss": 1.5448335409164429,
+    "diagonal": 1.5282632112503052,
+    "finite": 0.016570299863815308
+  },
+  {
+    "step": 478,
+    "loss": 1.9725176095962524,
+    "diagonal": 1.9598007202148438,
+    "finite": 0.012716947123408318
+  },
+  {
+    "step": 479,
+    "loss": 1.1738502979278564,
+    "diagonal": 1.1574759483337402,
+    "finite": 0.016374362632632256
+  },
+  {
+    "step": 480,
+    "loss": 1.5067782402038574,
+    "diagonal": 1.489158034324646,
+    "finite": 0.017620207741856575
+  },
+  {
+    "step": 481,
+    "loss": 2.05694317817688,
+    "diagonal": 2.039289951324463,
+    "finite": 0.017653323709964752
+  },
+  {
+    "step": 482,
+    "loss": 1.8935433626174927,
+    "diagonal": 1.8816804885864258,
+    "finite": 0.01186290942132473
+  },
+  {
+    "step": 483,
+    "loss": 1.403369665145874,
+    "diagonal": 1.3928238153457642,
+    "finite": 0.010545840486884117
+  },
+  {
+    "step": 484,
+    "loss": 2.246873617172241,
+    "diagonal": 2.2301621437072754,
+    "finite": 0.016711415722966194
+  },
+  {
+    "step": 485,
+    "loss": 1.5093344449996948,
+    "diagonal": 1.495011806488037,
+    "finite": 0.014322593808174133
+  },
+  {
+    "step": 486,
+    "loss": 1.230455994606018,
+    "diagonal": 1.2151292562484741,
+    "finite": 0.015326743014156818
+  },
+  {
+    "step": 487,
+    "loss": 1.3265920877456665,
+    "diagonal": 1.3133999109268188,
+    "finite": 0.013192164711654186
+  },
+  {
+    "step": 488,
+    "loss": 1.7124079465866089,
+    "diagonal": 1.7001053094863892,
+    "finite": 0.012302660383284092
+  },
+  {
+    "step": 489,
+    "loss": 2.1030404567718506,
+    "diagonal": 2.0906784534454346,
+    "finite": 0.01236205268651247
+  },
+  {
+    "step": 490,
+    "loss": 1.0191351175308228,
+    "diagonal": 0.992995023727417,
+    "finite": 0.026140131056308746
+  },
+  {
+    "step": 491,
+    "loss": 1.5242522954940796,
+    "diagonal": 1.5084937810897827,
+    "finite": 0.015758536756038666
+  },
+  {
+    "step": 492,
+    "loss": 2.115725040435791,
+    "diagonal": 2.097158193588257,
+    "finite": 0.018566958606243134
+  },
+  {
+    "step": 493,
+    "loss": 1.9334840774536133,
+    "diagonal": 1.91002357006073,
+    "finite": 0.02346045710146427
+  },
+  {
+    "step": 494,
+    "loss": 2.225687265396118,
+    "diagonal": 2.209308385848999,
+    "finite": 0.016378900036215782
+  },
+  {
+    "step": 495,
+    "loss": 1.3670870065689087,
+    "diagonal": 1.3452692031860352,
+    "finite": 0.02181779034435749
+  },
+  {
+    "step": 496,
+    "loss": 2.0034217834472656,
+    "diagonal": 1.9745787382125854,
+    "finite": 0.028842942789196968
+  },
+  {
+    "step": 497,
+    "loss": 1.9037024974822998,
+    "diagonal": 1.879516839981079,
+    "finite": 0.024185672402381897
+  },
+  {
+    "step": 498,
+    "loss": 2.323575973510742,
+    "diagonal": 2.3015434741973877,
+    "finite": 0.02203238382935524
+  },
+  {
+    "step": 499,
+    "loss": 1.7099398374557495,
+    "diagonal": 1.6920056343078613,
+    "finite": 0.01793418824672699
+  },
+  {
+    "step": 500,
+    "loss": 2.095097303390503,
+    "diagonal": 2.074070692062378,
+    "finite": 0.021026672795414925
+  },
+  {
+    "step": 501,
+    "loss": 1.957358479499817,
+    "diagonal": 1.9356234073638916,
+    "finite": 0.021735064685344696
+  },
+  {
+    "step": 502,
+    "loss": 1.4968270063400269,
+    "diagonal": 1.4762015342712402,
+    "finite": 0.020625421777367592
+  },
+  {
+    "step": 503,
+    "loss": 1.799890398979187,
+    "diagonal": 1.778486967086792,
+    "finite": 0.021403439342975616
+  },
+  {
+    "step": 504,
+    "loss": 1.7615611553192139,
+    "diagonal": 1.7360879182815552,
+    "finite": 0.02547324262559414
+  },
+  {
+    "step": 505,
+    "loss": 1.6194267272949219,
+    "diagonal": 1.5960382223129272,
+    "finite": 0.02338854968547821
+  },
+  {
+    "step": 506,
+    "loss": 1.5941871404647827,
+    "diagonal": 1.5803697109222412,
+    "finite": 0.01381740067154169
+  },
+  {
+    "step": 507,
+    "loss": 1.720986247062683,
+    "diagonal": 1.7061362266540527,
+    "finite": 0.014850071631371975
+  },
+  {
+    "step": 508,
+    "loss": 1.593841791152954,
+    "diagonal": 1.5797927379608154,
+    "finite": 0.014049028977751732
+  },
+  {
+    "step": 509,
+    "loss": 1.3445993661880493,
+    "diagonal": 1.3295609951019287,
+    "finite": 0.015038391575217247
+  },
+  {
+    "step": 510,
+    "loss": 1.6506743431091309,
+    "diagonal": 1.6365426778793335,
+    "finite": 0.014131716452538967
+  },
+  {
+    "step": 511,
+    "loss": 1.500842809677124,
+    "diagonal": 1.4881569147109985,
+    "finite": 0.01268593966960907
+  },
+  {
+    "step": 512,
+    "loss": 1.7241441011428833,
+    "diagonal": 1.7055869102478027,
+    "finite": 0.01855718530714512
+  },
+  {
+    "step": 513,
+    "loss": 1.9967095851898193,
+    "diagonal": 1.971882939338684,
+    "finite": 0.024826636537909508
+  },
+  {
+    "step": 514,
+    "loss": 1.7286763191223145,
+    "diagonal": 1.70869779586792,
+    "finite": 0.019978532567620277
+  },
+  {
+    "step": 515,
+    "loss": 2.0738234519958496,
+    "diagonal": 2.0601518154144287,
+    "finite": 0.013671716675162315
+  },
+  {
+    "step": 516,
+    "loss": 1.4203397035598755,
+    "diagonal": 1.401994228363037,
+    "finite": 0.018345480784773827
+  },
+  {
+    "step": 517,
+    "loss": 1.7923591136932373,
+    "diagonal": 1.7760982513427734,
+    "finite": 0.016260916367173195
+  },
+  {
+    "step": 518,
+    "loss": 2.2127485275268555,
+    "diagonal": 2.196828842163086,
+    "finite": 0.015919754281640053
+  },
+  {
+    "step": 519,
+    "loss": 1.6443023681640625,
+    "diagonal": 1.6257379055023193,
+    "finite": 0.018564442172646523
+  },
+  {
+    "step": 520,
+    "loss": 1.171451210975647,
+    "diagonal": 1.1565269231796265,
+    "finite": 0.01492434460669756
+  },
+  {
+    "step": 521,
+    "loss": 1.469709873199463,
+    "diagonal": 1.4497251510620117,
+    "finite": 0.019984737038612366
+  },
+  {
+    "step": 522,
+    "loss": 1.9344722032546997,
+    "diagonal": 1.9173105955123901,
+    "finite": 0.017161626368761063
+  },
+  {
+    "step": 523,
+    "loss": 1.6279139518737793,
+    "diagonal": 1.6093811988830566,
+    "finite": 0.018532734364271164
+  },
+  {
+    "step": 524,
+    "loss": 1.6532938480377197,
+    "diagonal": 1.6285706758499146,
+    "finite": 0.02472321316599846
+  },
+  {
+    "step": 525,
+    "loss": 2.1386289596557617,
+    "diagonal": 2.121095657348633,
+    "finite": 0.01753319799900055
+  },
+  {
+    "step": 526,
+    "loss": 1.7188880443572998,
+    "diagonal": 1.6996582746505737,
+    "finite": 0.01922973431646824
+  },
+  {
+    "step": 527,
+    "loss": 1.3939313888549805,
+    "diagonal": 1.3702068328857422,
+    "finite": 0.02372453361749649
+  },
+  {
+    "step": 528,
+    "loss": 1.403851866722107,
+    "diagonal": 1.3837542533874512,
+    "finite": 0.02009756676852703
+  },
+  {
+    "step": 529,
+    "loss": 1.6750448942184448,
+    "diagonal": 1.6570019721984863,
+    "finite": 0.01804291270673275
+  },
+  {
+    "step": 530,
+    "loss": 1.7021297216415405,
+    "diagonal": 1.676210880279541,
+    "finite": 0.025918789207935333
+  },
+  {
+    "step": 531,
+    "loss": 2.1226866245269775,
+    "diagonal": 2.105229616165161,
+    "finite": 0.017457107082009315
+  },
+  {
+    "step": 532,
+    "loss": 1.7441374063491821,
+    "diagonal": 1.7242201566696167,
+    "finite": 0.01991729624569416
+  },
+  {
+    "step": 533,
+    "loss": 1.9990456104278564,
+    "diagonal": 1.9772827625274658,
+    "finite": 0.02176283299922943
+  },
+  {
+    "step": 534,
+    "loss": 1.433127760887146,
+    "diagonal": 1.4104359149932861,
+    "finite": 0.022691862657666206
+  },
+  {
+    "step": 535,
+    "loss": 2.0848283767700195,
+    "diagonal": 2.0574162006378174,
+    "finite": 0.027412110939621925
+  },
+  {
+    "step": 536,
+    "loss": 1.3028991222381592,
+    "diagonal": 1.2704604864120483,
+    "finite": 0.032438598573207855
+  },
+  {
+    "step": 537,
+    "loss": 1.7127420902252197,
+    "diagonal": 1.6792573928833008,
+    "finite": 0.033484719693660736
+  },
+  {
+    "step": 538,
+    "loss": 1.5287904739379883,
+    "diagonal": 1.4978121519088745,
+    "finite": 0.030978357419371605
+  },
+  {
+    "step": 539,
+    "loss": 1.6798433065414429,
+    "diagonal": 1.6612204313278198,
+    "finite": 0.01862289011478424
+  },
+  {
+    "step": 540,
+    "loss": 2.0607175827026367,
+    "diagonal": 2.0314440727233887,
+    "finite": 0.029273517429828644
+  },
+  {
+    "step": 541,
+    "loss": 2.128462791442871,
+    "diagonal": 2.099897861480713,
+    "finite": 0.028564883396029472
+  },
+  {
+    "step": 542,
+    "loss": 2.0811619758605957,
+    "diagonal": 2.0568318367004395,
+    "finite": 0.024330254644155502
+  },
+  {
+    "step": 543,
+    "loss": 1.7809652090072632,
+    "diagonal": 1.7644157409667969,
+    "finite": 0.016549425199627876
+  },
+  {
+    "step": 544,
+    "loss": 1.7767752408981323,
+    "diagonal": 1.760884165763855,
+    "finite": 0.015891123563051224
+  },
+  {
+    "step": 545,
+    "loss": 1.6477649211883545,
+    "diagonal": 1.6334458589553833,
+    "finite": 0.014319032430648804
+  },
+  {
+    "step": 546,
+    "loss": 1.4311891794204712,
+    "diagonal": 1.4173810482025146,
+    "finite": 0.0138081144541502
+  },
+  {
+    "step": 547,
+    "loss": 1.7002609968185425,
+    "diagonal": 1.673227310180664,
+    "finite": 0.027033744379878044
+  },
+  {
+    "step": 548,
+    "loss": 1.6228816509246826,
+    "diagonal": 1.6081935167312622,
+    "finite": 0.014688074588775635
+  },
+  {
+    "step": 549,
+    "loss": 1.9971297979354858,
+    "diagonal": 1.9859399795532227,
+    "finite": 0.011189790442585945
+  },
+  {
+    "step": 550,
+    "loss": 1.8285943269729614,
+    "diagonal": 1.8141512870788574,
+    "finite": 0.014443038031458855
+  },
+  {
+    "step": 551,
+    "loss": 1.682633638381958,
+    "diagonal": 1.6608383655548096,
+    "finite": 0.021795302629470825
+  },
+  {
+    "step": 552,
+    "loss": 1.895094871520996,
+    "diagonal": 1.872936487197876,
+    "finite": 0.022158440202474594
+  },
+  {
+    "step": 553,
+    "loss": 1.598995566368103,
+    "diagonal": 1.5807478427886963,
+    "finite": 0.01824776642024517
+  },
+  {
+    "step": 554,
+    "loss": 1.9976996183395386,
+    "diagonal": 1.9786779880523682,
+    "finite": 0.019021589308977127
+  },
+  {
+    "step": 555,
+    "loss": 1.395838737487793,
+    "diagonal": 1.3709303140640259,
+    "finite": 0.02490844577550888
+  },
+  {
+    "step": 556,
+    "loss": 1.6511058807373047,
+    "diagonal": 1.6249489784240723,
+    "finite": 0.026156911626458168
+  },
+  {
+    "step": 557,
+    "loss": 1.7460544109344482,
+    "diagonal": 1.7222191095352173,
+    "finite": 0.023835353553295135
+  },
+  {
+    "step": 558,
+    "loss": 1.1998777389526367,
+    "diagonal": 1.175255298614502,
+    "finite": 0.024622485041618347
+  },
+  {
+    "step": 559,
+    "loss": 1.8036412000656128,
+    "diagonal": 1.7720835208892822,
+    "finite": 0.03155772387981415
+  },
+  {
+    "step": 560,
+    "loss": 1.5840057134628296,
+    "diagonal": 1.5653384923934937,
+    "finite": 0.018667196854948997
+  },
+  {
+    "step": 561,
+    "loss": 1.8915637731552124,
+    "diagonal": 1.8698996305465698,
+    "finite": 0.0216640867292881
+  },
+  {
+    "step": 562,
+    "loss": 1.7090859413146973,
+    "diagonal": 1.683383584022522,
+    "finite": 0.025702357292175293
+  },
+  {
+    "step": 563,
+    "loss": 1.6221354007720947,
+    "diagonal": 1.6000053882598877,
+    "finite": 0.02213001623749733
+  },
+  {
+    "step": 564,
+    "loss": 1.5923453569412231,
+    "diagonal": 1.5739109516143799,
+    "finite": 0.018434379249811172
+  },
+  {
+    "step": 565,
+    "loss": 1.4613304138183594,
+    "diagonal": 1.4434034824371338,
+    "finite": 0.017926905304193497
+  },
+  {
+    "step": 566,
+    "loss": 2.003774881362915,
+    "diagonal": 1.9862768650054932,
+    "finite": 0.017497975379228592
+  },
+  {
+    "step": 567,
+    "loss": 1.2287086248397827,
+    "diagonal": 1.2098199129104614,
+    "finite": 0.01888873428106308
+  },
+  {
+    "step": 568,
+    "loss": 1.3300011157989502,
+    "diagonal": 1.3141124248504639,
+    "finite": 0.015888636931777
+  },
+  {
+    "step": 569,
+    "loss": 1.6767566204071045,
+    "diagonal": 1.6584460735321045,
+    "finite": 0.0183105431497097
+  },
+  {
+    "step": 570,
+    "loss": 1.4190900325775146,
+    "diagonal": 1.400711178779602,
+    "finite": 0.01837879791855812
+  },
+  {
+    "step": 571,
+    "loss": 2.1975648403167725,
+    "diagonal": 2.1794092655181885,
+    "finite": 0.018155623227357864
+  },
+  {
+    "step": 572,
+    "loss": 1.252416729927063,
+    "diagonal": 1.2299555540084839,
+    "finite": 0.022461185231804848
+  },
+  {
+    "step": 573,
+    "loss": 1.556684136390686,
+    "diagonal": 1.535278558731079,
+    "finite": 0.02140558511018753
+  },
+  {
+    "step": 574,
+    "loss": 1.6997711658477783,
+    "diagonal": 1.6788424253463745,
+    "finite": 0.020928720012307167
+  },
+  {
+    "step": 575,
+    "loss": 1.5369614362716675,
+    "diagonal": 1.514854073524475,
+    "finite": 0.022107310593128204
+  },
+  {
+    "step": 576,
+    "loss": 1.6007269620895386,
+    "diagonal": 1.5866262912750244,
+    "finite": 0.014100688509643078
+  },
+  {
+    "step": 577,
+    "loss": 1.4927494525909424,
+    "diagonal": 1.4721801280975342,
+    "finite": 0.02056937851011753
+  },
+  {
+    "step": 578,
+    "loss": 1.6262141466140747,
+    "diagonal": 1.6060007810592651,
+    "finite": 0.020213356241583824
+  },
+  {
+    "step": 579,
+    "loss": 1.7328499555587769,
+    "diagonal": 1.7135165929794312,
+    "finite": 0.01933332532644272
+  },
+  {
+    "step": 580,
+    "loss": 1.8418960571289062,
+    "diagonal": 1.825735092163086,
+    "finite": 0.01616097241640091
+  },
+  {
+    "step": 581,
+    "loss": 1.8026535511016846,
+    "diagonal": 1.7877596616744995,
+    "finite": 0.014893939718604088
+  },
+  {
+    "step": 582,
+    "loss": 1.5902197360992432,
+    "diagonal": 1.5676171779632568,
+    "finite": 0.022602595388889313
+  },
+  {
+    "step": 583,
+    "loss": 1.367847204208374,
+    "diagonal": 1.3542951345443726,
+    "finite": 0.013552114367485046
+  },
+  {
+    "step": 584,
+    "loss": 1.8911718130111694,
+    "diagonal": 1.8713723421096802,
+    "finite": 0.01979946717619896
+  },
+  {
+    "step": 585,
+    "loss": 1.8736655712127686,
+    "diagonal": 1.8592112064361572,
+    "finite": 0.014454323798418045
+  },
+  {
+    "step": 586,
+    "loss": 1.3055660724639893,
+    "diagonal": 1.2895805835723877,
+    "finite": 0.015985481441020966
+  },
+  {
+    "step": 587,
+    "loss": 1.6686488389968872,
+    "diagonal": 1.6491832733154297,
+    "finite": 0.019465524703264236
+  },
+  {
+    "step": 588,
+    "loss": 1.640288233757019,
+    "diagonal": 1.6229679584503174,
+    "finite": 0.01732032746076584
+  },
+  {
+    "step": 589,
+    "loss": 1.347477674484253,
+    "diagonal": 1.3317677974700928,
+    "finite": 0.01570988819003105
+  },
+  {
+    "step": 590,
+    "loss": 1.4082273244857788,
+    "diagonal": 1.3904985189437866,
+    "finite": 0.017728831619024277
+  },
+  {
+    "step": 591,
+    "loss": 1.950211524963379,
+    "diagonal": 1.935402750968933,
+    "finite": 0.014808827079832554
+  },
+  {
+    "step": 592,
+    "loss": 2.094852924346924,
+    "diagonal": 2.070744514465332,
+    "finite": 0.02410842292010784
+  },
+  {
+    "step": 593,
+    "loss": 1.5177509784698486,
+    "diagonal": 1.4933834075927734,
+    "finite": 0.02436758019030094
+  },
+  {
+    "step": 594,
+    "loss": 1.632956862449646,
+    "diagonal": 1.6078298091888428,
+    "finite": 0.025127047672867775
+  },
+  {
+    "step": 595,
+    "loss": 2.0269649028778076,
+    "diagonal": 2.0066606998443604,
+    "finite": 0.0203042384237051
+  },
+  {
+    "step": 596,
+    "loss": 1.328771948814392,
+    "diagonal": 1.3091716766357422,
+    "finite": 0.019600315019488335
+  },
+  {
+    "step": 597,
+    "loss": 1.741045594215393,
+    "diagonal": 1.7165182828903198,
+    "finite": 0.024527262896299362
+  },
+  {
+    "step": 598,
+    "loss": 1.5015159845352173,
+    "diagonal": 1.4799965620040894,
+    "finite": 0.021519416943192482
+  },
+  {
+    "step": 599,
+    "loss": 1.6016119718551636,
+    "diagonal": 1.5839602947235107,
+    "finite": 0.017651719972491264
+  },
+  {
+    "step": 600,
+    "loss": 1.7161920070648193,
+    "diagonal": 1.6973872184753418,
+    "finite": 0.018804745748639107
+  },
+  {
+    "step": 601,
+    "loss": 1.6584581136703491,
+    "diagonal": 1.641369342803955,
+    "finite": 0.017088795080780983
+  },
+  {
+    "step": 602,
+    "loss": 1.3283895254135132,
+    "diagonal": 1.315561294555664,
+    "finite": 0.012828215956687927
+  },
+  {
+    "step": 603,
+    "loss": 1.9694849252700806,
+    "diagonal": 1.9492177963256836,
+    "finite": 0.02026718482375145
+  },
+  {
+    "step": 604,
+    "loss": 1.6945775747299194,
+    "diagonal": 1.6786845922470093,
+    "finite": 0.015893036499619484
+  },
+  {
+    "step": 605,
+    "loss": 1.4101736545562744,
+    "diagonal": 1.3940304517745972,
+    "finite": 0.016143159940838814
+  },
+  {
+    "step": 606,
+    "loss": 1.7889999151229858,
+    "diagonal": 1.7701143026351929,
+    "finite": 0.0188856590539217
+  },
+  {
+    "step": 607,
+    "loss": 1.6721028089523315,
+    "diagonal": 1.6553828716278076,
+    "finite": 0.01671995408833027
+  },
+  {
+    "step": 608,
+    "loss": 1.4831364154815674,
+    "diagonal": 1.4701200723648071,
+    "finite": 0.013016367331147194
+  },
+  {
+    "step": 609,
+    "loss": 1.384550929069519,
+    "diagonal": 1.3668339252471924,
+    "finite": 0.017717061564326286
+  },
+  {
+    "step": 610,
+    "loss": 1.331800937652588,
+    "diagonal": 1.313710331916809,
+    "finite": 0.01809064857661724
+  },
+  {
+    "step": 611,
+    "loss": 1.3671590089797974,
+    "diagonal": 1.3497374057769775,
+    "finite": 0.017421608790755272
+  },
+  {
+    "step": 612,
+    "loss": 2.397193670272827,
+    "diagonal": 2.37906551361084,
+    "finite": 0.018128061667084694
+  },
+  {
+    "step": 613,
+    "loss": 1.8545583486557007,
+    "diagonal": 1.840965747833252,
+    "finite": 0.013592550531029701
+  },
+  {
+    "step": 614,
+    "loss": 1.2299293279647827,
+    "diagonal": 1.207130789756775,
+    "finite": 0.022798506543040276
+  },
+  {
+    "step": 615,
+    "loss": 1.7194840908050537,
+    "diagonal": 1.7001827955245972,
+    "finite": 0.019301244989037514
+  },
+  {
+    "step": 616,
+    "loss": 1.7302501201629639,
+    "diagonal": 1.7091994285583496,
+    "finite": 0.02105071023106575
+  },
+  {
+    "step": 617,
+    "loss": 1.5389894247055054,
+    "diagonal": 1.5178929567337036,
+    "finite": 0.021096497774124146
+  },
+  {
+    "step": 618,
+    "loss": 1.369721531867981,
+    "diagonal": 1.354630708694458,
+    "finite": 0.01509085763245821
+  },
+  {
+    "step": 619,
+    "loss": 1.8379098176956177,
+    "diagonal": 1.8158023357391357,
+    "finite": 0.022107470780611038
+  },
+  {
+    "step": 620,
+    "loss": 1.2485299110412598,
+    "diagonal": 1.2249294519424438,
+    "finite": 0.02360040508210659
+  },
+  {
+    "step": 621,
+    "loss": 1.7629358768463135,
+    "diagonal": 1.740328073501587,
+    "finite": 0.022607853636145592
+  },
+  {
+    "step": 622,
+    "loss": 1.502949833869934,
+    "diagonal": 1.4829130172729492,
+    "finite": 0.020036838948726654
+  },
+  {
+    "step": 623,
+    "loss": 1.8688254356384277,
+    "diagonal": 1.8510013818740845,
+    "finite": 0.01782401278614998
+  },
+  {
+    "step": 624,
+    "loss": 1.5154203176498413,
+    "diagonal": 1.4876995086669922,
+    "finite": 0.02772081084549427
+  },
+  {
+    "step": 625,
+    "loss": 1.5186598300933838,
+    "diagonal": 1.5027728080749512,
+    "finite": 0.015887008979916573
+  },
+  {
+    "step": 626,
+    "loss": 1.6995956897735596,
+    "diagonal": 1.6815683841705322,
+    "finite": 0.018027300015091896
+  },
+  {
+    "step": 627,
+    "loss": 1.5137889385223389,
+    "diagonal": 1.4918622970581055,
+    "finite": 0.02192658558487892
+  },
+  {
+    "step": 628,
+    "loss": 1.5024254322052002,
+    "diagonal": 1.4686211347579956,
+    "finite": 0.033804312348365784
+  },
+  {
+    "step": 629,
+    "loss": 1.6173992156982422,
+    "diagonal": 1.6053508520126343,
+    "finite": 0.012048340402543545
+  },
+  {
+    "step": 630,
+    "loss": 1.5829068422317505,
+    "diagonal": 1.5710158348083496,
+    "finite": 0.011891045607626438
+  },
+  {
+    "step": 631,
+    "loss": 1.66001296043396,
+    "diagonal": 1.643688678741455,
+    "finite": 0.016324292868375778
+  },
+  {
+    "step": 632,
+    "loss": 1.9593499898910522,
+    "diagonal": 1.9449745416641235,
+    "finite": 0.014375420287251472
+  },
+  {
+    "step": 633,
+    "loss": 1.5691524744033813,
+    "diagonal": 1.5588983297348022,
+    "finite": 0.010254179127514362
+  },
+  {
+    "step": 634,
+    "loss": 1.2812583446502686,
+    "diagonal": 1.2664704322814941,
+    "finite": 0.014787907712161541
+  },
+  {
+    "step": 635,
+    "loss": 1.590667486190796,
+    "diagonal": 1.5730522871017456,
+    "finite": 0.017615191638469696
+  },
+  {
+    "step": 636,
+    "loss": 1.3395055532455444,
+    "diagonal": 1.319994330406189,
+    "finite": 0.019511207938194275
+  },
+  {
+    "step": 637,
+    "loss": 1.8761940002441406,
+    "diagonal": 1.858099341392517,
+    "finite": 0.018094711005687714
+  },
+  {
+    "step": 638,
+    "loss": 1.812035083770752,
+    "diagonal": 1.7928920984268188,
+    "finite": 0.019142944365739822
+  },
+  {
+    "step": 639,
+    "loss": 1.2801073789596558,
+    "diagonal": 1.2553575038909912,
+    "finite": 0.024749882519245148
+  },
+  {
+    "step": 640,
+    "loss": 2.02374529838562,
+    "diagonal": 2.00500750541687,
+    "finite": 0.01873788610100746
+  },
+  {
+    "step": 641,
+    "loss": 1.7976213693618774,
+    "diagonal": 1.7748082876205444,
+    "finite": 0.022813070565462112
+  },
+  {
+    "step": 642,
+    "loss": 1.8907383680343628,
+    "diagonal": 1.871231198310852,
+    "finite": 0.01950717903673649
+  },
+  {
+    "step": 643,
+    "loss": 1.815154790878296,
+    "diagonal": 1.7985492944717407,
+    "finite": 0.01660553179681301
+  },
+  {
+    "step": 644,
+    "loss": 2.1020312309265137,
+    "diagonal": 2.085146427154541,
+    "finite": 0.01688476651906967
+  },
+  {
+    "step": 645,
+    "loss": 1.4506795406341553,
+    "diagonal": 1.4367811679840088,
+    "finite": 0.01389835774898529
+  },
+  {
+    "step": 646,
+    "loss": 1.5512973070144653,
+    "diagonal": 1.5269416570663452,
+    "finite": 0.024355696514248848
+  },
+  {
+    "step": 647,
+    "loss": 2.058765172958374,
+    "diagonal": 2.044924736022949,
+    "finite": 0.01384048257023096
+  },
+  {
+    "step": 648,
+    "loss": 1.4006427526474,
+    "diagonal": 1.379473090171814,
+    "finite": 0.02116965502500534
+  },
+  {
+    "step": 649,
+    "loss": 1.7620697021484375,
+    "diagonal": 1.7410036325454712,
+    "finite": 0.021066032350063324
+  },
+  {
+    "step": 650,
+    "loss": 1.489961862564087,
+    "diagonal": 1.471167802810669,
+    "finite": 0.018794016912579536
+  },
+  {
+    "step": 651,
+    "loss": 1.6678709983825684,
+    "diagonal": 1.6419212818145752,
+    "finite": 0.02594972774386406
+  },
+  {
+    "step": 652,
+    "loss": 2.0797762870788574,
+    "diagonal": 2.0492377281188965,
+    "finite": 0.03053848259150982
+  },
+  {
+    "step": 653,
+    "loss": 1.354400634765625,
+    "diagonal": 1.3307104110717773,
+    "finite": 0.02369016595184803
+  },
+  {
+    "step": 654,
+    "loss": 1.7446510791778564,
+    "diagonal": 1.7205898761749268,
+    "finite": 0.024061214178800583
+  },
+  {
+    "step": 655,
+    "loss": 1.2300969362258911,
+    "diagonal": 1.2105530500411987,
+    "finite": 0.01954387128353119
+  },
+  {
+    "step": 656,
+    "loss": 2.0060033798217773,
+    "diagonal": 1.9865202903747559,
+    "finite": 0.01948297768831253
+  },
+  {
+    "step": 657,
+    "loss": 1.7281886339187622,
+    "diagonal": 1.7130168676376343,
+    "finite": 0.015171820297837257
+  },
+  {
+    "step": 658,
+    "loss": 1.9335094690322876,
+    "diagonal": 1.9152013063430786,
+    "finite": 0.01830819435417652
+  },
+  {
+    "step": 659,
+    "loss": 1.6646069288253784,
+    "diagonal": 1.6431533098220825,
+    "finite": 0.02145366743206978
+  },
+  {
+    "step": 660,
+    "loss": 1.692661166191101,
+    "diagonal": 1.674691081047058,
+    "finite": 0.017970101907849312
+  },
+  {
+    "step": 661,
+    "loss": 1.5113073587417603,
+    "diagonal": 1.4920010566711426,
+    "finite": 0.01930631697177887
+  },
+  {
+    "step": 662,
+    "loss": 1.762817621231079,
+    "diagonal": 1.7394676208496094,
+    "finite": 0.023349961265921593
+  },
+  {
+    "step": 663,
+    "loss": 1.8215662240982056,
+    "diagonal": 1.8067400455474854,
+    "finite": 0.014826178550720215
+  },
+  {
+    "step": 664,
+    "loss": 1.5105441808700562,
+    "diagonal": 1.4950484037399292,
+    "finite": 0.015495791099965572
+  },
+  {
+    "step": 665,
+    "loss": 2.1989142894744873,
+    "diagonal": 2.178589344024658,
+    "finite": 0.020325053483247757
+  },
+  {
+    "step": 666,
+    "loss": 2.0494046211242676,
+    "diagonal": 2.0290565490722656,
+    "finite": 0.020348109304904938
+  },
+  {
+    "step": 667,
+    "loss": 1.7326674461364746,
+    "diagonal": 1.7128006219863892,
+    "finite": 0.019866809248924255
+  },
+  {
+    "step": 668,
+    "loss": 2.3484363555908203,
+    "diagonal": 2.3295271396636963,
+    "finite": 0.01890917494893074
+  },
+  {
+    "step": 669,
+    "loss": 1.9494985342025757,
+    "diagonal": 1.9349836111068726,
+    "finite": 0.014514921233057976
+  },
+  {
+    "step": 670,
+    "loss": 1.731793761253357,
+    "diagonal": 1.7097702026367188,
+    "finite": 0.022023607045412064
+  },
+  {
+    "step": 671,
+    "loss": 1.6811259984970093,
+    "diagonal": 1.662304162979126,
+    "finite": 0.01882179081439972
+  },
+  {
+    "step": 672,
+    "loss": 1.7091047763824463,
+    "diagonal": 1.6946278810501099,
+    "finite": 0.014476899988949299
+  },
+  {
+    "step": 673,
+    "loss": 2.016085386276245,
+    "diagonal": 1.9961485862731934,
+    "finite": 0.019936803728342056
+  },
+  {
+    "step": 674,
+    "loss": 1.1984487771987915,
+    "diagonal": 1.186651349067688,
+    "finite": 0.011797457933425903
+  },
+  {
+    "step": 675,
+    "loss": 1.3722904920578003,
+    "diagonal": 1.3556585311889648,
+    "finite": 0.016632014885544777
+  },
+  {
+    "step": 676,
+    "loss": 1.7977567911148071,
+    "diagonal": 1.7824265956878662,
+    "finite": 0.015330147929489613
+  },
+  {
+    "step": 677,
+    "loss": 1.7018423080444336,
+    "diagonal": 1.6872377395629883,
+    "finite": 0.01460458803921938
+  },
+  {
+    "step": 678,
+    "loss": 1.2997113466262817,
+    "diagonal": 1.2811437845230103,
+    "finite": 0.018567580729722977
+  },
+  {
+    "step": 679,
+    "loss": 1.7265487909317017,
+    "diagonal": 1.7130769491195679,
+    "finite": 0.01347178965806961
+  },
+  {
+    "step": 680,
+    "loss": 1.3478281497955322,
+    "diagonal": 1.3323265314102173,
+    "finite": 0.01550157181918621
+  },
+  {
+    "step": 681,
+    "loss": 1.6054767370224,
+    "diagonal": 1.5909106731414795,
+    "finite": 0.014566109515726566
+  },
+  {
+    "step": 682,
+    "loss": 1.7117506265640259,
+    "diagonal": 1.6950169801712036,
+    "finite": 0.016733650118112564
+  },
+  {
+    "step": 683,
+    "loss": 2.2291171550750732,
+    "diagonal": 2.2090396881103516,
+    "finite": 0.02007753774523735
+  },
+  {
+    "step": 684,
+    "loss": 1.5537042617797852,
+    "diagonal": 1.53327214717865,
+    "finite": 0.020432068035006523
+  },
+  {
+    "step": 685,
+    "loss": 1.7346326112747192,
+    "diagonal": 1.7148609161376953,
+    "finite": 0.019771642982959747
+  },
+  {
+    "step": 686,
+    "loss": 1.6219180822372437,
+    "diagonal": 1.604828119277954,
+    "finite": 0.017089931294322014
+  },
+  {
+    "step": 687,
+    "loss": 1.654593825340271,
+    "diagonal": 1.635174036026001,
+    "finite": 0.01941979117691517
+  },
+  {
+    "step": 688,
+    "loss": 1.9327892065048218,
+    "diagonal": 1.9139165878295898,
+    "finite": 0.018872570246458054
+  },
+  {
+    "step": 689,
+    "loss": 1.8291468620300293,
+    "diagonal": 1.808595895767212,
+    "finite": 0.02055102214217186
+  },
+  {
+    "step": 690,
+    "loss": 1.5139533281326294,
+    "diagonal": 1.4971740245819092,
+    "finite": 0.016779309138655663
+  },
+  {
+    "step": 691,
+    "loss": 1.484679937362671,
+    "diagonal": 1.4642002582550049,
+    "finite": 0.020479630678892136
+  },
+  {
+    "step": 692,
+    "loss": 1.4412235021591187,
+    "diagonal": 1.4242372512817383,
+    "finite": 0.016986265778541565
+  },
+  {
+    "step": 693,
+    "loss": 1.5837353467941284,
+    "diagonal": 1.5617581605911255,
+    "finite": 0.02197718247771263
+  },
+  {
+    "step": 694,
+    "loss": 1.7058025598526,
+    "diagonal": 1.6879677772521973,
+    "finite": 0.017834730446338654
+  },
+  {
+    "step": 695,
+    "loss": 2.1414921283721924,
+    "diagonal": 2.119002342224121,
+    "finite": 0.022489801049232483
+  },
+  {
+    "step": 696,
+    "loss": 1.9006550312042236,
+    "diagonal": 1.883958101272583,
+    "finite": 0.016696883365511894
+  },
+  {
+    "step": 697,
+    "loss": 1.877813458442688,
+    "diagonal": 1.861169695854187,
+    "finite": 0.016643786802887917
+  },
+  {
+    "step": 698,
+    "loss": 1.6867647171020508,
+    "diagonal": 1.6655521392822266,
+    "finite": 0.021212562918663025
+  },
+  {
+    "step": 699,
+    "loss": 1.7260994911193848,
+    "diagonal": 1.7052744626998901,
+    "finite": 0.020825030282139778
+  },
+  {
+    "step": 700,
+    "loss": 1.2514439821243286,
+    "diagonal": 1.2332100868225098,
+    "finite": 0.01823389157652855
+  },
+  {
+    "step": 701,
+    "loss": 1.427764654159546,
+    "diagonal": 1.4054670333862305,
+    "finite": 0.02229766920208931
+  },
+  {
+    "step": 702,
+    "loss": 1.7314990758895874,
+    "diagonal": 1.7131633758544922,
+    "finite": 0.018335750326514244
+  },
+  {
+    "step": 703,
+    "loss": 1.4878877401351929,
+    "diagonal": 1.4672646522521973,
+    "finite": 0.020623112097382545
+  },
+  {
+    "step": 704,
+    "loss": 1.9040509462356567,
+    "diagonal": 1.8900538682937622,
+    "finite": 0.013997072353959084
+  },
+  {
+    "step": 705,
+    "loss": 1.7186617851257324,
+    "diagonal": 1.7026640176773071,
+    "finite": 0.015997810289263725
+  },
+  {
+    "step": 706,
+    "loss": 1.5382075309753418,
+    "diagonal": 1.519627571105957,
+    "finite": 0.018579907715320587
+  },
+  {
+    "step": 707,
+    "loss": 2.3199756145477295,
+    "diagonal": 2.3069891929626465,
+    "finite": 0.012986531481146812
+  },
+  {
+    "step": 708,
+    "loss": 1.5433132648468018,
+    "diagonal": 1.5199449062347412,
+    "finite": 0.023368366062641144
+  },
+  {
+    "step": 709,
+    "loss": 2.027791976928711,
+    "diagonal": 2.0120089054107666,
+    "finite": 0.01578318513929844
+  },
+  {
+    "step": 710,
+    "loss": 1.9018141031265259,
+    "diagonal": 1.889367938041687,
+    "finite": 0.012446212582290173
+  },
+  {
+    "step": 711,
+    "loss": 1.3029367923736572,
+    "diagonal": 1.288495659828186,
+    "finite": 0.014441176317632198
+  },
+  {
+    "step": 712,
+    "loss": 1.7278169393539429,
+    "diagonal": 1.712886095046997,
+    "finite": 0.01493084616959095
+  },
+  {
+    "step": 713,
+    "loss": 1.0592257976531982,
+    "diagonal": 1.0402252674102783,
+    "finite": 0.019000552594661713
+  },
+  {
+    "step": 714,
+    "loss": 1.8084157705307007,
+    "diagonal": 1.7957673072814941,
+    "finite": 0.012648448348045349
+  },
+  {
+    "step": 715,
+    "loss": 1.2393462657928467,
+    "diagonal": 1.2265899181365967,
+    "finite": 0.01275638211518526
+  },
+  {
+    "step": 716,
+    "loss": 1.5754895210266113,
+    "diagonal": 1.561718463897705,
+    "finite": 0.013771109282970428
+  },
+  {
+    "step": 717,
+    "loss": 1.3274728059768677,
+    "diagonal": 1.3112530708312988,
+    "finite": 0.0162197258323431
+  },
+  {
+    "step": 718,
+    "loss": 1.1851704120635986,
+    "diagonal": 1.1693792343139648,
+    "finite": 0.015791159123182297
+  },
+  {
+    "step": 719,
+    "loss": 1.6293785572052002,
+    "diagonal": 1.6149917840957642,
+    "finite": 0.014386738650500774
+  },
+  {
+    "step": 720,
+    "loss": 1.6495956182479858,
+    "diagonal": 1.635532259941101,
+    "finite": 0.014063368551433086
+  },
+  {
+    "step": 721,
+    "loss": 1.39640212059021,
+    "diagonal": 1.3835499286651611,
+    "finite": 0.012852170504629612
+  },
+  {
+    "step": 722,
+    "loss": 1.4621407985687256,
+    "diagonal": 1.4494247436523438,
+    "finite": 0.012716050259768963
+  },
+  {
+    "step": 723,
+    "loss": 1.6607812643051147,
+    "diagonal": 1.6427956819534302,
+    "finite": 0.017985574901103973
+  },
+  {
+    "step": 724,
+    "loss": 1.6873201131820679,
+    "diagonal": 1.6723899841308594,
+    "finite": 0.014930100180208683
+  },
+  {
+    "step": 725,
+    "loss": 1.52420973777771,
+    "diagonal": 1.5048513412475586,
+    "finite": 0.01935839094221592
+  },
+  {
+    "step": 726,
+    "loss": 2.101121664047241,
+    "diagonal": 2.0851449966430664,
+    "finite": 0.015976671129465103
+  },
+  {
+    "step": 727,
+    "loss": 1.407179355621338,
+    "diagonal": 1.3927289247512817,
+    "finite": 0.0144504364579916
+  },
+  {
+    "step": 728,
+    "loss": 1.6421469449996948,
+    "diagonal": 1.6314412355422974,
+    "finite": 0.010705705732107162
+  },
+  {
+    "step": 729,
+    "loss": 1.613356351852417,
+    "diagonal": 1.600077509880066,
+    "finite": 0.01327888760715723
+  },
+  {
+    "step": 730,
+    "loss": 1.192371129989624,
+    "diagonal": 1.1814216375350952,
+    "finite": 0.010949540883302689
+  },
+  {
+    "step": 731,
+    "loss": 1.84800124168396,
+    "diagonal": 1.8375661373138428,
+    "finite": 0.010435124859213829
+  },
+  {
+    "step": 732,
+    "loss": 1.6094058752059937,
+    "diagonal": 1.599265217781067,
+    "finite": 0.010140600614249706
+  },
+  {
+    "step": 733,
+    "loss": 1.4703283309936523,
+    "diagonal": 1.4588655233383179,
+    "finite": 0.011462762951850891
+  },
+  {
+    "step": 734,
+    "loss": 1.7413952350616455,
+    "diagonal": 1.729280710220337,
+    "finite": 0.01211454439908266
+  },
+  {
+    "step": 735,
+    "loss": 1.11704683303833,
+    "diagonal": 1.102277159690857,
+    "finite": 0.014769692905247211
+  },
+  {
+    "step": 736,
+    "loss": 1.9226629734039307,
+    "diagonal": 1.9114476442337036,
+    "finite": 0.011215386912226677
+  },
+  {
+    "step": 737,
+    "loss": 1.5856242179870605,
+    "diagonal": 1.571744680404663,
+    "finite": 0.013879546895623207
+  },
+  {
+    "step": 738,
+    "loss": 1.4714019298553467,
+    "diagonal": 1.462220311164856,
+    "finite": 0.009181592613458633
+  },
+  {
+    "step": 739,
+    "loss": 1.4533870220184326,
+    "diagonal": 1.445276141166687,
+    "finite": 0.00811091810464859
+  },
+  {
+    "step": 740,
+    "loss": 2.101149559020996,
+    "diagonal": 2.0833568572998047,
+    "finite": 0.017792679369449615
+  },
+  {
+    "step": 741,
+    "loss": 1.795962929725647,
+    "diagonal": 1.7853822708129883,
+    "finite": 0.0105806989595294
+  },
+  {
+    "step": 742,
+    "loss": 1.3979542255401611,
+    "diagonal": 1.3860150575637817,
+    "finite": 0.01193914469331503
+  },
+  {
+    "step": 743,
+    "loss": 1.1696979999542236,
+    "diagonal": 1.1587705612182617,
+    "finite": 0.010927421040832996
+  },
+  {
+    "step": 744,
+    "loss": 1.6849493980407715,
+    "diagonal": 1.671083688735962,
+    "finite": 0.013865666463971138
+  },
+  {
+    "step": 745,
+    "loss": 1.2869186401367188,
+    "diagonal": 1.273069143295288,
+    "finite": 0.013849446550011635
+  },
+  {
+    "step": 746,
+    "loss": 1.8035569190979004,
+    "diagonal": 1.787798285484314,
+    "finite": 0.015758583322167397
+  },
+  {
+    "step": 747,
+    "loss": 1.1503093242645264,
+    "diagonal": 1.1331400871276855,
+    "finite": 0.017169255763292313
+  },
+  {
+    "step": 748,
+    "loss": 1.303629755973816,
+    "diagonal": 1.2878358364105225,
+    "finite": 0.015793906524777412
+  },
+  {
+    "step": 749,
+    "loss": 2.0099880695343018,
+    "diagonal": 1.9969371557235718,
+    "finite": 0.013050963170826435
+  },
+  {
+    "step": 750,
+    "loss": 1.5998836755752563,
+    "diagonal": 1.5794875621795654,
+    "finite": 0.020396076142787933
+  },
+  {
+    "step": 751,
+    "loss": 1.6754190921783447,
+    "diagonal": 1.659501075744629,
+    "finite": 0.015918053686618805
+  },
+  {
+    "step": 752,
+    "loss": 1.618118166923523,
+    "diagonal": 1.601737380027771,
+    "finite": 0.016380831599235535
+  },
+  {
+    "step": 753,
+    "loss": 1.7583420276641846,
+    "diagonal": 1.744377851486206,
+    "finite": 0.013964144513010979
+  },
+  {
+    "step": 754,
+    "loss": 1.2504816055297852,
+    "diagonal": 1.2346577644348145,
+    "finite": 0.01582382060587406
+  },
+  {
+    "step": 755,
+    "loss": 1.9653606414794922,
+    "diagonal": 1.9513208866119385,
+    "finite": 0.014039777219295502
+  },
+  {
+    "step": 756,
+    "loss": 1.575486660003662,
+    "diagonal": 1.5608806610107422,
+    "finite": 0.014606035314500332
+  },
+  {
+    "step": 757,
+    "loss": 1.4444001913070679,
+    "diagonal": 1.4291706085205078,
+    "finite": 0.015229560434818268
+  },
+  {
+    "step": 758,
+    "loss": 1.3674253225326538,
+    "diagonal": 1.3526347875595093,
+    "finite": 0.014790592715144157
+  },
+  {
+    "step": 759,
+    "loss": 1.9799537658691406,
+    "diagonal": 1.9690685272216797,
+    "finite": 0.01088524330407381
+  },
+  {
+    "step": 760,
+    "loss": 1.7442283630371094,
+    "diagonal": 1.7226001024246216,
+    "finite": 0.021628260612487793
+  },
+  {
+    "step": 761,
+    "loss": 1.2647244930267334,
+    "diagonal": 1.248655080795288,
+    "finite": 0.01606946811079979
+  },
+  {
+    "step": 762,
+    "loss": 2.0660276412963867,
+    "diagonal": 2.05377197265625,
+    "finite": 0.012255570851266384
+  },
+  {
+    "step": 763,
+    "loss": 1.1232855319976807,
+    "diagonal": 1.103484869003296,
+    "finite": 0.01980065181851387
+  },
+  {
+    "step": 764,
+    "loss": 1.5194761753082275,
+    "diagonal": 1.496451497077942,
+    "finite": 0.023024730384349823
+  },
+  {
+    "step": 765,
+    "loss": 1.2568520307540894,
+    "diagonal": 1.2386428117752075,
+    "finite": 0.01820923574268818
+  },
+  {
+    "step": 766,
+    "loss": 1.6700794696807861,
+    "diagonal": 1.6459325551986694,
+    "finite": 0.02414689213037491
+  },
+  {
+    "step": 767,
+    "loss": 1.3938250541687012,
+    "diagonal": 1.3762867450714111,
+    "finite": 0.017538297921419144
+  },
+  {
+    "step": 768,
+    "loss": 1.7381508350372314,
+    "diagonal": 1.720585584640503,
+    "finite": 0.0175652913749218
+  },
+  {
+    "step": 769,
+    "loss": 1.620068907737732,
+    "diagonal": 1.6041892766952515,
+    "finite": 0.01587958075106144
+  },
+  {
+    "step": 770,
+    "loss": 1.9147838354110718,
+    "diagonal": 1.900078296661377,
+    "finite": 0.014705541543662548
+  },
+  {
+    "step": 771,
+    "loss": 1.676988124847412,
+    "diagonal": 1.6589462757110596,
+    "finite": 0.01804179511964321
+  },
+  {
+    "step": 772,
+    "loss": 2.0148327350616455,
+    "diagonal": 2.0017662048339844,
+    "finite": 0.013066429644823074
+  },
+  {
+    "step": 773,
+    "loss": 1.8528624773025513,
+    "diagonal": 1.8424324989318848,
+    "finite": 0.01042996160686016
+  },
+  {
+    "step": 774,
+    "loss": 1.768033504486084,
+    "diagonal": 1.7502678632736206,
+    "finite": 0.017765620723366737
+  },
+  {
+    "step": 775,
+    "loss": 1.3007196187973022,
+    "diagonal": 1.283479928970337,
+    "finite": 0.017239674925804138
+  },
+  {
+    "step": 776,
+    "loss": 2.0066919326782227,
+    "diagonal": 1.991307258605957,
+    "finite": 0.015384720638394356
+  },
+  {
+    "step": 777,
+    "loss": 1.430749773979187,
+    "diagonal": 1.4143768548965454,
+    "finite": 0.01637296751141548
+  },
+  {
+    "step": 778,
+    "loss": 1.467279076576233,
+    "diagonal": 1.4463903903961182,
+    "finite": 0.020888736471533775
+  },
+  {
+    "step": 779,
+    "loss": 1.423026442527771,
+    "diagonal": 1.4064197540283203,
+    "finite": 0.016606681048870087
+  },
+  {
+    "step": 780,
+    "loss": 1.707370638847351,
+    "diagonal": 1.6957943439483643,
+    "finite": 0.011576253920793533
+  },
+  {
+    "step": 781,
+    "loss": 1.248893141746521,
+    "diagonal": 1.2336187362670898,
+    "finite": 0.015274398028850555
+  },
+  {
+    "step": 782,
+    "loss": 1.3400517702102661,
+    "diagonal": 1.3293267488479614,
+    "finite": 0.010725011117756367
+  },
+  {
+    "step": 783,
+    "loss": 1.5009626150131226,
+    "diagonal": 1.4903162717819214,
+    "finite": 0.010646352544426918
+  },
+  {
+    "step": 784,
+    "loss": 1.9077068567276,
+    "diagonal": 1.8943328857421875,
+    "finite": 0.013373954221606255
+  },
+  {
+    "step": 785,
+    "loss": 1.758048176765442,
+    "diagonal": 1.7450463771820068,
+    "finite": 0.013001758605241776
+  },
+  {
+    "step": 786,
+    "loss": 1.6095997095108032,
+    "diagonal": 1.596335530281067,
+    "finite": 0.013264141976833344
+  },
+  {
+    "step": 787,
+    "loss": 1.6223963499069214,
+    "diagonal": 1.6053483486175537,
+    "finite": 0.01704796962440014
+  },
+  {
+    "step": 788,
+    "loss": 1.5655547380447388,
+    "diagonal": 1.553473949432373,
+    "finite": 0.012080846354365349
+  },
+  {
+    "step": 789,
+    "loss": 1.1945712566375732,
+    "diagonal": 1.1846504211425781,
+    "finite": 0.009920790791511536
+  },
+  {
+    "step": 790,
+    "loss": 1.32438063621521,
+    "diagonal": 1.3080203533172607,
+    "finite": 0.016360340639948845
+  },
+  {
+    "step": 791,
+    "loss": 1.7375166416168213,
+    "diagonal": 1.7238507270812988,
+    "finite": 0.013665872626006603
+  },
+  {
+    "step": 792,
+    "loss": 1.7719314098358154,
+    "diagonal": 1.7579362392425537,
+    "finite": 0.013995145447552204
+  },
+  {
+    "step": 793,
+    "loss": 1.2667818069458008,
+    "diagonal": 1.2569434642791748,
+    "finite": 0.009838302619755268
+  },
+  {
+    "step": 794,
+    "loss": 1.3805820941925049,
+    "diagonal": 1.3621677160263062,
+    "finite": 0.018414337188005447
+  },
+  {
+    "step": 795,
+    "loss": 1.4286140203475952,
+    "diagonal": 1.4156733751296997,
+    "finite": 0.012940691784024239
+  },
+  {
+    "step": 796,
+    "loss": 1.6503031253814697,
+    "diagonal": 1.6375623941421509,
+    "finite": 0.012740758247673512
+  },
+  {
+    "step": 797,
+    "loss": 1.3978474140167236,
+    "diagonal": 1.3818938732147217,
+    "finite": 0.01595354825258255
+  },
+  {
+    "step": 798,
+    "loss": 1.6686968803405762,
+    "diagonal": 1.6506547927856445,
+    "finite": 0.018042054027318954
+  },
+  {
+    "step": 799,
+    "loss": 1.6815296411514282,
+    "diagonal": 1.6687219142913818,
+    "finite": 0.012807670049369335
+  },
+  {
+    "step": 800,
+    "loss": 1.2474822998046875,
+    "diagonal": 1.2351242303848267,
+    "finite": 0.012358095496892929
+  },
+  {
+    "step": 801,
+    "loss": 1.5107110738754272,
+    "diagonal": 1.4965964555740356,
+    "finite": 0.014114602468907833
+  },
+  {
+    "step": 802,
+    "loss": 0.9250317215919495,
+    "diagonal": 0.914050817489624,
+    "finite": 0.010980903171002865
+  },
+  {
+    "step": 803,
+    "loss": 1.4421348571777344,
+    "diagonal": 1.4329826831817627,
+    "finite": 0.009152191691100597
+  },
+  {
+    "step": 804,
+    "loss": 1.5352481603622437,
+    "diagonal": 1.5224231481552124,
+    "finite": 0.012825055047869682
+  },
+  {
+    "step": 805,
+    "loss": 1.0040850639343262,
+    "diagonal": 0.9954710602760315,
+    "finite": 0.008613972924649715
+  },
+  {
+    "step": 806,
+    "loss": 1.5846836566925049,
+    "diagonal": 1.5729365348815918,
+    "finite": 0.01174713484942913
+  },
+  {
+    "step": 807,
+    "loss": 1.5977863073349,
+    "diagonal": 1.58769953250885,
+    "finite": 0.010086766444146633
+  },
+  {
+    "step": 808,
+    "loss": 1.7499665021896362,
+    "diagonal": 1.7373573780059814,
+    "finite": 0.012609165161848068
+  },
+  {
+    "step": 809,
+    "loss": 1.4267804622650146,
+    "diagonal": 1.4155218601226807,
+    "finite": 0.011258658021688461
+  },
+  {
+    "step": 810,
+    "loss": 1.5596970319747925,
+    "diagonal": 1.5501883029937744,
+    "finite": 0.009508782997727394
+  },
+  {
+    "step": 811,
+    "loss": 1.4269869327545166,
+    "diagonal": 1.417487621307373,
+    "finite": 0.009499270468950272
+  },
+  {
+    "step": 812,
+    "loss": 1.2266998291015625,
+    "diagonal": 1.2138346433639526,
+    "finite": 0.012865218333899975
+  },
+  {
+    "step": 813,
+    "loss": 1.8471914529800415,
+    "diagonal": 1.8293927907943726,
+    "finite": 0.017798610031604767
+  },
+  {
+    "step": 814,
+    "loss": 0.8707544207572937,
+    "diagonal": 0.8514622449874878,
+    "finite": 0.01929219625890255
+  },
+  {
+    "step": 815,
+    "loss": 1.8034625053405762,
+    "diagonal": 1.7906720638275146,
+    "finite": 0.012790434062480927
+  },
+  {
+    "step": 816,
+    "loss": 1.2343097925186157,
+    "diagonal": 1.220245599746704,
+    "finite": 0.014064141549170017
+  },
+  {
+    "step": 817,
+    "loss": 1.627583622932434,
+    "diagonal": 1.6123204231262207,
+    "finite": 0.015263250097632408
+  },
+  {
+    "step": 818,
+    "loss": 1.5071872472763062,
+    "diagonal": 1.4947562217712402,
+    "finite": 0.012431036680936813
+  },
+  {
+    "step": 819,
+    "loss": 1.717527985572815,
+    "diagonal": 1.7063349485397339,
+    "finite": 0.011193027719855309
+  },
+  {
+    "step": 820,
+    "loss": 1.9305155277252197,
+    "diagonal": 1.9194116592407227,
+    "finite": 0.011103913187980652
+  },
+  {
+    "step": 821,
+    "loss": 1.5805662870407104,
+    "diagonal": 1.5675705671310425,
+    "finite": 0.01299575436860323
+  },
+  {
+    "step": 822,
+    "loss": 1.3354120254516602,
+    "diagonal": 1.3223143815994263,
+    "finite": 0.013097595423460007
+  },
+  {
+    "step": 823,
+    "loss": 1.7717000246047974,
+    "diagonal": 1.7591090202331543,
+    "finite": 0.012591022066771984
+  },
+  {
+    "step": 824,
+    "loss": 1.5985714197158813,
+    "diagonal": 1.5847240686416626,
+    "finite": 0.013847317546606064
+  },
+  {
+    "step": 825,
+    "loss": 1.670927882194519,
+    "diagonal": 1.6560345888137817,
+    "finite": 0.014893345534801483
+  },
+  {
+    "step": 826,
+    "loss": 1.3505722284317017,
+    "diagonal": 1.334681749343872,
+    "finite": 0.01589050516486168
+  },
+  {
+    "step": 827,
+    "loss": 1.677085041999817,
+    "diagonal": 1.6598317623138428,
+    "finite": 0.017253262922167778
+  },
+  {
+    "step": 828,
+    "loss": 1.586592674255371,
+    "diagonal": 1.5743967294692993,
+    "finite": 0.012195955961942673
+  },
+  {
+    "step": 829,
+    "loss": 1.1638957262039185,
+    "diagonal": 1.1408171653747559,
+    "finite": 0.023078564554452896
+  },
+  {
+    "step": 830,
+    "loss": 1.7071537971496582,
+    "diagonal": 1.6942520141601562,
+    "finite": 0.012901832349598408
+  },
+  {
+    "step": 831,
+    "loss": 1.5392887592315674,
+    "diagonal": 1.5299900770187378,
+    "finite": 0.009298639371991158
+  },
+  {
+    "step": 832,
+    "loss": 1.3970391750335693,
+    "diagonal": 1.3808761835098267,
+    "finite": 0.016163015738129616
+  },
+  {
+    "step": 833,
+    "loss": 1.8548638820648193,
+    "diagonal": 1.8425228595733643,
+    "finite": 0.01234107743948698
+  },
+  {
+    "step": 834,
+    "loss": 1.6756683588027954,
+    "diagonal": 1.664003849029541,
+    "finite": 0.011664561927318573
+  },
+  {
+    "step": 835,
+    "loss": 1.7553958892822266,
+    "diagonal": 1.7385716438293457,
+    "finite": 0.016824249178171158
+  },
+  {
+    "step": 836,
+    "loss": 1.5941946506500244,
+    "diagonal": 1.583083152770996,
+    "finite": 0.011111557483673096
+  },
+  {
+    "step": 837,
+    "loss": 1.6475692987442017,
+    "diagonal": 1.6354124546051025,
+    "finite": 0.01215679943561554
+  },
+  {
+    "step": 838,
+    "loss": 1.6611894369125366,
+    "diagonal": 1.6480854749679565,
+    "finite": 0.013103949837386608
+  },
+  {
+    "step": 839,
+    "loss": 1.667007327079773,
+    "diagonal": 1.6576796770095825,
+    "finite": 0.009327614679932594
+  },
+  {
+    "step": 840,
+    "loss": 1.8493672609329224,
+    "diagonal": 1.83603835105896,
+    "finite": 0.013328946195542812
+  },
+  {
+    "step": 841,
+    "loss": 1.459134817123413,
+    "diagonal": 1.4466943740844727,
+    "finite": 0.012440487742424011
+  },
+  {
+    "step": 842,
+    "loss": 0.994112491607666,
+    "diagonal": 0.982944905757904,
+    "finite": 0.011167574673891068
+  },
+  {
+    "step": 843,
+    "loss": 1.3994964361190796,
+    "diagonal": 1.3865185976028442,
+    "finite": 0.012977802194654942
+  },
+  {
+    "step": 844,
+    "loss": 1.5205934047698975,
+    "diagonal": 1.5119504928588867,
+    "finite": 0.008642910048365593
+  },
+  {
+    "step": 845,
+    "loss": 1.9570127725601196,
+    "diagonal": 1.9486641883850098,
+    "finite": 0.008348576724529266
+  },
+  {
+    "step": 846,
+    "loss": 1.6443753242492676,
+    "diagonal": 1.6343759298324585,
+    "finite": 0.009999364614486694
+  },
+  {
+    "step": 847,
+    "loss": 1.8099509477615356,
+    "diagonal": 1.7978549003601074,
+    "finite": 0.012096082791686058
+  },
+  {
+    "step": 848,
+    "loss": 1.6176520586013794,
+    "diagonal": 1.6084928512573242,
+    "finite": 0.009159154258668423
+  },
+  {
+    "step": 849,
+    "loss": 1.7995260953903198,
+    "diagonal": 1.7855000495910645,
+    "finite": 0.014026056043803692
+  },
+  {
+    "step": 850,
+    "loss": 1.8676939010620117,
+    "diagonal": 1.8547251224517822,
+    "finite": 0.012968813069164753
+  },
+  {
+    "step": 851,
+    "loss": 1.6362587213516235,
+    "diagonal": 1.6224921941757202,
+    "finite": 0.013766529969871044
+  },
+  {
+    "step": 852,
+    "loss": 1.1153050661087036,
+    "diagonal": 1.0984877347946167,
+    "finite": 0.016817323863506317
+  },
+  {
+    "step": 853,
+    "loss": 1.3628562688827515,
+    "diagonal": 1.3473891019821167,
+    "finite": 0.015467124059796333
+  },
+  {
+    "step": 854,
+    "loss": 2.2294516563415527,
+    "diagonal": 2.2182822227478027,
+    "finite": 0.011169485747814178
+  },
+  {
+    "step": 855,
+    "loss": 1.563577651977539,
+    "diagonal": 1.5488002300262451,
+    "finite": 0.014777394942939281
+  },
+  {
+    "step": 856,
+    "loss": 2.044987916946411,
+    "diagonal": 2.033848285675049,
+    "finite": 0.011139614507555962
+  },
+  {
+    "step": 857,
+    "loss": 1.5525013208389282,
+    "diagonal": 1.542656421661377,
+    "finite": 0.009844868443906307
+  },
+  {
+    "step": 858,
+    "loss": 1.7510854005813599,
+    "diagonal": 1.7431731224060059,
+    "finite": 0.007912304252386093
+  },
+  {
+    "step": 859,
+    "loss": 1.31319260597229,
+    "diagonal": 1.3036816120147705,
+    "finite": 0.009510965086519718
+  },
+  {
+    "step": 860,
+    "loss": 1.3128849267959595,
+    "diagonal": 1.303422212600708,
+    "finite": 0.009462720714509487
+  },
+  {
+    "step": 861,
+    "loss": 1.8752326965332031,
+    "diagonal": 1.865114450454712,
+    "finite": 0.01011823583394289
+  },
+  {
+    "step": 862,
+    "loss": 1.8300849199295044,
+    "diagonal": 1.819943904876709,
+    "finite": 0.010141054168343544
+  },
+  {
+    "step": 863,
+    "loss": 1.371350884437561,
+    "diagonal": 1.3627099990844727,
+    "finite": 0.008640923537313938
+  },
+  {
+    "step": 864,
+    "loss": 1.1401159763336182,
+    "diagonal": 1.1287133693695068,
+    "finite": 0.011402659118175507
+  },
+  {
+    "step": 865,
+    "loss": 1.0788023471832275,
+    "diagonal": 1.0680086612701416,
+    "finite": 0.010793634690344334
+  },
+  {
+    "step": 866,
+    "loss": 1.1154268980026245,
+    "diagonal": 1.104163408279419,
+    "finite": 0.01126345805823803
+  },
+  {
+    "step": 867,
+    "loss": 1.386883020401001,
+    "diagonal": 1.369697093963623,
+    "finite": 0.01718597114086151
+  },
+  {
+    "step": 868,
+    "loss": 1.4687539339065552,
+    "diagonal": 1.4565815925598145,
+    "finite": 0.012172340415418148
+  },
+  {
+    "step": 869,
+    "loss": 1.242180585861206,
+    "diagonal": 1.2287969589233398,
+    "finite": 0.013383639976382256
+  },
+  {
+    "step": 870,
+    "loss": 1.6648449897766113,
+    "diagonal": 1.6486377716064453,
+    "finite": 0.016207220032811165
+  },
+  {
+    "step": 871,
+    "loss": 1.4803264141082764,
+    "diagonal": 1.4656250476837158,
+    "finite": 0.01470132078975439
+  },
+  {
+    "step": 872,
+    "loss": 1.6849687099456787,
+    "diagonal": 1.6728014945983887,
+    "finite": 0.012167169712483883
+  },
+  {
+    "step": 873,
+    "loss": 1.3806432485580444,
+    "diagonal": 1.3661620616912842,
+    "finite": 0.01448121853172779
+  },
+  {
+    "step": 874,
+    "loss": 1.6295392513275146,
+    "diagonal": 1.6187176704406738,
+    "finite": 0.010821613483130932
+  },
+  {
+    "step": 875,
+    "loss": 1.4475562572479248,
+    "diagonal": 1.4341166019439697,
+    "finite": 0.013439683243632317
+  },
+  {
+    "step": 876,
+    "loss": 2.0101101398468018,
+    "diagonal": 1.9924184083938599,
+    "finite": 0.017691796645522118
+  },
+  {
+    "step": 877,
+    "loss": 1.3708094358444214,
+    "diagonal": 1.353783130645752,
+    "finite": 0.017026351764798164
+  },
+  {
+    "step": 878,
+    "loss": 1.7881927490234375,
+    "diagonal": 1.7757340669631958,
+    "finite": 0.012458651326596737
+  },
+  {
+    "step": 879,
+    "loss": 1.92266047000885,
+    "diagonal": 1.911484718322754,
+    "finite": 0.011175695806741714
+  },
+  {
+    "step": 880,
+    "loss": 1.650806188583374,
+    "diagonal": 1.639676809310913,
+    "finite": 0.011129389517009258
+  },
+  {
+    "step": 881,
+    "loss": 1.8107872009277344,
+    "diagonal": 1.796736717224121,
+    "finite": 0.014050469733774662
+  },
+  {
+    "step": 882,
+    "loss": 1.359190583229065,
+    "diagonal": 1.347874641418457,
+    "finite": 0.011315980926156044
+  },
+  {
+    "step": 883,
+    "loss": 1.0275979042053223,
+    "diagonal": 1.016765832901001,
+    "finite": 0.01083209365606308
+  },
+  {
+    "step": 884,
+    "loss": 1.8502579927444458,
+    "diagonal": 1.8419508934020996,
+    "finite": 0.008307131007313728
+  },
+  {
+    "step": 885,
+    "loss": 1.370584487915039,
+    "diagonal": 1.3573588132858276,
+    "finite": 0.013225732371211052
+  },
+  {
+    "step": 886,
+    "loss": 1.31410813331604,
+    "diagonal": 1.305834174156189,
+    "finite": 0.008273925632238388
+  },
+  {
+    "step": 887,
+    "loss": 1.784704566001892,
+    "diagonal": 1.7745987176895142,
+    "finite": 0.010105814784765244
+  },
+  {
+    "step": 888,
+    "loss": 1.5660845041275024,
+    "diagonal": 1.5550360679626465,
+    "finite": 0.011048460379242897
+  },
+  {
+    "step": 889,
+    "loss": 1.2778571844100952,
+    "diagonal": 1.2667028903961182,
+    "finite": 0.011154266074299812
+  },
+  {
+    "step": 890,
+    "loss": 1.770222544670105,
+    "diagonal": 1.7572742700576782,
+    "finite": 0.012948325835168362
+  },
+  {
+    "step": 891,
+    "loss": 1.4415767192840576,
+    "diagonal": 1.428967833518982,
+    "finite": 0.012608885765075684
+  },
+  {
+    "step": 892,
+    "loss": 1.3563414812088013,
+    "diagonal": 1.346960425376892,
+    "finite": 0.009381096810102463
+  },
+  {
+    "step": 893,
+    "loss": 1.4656260013580322,
+    "diagonal": 1.4546711444854736,
+    "finite": 0.010954913683235645
+  },
+  {
+    "step": 894,
+    "loss": 1.9071272611618042,
+    "diagonal": 1.8956401348114014,
+    "finite": 0.011487184092402458
+  },
+  {
+    "step": 895,
+    "loss": 1.6666479110717773,
+    "diagonal": 1.657382845878601,
+    "finite": 0.009265044704079628
+  },
+  {
+    "step": 896,
+    "loss": 1.7817450761795044,
+    "diagonal": 1.7722406387329102,
+    "finite": 0.009504461660981178
+  },
+  {
+    "step": 897,
+    "loss": 1.954017162322998,
+    "diagonal": 1.9471207857131958,
+    "finite": 0.006896421313285828
+  },
+  {
+    "step": 898,
+    "loss": 1.4325400590896606,
+    "diagonal": 1.4193588495254517,
+    "finite": 0.013181181624531746
+  },
+  {
+    "step": 899,
+    "loss": 1.2174018621444702,
+    "diagonal": 1.2086594104766846,
+    "finite": 0.008742461912333965
+  },
+  {
+    "step": 900,
+    "loss": 1.6341248750686646,
+    "diagonal": 1.6273897886276245,
+    "finite": 0.006735141389071941
+  },
+  {
+    "step": 901,
+    "loss": 1.8363664150238037,
+    "diagonal": 1.826934576034546,
+    "finite": 0.009431829676032066
+  },
+  {
+    "step": 902,
+    "loss": 1.6034456491470337,
+    "diagonal": 1.5950753688812256,
+    "finite": 0.008370274677872658
+  },
+  {
+    "step": 903,
+    "loss": 1.420591950416565,
+    "diagonal": 1.4101535081863403,
+    "finite": 0.010438383556902409
+  },
+  {
+    "step": 904,
+    "loss": 1.4673010110855103,
+    "diagonal": 1.4578052759170532,
+    "finite": 0.009495748206973076
+  },
+  {
+    "step": 905,
+    "loss": 1.7073968648910522,
+    "diagonal": 1.696094036102295,
+    "finite": 0.011302785947918892
+  },
+  {
+    "step": 906,
+    "loss": 1.3401800394058228,
+    "diagonal": 1.3281205892562866,
+    "finite": 0.012059479020535946
+  },
+  {
+    "step": 907,
+    "loss": 1.6829553842544556,
+    "diagonal": 1.6650230884552002,
+    "finite": 0.017932264134287834
+  },
+  {
+    "step": 908,
+    "loss": 1.4747039079666138,
+    "diagonal": 1.463990569114685,
+    "finite": 0.010713357478380203
+  },
+  {
+    "step": 909,
+    "loss": 1.4389891624450684,
+    "diagonal": 1.4254816770553589,
+    "finite": 0.013507437892258167
+  },
+  {
+    "step": 910,
+    "loss": 1.903977870941162,
+    "diagonal": 1.8935275077819824,
+    "finite": 0.010450323112308979
+  },
+  {
+    "step": 911,
+    "loss": 1.7042337656021118,
+    "diagonal": 1.6968536376953125,
+    "finite": 0.007380164694041014
+  },
+  {
+    "step": 912,
+    "loss": 1.281489372253418,
+    "diagonal": 1.2693887948989868,
+    "finite": 0.012100526131689548
+  },
+  {
+    "step": 913,
+    "loss": 1.6409461498260498,
+    "diagonal": 1.6278082132339478,
+    "finite": 0.013137927278876305
+  },
+  {
+    "step": 914,
+    "loss": 1.4797921180725098,
+    "diagonal": 1.4597790241241455,
+    "finite": 0.02001308463513851
+  },
+  {
+    "step": 915,
+    "loss": 0.99857097864151,
+    "diagonal": 0.9851177930831909,
+    "finite": 0.013453156687319279
+  },
+  {
+    "step": 916,
+    "loss": 1.8373476266860962,
+    "diagonal": 1.824108362197876,
+    "finite": 0.013239222578704357
+  },
+  {
+    "step": 917,
+    "loss": 1.126580834388733,
+    "diagonal": 1.114195466041565,
+    "finite": 0.012385356239974499
+  },
+  {
+    "step": 918,
+    "loss": 1.3640612363815308,
+    "diagonal": 1.3544632196426392,
+    "finite": 0.00959802232682705
+  },
+  {
+    "step": 919,
+    "loss": 1.7337570190429688,
+    "diagonal": 1.7212133407592773,
+    "finite": 0.01254361867904663
+  },
+  {
+    "step": 920,
+    "loss": 1.5778062343597412,
+    "diagonal": 1.5668195486068726,
+    "finite": 0.010986654087901115
+  },
+  {
+    "step": 921,
+    "loss": 1.7553633451461792,
+    "diagonal": 1.7471314668655396,
+    "finite": 0.008231839165091515
+  },
+  {
+    "step": 922,
+    "loss": 1.6292611360549927,
+    "diagonal": 1.6174813508987427,
+    "finite": 0.011779842898249626
+  },
+  {
+    "step": 923,
+    "loss": 1.5502941608428955,
+    "diagonal": 1.5402096509933472,
+    "finite": 0.010084496811032295
+  },
+  {
+    "step": 924,
+    "loss": 0.9145259261131287,
+    "diagonal": 0.9048751592636108,
+    "finite": 0.009650755673646927
+  },
+  {
+    "step": 925,
+    "loss": 1.5460141897201538,
+    "diagonal": 1.532922387123108,
+    "finite": 0.013091820292174816
+  },
+  {
+    "step": 926,
+    "loss": 1.8015470504760742,
+    "diagonal": 1.7933037281036377,
+    "finite": 0.008243272081017494
+  },
+  {
+    "step": 927,
+    "loss": 1.9664747714996338,
+    "diagonal": 1.9569542407989502,
+    "finite": 0.009520581923425198
+  },
+  {
+    "step": 928,
+    "loss": 1.5304808616638184,
+    "diagonal": 1.5180466175079346,
+    "finite": 0.012434237636625767
+  },
+  {
+    "step": 929,
+    "loss": 1.5785939693450928,
+    "diagonal": 1.567367434501648,
+    "finite": 0.011226563714444637
+  },
+  {
+    "step": 930,
+    "loss": 1.4348342418670654,
+    "diagonal": 1.4250344038009644,
+    "finite": 0.009799801744520664
+  },
+  {
+    "step": 931,
+    "loss": 1.578034520149231,
+    "diagonal": 1.5666980743408203,
+    "finite": 0.01133644673973322
+  },
+  {
+    "step": 932,
+    "loss": 1.1064881086349487,
+    "diagonal": 1.0961295366287231,
+    "finite": 0.010358534753322601
+  },
+  {
+    "step": 933,
+    "loss": 1.605224370956421,
+    "diagonal": 1.5957821607589722,
+    "finite": 0.009442185051739216
+  },
+  {
+    "step": 934,
+    "loss": 1.2615859508514404,
+    "diagonal": 1.2511695623397827,
+    "finite": 0.010416403412818909
+  },
+  {
+    "step": 935,
+    "loss": 1.616051197052002,
+    "diagonal": 1.6055883169174194,
+    "finite": 0.010462882928550243
+  },
+  {
+    "step": 936,
+    "loss": 1.4501497745513916,
+    "diagonal": 1.4388011693954468,
+    "finite": 0.011348624713718891
+  },
+  {
+    "step": 937,
+    "loss": 1.6244672536849976,
+    "diagonal": 1.6131045818328857,
+    "finite": 0.011362656950950623
+  },
+  {
+    "step": 938,
+    "loss": 1.5522689819335938,
+    "diagonal": 1.540671944618225,
+    "finite": 0.011596988886594772
+  },
+  {
+    "step": 939,
+    "loss": 1.1775238513946533,
+    "diagonal": 1.1665520668029785,
+    "finite": 0.010971770621836185
+  },
+  {
+    "step": 940,
+    "loss": 1.4454649686813354,
+    "diagonal": 1.4335877895355225,
+    "finite": 0.011877130717039108
+  },
+  {
+    "step": 941,
+    "loss": 1.4560794830322266,
+    "diagonal": 1.4457001686096191,
+    "finite": 0.010379301384091377
+  },
+  {
+    "step": 942,
+    "loss": 1.4683302640914917,
+    "diagonal": 1.4504770040512085,
+    "finite": 0.017853213474154472
+  },
+  {
+    "step": 943,
+    "loss": 1.467303991317749,
+    "diagonal": 1.4559234380722046,
+    "finite": 0.011380594223737717
+  },
+  {
+    "step": 944,
+    "loss": 1.536730170249939,
+    "diagonal": 1.5251643657684326,
+    "finite": 0.011565840803086758
+  },
+  {
+    "step": 945,
+    "loss": 1.312707781791687,
+    "diagonal": 1.3021533489227295,
+    "finite": 0.010554446838796139
+  },
+  {
+    "step": 946,
+    "loss": 1.3046602010726929,
+    "diagonal": 1.2914891242980957,
+    "finite": 0.013171033933758736
+  },
+  {
+    "step": 947,
+    "loss": 1.5819883346557617,
+    "diagonal": 1.5692999362945557,
+    "finite": 0.01268844585865736
+  },
+  {
+    "step": 948,
+    "loss": 1.680151343345642,
+    "diagonal": 1.6679872274398804,
+    "finite": 0.012164116837084293
+  },
+  {
+    "step": 949,
+    "loss": 1.7925786972045898,
+    "diagonal": 1.780956506729126,
+    "finite": 0.011622234247624874
+  },
+  {
+    "step": 950,
+    "loss": 1.5826060771942139,
+    "diagonal": 1.569654941558838,
+    "finite": 0.012951084412634373
+  },
+  {
+    "step": 951,
+    "loss": 1.7767243385314941,
+    "diagonal": 1.7647141218185425,
+    "finite": 0.012010197155177593
+  },
+  {
+    "step": 952,
+    "loss": 1.66484534740448,
+    "diagonal": 1.6547859907150269,
+    "finite": 0.01005934551358223
+  },
+  {
+    "step": 953,
+    "loss": 1.580422282218933,
+    "diagonal": 1.5625159740447998,
+    "finite": 0.017906298860907555
+  },
+  {
+    "step": 954,
+    "loss": 1.2367491722106934,
+    "diagonal": 1.22377610206604,
+    "finite": 0.012973015196621418
+  },
+  {
+    "step": 955,
+    "loss": 1.7240184545516968,
+    "diagonal": 1.7123421430587769,
+    "finite": 0.01167629286646843
+  },
+  {
+    "step": 956,
+    "loss": 1.4353309869766235,
+    "diagonal": 1.4281951189041138,
+    "finite": 0.007135861553251743
+  },
+  {
+    "step": 957,
+    "loss": 1.2848081588745117,
+    "diagonal": 1.2728646993637085,
+    "finite": 0.011943417601287365
+  },
+  {
+    "step": 958,
+    "loss": 1.5515882968902588,
+    "diagonal": 1.5410947799682617,
+    "finite": 0.01049345824867487
+  },
+  {
+    "step": 959,
+    "loss": 1.2117148637771606,
+    "diagonal": 1.2006211280822754,
+    "finite": 0.011093772947788239
+  },
+  {
+    "step": 960,
+    "loss": 1.617156982421875,
+    "diagonal": 1.608130693435669,
+    "finite": 0.00902628991752863
+  },
+  {
+    "step": 961,
+    "loss": 1.823947787284851,
+    "diagonal": 1.812185287475586,
+    "finite": 0.0117624681442976
+  },
+  {
+    "step": 962,
+    "loss": 1.4703788757324219,
+    "diagonal": 1.4580315351486206,
+    "finite": 0.012347341515123844
+  },
+  {
+    "step": 963,
+    "loss": 1.4831523895263672,
+    "diagonal": 1.4722840785980225,
+    "finite": 0.010868335142731667
+  },
+  {
+    "step": 964,
+    "loss": 1.3021128177642822,
+    "diagonal": 1.2882869243621826,
+    "finite": 0.01382586918771267
+  },
+  {
+    "step": 965,
+    "loss": 1.4034322500228882,
+    "diagonal": 1.3930693864822388,
+    "finite": 0.010362916626036167
+  },
+  {
+    "step": 966,
+    "loss": 1.8782645463943481,
+    "diagonal": 1.8657491207122803,
+    "finite": 0.012515460141003132
+  },
+  {
+    "step": 967,
+    "loss": 1.244925618171692,
+    "diagonal": 1.2274596691131592,
+    "finite": 0.01746595837175846
+  },
+  {
+    "step": 968,
+    "loss": 1.4000808000564575,
+    "diagonal": 1.388829231262207,
+    "finite": 0.011251583695411682
+  },
+  {
+    "step": 969,
+    "loss": 1.7451624870300293,
+    "diagonal": 1.7336905002593994,
+    "finite": 0.011471993289887905
+  },
+  {
+    "step": 970,
+    "loss": 1.1808640956878662,
+    "diagonal": 1.1683822870254517,
+    "finite": 0.012481828220188618
+  },
+  {
+    "step": 971,
+    "loss": 1.4364268779754639,
+    "diagonal": 1.4215564727783203,
+    "finite": 0.014870349317789078
+  },
+  {
+    "step": 972,
+    "loss": 1.2260819673538208,
+    "diagonal": 1.212153434753418,
+    "finite": 0.013928496278822422
+  },
+  {
+    "step": 973,
+    "loss": 1.6866589784622192,
+    "diagonal": 1.673459768295288,
+    "finite": 0.013199230656027794
+  },
+  {
+    "step": 974,
+    "loss": 1.2869048118591309,
+    "diagonal": 1.276890754699707,
+    "finite": 0.010014076717197895
+  },
+  {
+    "step": 975,
+    "loss": 1.3142194747924805,
+    "diagonal": 1.3024333715438843,
+    "finite": 0.011786107905209064
+  },
+  {
+    "step": 976,
+    "loss": 1.4329811334609985,
+    "diagonal": 1.4208083152770996,
+    "finite": 0.012172764167189598
+  },
+  {
+    "step": 977,
+    "loss": 1.267240047454834,
+    "diagonal": 1.252692699432373,
+    "finite": 0.01454737689346075
+  },
+  {
+    "step": 978,
+    "loss": 1.6191284656524658,
+    "diagonal": 1.6062602996826172,
+    "finite": 0.012868178077042103
+  },
+  {
+    "step": 979,
+    "loss": 1.7430675029754639,
+    "diagonal": 1.7317637205123901,
+    "finite": 0.011303759180009365
+  },
+  {
+    "step": 980,
+    "loss": 1.804638385772705,
+    "diagonal": 1.7914040088653564,
+    "finite": 0.013234386220574379
+  },
+  {
+    "step": 981,
+    "loss": 1.8807165622711182,
+    "diagonal": 1.8589928150177002,
+    "finite": 0.021723758429288864
+  },
+  {
+    "step": 982,
+    "loss": 1.2586305141448975,
+    "diagonal": 1.24540376663208,
+    "finite": 0.01322675310075283
+  },
+  {
+    "step": 983,
+    "loss": 1.5774874687194824,
+    "diagonal": 1.55953049659729,
+    "finite": 0.01795697957277298
+  },
+  {
+    "step": 984,
+    "loss": 1.434025764465332,
+    "diagonal": 1.4246189594268799,
+    "finite": 0.009406838566064835
+  },
+  {
+    "step": 985,
+    "loss": 1.395291805267334,
+    "diagonal": 1.3760406970977783,
+    "finite": 0.01925111748278141
+  },
+  {
+    "step": 986,
+    "loss": 1.3083462715148926,
+    "diagonal": 1.2960748672485352,
+    "finite": 0.012271457351744175
+  },
+  {
+    "step": 987,
+    "loss": 1.8161016702651978,
+    "diagonal": 1.8030376434326172,
+    "finite": 0.01306404173374176
+  },
+  {
+    "step": 988,
+    "loss": 1.5848900079727173,
+    "diagonal": 1.5740140676498413,
+    "finite": 0.010875887237489223
+  },
+  {
+    "step": 989,
+    "loss": 1.5864003896713257,
+    "diagonal": 1.5714555978775024,
+    "finite": 0.014944837428629398
+  },
+  {
+    "step": 990,
+    "loss": 1.5194449424743652,
+    "diagonal": 1.5082547664642334,
+    "finite": 0.011190160177648067
+  },
+  {
+    "step": 991,
+    "loss": 1.3973973989486694,
+    "diagonal": 1.3812777996063232,
+    "finite": 0.016119573265314102
+  },
+  {
+    "step": 992,
+    "loss": 1.6073291301727295,
+    "diagonal": 1.5941946506500244,
+    "finite": 0.013134434819221497
+  },
+  {
+    "step": 993,
+    "loss": 0.9474266767501831,
+    "diagonal": 0.9332826137542725,
+    "finite": 0.014144064858555794
+  },
+  {
+    "step": 994,
+    "loss": 1.5901778936386108,
+    "diagonal": 1.5735042095184326,
+    "finite": 0.016673695296049118
+  },
+  {
+    "step": 995,
+    "loss": 1.1700079441070557,
+    "diagonal": 1.1566864252090454,
+    "finite": 0.013321483507752419
+  },
+  {
+    "step": 996,
+    "loss": 1.5542638301849365,
+    "diagonal": 1.540337085723877,
+    "finite": 0.013926783576607704
+  },
+  {
+    "step": 997,
+    "loss": 1.9929472208023071,
+    "diagonal": 1.9811441898345947,
+    "finite": 0.011803047731518745
+  },
+  {
+    "step": 998,
+    "loss": 1.1867130994796753,
+    "diagonal": 1.1767488718032837,
+    "finite": 0.00996426586061716
+  },
+  {
+    "step": 999,
+    "loss": 1.4517956972122192,
+    "diagonal": 1.4401682615280151,
+    "finite": 0.011627462692558765
+  }
+]
diff --git a/lecture_6/verified_examples/meta-finetune/report.json b/lecture_6/verified_examples/meta-finetune/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..5705bbdbf2f8895702ac73f09fd13711222c251e
--- /dev/null
+++ b/lecture_6/verified_examples/meta-finetune/report.json
@@ -0,0 +1,1116 @@
+{
+  "method": "meta",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 3.0458434343338014,
+  "train_loss_last_20_mean": 1.5032016336917877,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "posterior_mean_rmse": 0.27705347537994385,
+  "posterior_variance_rmse": 0.48735880851745605,
+  "posterior_reference_mean": [
+    [
+      0.0,
+      0.0
+    ],
+    [
+      1.5137563943862915,
+      -1.3221392631530762
+    ],
+    [
+      -1.3908926248550415,
+      1.3908926248550415
+    ]
+  ],
+  "posterior_estimated_mean": [
+    [
+      -0.157099649310112,
+      -0.1464245617389679
+    ],
+    [
+      1.1796598434448242,
+      -0.7746201753616333
+    ],
+    [
+      -1.3402910232543945,
+      1.4126453399658203
+    ]
+  ],
+  "unconditional_mean_reward": -0.14134308695793152,
+  "guided_mean_reward": 0.7622178196907043,
+  "guided_distribution": {
+    "finite_samples": true,
+    "mean_distance_to_center": 0.6410579681396484,
+    "mode_fractions": [
+      0.015625,
+      0.0546875,
+      0.5078125,
+      0.421875
+    ],
+    "mode_entropy": 0.932124137878418,
+    "mean_target_log_density": -6.232669830322266
+  },
+  "posterior_steps": 4,
+  "particles": 32,
+  "importance_posterior_mean": [
+    [
+      1.3134080171585083,
+      -1.0870338678359985
+    ]
+  ],
+  "importance_effective_sample_size": [
+    87.88063049316406
+  ],
+  "posterior_value_context_gradient": [
+    [
+      0.4733681380748749,
+      0.002515168162062764
+    ]
+  ],
+  "finite_value_gradient": true,
+  "guided_samples": [
+    [
+      1.432874083518982,
+      -1.9540385007858276
+    ],
+    [
+      0.2208276093006134,
+      -0.04639088362455368
+    ],
+    [
+      1.979648470878601,
+      1.3869153261184692
+    ],
+    [
+      1.9227641820907593,
+      -1.5197793245315552
+    ],
+    [
+      2.124160051345825,
+      0.16127659380435944
+    ],
+    [
+      1.2938504219055176,
+      -1.8208990097045898
+    ],
+    [
+      0.8483301401138306,
+      1.1801302433013916
+    ],
+    [
+      2.000957489013672,
+      -1.7235546112060547
+    ],
+    [
+      1.698338508605957,
+      -1.9467189311981201
+    ],
+    [
+      1.3912973403930664,
+      -1.872453212738037
+    ],
+    [
+      1.1438207626342773,
+      -1.5401631593704224
+    ],
+    [
+      1.5465234518051147,
+      0.8512535095214844
+    ],
+    [
+      1.6385042667388916,
+      1.4052202701568604
+    ],
+    [
+      1.521420955657959,
+      0.5652914047241211
+    ],
+    [
+      1.9247902631759644,
+      1.5180368423461914
+    ],
+    [
+      1.8034380674362183,
+      1.7750799655914307
+    ],
+    [
+      -2.092954635620117,
+      -0.43861156702041626
+    ],
+    [
+      0.32258427143096924,
+      1.798687219619751
+    ],
+    [
+      1.7338910102844238,
+      1.1989892721176147
+    ],
+    [
+      0.9456591606140137,
+      -1.5983660221099854
+    ],
+    [
+      1.175989031791687,
+      -1.5632191896438599
+    ],
+    [
+      1.424456238746643,
+      1.1700040102005005
+    ],
+    [
+      0.8277812600135803,
+      1.0473628044128418
+    ],
+    [
+      1.4300353527069092,
+      1.5866093635559082
+    ],
+    [
+      1.670502781867981,
+      1.8120521306991577
+    ],
+    [
+      1.8810707330703735,
+      -1.624727487564087
+    ],
+    [
+      1.384511947631836,
+      -1.9195313453674316
+    ],
+    [
+      1.5273152589797974,
+      1.6956303119659424
+    ],
+    [
+      1.8767547607421875,
+      -1.8994884490966797
+    ],
+    [
+      1.857665777206421,
+      1.6681671142578125
+    ],
+    [
+      1.5546627044677734,
+      1.3074443340301514
+    ],
+    [
+      1.5416957139968872,
+      1.6860566139221191
+    ],
+    [
+      1.4616161584854126,
+      1.4331393241882324
+    ],
+    [
+      1.944293737411499,
+      1.2703872919082642
+    ],
+    [
+      1.879935383796692,
+      -1.026494026184082
+    ],
+    [
+      1.934020757675171,
+      -1.7339022159576416
+    ],
+    [
+      1.9083325862884521,
+      1.6035058498382568
+    ],
+    [
+      0.7840400338172913,
+      -1.852790117263794
+    ],
+    [
+      0.45498979091644287,
+      -0.15131686627864838
+    ],
+    [
+      1.9579304456710815,
+      1.2055346965789795
+    ],
+    [
+      -0.04084652662277222,
+      1.3847987651824951
+    ],
+    [
+      1.3900651931762695,
+      -1.3787974119186401
+    ],
+    [
+      -1.831339716911316,
+      1.7367851734161377
+    ],
+    [
+      1.8523409366607666,
+      -0.3262990713119507
+    ],
+    [
+      2.0067789554595947,
+      -1.3549904823303223
+    ],
+    [
+      1.414245367050171,
+      -0.6606642603874207
+    ],
+    [
+      1.6482794284820557,
+      -1.763962984085083
+    ],
+    [
+      1.965883493423462,
+      -0.9733855724334717
+    ],
+    [
+      1.2045841217041016,
+      -1.9775246381759644
+    ],
+    [
+      1.6554720401763916,
+      1.3468334674835205
+    ],
+    [
+      2.06345272064209,
+      -1.598726511001587
+    ],
+    [
+      1.5615274906158447,
+      -1.5594720840454102
+    ],
+    [
+      1.8998456001281738,
+      1.162188172340393
+    ],
+    [
+      1.4374051094055176,
+      -1.883378267288208
+    ],
+    [
+      1.640458583831787,
+      1.5289158821105957
+    ],
+    [
+      1.2299273014068604,
+      -1.8908863067626953
+    ],
+    [
+      1.6861473321914673,
+      -1.8475886583328247
+    ],
+    [
+      1.9658950567245483,
+      1.6793895959854126
+    ],
+    [
+      1.3812224864959717,
+      1.8047938346862793
+    ],
+    [
+      1.8473602533340454,
+      -1.9482097625732422
+    ],
+    [
+      1.2858154773712158,
+      -1.8881914615631104
+    ],
+    [
+      1.4477341175079346,
+      0.28412652015686035
+    ],
+    [
+      1.3478004932403564,
+      1.1183335781097412
+    ],
+    [
+      1.624673843383789,
+      -1.4096980094909668
+    ],
+    [
+      0.487331360578537,
+      0.4385218322277069
+    ],
+    [
+      0.8607577085494995,
+      1.8577219247817993
+    ],
+    [
+      1.5059430599212646,
+      -1.8200547695159912
+    ],
+    [
+      1.711211919784546,
+      -1.0476093292236328
+    ],
+    [
+      1.7383251190185547,
+      -1.5973925590515137
+    ],
+    [
+      1.9382457733154297,
+      -0.97356116771698
+    ],
+    [
+      1.75698983669281,
+      -2.0078370571136475
+    ],
+    [
+      1.6290740966796875,
+      -1.7874962091445923
+    ],
+    [
+      1.796375036239624,
+      0.5234100818634033
+    ],
+    [
+      1.5999326705932617,
+      1.2443598508834839
+    ],
+    [
+      1.850302815437317,
+      1.4281625747680664
+    ],
+    [
+      1.983588695526123,
+      0.45138734579086304
+    ],
+    [
+      1.293163776397705,
+      -1.8952271938323975
+    ],
+    [
+      1.8628308773040771,
+      -1.1983681917190552
+    ],
+    [
+      1.5650606155395508,
+      -1.902662992477417
+    ],
+    [
+      2.283637762069702,
+      0.09935762733221054
+    ],
+    [
+      -1.2044546604156494,
+      0.4875372052192688
+    ],
+    [
+      1.8968276977539062,
+      -0.33155375719070435
+    ],
+    [
+      1.5010015964508057,
+      -1.5839101076126099
+    ],
+    [
+      1.3440064191818237,
+      0.3072242736816406
+    ],
+    [
+      1.802398920059204,
+      -0.6630058288574219
+    ],
+    [
+      1.881528615951538,
+      -1.4837820529937744
+    ],
+    [
+      1.0239070653915405,
+      -1.9808070659637451
+    ],
+    [
+      1.5244547128677368,
+      0.8141316771507263
+    ],
+    [
+      0.32002905011177063,
+      -1.5569409132003784
+    ],
+    [
+      1.5200626850128174,
+      -0.25145983695983887
+    ],
+    [
+      0.2447371482849121,
+      -1.7817766666412354
+    ],
+    [
+      1.729570984840393,
+      -0.582362949848175
+    ],
+    [
+      1.6565954685211182,
+      1.5481932163238525
+    ],
+    [
+      1.739347219467163,
+      1.1911739110946655
+    ],
+    [
+      -0.39820170402526855,
+      0.30793625116348267
+    ],
+    [
+      1.1334669589996338,
+      1.2492892742156982
+    ],
+    [
+      -0.3003109097480774,
+      1.3871939182281494
+    ],
+    [
+      -1.3934688568115234,
+      1.4562675952911377
+    ],
+    [
+      1.1395008563995361,
+      -1.0350968837738037
+    ],
+    [
+      1.8361214399337769,
+      -1.884864330291748
+    ],
+    [
+      2.1193716526031494,
+      1.4756169319152832
+    ],
+    [
+      2.1061878204345703,
+      0.9368805289268494
+    ],
+    [
+      1.1800754070281982,
+      -0.1682790219783783
+    ],
+    [
+      1.8791199922561646,
+      0.7410354018211365
+    ],
+    [
+      1.4908061027526855,
+      -1.3782926797866821
+    ],
+    [
+      -0.927864670753479,
+      -1.0457499027252197
+    ],
+    [
+      1.3490841388702393,
+      -2.0117571353912354
+    ],
+    [
+      1.6318436861038208,
+      0.3625527620315552
+    ],
+    [
+      2.206484317779541,
+      1.363595962524414
+    ],
+    [
+      0.7087500095367432,
+      -1.834436058998108
+    ],
+    [
+      1.2797033786773682,
+      -1.7353260517120361
+    ],
+    [
+      1.5315409898757935,
+      -1.5559444427490234
+    ],
+    [
+      1.358616590499878,
+      0.20357294380664825
+    ],
+    [
+      1.9184476137161255,
+      1.464897632598877
+    ],
+    [
+      1.0342620611190796,
+      -0.08142930269241333
+    ],
+    [
+      0.6879051923751831,
+      -1.6877650022506714
+    ],
+    [
+      1.337918758392334,
+      1.6181681156158447
+    ],
+    [
+      0.9619367718696594,
+      -0.14192847907543182
+    ],
+    [
+      1.7112085819244385,
+      -1.7760181427001953
+    ],
+    [
+      1.640207290649414,
+      1.3012608289718628
+    ],
+    [
+      1.5726418495178223,
+      1.667948842048645
+    ],
+    [
+      0.8728251457214355,
+      0.8489036560058594
+    ],
+    [
+      1.5849840641021729,
+      0.37725794315338135
+    ],
+    [
+      2.017688035964966,
+      1.1252654790878296
+    ],
+    [
+      1.673474669456482,
+      -1.9042937755584717
+    ],
+    [
+      -1.781908392906189,
+      1.7424404621124268
+    ],
+    [
+      1.6836049556732178,
+      -0.2011474221944809
+    ],
+    [
+      1.8146699666976929,
+      -1.7402317523956299
+    ]
+  ],
+  "finetuned_mean_reward": 0.734612762928009,
+  "finetuned_finite_samples": true,
+  "finetuned_samples": [
+    [
+      1.204545497894287,
+      2.0202763080596924
+    ],
+    [
+      0.8395195603370667,
+      1.563661813735962
+    ],
+    [
+      0.011432977393269539,
+      -1.9247214794158936
+    ],
+    [
+      1.0292080640792847,
+      0.08555689454078674
+    ],
+    [
+      1.552053451538086,
+      -0.7888545989990234
+    ],
+    [
+      1.0204752683639526,
+      1.6653940677642822
+    ],
+    [
+      1.8751704692840576,
+      -2.5189976692199707
+    ],
+    [
+      1.1472216844558716,
+      -2.851229667663574
+    ],
+    [
+      1.031595230102539,
+      -1.153358817100525
+    ],
+    [
+      1.5156258344650269,
+      2.2274580001831055
+    ],
+    [
+      1.4613581895828247,
+      0.6079965233802795
+    ],
+    [
+      1.9079248905181885,
+      -0.22090007364749908
+    ],
+    [
+      1.7812514305114746,
+      0.3539029359817505
+    ],
+    [
+      1.5308512449264526,
+      -0.0620194748044014
+    ],
+    [
+      1.2873573303222656,
+      -1.4287210702896118
+    ],
+    [
+      1.9191255569458008,
+      -1.66712486743927
+    ],
+    [
+      1.579154133796692,
+      1.0533397197723389
+    ],
+    [
+      1.758602261543274,
+      -2.5534403324127197
+    ],
+    [
+      1.4980533123016357,
+      0.29112255573272705
+    ],
+    [
+      1.7520976066589355,
+      -1.2870943546295166
+    ],
+    [
+      0.607453465461731,
+      1.8191065788269043
+    ],
+    [
+      1.0636922121047974,
+      -0.4320974349975586
+    ],
+    [
+      1.1059573888778687,
+      -2.447324514389038
+    ],
+    [
+      1.3352887630462646,
+      -2.606428623199463
+    ],
+    [
+      1.5631366968154907,
+      -1.7312020063400269
+    ],
+    [
+      0.6072590947151184,
+      0.30393028259277344
+    ],
+    [
+      1.5674540996551514,
+      0.07271324098110199
+    ],
+    [
+      1.509547472000122,
+      -2.0025200843811035
+    ],
+    [
+      0.6410830020904541,
+      0.9192053079605103
+    ],
+    [
+      1.533889889717102,
+      -2.3215458393096924
+    ],
+    [
+      1.3453178405761719,
+      -0.7663209438323975
+    ],
+    [
+      -2.2716586589813232,
+      -1.751798152923584
+    ],
+    [
+      1.6451207399368286,
+      -3.339946985244751
+    ],
+    [
+      1.1326465606689453,
+      -1.6525263786315918
+    ],
+    [
+      1.7562757730484009,
+      2.0664584636688232
+    ],
+    [
+      1.5056228637695312,
+      -1.1336036920547485
+    ],
+    [
+      1.747294545173645,
+      0.8872401118278503
+    ],
+    [
+      1.3786579370498657,
+      1.9116294384002686
+    ],
+    [
+      1.6772531270980835,
+      3.892578601837158
+    ],
+    [
+      1.6930135488510132,
+      -0.09875494241714478
+    ],
+    [
+      1.446522831916809,
+      1.2329654693603516
+    ],
+    [
+      0.668691873550415,
+      -0.3085908889770508
+    ],
+    [
+      1.4806814193725586,
+      -0.742067277431488
+    ],
+    [
+      1.9174156188964844,
+      0.697191596031189
+    ],
+    [
+      0.9604248404502869,
+      -1.5259552001953125
+    ],
+    [
+      1.3479887247085571,
+      1.1450366973876953
+    ],
+    [
+      1.2622473239898682,
+      -0.9540344476699829
+    ],
+    [
+      1.798174500465393,
+      -1.7271538972854614
+    ],
+    [
+      1.5813689231872559,
+      3.086974620819092
+    ],
+    [
+      0.714966356754303,
+      0.7170688509941101
+    ],
+    [
+      1.4665069580078125,
+      1.4499108791351318
+    ],
+    [
+      1.4766684770584106,
+      -0.18675798177719116
+    ],
+    [
+      1.5891591310501099,
+      -0.48987895250320435
+    ],
+    [
+      1.514191746711731,
+      1.0594515800476074
+    ],
+    [
+      1.3443447351455688,
+      2.252375364303589
+    ],
+    [
+      -1.9139573574066162,
+      1.0223358869552612
+    ],
+    [
+      1.6179765462875366,
+      -0.521959662437439
+    ],
+    [
+      1.3962427377700806,
+      0.5039499998092651
+    ],
+    [
+      0.8394510746002197,
+      -0.7557700276374817
+    ],
+    [
+      0.36558306217193604,
+      4.093613147735596
+    ],
+    [
+      0.8844572901725769,
+      -0.16319122910499573
+    ],
+    [
+      1.5393340587615967,
+      1.84600031375885
+    ],
+    [
+      1.4663207530975342,
+      1.1740261316299438
+    ],
+    [
+      1.78615403175354,
+      0.3660852611064911
+    ],
+    [
+      2.012873888015747,
+      -1.8843377828598022
+    ],
+    [
+      1.9175571203231812,
+      -3.1384449005126953
+    ],
+    [
+      1.4937684535980225,
+      -0.49992799758911133
+    ],
+    [
+      1.9081119298934937,
+      -1.3846001625061035
+    ],
+    [
+      1.1282516717910767,
+      -1.3550089597702026
+    ],
+    [
+      0.582141637802124,
+      -0.4057713747024536
+    ],
+    [
+      1.6701393127441406,
+      0.6978490948677063
+    ],
+    [
+      1.6558542251586914,
+      0.14261481165885925
+    ],
+    [
+      1.4740654230117798,
+      -0.10865404456853867
+    ],
+    [
+      1.377184271812439,
+      0.6311445236206055
+    ],
+    [
+      1.6776789426803589,
+      1.7064096927642822
+    ],
+    [
+      1.5761741399765015,
+      -2.0794873237609863
+    ],
+    [
+      1.8214240074157715,
+      -2.305760383605957
+    ],
+    [
+      1.9291707277297974,
+      -1.0854920148849487
+    ],
+    [
+      1.6693333387374878,
+      1.1520922183990479
+    ],
+    [
+      1.978025197982788,
+      -0.7698981761932373
+    ],
+    [
+      1.2478212118148804,
+      2.18684983253479
+    ],
+    [
+      1.6668823957443237,
+      0.6381587982177734
+    ],
+    [
+      1.5765467882156372,
+      2.9528133869171143
+    ],
+    [
+      0.9844843149185181,
+      4.793434143066406
+    ],
+    [
+      1.2976927757263184,
+      -0.34722381830215454
+    ],
+    [
+      0.001991868019104004,
+      -0.4842826724052429
+    ],
+    [
+      2.162364959716797,
+      2.3297102451324463
+    ],
+    [
+      1.3965034484863281,
+      0.6863333582878113
+    ],
+    [
+      -0.7172364592552185,
+      1.9836323261260986
+    ],
+    [
+      1.4534975290298462,
+      -0.11517003178596497
+    ],
+    [
+      1.936685562133789,
+      0.8885366916656494
+    ],
+    [
+      -2.5725338459014893,
+      1.4392259120941162
+    ],
+    [
+      2.1394033432006836,
+      -1.7810170650482178
+    ],
+    [
+      1.5904786586761475,
+      1.13544762134552
+    ],
+    [
+      0.6009702086448669,
+      0.33576881885528564
+    ],
+    [
+      1.3099594116210938,
+      0.746395468711853
+    ],
+    [
+      1.38883376121521,
+      0.5075179934501648
+    ],
+    [
+      1.6963675022125244,
+      -1.4597320556640625
+    ],
+    [
+      0.8554782271385193,
+      0.03789554908871651
+    ],
+    [
+      1.6491267681121826,
+      -1.4370250701904297
+    ],
+    [
+      0.6046675443649292,
+      -1.417728066444397
+    ],
+    [
+      0.9545380473136902,
+      0.4258308410644531
+    ],
+    [
+      1.2988592386245728,
+      1.9150599241256714
+    ],
+    [
+      -0.6126967072486877,
+      -0.7636808156967163
+    ],
+    [
+      1.1173759698867798,
+      -2.252331495285034
+    ],
+    [
+      0.32354608178138733,
+      1.5408375263214111
+    ],
+    [
+      1.6510168313980103,
+      -1.9720102548599243
+    ],
+    [
+      1.70579195022583,
+      -1.8305665254592896
+    ],
+    [
+      -1.9881759881973267,
+      -1.9685523509979248
+    ],
+    [
+      1.279486060142517,
+      0.8521073460578918
+    ],
+    [
+      1.4578067064285278,
+      -1.56979238986969
+    ],
+    [
+      1.9585494995117188,
+      0.7976276874542236
+    ],
+    [
+      1.520999550819397,
+      0.35213571786880493
+    ],
+    [
+      1.688349962234497,
+      -1.6569067239761353
+    ],
+    [
+      1.9023723602294922,
+      -1.040700912475586
+    ],
+    [
+      1.2333146333694458,
+      -0.5123099088668823
+    ],
+    [
+      1.5982524156570435,
+      3.0023305416107178
+    ],
+    [
+      1.8805029392242432,
+      1.5111782550811768
+    ],
+    [
+      1.5935304164886475,
+      -0.31875303387641907
+    ],
+    [
+      0.3667575716972351,
+      -1.6032779216766357
+    ],
+    [
+      2.143226146697998,
+      -1.594353199005127
+    ],
+    [
+      -0.7376735806465149,
+      0.19856323301792145
+    ],
+    [
+      0.6441078186035156,
+      1.1749310493469238
+    ],
+    [
+      1.646370530128479,
+      2.7759838104248047
+    ],
+    [
+      1.7047877311706543,
+      -1.6882044076919556
+    ],
+    [
+      -3.91290545463562,
+      2.10302996635437
+    ],
+    [
+      1.243596076965332,
+      0.547980785369873
+    ],
+    [
+      1.9510372877120972,
+      -1.5548598766326904
+    ]
+  ],
+  "finetuned_sampling_note": "Full-interval Heun integration; boundary times extrapolate beyond fine-tuning support.",
+  "finite_samples": true,
+  "mean_distance_to_center": 0.9143958687782288,
+  "mode_fractions": [
+    0.3125,
+    0.2578125,
+    0.2578125,
+    0.171875
+  ],
+  "mode_entropy": 1.365095853805542,
+  "mean_target_log_density": -10.699212074279785,
+  "elapsed_seconds": 3.420703316005529
+}
diff --git a/lecture_6/verified_examples/meta-finetune/samples.txt b/lecture_6/verified_examples/meta-finetune/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..bb0431cbf06e8bb9dce52a0b3db17b89567e73be
--- /dev/null
+++ b/lecture_6/verified_examples/meta-finetune/samples.txt
@@ -0,0 +1,128 @@
+1.8235646 0.2840534
+-0.5814909 1.4675775
+-1.8262382 -0.5463361
+-2.1038854 -0.9290856
+-0.5743225 -1.8152400
+-2.2973895 1.6775420
+0.5299083 -2.1270809
+0.8204561 1.3323586
+0.6014575 -0.1730817
+-1.1869117 0.2184291
+-1.0309213 1.5909073
+0.5516089 0.6442144
+0.8404521 -1.0471361
+-1.9026124 -1.9249947
+-1.2030610 -1.3287936
+1.1189814 -0.8402100
+-0.4988412 1.0487860
+0.0658105 -1.7212564
+2.0743008 -1.6605499
+0.1236886 0.5871138
+-1.6329110 1.5222962
+-2.6675615 0.4633856
+-1.5704458 -0.6821549
+1.5613501 -1.8913007
+-2.6032236 -2.0263000
+-1.5067567 -0.3172832
+-1.9537389 -1.3581443
+0.6129556 -2.2514820
+1.4496561 1.2255797
+-0.1838326 -2.1546605
+-2.7607505 1.9977862
+-2.4884427 1.0715288
+0.8479332 -1.1511809
+0.5794094 -2.4070587
+-1.5050663 1.9545105
+-1.4026222 -1.5872152
+-1.7973433 -1.3198395
+-1.2342426 1.8729073
+1.9491110 0.8056205
+0.1061184 -2.2566013
+-0.3054272 0.5977394
+-1.6626368 -0.8267638
+-0.8401585 1.3837842
+2.2069483 -0.8624932
+-1.0141340 -1.8917056
+-0.3683970 -0.4894097
+1.5109534 1.5286602
+-0.4530666 1.2331275
+0.8551937 1.3678513
+-1.0781388 1.5701976
+1.7152305 0.9469091
+1.2406930 0.0315916
+-0.7125176 -1.2778836
+-0.4830938 1.0424199
+-1.1490767 1.7313992
+-2.0085611 0.7131109
+0.9569877 -2.0194778
+-1.0347059 -1.5298440
+-1.5424138 -0.9005758
+-1.4319432 2.2767177
+-1.4173055 -1.3439649
+0.4780815 0.6122875
+0.0199950 0.8457472
+1.4453430 2.0340047
+1.1257138 0.1471111
+1.2938999 -1.7328856
+2.0727005 -1.6808670
+-1.7246425 -1.6863568
+-0.3860345 -1.3310034
+-2.2909045 -0.4902134
+-0.1369570 -2.0212309
+-2.1521020 0.8427050
+-1.8755906 1.5917650
+1.6317800 1.2439458
+0.8764249 -2.0320723
+-0.2034333 -0.7536104
+-0.6149109 -1.3143404
+0.7797673 -1.7384816
+-0.8145548 0.3170268
+2.4403534 1.8561149
+-2.3181899 -1.4791181
+0.2916472 -1.1452258
+-1.2054375 2.2681451
+0.4937436 0.6093829
+-0.2878294 -2.5764925
+-1.1713526 -1.8817768
+0.8140897 2.1135807
+0.8390487 -1.8510487
+-2.1428463 -0.8781706
+1.4871042 -1.5311562
+0.9443722 -2.0985630
+-2.8753469 0.8312819
+1.3258595 -1.0892494
+-0.8831242 -1.9832208
+-2.1194906 -2.4844036
+-1.6342931 0.7363718
+1.2487797 -2.2321706
+0.5276757 -2.3629532
+-1.5941479 1.1652606
+-0.3122345 -2.1854608
+-0.7947186 0.6110249
+0.5482047 -1.6277281
+-0.2658420 1.3829620
+-1.5029284 0.7142269
+-1.6991533 -0.7421408
+-0.5590621 -2.1612377
+1.0103567 -0.1444041
+-0.7205022 -1.0651522
+-0.6758839 -0.4015428
+-2.1426892 1.8529508
+0.9843839 0.4604543
+2.4236128 -0.5857831
+0.2229572 -2.5284841
+-1.7341564 -1.7494152
+0.2604243 -0.5902460
+-0.9988738 -0.5933940
+1.7811785 1.3393323
+1.4884186 0.9384286
+0.7130125 -0.6618559
+-1.3420393 -1.5511777
+0.4685817 -1.4641353
+-0.8732074 1.0521674
+-0.0105790 0.5828336
+1.7100034 1.0594392
+0.1160956 -2.1494484
+-1.6675565 1.5062786
+-1.8025006 -2.5524969
+0.7404482 -2.6601062
diff --git a/lecture_6/verified_examples/meta/config.json b/lecture_6/verified_examples/meta/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..5dff3cde7a79356de569e36d8b384b5b3edadff5
--- /dev/null
+++ b/lecture_6/verified_examples/meta/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "meta",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/meta"
+}
diff --git a/lecture_6/verified_examples/meta/losses.json b/lecture_6/verified_examples/meta/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..ef69f0381758edd1b433af47bd7f433dfb295ff1
--- /dev/null
+++ b/lecture_6/verified_examples/meta/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 2.8069956302642822,
+    "diagonal": 2.8069956302642822,
+    "finite": 1.6036477973102592e-05
+  },
+  {
+    "step": 1,
+    "loss": 3.074927568435669,
+    "diagonal": 3.0749261379241943,
+    "finite": 0.00017141597345471382
+  },
+  {
+    "step": 2,
+    "loss": 4.215892791748047,
+    "diagonal": 4.215885162353516,
+    "finite": 0.0006397111574187875
+  },
+  {
+    "step": 3,
+    "loss": 2.811654806137085,
+    "diagonal": 2.8116350173950195,
+    "finite": 0.0012350926408544183
+  },
+  {
+    "step": 4,
+    "loss": 2.7368509769439697,
+    "diagonal": 2.7368104457855225,
+    "finite": 0.0020273281261324883
+  },
+  {
+    "step": 5,
+    "loss": 2.609227180480957,
+    "diagonal": 2.6091418266296387,
+    "finite": 0.003557848045602441
+  },
+  {
+    "step": 6,
+    "loss": 2.785521984100342,
+    "diagonal": 2.7853894233703613,
+    "finite": 0.004734779242426157
+  },
+  {
+    "step": 7,
+    "loss": 2.833909511566162,
+    "diagonal": 2.833706855773926,
+    "finite": 0.006330839823931456
+  },
+  {
+    "step": 8,
+    "loss": 3.8368701934814453,
+    "diagonal": 3.836601495742798,
+    "finite": 0.007462475448846817
+  },
+  {
+    "step": 9,
+    "loss": 3.3032782077789307,
+    "diagonal": 3.3029003143310547,
+    "finite": 0.009446321986615658
+  },
+  {
+    "step": 10,
+    "loss": 3.144731283187866,
+    "diagonal": 3.1443347930908203,
+    "finite": 0.0090120704844594
+  },
+  {
+    "step": 11,
+    "loss": 3.2948248386383057,
+    "diagonal": 3.2942471504211426,
+    "finite": 0.012035545893013477
+  },
+  {
+    "step": 12,
+    "loss": 3.2986042499542236,
+    "diagonal": 3.2978270053863525,
+    "finite": 0.014945673756301403
+  },
+  {
+    "step": 13,
+    "loss": 2.9874086380004883,
+    "diagonal": 2.986298084259033,
+    "finite": 0.019831398501992226
+  },
+  {
+    "step": 14,
+    "loss": 3.091095209121704,
+    "diagonal": 3.089963436126709,
+    "finite": 0.018863970413804054
+  },
+  {
+    "step": 15,
+    "loss": 3.0512516498565674,
+    "diagonal": 3.0496177673339844,
+    "finite": 0.025528477504849434
+  },
+  {
+    "step": 16,
+    "loss": 2.4063239097595215,
+    "diagonal": 2.4044957160949707,
+    "finite": 0.026885831728577614
+  },
+  {
+    "step": 17,
+    "loss": 3.043684720993042,
+    "diagonal": 3.041342258453369,
+    "finite": 0.032533951103687286
+  },
+  {
+    "step": 18,
+    "loss": 3.0211808681488037,
+    "diagonal": 3.018683433532715,
+    "finite": 0.03286237269639969
+  },
+  {
+    "step": 19,
+    "loss": 2.5626344680786133,
+    "diagonal": 2.5590932369232178,
+    "finite": 0.04426520690321922
+  },
+  {
+    "step": 20,
+    "loss": 2.6786863803863525,
+    "diagonal": 2.675204277038574,
+    "finite": 0.041452556848526
+  },
+  {
+    "step": 21,
+    "loss": 3.380387306213379,
+    "diagonal": 3.3762152194976807,
+    "finite": 0.04740891233086586
+  },
+  {
+    "step": 22,
+    "loss": 2.74570369720459,
+    "diagonal": 2.740696907043457,
+    "finite": 0.05442281439900398
+  },
+  {
+    "step": 23,
+    "loss": 3.0334250926971436,
+    "diagonal": 3.028674840927124,
+    "finite": 0.04948138818144798
+  },
+  {
+    "step": 24,
+    "loss": 2.9872004985809326,
+    "diagonal": 2.9803104400634766,
+    "finite": 0.06889992952346802
+  },
+  {
+    "step": 25,
+    "loss": 2.677898406982422,
+    "diagonal": 2.668539047241211,
+    "finite": 0.08999381214380264
+  },
+  {
+    "step": 26,
+    "loss": 2.6587164402008057,
+    "diagonal": 2.650024890899658,
+    "finite": 0.0804772675037384
+  },
+  {
+    "step": 27,
+    "loss": 2.4385454654693604,
+    "diagonal": 2.4287936687469482,
+    "finite": 0.08707059174776077
+  },
+  {
+    "step": 28,
+    "loss": 2.8749330043792725,
+    "diagonal": 2.863264322280884,
+    "finite": 0.10059255361557007
+  },
+  {
+    "step": 29,
+    "loss": 2.1367387771606445,
+    "diagonal": 2.123899221420288,
+    "finite": 0.10699589550495148
+  },
+  {
+    "step": 30,
+    "loss": 2.65293550491333,
+    "diagonal": 2.6400434970855713,
+    "finite": 0.1039675772190094
+  },
+  {
+    "step": 31,
+    "loss": 2.357799768447876,
+    "diagonal": 2.3455002307891846,
+    "finite": 0.0960906594991684
+  },
+  {
+    "step": 32,
+    "loss": 2.4420056343078613,
+    "diagonal": 2.424644947052002,
+    "finite": 0.13151966035366058
+  },
+  {
+    "step": 33,
+    "loss": 2.202800989151001,
+    "diagonal": 2.182314157485962,
+    "finite": 0.150638148188591
+  },
+  {
+    "step": 34,
+    "loss": 2.683154582977295,
+    "diagonal": 2.664757013320923,
+    "finite": 0.13141125440597534
+  },
+  {
+    "step": 35,
+    "loss": 2.338933229446411,
+    "diagonal": 2.319424867630005,
+    "finite": 0.13547508418560028
+  },
+  {
+    "step": 36,
+    "loss": 2.67002272605896,
+    "diagonal": 2.648465633392334,
+    "finite": 0.1456553190946579
+  },
+  {
+    "step": 37,
+    "loss": 2.197976589202881,
+    "diagonal": 2.1697375774383545,
+    "finite": 0.18578247725963593
+  },
+  {
+    "step": 38,
+    "loss": 2.657768487930298,
+    "diagonal": 2.6316158771514893,
+    "finite": 0.1676454097032547
+  },
+  {
+    "step": 39,
+    "loss": 2.198908567428589,
+    "diagonal": 2.166872501373291,
+    "finite": 0.20022545754909515
+  },
+  {
+    "step": 40,
+    "loss": 2.584825277328491,
+    "diagonal": 2.5535237789154053,
+    "finite": 0.190862774848938
+  },
+  {
+    "step": 41,
+    "loss": 2.5395636558532715,
+    "diagonal": 2.4971184730529785,
+    "finite": 0.25264933705329895
+  },
+  {
+    "step": 42,
+    "loss": 2.593226432800293,
+    "diagonal": 2.5474636554718018,
+    "finite": 0.26606234908103943
+  },
+  {
+    "step": 43,
+    "loss": 3.0073838233947754,
+    "diagonal": 2.9613521099090576,
+    "finite": 0.2615443766117096
+  },
+  {
+    "step": 44,
+    "loss": 2.072784423828125,
+    "diagonal": 2.0204131603240967,
+    "finite": 0.29095104336738586
+  },
+  {
+    "step": 45,
+    "loss": 2.7881054878234863,
+    "diagonal": 2.738741874694824,
+    "finite": 0.2682799994945526
+  },
+  {
+    "step": 46,
+    "loss": 2.482635259628296,
+    "diagonal": 2.433072090148926,
+    "finite": 0.2636339068412781
+  },
+  {
+    "step": 47,
+    "loss": 2.578479290008545,
+    "diagonal": 2.517843008041382,
+    "finite": 0.3158145248889923
+  },
+  {
+    "step": 48,
+    "loss": 2.498321771621704,
+    "diagonal": 2.4290664196014404,
+    "finite": 0.35334375500679016
+  },
+  {
+    "step": 49,
+    "loss": 2.3608524799346924,
+    "diagonal": 2.284632444381714,
+    "finite": 0.3810998797416687
+  },
+  {
+    "step": 50,
+    "loss": 2.5263426303863525,
+    "diagonal": 2.4523825645446777,
+    "finite": 0.36254939436912537
+  },
+  {
+    "step": 51,
+    "loss": 2.1986684799194336,
+    "diagonal": 2.112879753112793,
+    "finite": 0.4124453365802765
+  },
+  {
+    "step": 52,
+    "loss": 2.2526793479919434,
+    "diagonal": 2.1839661598205566,
+    "finite": 0.3241192698478699
+  },
+  {
+    "step": 53,
+    "loss": 1.8461322784423828,
+    "diagonal": 1.7619132995605469,
+    "finite": 0.3899025022983551
+  },
+  {
+    "step": 54,
+    "loss": 2.260822057723999,
+    "diagonal": 2.177457571029663,
+    "finite": 0.3789299726486206
+  },
+  {
+    "step": 55,
+    "loss": 2.3174147605895996,
+    "diagonal": 2.243345260620117,
+    "finite": 0.3306679427623749
+  },
+  {
+    "step": 56,
+    "loss": 2.490051031112671,
+    "diagonal": 2.391594886779785,
+    "finite": 0.43182507157325745
+  },
+  {
+    "step": 57,
+    "loss": 2.1433324813842773,
+    "diagonal": 2.030001640319824,
+    "finite": 0.4884951710700989
+  },
+  {
+    "step": 58,
+    "loss": 1.999982476234436,
+    "diagonal": 1.900361180305481,
+    "finite": 0.42212432622909546
+  },
+  {
+    "step": 59,
+    "loss": 1.9598116874694824,
+    "diagonal": 1.8363806009292603,
+    "finite": 0.5142963528633118
+  },
+  {
+    "step": 60,
+    "loss": 1.9787441492080688,
+    "diagonal": 1.8620755672454834,
+    "finite": 0.47814998030662537
+  },
+  {
+    "step": 61,
+    "loss": 1.9809156656265259,
+    "diagonal": 1.8368520736694336,
+    "finite": 0.5809016227722168
+  },
+  {
+    "step": 62,
+    "loss": 1.8451629877090454,
+    "diagonal": 1.7161004543304443,
+    "finite": 0.512152910232544
+  },
+  {
+    "step": 63,
+    "loss": 2.2742111682891846,
+    "diagonal": 2.136435031890869,
+    "finite": 0.5381883382797241
+  },
+  {
+    "step": 64,
+    "loss": 2.273287773132324,
+    "diagonal": 2.1227102279663086,
+    "finite": 0.5791442394256592
+  },
+  {
+    "step": 65,
+    "loss": 2.0214521884918213,
+    "diagonal": 1.8821924924850464,
+    "finite": 0.527498722076416
+  },
+  {
+    "step": 66,
+    "loss": 2.1416900157928467,
+    "diagonal": 2.0069210529327393,
+    "finite": 0.5028693079948425
+  },
+  {
+    "step": 67,
+    "loss": 1.9526633024215698,
+    "diagonal": 1.8053311109542847,
+    "finite": 0.5416625738143921
+  },
+  {
+    "step": 68,
+    "loss": 2.0982513427734375,
+    "diagonal": 1.9491933584213257,
+    "finite": 0.5400649905204773
+  },
+  {
+    "step": 69,
+    "loss": 2.4140124320983887,
+    "diagonal": 2.2468209266662598,
+    "finite": 0.5971121788024902
+  },
+  {
+    "step": 70,
+    "loss": 2.7674405574798584,
+    "diagonal": 2.628884792327881,
+    "finite": 0.4878724217414856
+  },
+  {
+    "step": 71,
+    "loss": 1.7945780754089355,
+    "diagonal": 1.6316888332366943,
+    "finite": 0.5655876398086548
+  },
+  {
+    "step": 72,
+    "loss": 1.957055926322937,
+    "diagonal": 1.8002420663833618,
+    "finite": 0.5370339155197144
+  },
+  {
+    "step": 73,
+    "loss": 2.16245174407959,
+    "diagonal": 2.0112602710723877,
+    "finite": 0.5107817053794861
+  },
+  {
+    "step": 74,
+    "loss": 2.5562222003936768,
+    "diagonal": 2.345935821533203,
+    "finite": 0.7009545564651489
+  },
+  {
+    "step": 75,
+    "loss": 2.5723955631256104,
+    "diagonal": 2.447998523712158,
+    "finite": 0.4092004895210266
+  },
+  {
+    "step": 76,
+    "loss": 2.3991355895996094,
+    "diagonal": 2.230273723602295,
+    "finite": 0.5482527017593384
+  },
+  {
+    "step": 77,
+    "loss": 2.9962761402130127,
+    "diagonal": 2.8370022773742676,
+    "finite": 0.5104934573173523
+  },
+  {
+    "step": 78,
+    "loss": 2.148745536804199,
+    "diagonal": 2.001556396484375,
+    "finite": 0.4657882750034332
+  },
+  {
+    "step": 79,
+    "loss": 2.9647417068481445,
+    "diagonal": 2.8199596405029297,
+    "finite": 0.45244383811950684
+  },
+  {
+    "step": 80,
+    "loss": 2.131894826889038,
+    "diagonal": 1.9787249565124512,
+    "finite": 0.47274649143218994
+  },
+  {
+    "step": 81,
+    "loss": 1.92849862575531,
+    "diagonal": 1.7544363737106323,
+    "finite": 0.5306777358055115
+  },
+  {
+    "step": 82,
+    "loss": 1.9041979312896729,
+    "diagonal": 1.7558454275131226,
+    "finite": 0.44684484601020813
+  },
+  {
+    "step": 83,
+    "loss": 2.5239899158477783,
+    "diagonal": 2.3480224609375,
+    "finite": 0.5237123966217041
+  },
+  {
+    "step": 84,
+    "loss": 2.747459888458252,
+    "diagonal": 2.5952112674713135,
+    "finite": 0.44779038429260254
+  },
+  {
+    "step": 85,
+    "loss": 2.1410231590270996,
+    "diagonal": 1.9963871240615845,
+    "finite": 0.4204533100128174
+  },
+  {
+    "step": 86,
+    "loss": 2.331653594970703,
+    "diagonal": 2.2119762897491455,
+    "finite": 0.343900203704834
+  },
+  {
+    "step": 87,
+    "loss": 2.1430771350860596,
+    "diagonal": 2.0016021728515625,
+    "finite": 0.40191739797592163
+  },
+  {
+    "step": 88,
+    "loss": 2.33323335647583,
+    "diagonal": 2.209773063659668,
+    "finite": 0.34679850935935974
+  },
+  {
+    "step": 89,
+    "loss": 2.2590832710266113,
+    "diagonal": 2.1292953491210938,
+    "finite": 0.3605222702026367
+  },
+  {
+    "step": 90,
+    "loss": 2.796050786972046,
+    "diagonal": 2.654806613922119,
+    "finite": 0.3880334794521332
+  },
+  {
+    "step": 91,
+    "loss": 1.9963884353637695,
+    "diagonal": 1.8662071228027344,
+    "finite": 0.3537536859512329
+  },
+  {
+    "step": 92,
+    "loss": 1.8122411966323853,
+    "diagonal": 1.6868007183074951,
+    "finite": 0.33720552921295166
+  },
+  {
+    "step": 93,
+    "loss": 2.1467721462249756,
+    "diagonal": 2.027082681655884,
+    "finite": 0.3183228373527527
+  },
+  {
+    "step": 94,
+    "loss": 1.9436217546463013,
+    "diagonal": 1.813447117805481,
+    "finite": 0.3425649404525757
+  },
+  {
+    "step": 95,
+    "loss": 2.0724563598632812,
+    "diagonal": 1.9633373022079468,
+    "finite": 0.2841643691062927
+  },
+  {
+    "step": 96,
+    "loss": 2.502373456954956,
+    "diagonal": 2.376674175262451,
+    "finite": 0.3239673972129822
+  },
+  {
+    "step": 97,
+    "loss": 2.0256662368774414,
+    "diagonal": 1.91057288646698,
+    "finite": 0.2936052978038788
+  },
+  {
+    "step": 98,
+    "loss": 2.304405689239502,
+    "diagonal": 2.1902389526367188,
+    "finite": 0.28829991817474365
+  },
+  {
+    "step": 99,
+    "loss": 2.2231202125549316,
+    "diagonal": 2.1297054290771484,
+    "finite": 0.23353707790374756
+  },
+  {
+    "step": 100,
+    "loss": 2.3900058269500732,
+    "diagonal": 2.280395984649658,
+    "finite": 0.27131152153015137
+  },
+  {
+    "step": 101,
+    "loss": 2.222144365310669,
+    "diagonal": 2.1052801609039307,
+    "finite": 0.28643208742141724
+  },
+  {
+    "step": 102,
+    "loss": 1.9896074533462524,
+    "diagonal": 1.8901219367980957,
+    "finite": 0.2414698302745819
+  },
+  {
+    "step": 103,
+    "loss": 1.871809482574463,
+    "diagonal": 1.7712239027023315,
+    "finite": 0.24179218709468842
+  },
+  {
+    "step": 104,
+    "loss": 2.043701410293579,
+    "diagonal": 1.9242724180221558,
+    "finite": 0.28435465693473816
+  },
+  {
+    "step": 105,
+    "loss": 2.157493829727173,
+    "diagonal": 2.060941696166992,
+    "finite": 0.22771744430065155
+  },
+  {
+    "step": 106,
+    "loss": 2.499375581741333,
+    "diagonal": 2.3960726261138916,
+    "finite": 0.24136187136173248
+  },
+  {
+    "step": 107,
+    "loss": 2.0208675861358643,
+    "diagonal": 1.8846811056137085,
+    "finite": 0.3152465224266052
+  },
+  {
+    "step": 108,
+    "loss": 2.109743595123291,
+    "diagonal": 1.9780733585357666,
+    "finite": 0.3019959032535553
+  },
+  {
+    "step": 109,
+    "loss": 1.9172190427780151,
+    "diagonal": 1.7733116149902344,
+    "finite": 0.3270624279975891
+  },
+  {
+    "step": 110,
+    "loss": 2.3048458099365234,
+    "diagonal": 2.1840691566467285,
+    "finite": 0.2720196545124054
+  },
+  {
+    "step": 111,
+    "loss": 1.860410213470459,
+    "diagonal": 1.739485502243042,
+    "finite": 0.26992133259773254
+  },
+  {
+    "step": 112,
+    "loss": 1.9445315599441528,
+    "diagonal": 1.7984614372253418,
+    "finite": 0.32316404581069946
+  },
+  {
+    "step": 113,
+    "loss": 1.9957644939422607,
+    "diagonal": 1.8693773746490479,
+    "finite": 0.27716466784477234
+  },
+  {
+    "step": 114,
+    "loss": 2.5679242610931396,
+    "diagonal": 2.4746296405792236,
+    "finite": 0.20281456410884857
+  },
+  {
+    "step": 115,
+    "loss": 2.012930154800415,
+    "diagonal": 1.9060156345367432,
+    "finite": 0.23041920363903046
+  },
+  {
+    "step": 116,
+    "loss": 2.0834295749664307,
+    "diagonal": 1.9413065910339355,
+    "finite": 0.3036816120147705
+  },
+  {
+    "step": 117,
+    "loss": 2.1906919479370117,
+    "diagonal": 2.0746982097625732,
+    "finite": 0.2457493543624878
+  },
+  {
+    "step": 118,
+    "loss": 2.0832247734069824,
+    "diagonal": 1.9549760818481445,
+    "finite": 0.2694302499294281
+  },
+  {
+    "step": 119,
+    "loss": 1.84365713596344,
+    "diagonal": 1.7086366415023804,
+    "finite": 0.2812926769256592
+  },
+  {
+    "step": 120,
+    "loss": 2.004087209701538,
+    "diagonal": 1.90079927444458,
+    "finite": 0.21340490877628326
+  },
+  {
+    "step": 121,
+    "loss": 2.183072566986084,
+    "diagonal": 2.059546709060669,
+    "finite": 0.25312697887420654
+  },
+  {
+    "step": 122,
+    "loss": 2.490384578704834,
+    "diagonal": 2.3526134490966797,
+    "finite": 0.2800227403640747
+  },
+  {
+    "step": 123,
+    "loss": 2.1781089305877686,
+    "diagonal": 2.0633580684661865,
+    "finite": 0.23135235905647278
+  },
+  {
+    "step": 124,
+    "loss": 1.904137134552002,
+    "diagonal": 1.7821152210235596,
+    "finite": 0.24404381215572357
+  },
+  {
+    "step": 125,
+    "loss": 1.9962619543075562,
+    "diagonal": 1.8794349431991577,
+    "finite": 0.2317996770143509
+  },
+  {
+    "step": 126,
+    "loss": 2.0796122550964355,
+    "diagonal": 1.9457615613937378,
+    "finite": 0.26348572969436646
+  },
+  {
+    "step": 127,
+    "loss": 1.841684103012085,
+    "diagonal": 1.7245681285858154,
+    "finite": 0.22874212265014648
+  },
+  {
+    "step": 128,
+    "loss": 2.5640225410461426,
+    "diagonal": 2.483609199523926,
+    "finite": 0.15583983063697815
+  },
+  {
+    "step": 129,
+    "loss": 2.2295827865600586,
+    "diagonal": 2.104253053665161,
+    "finite": 0.24101877212524414
+  },
+  {
+    "step": 130,
+    "loss": 2.5307633876800537,
+    "diagonal": 2.417215347290039,
+    "finite": 0.21669483184814453
+  },
+  {
+    "step": 131,
+    "loss": 2.222733736038208,
+    "diagonal": 2.093357801437378,
+    "finite": 0.24503017961978912
+  },
+  {
+    "step": 132,
+    "loss": 1.6210848093032837,
+    "diagonal": 1.4765903949737549,
+    "finite": 0.2716060280799866
+  },
+  {
+    "step": 133,
+    "loss": 2.3227756023406982,
+    "diagonal": 2.1930606365203857,
+    "finite": 0.24200549721717834
+  },
+  {
+    "step": 134,
+    "loss": 2.1980209350585938,
+    "diagonal": 2.089439868927002,
+    "finite": 0.20107614994049072
+  },
+  {
+    "step": 135,
+    "loss": 2.380324363708496,
+    "diagonal": 2.263733386993408,
+    "finite": 0.21432146430015564
+  },
+  {
+    "step": 136,
+    "loss": 2.0976505279541016,
+    "diagonal": 1.9866433143615723,
+    "finite": 0.20256781578063965
+  },
+  {
+    "step": 137,
+    "loss": 2.010584592819214,
+    "diagonal": 1.913210153579712,
+    "finite": 0.1764029562473297
+  },
+  {
+    "step": 138,
+    "loss": 1.8779820203781128,
+    "diagonal": 1.7705926895141602,
+    "finite": 0.19314631819725037
+  },
+  {
+    "step": 139,
+    "loss": 2.293182373046875,
+    "diagonal": 2.197294235229492,
+    "finite": 0.17122891545295715
+  },
+  {
+    "step": 140,
+    "loss": 2.132535457611084,
+    "diagonal": 2.0426650047302246,
+    "finite": 0.15934468805789948
+  },
+  {
+    "step": 141,
+    "loss": 2.4095253944396973,
+    "diagonal": 2.3261170387268066,
+    "finite": 0.14684557914733887
+  },
+  {
+    "step": 142,
+    "loss": 1.6516996622085571,
+    "diagonal": 1.5539089441299438,
+    "finite": 0.1709628403186798
+  },
+  {
+    "step": 143,
+    "loss": 1.6047625541687012,
+    "diagonal": 1.5230770111083984,
+    "finite": 0.14181508123874664
+  },
+  {
+    "step": 144,
+    "loss": 2.016681432723999,
+    "diagonal": 1.9115709066390991,
+    "finite": 0.18122485280036926
+  },
+  {
+    "step": 145,
+    "loss": 1.8062777519226074,
+    "diagonal": 1.7213449478149414,
+    "finite": 0.14543291926383972
+  },
+  {
+    "step": 146,
+    "loss": 2.2902865409851074,
+    "diagonal": 2.179062843322754,
+    "finite": 0.18915587663650513
+  },
+  {
+    "step": 147,
+    "loss": 1.5230062007904053,
+    "diagonal": 1.4351425170898438,
+    "finite": 0.1484183818101883
+  },
+  {
+    "step": 148,
+    "loss": 2.3276078701019287,
+    "diagonal": 2.2428388595581055,
+    "finite": 0.14223003387451172
+  },
+  {
+    "step": 149,
+    "loss": 2.1051108837127686,
+    "diagonal": 2.018260955810547,
+    "finite": 0.1447499841451645
+  },
+  {
+    "step": 150,
+    "loss": 2.4256529808044434,
+    "diagonal": 2.3336920738220215,
+    "finite": 0.1522531807422638
+  },
+  {
+    "step": 151,
+    "loss": 2.4502639770507812,
+    "diagonal": 2.3619132041931152,
+    "finite": 0.14531363546848297
+  },
+  {
+    "step": 152,
+    "loss": 1.730540156364441,
+    "diagonal": 1.6364164352416992,
+    "finite": 0.15379685163497925
+  },
+  {
+    "step": 153,
+    "loss": 2.0666725635528564,
+    "diagonal": 1.9441198110580444,
+    "finite": 0.19894936680793762
+  },
+  {
+    "step": 154,
+    "loss": 1.8268301486968994,
+    "diagonal": 1.730872392654419,
+    "finite": 0.15477067232131958
+  },
+  {
+    "step": 155,
+    "loss": 2.0642054080963135,
+    "diagonal": 1.9638025760650635,
+    "finite": 0.1609020233154297
+  },
+  {
+    "step": 156,
+    "loss": 2.1084938049316406,
+    "diagonal": 2.0301146507263184,
+    "finite": 0.12480773776769638
+  },
+  {
+    "step": 157,
+    "loss": 1.933156967163086,
+    "diagonal": 1.8388713598251343,
+    "finite": 0.14918604493141174
+  },
+  {
+    "step": 158,
+    "loss": 1.9536149501800537,
+    "diagonal": 1.8733445405960083,
+    "finite": 0.1262112557888031
+  },
+  {
+    "step": 159,
+    "loss": 2.13521409034729,
+    "diagonal": 2.0308666229248047,
+    "finite": 0.16304302215576172
+  },
+  {
+    "step": 160,
+    "loss": 2.208540439605713,
+    "diagonal": 2.1323187351226807,
+    "finite": 0.1183566153049469
+  },
+  {
+    "step": 161,
+    "loss": 2.4211337566375732,
+    "diagonal": 2.3476202487945557,
+    "finite": 0.11344694346189499
+  },
+  {
+    "step": 162,
+    "loss": 2.3214051723480225,
+    "diagonal": 2.238259792327881,
+    "finite": 0.12752357125282288
+  },
+  {
+    "step": 163,
+    "loss": 1.9746627807617188,
+    "diagonal": 1.9096887111663818,
+    "finite": 0.09904581308364868
+  },
+  {
+    "step": 164,
+    "loss": 2.270169973373413,
+    "diagonal": 2.199767589569092,
+    "finite": 0.10667039453983307
+  },
+  {
+    "step": 165,
+    "loss": 1.729362964630127,
+    "diagonal": 1.667038083076477,
+    "finite": 0.09386276453733444
+  },
+  {
+    "step": 166,
+    "loss": 2.608980655670166,
+    "diagonal": 2.5391414165496826,
+    "finite": 0.1045498177409172
+  },
+  {
+    "step": 167,
+    "loss": 1.5363596677780151,
+    "diagonal": 1.4725825786590576,
+    "finite": 0.09490633755922318
+  },
+  {
+    "step": 168,
+    "loss": 2.44164776802063,
+    "diagonal": 2.3970112800598145,
+    "finite": 0.0660303458571434
+  },
+  {
+    "step": 169,
+    "loss": 2.3490889072418213,
+    "diagonal": 2.292508363723755,
+    "finite": 0.08320675045251846
+  },
+  {
+    "step": 170,
+    "loss": 1.8020596504211426,
+    "diagonal": 1.7606887817382812,
+    "finite": 0.06048371642827988
+  },
+  {
+    "step": 171,
+    "loss": 2.218090534210205,
+    "diagonal": 2.156571865081787,
+    "finite": 0.08941683918237686
+  },
+  {
+    "step": 172,
+    "loss": 2.7719860076904297,
+    "diagonal": 2.727123737335205,
+    "finite": 0.06482991576194763
+  },
+  {
+    "step": 173,
+    "loss": 2.082286834716797,
+    "diagonal": 2.027414083480835,
+    "finite": 0.07884006947278976
+  },
+  {
+    "step": 174,
+    "loss": 2.514464855194092,
+    "diagonal": 2.4541497230529785,
+    "finite": 0.08616442233324051
+  },
+  {
+    "step": 175,
+    "loss": 2.2662837505340576,
+    "diagonal": 2.2095587253570557,
+    "finite": 0.08057522773742676
+  },
+  {
+    "step": 176,
+    "loss": 2.4205398559570312,
+    "diagonal": 2.3541336059570312,
+    "finite": 0.09379418939352036
+  },
+  {
+    "step": 177,
+    "loss": 2.0207252502441406,
+    "diagonal": 1.9578076601028442,
+    "finite": 0.0883672833442688
+  },
+  {
+    "step": 178,
+    "loss": 2.2394704818725586,
+    "diagonal": 2.179797410964966,
+    "finite": 0.08334222435951233
+  },
+  {
+    "step": 179,
+    "loss": 1.8233113288879395,
+    "diagonal": 1.7812083959579468,
+    "finite": 0.0584762878715992
+  },
+  {
+    "step": 180,
+    "loss": 1.6253275871276855,
+    "diagonal": 1.5774526596069336,
+    "finite": 0.06612558662891388
+  },
+  {
+    "step": 181,
+    "loss": 2.0593743324279785,
+    "diagonal": 1.9983770847320557,
+    "finite": 0.08378733694553375
+  },
+  {
+    "step": 182,
+    "loss": 2.2712109088897705,
+    "diagonal": 2.2053539752960205,
+    "finite": 0.08996845781803131
+  },
+  {
+    "step": 183,
+    "loss": 1.5357122421264648,
+    "diagonal": 1.4699699878692627,
+    "finite": 0.08932369947433472
+  },
+  {
+    "step": 184,
+    "loss": 1.893786907196045,
+    "diagonal": 1.8230135440826416,
+    "finite": 0.09563969075679779
+  },
+  {
+    "step": 185,
+    "loss": 1.7431282997131348,
+    "diagonal": 1.6639055013656616,
+    "finite": 0.10648225992918015
+  },
+  {
+    "step": 186,
+    "loss": 1.997130274772644,
+    "diagonal": 1.9406439065933228,
+    "finite": 0.07551658898591995
+  },
+  {
+    "step": 187,
+    "loss": 1.9818059206008911,
+    "diagonal": 1.9064946174621582,
+    "finite": 0.10014798492193222
+  },
+  {
+    "step": 188,
+    "loss": 1.5912482738494873,
+    "diagonal": 1.4960319995880127,
+    "finite": 0.125947505235672
+  },
+  {
+    "step": 189,
+    "loss": 1.7336565256118774,
+    "diagonal": 1.6655168533325195,
+    "finite": 0.08965742588043213
+  },
+  {
+    "step": 190,
+    "loss": 1.8539012670516968,
+    "diagonal": 1.7754770517349243,
+    "finite": 0.10264953225851059
+  },
+  {
+    "step": 191,
+    "loss": 2.089449644088745,
+    "diagonal": 2.0108325481414795,
+    "finite": 0.10236594080924988
+  },
+  {
+    "step": 192,
+    "loss": 2.031237840652466,
+    "diagonal": 1.9547410011291504,
+    "finite": 0.09908915311098099
+  },
+  {
+    "step": 193,
+    "loss": 2.031200885772705,
+    "diagonal": 1.951714038848877,
+    "finite": 0.10243144631385803
+  },
+  {
+    "step": 194,
+    "loss": 1.873511791229248,
+    "diagonal": 1.775068759918213,
+    "finite": 0.1262090653181076
+  },
+  {
+    "step": 195,
+    "loss": 1.8691495656967163,
+    "diagonal": 1.8014435768127441,
+    "finite": 0.08635968714952469
+  },
+  {
+    "step": 196,
+    "loss": 1.4754770994186401,
+    "diagonal": 1.3958293199539185,
+    "finite": 0.1010759174823761
+  },
+  {
+    "step": 197,
+    "loss": 2.356457471847534,
+    "diagonal": 2.2828476428985596,
+    "finite": 0.09294171631336212
+  },
+  {
+    "step": 198,
+    "loss": 2.2736315727233887,
+    "diagonal": 2.1905598640441895,
+    "finite": 0.10436130315065384
+  },
+  {
+    "step": 199,
+    "loss": 2.076889753341675,
+    "diagonal": 2.0064890384674072,
+    "finite": 0.0880008190870285
+  },
+  {
+    "step": 200,
+    "loss": 1.6903513669967651,
+    "diagonal": 1.6146129369735718,
+    "finite": 0.09420205652713776
+  },
+  {
+    "step": 201,
+    "loss": 1.9987441301345825,
+    "diagonal": 1.9344618320465088,
+    "finite": 0.07955724000930786
+  },
+  {
+    "step": 202,
+    "loss": 2.245645761489868,
+    "diagonal": 2.165066719055176,
+    "finite": 0.09923534840345383
+  },
+  {
+    "step": 203,
+    "loss": 1.888670563697815,
+    "diagonal": 1.8245550394058228,
+    "finite": 0.07857292145490646
+  },
+  {
+    "step": 204,
+    "loss": 1.7394587993621826,
+    "diagonal": 1.6733709573745728,
+    "finite": 0.08059488236904144
+  },
+  {
+    "step": 205,
+    "loss": 1.885148286819458,
+    "diagonal": 1.826545000076294,
+    "finite": 0.0711205005645752
+  },
+  {
+    "step": 206,
+    "loss": 2.223264217376709,
+    "diagonal": 2.17152738571167,
+    "finite": 0.062484219670295715
+  },
+  {
+    "step": 207,
+    "loss": 1.8486287593841553,
+    "diagonal": 1.7979668378829956,
+    "finite": 0.06089172884821892
+  },
+  {
+    "step": 208,
+    "loss": 1.9386283159255981,
+    "diagonal": 1.8751920461654663,
+    "finite": 0.07588066160678864
+  },
+  {
+    "step": 209,
+    "loss": 1.9663594961166382,
+    "diagonal": 1.9205195903778076,
+    "finite": 0.05457127466797829
+  },
+  {
+    "step": 210,
+    "loss": 2.0101068019866943,
+    "diagonal": 1.959944725036621,
+    "finite": 0.05943366140127182
+  },
+  {
+    "step": 211,
+    "loss": 1.6317325830459595,
+    "diagonal": 1.5879364013671875,
+    "finite": 0.051646508276462555
+  },
+  {
+    "step": 212,
+    "loss": 1.8718904256820679,
+    "diagonal": 1.8264172077178955,
+    "finite": 0.053372304886579514
+  },
+  {
+    "step": 213,
+    "loss": 2.5029215812683105,
+    "diagonal": 2.4653947353363037,
+    "finite": 0.043839722871780396
+  },
+  {
+    "step": 214,
+    "loss": 1.8221086263656616,
+    "diagonal": 1.7749488353729248,
+    "finite": 0.0548369474709034
+  },
+  {
+    "step": 215,
+    "loss": 1.727908968925476,
+    "diagonal": 1.679458737373352,
+    "finite": 0.05607660114765167
+  },
+  {
+    "step": 216,
+    "loss": 2.300417423248291,
+    "diagonal": 2.2631287574768066,
+    "finite": 0.04295920580625534
+  },
+  {
+    "step": 217,
+    "loss": 1.8669801950454712,
+    "diagonal": 1.8196654319763184,
+    "finite": 0.0542600080370903
+  },
+  {
+    "step": 218,
+    "loss": 1.602734923362732,
+    "diagonal": 1.5558807849884033,
+    "finite": 0.05348648875951767
+  },
+  {
+    "step": 219,
+    "loss": 1.9647927284240723,
+    "diagonal": 1.9155025482177734,
+    "finite": 0.05601150542497635
+  },
+  {
+    "step": 220,
+    "loss": 2.7248616218566895,
+    "diagonal": 2.685730218887329,
+    "finite": 0.04426629841327667
+  },
+  {
+    "step": 221,
+    "loss": 2.270888090133667,
+    "diagonal": 2.235211133956909,
+    "finite": 0.0401768684387207
+  },
+  {
+    "step": 222,
+    "loss": 2.0561683177948,
+    "diagonal": 2.010991096496582,
+    "finite": 0.050646983087062836
+  },
+  {
+    "step": 223,
+    "loss": 1.6903284788131714,
+    "diagonal": 1.6542526483535767,
+    "finite": 0.04026314988732338
+  },
+  {
+    "step": 224,
+    "loss": 2.3613672256469727,
+    "diagonal": 2.3108742237091064,
+    "finite": 0.056103240698575974
+  },
+  {
+    "step": 225,
+    "loss": 1.9709348678588867,
+    "diagonal": 1.9315900802612305,
+    "finite": 0.04352305084466934
+  },
+  {
+    "step": 226,
+    "loss": 2.088736057281494,
+    "diagonal": 2.0568480491638184,
+    "finite": 0.0351189523935318
+  },
+  {
+    "step": 227,
+    "loss": 2.1878669261932373,
+    "diagonal": 2.1490020751953125,
+    "finite": 0.042615074664354324
+  },
+  {
+    "step": 228,
+    "loss": 2.2044014930725098,
+    "diagonal": 2.1760013103485107,
+    "finite": 0.031004637479782104
+  },
+  {
+    "step": 229,
+    "loss": 1.922195315361023,
+    "diagonal": 1.8848859071731567,
+    "finite": 0.04055371508002281
+  },
+  {
+    "step": 230,
+    "loss": 1.8687944412231445,
+    "diagonal": 1.8067421913146973,
+    "finite": 0.0671560987830162
+  },
+  {
+    "step": 231,
+    "loss": 2.2623629570007324,
+    "diagonal": 2.2134037017822266,
+    "finite": 0.052757877856492996
+  },
+  {
+    "step": 232,
+    "loss": 1.5316085815429688,
+    "diagonal": 1.4799643754959106,
+    "finite": 0.055412303656339645
+  },
+  {
+    "step": 233,
+    "loss": 2.22627329826355,
+    "diagonal": 2.176429510116577,
+    "finite": 0.05325182154774666
+  },
+  {
+    "step": 234,
+    "loss": 2.2628681659698486,
+    "diagonal": 2.2256858348846436,
+    "finite": 0.03955565020442009
+  },
+  {
+    "step": 235,
+    "loss": 1.8694965839385986,
+    "diagonal": 1.8224231004714966,
+    "finite": 0.04986591637134552
+  },
+  {
+    "step": 236,
+    "loss": 1.9650882482528687,
+    "diagonal": 1.9213237762451172,
+    "finite": 0.04616502672433853
+  },
+  {
+    "step": 237,
+    "loss": 2.227184534072876,
+    "diagonal": 2.1949729919433594,
+    "finite": 0.03383561596274376
+  },
+  {
+    "step": 238,
+    "loss": 2.0806243419647217,
+    "diagonal": 2.0544321537017822,
+    "finite": 0.02739771455526352
+  },
+  {
+    "step": 239,
+    "loss": 2.3886377811431885,
+    "diagonal": 2.3570146560668945,
+    "finite": 0.03294084966182709
+  },
+  {
+    "step": 240,
+    "loss": 2.181165933609009,
+    "diagonal": 2.1430630683898926,
+    "finite": 0.03952575474977493
+  },
+  {
+    "step": 241,
+    "loss": 2.1715087890625,
+    "diagonal": 2.1412718296051025,
+    "finite": 0.031236479058861732
+  },
+  {
+    "step": 242,
+    "loss": 2.1539409160614014,
+    "diagonal": 2.119779109954834,
+    "finite": 0.03514578193426132
+  },
+  {
+    "step": 243,
+    "loss": 2.216517448425293,
+    "diagonal": 2.184361219406128,
+    "finite": 0.0329468660056591
+  },
+  {
+    "step": 244,
+    "loss": 1.4684416055679321,
+    "diagonal": 1.4281387329101562,
+    "finite": 0.04112541675567627
+  },
+  {
+    "step": 245,
+    "loss": 2.825486421585083,
+    "diagonal": 2.799715280532837,
+    "finite": 0.02619015797972679
+  },
+  {
+    "step": 246,
+    "loss": 2.0740058422088623,
+    "diagonal": 2.0440993309020996,
+    "finite": 0.03026975691318512
+  },
+  {
+    "step": 247,
+    "loss": 2.114283561706543,
+    "diagonal": 2.0637316703796387,
+    "finite": 0.05095953494310379
+  },
+  {
+    "step": 248,
+    "loss": 2.3214914798736572,
+    "diagonal": 2.2757444381713867,
+    "finite": 0.04593082144856453
+  },
+  {
+    "step": 249,
+    "loss": 1.9425827264785767,
+    "diagonal": 1.9145402908325195,
+    "finite": 0.02804248034954071
+  },
+  {
+    "step": 250,
+    "loss": 1.406104564666748,
+    "diagonal": 1.3755356073379517,
+    "finite": 0.030569002032279968
+  },
+  {
+    "step": 251,
+    "loss": 2.1082828044891357,
+    "diagonal": 2.073557138442993,
+    "finite": 0.03472557291388512
+  },
+  {
+    "step": 252,
+    "loss": 2.1348612308502197,
+    "diagonal": 2.0950658321380615,
+    "finite": 0.03979530185461044
+  },
+  {
+    "step": 253,
+    "loss": 2.0051257610321045,
+    "diagonal": 1.9663031101226807,
+    "finite": 0.03882255405187607
+  },
+  {
+    "step": 254,
+    "loss": 2.1237218379974365,
+    "diagonal": 2.094088077545166,
+    "finite": 0.02963387407362461
+  },
+  {
+    "step": 255,
+    "loss": 2.0755276679992676,
+    "diagonal": 2.041965961456299,
+    "finite": 0.033561822026968
+  },
+  {
+    "step": 256,
+    "loss": 2.320681095123291,
+    "diagonal": 2.300344944000244,
+    "finite": 0.02033613622188568
+  },
+  {
+    "step": 257,
+    "loss": 2.080225706100464,
+    "diagonal": 2.0565500259399414,
+    "finite": 0.023675721138715744
+  },
+  {
+    "step": 258,
+    "loss": 1.5418667793273926,
+    "diagonal": 1.5185283422470093,
+    "finite": 0.0233384370803833
+  },
+  {
+    "step": 259,
+    "loss": 2.062347888946533,
+    "diagonal": 2.0232791900634766,
+    "finite": 0.03906877338886261
+  },
+  {
+    "step": 260,
+    "loss": 1.8982014656066895,
+    "diagonal": 1.860461950302124,
+    "finite": 0.03773954510688782
+  },
+  {
+    "step": 261,
+    "loss": 1.7912278175354004,
+    "diagonal": 1.7647114992141724,
+    "finite": 0.026516273617744446
+  },
+  {
+    "step": 262,
+    "loss": 1.8843300342559814,
+    "diagonal": 1.8494856357574463,
+    "finite": 0.034844376146793365
+  },
+  {
+    "step": 263,
+    "loss": 1.8188772201538086,
+    "diagonal": 1.778801441192627,
+    "finite": 0.040075819939374924
+  },
+  {
+    "step": 264,
+    "loss": 2.6515579223632812,
+    "diagonal": 2.6269309520721436,
+    "finite": 0.024626977741718292
+  },
+  {
+    "step": 265,
+    "loss": 1.6450417041778564,
+    "diagonal": 1.5928881168365479,
+    "finite": 0.05215361714363098
+  },
+  {
+    "step": 266,
+    "loss": 2.4666566848754883,
+    "diagonal": 2.4252679347991943,
+    "finite": 0.04138883203268051
+  },
+  {
+    "step": 267,
+    "loss": 1.7819013595581055,
+    "diagonal": 1.750922441482544,
+    "finite": 0.030978916212916374
+  },
+  {
+    "step": 268,
+    "loss": 2.4275662899017334,
+    "diagonal": 2.3979012966156006,
+    "finite": 0.029664993286132812
+  },
+  {
+    "step": 269,
+    "loss": 2.43058180809021,
+    "diagonal": 2.3952813148498535,
+    "finite": 0.03530057519674301
+  },
+  {
+    "step": 270,
+    "loss": 1.832322359085083,
+    "diagonal": 1.801027774810791,
+    "finite": 0.03129463642835617
+  },
+  {
+    "step": 271,
+    "loss": 2.1613287925720215,
+    "diagonal": 2.128067970275879,
+    "finite": 0.033260710537433624
+  },
+  {
+    "step": 272,
+    "loss": 1.7390553951263428,
+    "diagonal": 1.7071161270141602,
+    "finite": 0.0319393090903759
+  },
+  {
+    "step": 273,
+    "loss": 2.266911745071411,
+    "diagonal": 2.243784189224243,
+    "finite": 0.0231276024132967
+  },
+  {
+    "step": 274,
+    "loss": 1.9413201808929443,
+    "diagonal": 1.9169832468032837,
+    "finite": 0.0243369247764349
+  },
+  {
+    "step": 275,
+    "loss": 2.242924690246582,
+    "diagonal": 2.2106263637542725,
+    "finite": 0.03229837119579315
+  },
+  {
+    "step": 276,
+    "loss": 1.8790273666381836,
+    "diagonal": 1.8479371070861816,
+    "finite": 0.03109027072787285
+  },
+  {
+    "step": 277,
+    "loss": 1.9806472063064575,
+    "diagonal": 1.959965467453003,
+    "finite": 0.02068176306784153
+  },
+  {
+    "step": 278,
+    "loss": 2.187643527984619,
+    "diagonal": 2.167612075805664,
+    "finite": 0.020031409338116646
+  },
+  {
+    "step": 279,
+    "loss": 2.1006133556365967,
+    "diagonal": 2.069202423095703,
+    "finite": 0.031410835683345795
+  },
+  {
+    "step": 280,
+    "loss": 1.8129628896713257,
+    "diagonal": 1.7779757976531982,
+    "finite": 0.034987132996320724
+  },
+  {
+    "step": 281,
+    "loss": 1.758211374282837,
+    "diagonal": 1.7363767623901367,
+    "finite": 0.021834593266248703
+  },
+  {
+    "step": 282,
+    "loss": 1.4546831846237183,
+    "diagonal": 1.428152084350586,
+    "finite": 0.026531120762228966
+  },
+  {
+    "step": 283,
+    "loss": 1.704819917678833,
+    "diagonal": 1.678199052810669,
+    "finite": 0.02662082016468048
+  },
+  {
+    "step": 284,
+    "loss": 2.044806957244873,
+    "diagonal": 2.0260491371154785,
+    "finite": 0.018757887184619904
+  },
+  {
+    "step": 285,
+    "loss": 2.3847084045410156,
+    "diagonal": 2.368010997772217,
+    "finite": 0.016697511076927185
+  },
+  {
+    "step": 286,
+    "loss": 1.7563261985778809,
+    "diagonal": 1.7415153980255127,
+    "finite": 0.014810758642852306
+  },
+  {
+    "step": 287,
+    "loss": 2.2866365909576416,
+    "diagonal": 2.272786855697632,
+    "finite": 0.013849832117557526
+  },
+  {
+    "step": 288,
+    "loss": 2.0277981758117676,
+    "diagonal": 2.013637065887451,
+    "finite": 0.014161060564219952
+  },
+  {
+    "step": 289,
+    "loss": 1.7158563137054443,
+    "diagonal": 1.6931947469711304,
+    "finite": 0.02266162633895874
+  },
+  {
+    "step": 290,
+    "loss": 2.0967955589294434,
+    "diagonal": 2.07952880859375,
+    "finite": 0.017266739159822464
+  },
+  {
+    "step": 291,
+    "loss": 1.9385111331939697,
+    "diagonal": 1.9200310707092285,
+    "finite": 0.018480075523257256
+  },
+  {
+    "step": 292,
+    "loss": 1.9855412244796753,
+    "diagonal": 1.9660089015960693,
+    "finite": 0.019532358273863792
+  },
+  {
+    "step": 293,
+    "loss": 1.9170671701431274,
+    "diagonal": 1.8998185396194458,
+    "finite": 0.017248667776584625
+  },
+  {
+    "step": 294,
+    "loss": 1.9487576484680176,
+    "diagonal": 1.9323173761367798,
+    "finite": 0.016440274193882942
+  },
+  {
+    "step": 295,
+    "loss": 1.9172013998031616,
+    "diagonal": 1.8987491130828857,
+    "finite": 0.018452297896146774
+  },
+  {
+    "step": 296,
+    "loss": 1.6105247735977173,
+    "diagonal": 1.5847824811935425,
+    "finite": 0.025742268189787865
+  },
+  {
+    "step": 297,
+    "loss": 1.3603827953338623,
+    "diagonal": 1.3424701690673828,
+    "finite": 0.017912669107317924
+  },
+  {
+    "step": 298,
+    "loss": 1.908563494682312,
+    "diagonal": 1.8899139165878296,
+    "finite": 0.018649587407708168
+  },
+  {
+    "step": 299,
+    "loss": 1.8579691648483276,
+    "diagonal": 1.838334321975708,
+    "finite": 0.0196347925812006
+  },
+  {
+    "step": 300,
+    "loss": 1.691026210784912,
+    "diagonal": 1.6662322282791138,
+    "finite": 0.02479400672018528
+  },
+  {
+    "step": 301,
+    "loss": 1.642730712890625,
+    "diagonal": 1.6180410385131836,
+    "finite": 0.02468966692686081
+  },
+  {
+    "step": 302,
+    "loss": 2.1253788471221924,
+    "diagonal": 2.100823402404785,
+    "finite": 0.024555400013923645
+  },
+  {
+    "step": 303,
+    "loss": 1.7303402423858643,
+    "diagonal": 1.700392723083496,
+    "finite": 0.02994748391211033
+  },
+  {
+    "step": 304,
+    "loss": 1.890867829322815,
+    "diagonal": 1.8678243160247803,
+    "finite": 0.023043472319841385
+  },
+  {
+    "step": 305,
+    "loss": 2.0961763858795166,
+    "diagonal": 2.073366165161133,
+    "finite": 0.022810157388448715
+  },
+  {
+    "step": 306,
+    "loss": 1.6316323280334473,
+    "diagonal": 1.6112468242645264,
+    "finite": 0.020385537296533585
+  },
+  {
+    "step": 307,
+    "loss": 1.920278787612915,
+    "diagonal": 1.8911492824554443,
+    "finite": 0.02912953309714794
+  },
+  {
+    "step": 308,
+    "loss": 1.5359190702438354,
+    "diagonal": 1.5068180561065674,
+    "finite": 0.029100965708494186
+  },
+  {
+    "step": 309,
+    "loss": 2.0687263011932373,
+    "diagonal": 2.038215398788452,
+    "finite": 0.03051082231104374
+  },
+  {
+    "step": 310,
+    "loss": 1.545199990272522,
+    "diagonal": 1.51276695728302,
+    "finite": 0.03243301436305046
+  },
+  {
+    "step": 311,
+    "loss": 2.048870325088501,
+    "diagonal": 2.0161542892456055,
+    "finite": 0.03271612897515297
+  },
+  {
+    "step": 312,
+    "loss": 1.8847750425338745,
+    "diagonal": 1.8569656610488892,
+    "finite": 0.02780935727059841
+  },
+  {
+    "step": 313,
+    "loss": 1.8253170251846313,
+    "diagonal": 1.7856987714767456,
+    "finite": 0.03961825370788574
+  },
+  {
+    "step": 314,
+    "loss": 1.872559666633606,
+    "diagonal": 1.8370872735977173,
+    "finite": 0.035472359508275986
+  },
+  {
+    "step": 315,
+    "loss": 2.4801323413848877,
+    "diagonal": 2.445617198944092,
+    "finite": 0.0345151424407959
+  },
+  {
+    "step": 316,
+    "loss": 2.1275947093963623,
+    "diagonal": 2.1005001068115234,
+    "finite": 0.027094505727291107
+  },
+  {
+    "step": 317,
+    "loss": 1.8966058492660522,
+    "diagonal": 1.8611125946044922,
+    "finite": 0.03549320250749588
+  },
+  {
+    "step": 318,
+    "loss": 1.7196754217147827,
+    "diagonal": 1.6900124549865723,
+    "finite": 0.029662981629371643
+  },
+  {
+    "step": 319,
+    "loss": 2.042512893676758,
+    "diagonal": 2.013547658920288,
+    "finite": 0.028965158388018608
+  },
+  {
+    "step": 320,
+    "loss": 1.4823201894760132,
+    "diagonal": 1.4618916511535645,
+    "finite": 0.02042854204773903
+  },
+  {
+    "step": 321,
+    "loss": 1.712527871131897,
+    "diagonal": 1.6850392818450928,
+    "finite": 0.027488579973578453
+  },
+  {
+    "step": 322,
+    "loss": 1.8335270881652832,
+    "diagonal": 1.809629201889038,
+    "finite": 0.02389787696301937
+  },
+  {
+    "step": 323,
+    "loss": 2.096860885620117,
+    "diagonal": 2.077906608581543,
+    "finite": 0.018954278901219368
+  },
+  {
+    "step": 324,
+    "loss": 1.5656304359436035,
+    "diagonal": 1.5392653942108154,
+    "finite": 0.026365000754594803
+  },
+  {
+    "step": 325,
+    "loss": 1.7136554718017578,
+    "diagonal": 1.6913139820098877,
+    "finite": 0.022341500967741013
+  },
+  {
+    "step": 326,
+    "loss": 1.7504949569702148,
+    "diagonal": 1.7281008958816528,
+    "finite": 0.022394025698304176
+  },
+  {
+    "step": 327,
+    "loss": 2.1703598499298096,
+    "diagonal": 2.1439781188964844,
+    "finite": 0.026381665840744972
+  },
+  {
+    "step": 328,
+    "loss": 1.8423864841461182,
+    "diagonal": 1.8144571781158447,
+    "finite": 0.027929261326789856
+  },
+  {
+    "step": 329,
+    "loss": 1.8668917417526245,
+    "diagonal": 1.8389630317687988,
+    "finite": 0.027928750962018967
+  },
+  {
+    "step": 330,
+    "loss": 1.7927954196929932,
+    "diagonal": 1.7657561302185059,
+    "finite": 0.027039285749197006
+  },
+  {
+    "step": 331,
+    "loss": 1.879345178604126,
+    "diagonal": 1.8570542335510254,
+    "finite": 0.022290971130132675
+  },
+  {
+    "step": 332,
+    "loss": 1.7886712551116943,
+    "diagonal": 1.758418083190918,
+    "finite": 0.0302532110363245
+  },
+  {
+    "step": 333,
+    "loss": 1.6257297992706299,
+    "diagonal": 1.5986994504928589,
+    "finite": 0.027030354365706444
+  },
+  {
+    "step": 334,
+    "loss": 1.6718615293502808,
+    "diagonal": 1.6352946758270264,
+    "finite": 0.036566827446222305
+  },
+  {
+    "step": 335,
+    "loss": 1.9163155555725098,
+    "diagonal": 1.8800626993179321,
+    "finite": 0.03625291585922241
+  },
+  {
+    "step": 336,
+    "loss": 2.013146162033081,
+    "diagonal": 1.9844328165054321,
+    "finite": 0.02871345542371273
+  },
+  {
+    "step": 337,
+    "loss": 1.9184991121292114,
+    "diagonal": 1.8893691301345825,
+    "finite": 0.029129981994628906
+  },
+  {
+    "step": 338,
+    "loss": 1.7268346548080444,
+    "diagonal": 1.7015750408172607,
+    "finite": 0.025259610265493393
+  },
+  {
+    "step": 339,
+    "loss": 1.666633129119873,
+    "diagonal": 1.6390658617019653,
+    "finite": 0.027567220851778984
+  },
+  {
+    "step": 340,
+    "loss": 1.9236456155776978,
+    "diagonal": 1.8965709209442139,
+    "finite": 0.027074677869677544
+  },
+  {
+    "step": 341,
+    "loss": 1.5050039291381836,
+    "diagonal": 1.4743871688842773,
+    "finite": 0.030616816133260727
+  },
+  {
+    "step": 342,
+    "loss": 1.9077388048171997,
+    "diagonal": 1.8926113843917847,
+    "finite": 0.015127448365092278
+  },
+  {
+    "step": 343,
+    "loss": 1.630030870437622,
+    "diagonal": 1.5972713232040405,
+    "finite": 0.032759569585323334
+  },
+  {
+    "step": 344,
+    "loss": 1.5799787044525146,
+    "diagonal": 1.5565741062164307,
+    "finite": 0.02340463362634182
+  },
+  {
+    "step": 345,
+    "loss": 2.2474920749664307,
+    "diagonal": 2.2247891426086426,
+    "finite": 0.022703006863594055
+  },
+  {
+    "step": 346,
+    "loss": 2.00061297416687,
+    "diagonal": 1.9691717624664307,
+    "finite": 0.03144119307398796
+  },
+  {
+    "step": 347,
+    "loss": 1.6077390909194946,
+    "diagonal": 1.5820380449295044,
+    "finite": 0.02570107951760292
+  },
+  {
+    "step": 348,
+    "loss": 2.0926222801208496,
+    "diagonal": 2.065934181213379,
+    "finite": 0.026688024401664734
+  },
+  {
+    "step": 349,
+    "loss": 1.7756085395812988,
+    "diagonal": 1.7474286556243896,
+    "finite": 0.028179902583360672
+  },
+  {
+    "step": 350,
+    "loss": 2.3619959354400635,
+    "diagonal": 2.347045660018921,
+    "finite": 0.014950281009078026
+  },
+  {
+    "step": 351,
+    "loss": 1.4942024946212769,
+    "diagonal": 1.4723730087280273,
+    "finite": 0.02182946167886257
+  },
+  {
+    "step": 352,
+    "loss": 2.5016562938690186,
+    "diagonal": 2.4856410026550293,
+    "finite": 0.01601537875831127
+  },
+  {
+    "step": 353,
+    "loss": 1.7269998788833618,
+    "diagonal": 1.7117674350738525,
+    "finite": 0.015232405625283718
+  },
+  {
+    "step": 354,
+    "loss": 2.2018239498138428,
+    "diagonal": 2.1883347034454346,
+    "finite": 0.01348913460969925
+  },
+  {
+    "step": 355,
+    "loss": 2.1073122024536133,
+    "diagonal": 2.0987441539764404,
+    "finite": 0.008567990735173225
+  },
+  {
+    "step": 356,
+    "loss": 2.0898971557617188,
+    "diagonal": 2.0775012969970703,
+    "finite": 0.012395824305713177
+  },
+  {
+    "step": 357,
+    "loss": 1.8917887210845947,
+    "diagonal": 1.8852639198303223,
+    "finite": 0.006524786818772554
+  },
+  {
+    "step": 358,
+    "loss": 2.3465416431427,
+    "diagonal": 2.336360454559326,
+    "finite": 0.010181175544857979
+  },
+  {
+    "step": 359,
+    "loss": 2.088637113571167,
+    "diagonal": 2.079961061477661,
+    "finite": 0.008676045574247837
+  },
+  {
+    "step": 360,
+    "loss": 1.3698760271072388,
+    "diagonal": 1.3611383438110352,
+    "finite": 0.008737646974623203
+  },
+  {
+    "step": 361,
+    "loss": 2.1454405784606934,
+    "diagonal": 2.137662887573242,
+    "finite": 0.007777648977935314
+  },
+  {
+    "step": 362,
+    "loss": 1.9260913133621216,
+    "diagonal": 1.9183531999588013,
+    "finite": 0.007738153450191021
+  },
+  {
+    "step": 363,
+    "loss": 1.8385021686553955,
+    "diagonal": 1.8240501880645752,
+    "finite": 0.014451945200562477
+  },
+  {
+    "step": 364,
+    "loss": 1.7952848672866821,
+    "diagonal": 1.7853150367736816,
+    "finite": 0.009969867765903473
+  },
+  {
+    "step": 365,
+    "loss": 1.4760568141937256,
+    "diagonal": 1.466833472251892,
+    "finite": 0.009223326109349728
+  },
+  {
+    "step": 366,
+    "loss": 1.7250452041625977,
+    "diagonal": 1.716025471687317,
+    "finite": 0.009019733406603336
+  },
+  {
+    "step": 367,
+    "loss": 1.770246148109436,
+    "diagonal": 1.7602287530899048,
+    "finite": 0.010017422959208488
+  },
+  {
+    "step": 368,
+    "loss": 1.7885668277740479,
+    "diagonal": 1.7795456647872925,
+    "finite": 0.009021175093948841
+  },
+  {
+    "step": 369,
+    "loss": 1.7253466844558716,
+    "diagonal": 1.713741421699524,
+    "finite": 0.011605272069573402
+  },
+  {
+    "step": 370,
+    "loss": 1.8780698776245117,
+    "diagonal": 1.8654499053955078,
+    "finite": 0.012619927525520325
+  },
+  {
+    "step": 371,
+    "loss": 1.6627390384674072,
+    "diagonal": 1.6514348983764648,
+    "finite": 0.011304178275167942
+  },
+  {
+    "step": 372,
+    "loss": 1.3543939590454102,
+    "diagonal": 1.3384294509887695,
+    "finite": 0.015964463353157043
+  },
+  {
+    "step": 373,
+    "loss": 1.5771633386611938,
+    "diagonal": 1.5625824928283691,
+    "finite": 0.014580883085727692
+  },
+  {
+    "step": 374,
+    "loss": 1.4662600755691528,
+    "diagonal": 1.4455749988555908,
+    "finite": 0.020685063675045967
+  },
+  {
+    "step": 375,
+    "loss": 1.6633213758468628,
+    "diagonal": 1.6427630186080933,
+    "finite": 0.02055835723876953
+  },
+  {
+    "step": 376,
+    "loss": 2.079577922821045,
+    "diagonal": 2.061753034591675,
+    "finite": 0.01782488077878952
+  },
+  {
+    "step": 377,
+    "loss": 1.9897124767303467,
+    "diagonal": 1.9674385786056519,
+    "finite": 0.02227390930056572
+  },
+  {
+    "step": 378,
+    "loss": 1.5603539943695068,
+    "diagonal": 1.5392773151397705,
+    "finite": 0.02107665315270424
+  },
+  {
+    "step": 379,
+    "loss": 2.014587163925171,
+    "diagonal": 1.9917469024658203,
+    "finite": 0.022840339690446854
+  },
+  {
+    "step": 380,
+    "loss": 1.7777585983276367,
+    "diagonal": 1.7575045824050903,
+    "finite": 0.020253997296094894
+  },
+  {
+    "step": 381,
+    "loss": 1.7587379217147827,
+    "diagonal": 1.7333403825759888,
+    "finite": 0.025397520512342453
+  },
+  {
+    "step": 382,
+    "loss": 1.5109093189239502,
+    "diagonal": 1.4863896369934082,
+    "finite": 0.024519655853509903
+  },
+  {
+    "step": 383,
+    "loss": 1.6548292636871338,
+    "diagonal": 1.6306689977645874,
+    "finite": 0.024160314351320267
+  },
+  {
+    "step": 384,
+    "loss": 1.3850369453430176,
+    "diagonal": 1.3651071786880493,
+    "finite": 0.01992972195148468
+  },
+  {
+    "step": 385,
+    "loss": 2.0595767498016357,
+    "diagonal": 2.03635835647583,
+    "finite": 0.023218391463160515
+  },
+  {
+    "step": 386,
+    "loss": 2.0172927379608154,
+    "diagonal": 2.001457452774048,
+    "finite": 0.015835218131542206
+  },
+  {
+    "step": 387,
+    "loss": 1.6215540170669556,
+    "diagonal": 1.605270266532898,
+    "finite": 0.016283780336380005
+  },
+  {
+    "step": 388,
+    "loss": 1.9802972078323364,
+    "diagonal": 1.9609620571136475,
+    "finite": 0.019335193559527397
+  },
+  {
+    "step": 389,
+    "loss": 1.9518041610717773,
+    "diagonal": 1.924487829208374,
+    "finite": 0.027316303923726082
+  },
+  {
+    "step": 390,
+    "loss": 1.8146222829818726,
+    "diagonal": 1.793002963066101,
+    "finite": 0.021619286388158798
+  },
+  {
+    "step": 391,
+    "loss": 1.4565643072128296,
+    "diagonal": 1.4376680850982666,
+    "finite": 0.018896201625466347
+  },
+  {
+    "step": 392,
+    "loss": 1.8595579862594604,
+    "diagonal": 1.839372158050537,
+    "finite": 0.020185792818665504
+  },
+  {
+    "step": 393,
+    "loss": 2.0853376388549805,
+    "diagonal": 2.0691373348236084,
+    "finite": 0.01620025932788849
+  },
+  {
+    "step": 394,
+    "loss": 2.4211018085479736,
+    "diagonal": 2.398886203765869,
+    "finite": 0.02221549302339554
+  },
+  {
+    "step": 395,
+    "loss": 1.7628061771392822,
+    "diagonal": 1.7444310188293457,
+    "finite": 0.018375111743807793
+  },
+  {
+    "step": 396,
+    "loss": 1.811918020248413,
+    "diagonal": 1.796628713607788,
+    "finite": 0.015289254486560822
+  },
+  {
+    "step": 397,
+    "loss": 1.5841381549835205,
+    "diagonal": 1.5713849067687988,
+    "finite": 0.01275329478085041
+  },
+  {
+    "step": 398,
+    "loss": 1.706868052482605,
+    "diagonal": 1.6885963678359985,
+    "finite": 0.01827165111899376
+  },
+  {
+    "step": 399,
+    "loss": 1.6498562097549438,
+    "diagonal": 1.6360052824020386,
+    "finite": 0.013850885443389416
+  },
+  {
+    "step": 400,
+    "loss": 2.0032942295074463,
+    "diagonal": 1.9898861646652222,
+    "finite": 0.013408025726675987
+  },
+  {
+    "step": 401,
+    "loss": 1.6432347297668457,
+    "diagonal": 1.6288270950317383,
+    "finite": 0.014407583512365818
+  },
+  {
+    "step": 402,
+    "loss": 2.689664125442505,
+    "diagonal": 2.6762382984161377,
+    "finite": 0.013425740413367748
+  },
+  {
+    "step": 403,
+    "loss": 2.0090372562408447,
+    "diagonal": 1.9949887990951538,
+    "finite": 0.01404853630810976
+  },
+  {
+    "step": 404,
+    "loss": 1.6102319955825806,
+    "diagonal": 1.5975435972213745,
+    "finite": 0.0126884113997221
+  },
+  {
+    "step": 405,
+    "loss": 2.0218496322631836,
+    "diagonal": 2.0081863403320312,
+    "finite": 0.013663189485669136
+  },
+  {
+    "step": 406,
+    "loss": 1.9332354068756104,
+    "diagonal": 1.9176825284957886,
+    "finite": 0.015552891418337822
+  },
+  {
+    "step": 407,
+    "loss": 2.359863042831421,
+    "diagonal": 2.3448760509490967,
+    "finite": 0.014987049624323845
+  },
+  {
+    "step": 408,
+    "loss": 1.417462944984436,
+    "diagonal": 1.4066506624221802,
+    "finite": 0.010812317952513695
+  },
+  {
+    "step": 409,
+    "loss": 1.8806287050247192,
+    "diagonal": 1.86482834815979,
+    "finite": 0.015800345689058304
+  },
+  {
+    "step": 410,
+    "loss": 1.9515138864517212,
+    "diagonal": 1.9407603740692139,
+    "finite": 0.01075354777276516
+  },
+  {
+    "step": 411,
+    "loss": 1.3720762729644775,
+    "diagonal": 1.3580541610717773,
+    "finite": 0.014022169634699821
+  },
+  {
+    "step": 412,
+    "loss": 1.7042838335037231,
+    "diagonal": 1.6917182207107544,
+    "finite": 0.012565605342388153
+  },
+  {
+    "step": 413,
+    "loss": 1.6423488855361938,
+    "diagonal": 1.6266065835952759,
+    "finite": 0.015742257237434387
+  },
+  {
+    "step": 414,
+    "loss": 1.863547921180725,
+    "diagonal": 1.8517036437988281,
+    "finite": 0.011844250373542309
+  },
+  {
+    "step": 415,
+    "loss": 1.9553471803665161,
+    "diagonal": 1.939273476600647,
+    "finite": 0.01607367768883705
+  },
+  {
+    "step": 416,
+    "loss": 1.3925600051879883,
+    "diagonal": 1.37058424949646,
+    "finite": 0.021975701674818993
+  },
+  {
+    "step": 417,
+    "loss": 1.7455933094024658,
+    "diagonal": 1.7295262813568115,
+    "finite": 0.016066987067461014
+  },
+  {
+    "step": 418,
+    "loss": 1.8469963073730469,
+    "diagonal": 1.8309684991836548,
+    "finite": 0.016027765348553658
+  },
+  {
+    "step": 419,
+    "loss": 1.4337815046310425,
+    "diagonal": 1.4203014373779297,
+    "finite": 0.013480061665177345
+  },
+  {
+    "step": 420,
+    "loss": 1.8237301111221313,
+    "diagonal": 1.803928256034851,
+    "finite": 0.019801853224635124
+  },
+  {
+    "step": 421,
+    "loss": 1.9891539812088013,
+    "diagonal": 1.9747052192687988,
+    "finite": 0.014448723755776882
+  },
+  {
+    "step": 422,
+    "loss": 1.3700501918792725,
+    "diagonal": 1.353859782218933,
+    "finite": 0.01619040220975876
+  },
+  {
+    "step": 423,
+    "loss": 1.8715592622756958,
+    "diagonal": 1.8571643829345703,
+    "finite": 0.014394833706319332
+  },
+  {
+    "step": 424,
+    "loss": 1.9183491468429565,
+    "diagonal": 1.9062989950180054,
+    "finite": 0.012050099670886993
+  },
+  {
+    "step": 425,
+    "loss": 1.8856592178344727,
+    "diagonal": 1.8643925189971924,
+    "finite": 0.02126671001315117
+  },
+  {
+    "step": 426,
+    "loss": 1.669751763343811,
+    "diagonal": 1.648770809173584,
+    "finite": 0.020980937406420708
+  },
+  {
+    "step": 427,
+    "loss": 1.5149682760238647,
+    "diagonal": 1.5011776685714722,
+    "finite": 0.013790549710392952
+  },
+  {
+    "step": 428,
+    "loss": 1.607776165008545,
+    "diagonal": 1.586631417274475,
+    "finite": 0.021144773811101913
+  },
+  {
+    "step": 429,
+    "loss": 1.9960016012191772,
+    "diagonal": 1.982361912727356,
+    "finite": 0.013639742508530617
+  },
+  {
+    "step": 430,
+    "loss": 2.056750535964966,
+    "diagonal": 2.0429654121398926,
+    "finite": 0.013785144314169884
+  },
+  {
+    "step": 431,
+    "loss": 1.787246823310852,
+    "diagonal": 1.761165738105774,
+    "finite": 0.02608112245798111
+  },
+  {
+    "step": 432,
+    "loss": 1.8680545091629028,
+    "diagonal": 1.8543812036514282,
+    "finite": 0.013673307374119759
+  },
+  {
+    "step": 433,
+    "loss": 1.977349042892456,
+    "diagonal": 1.9586948156356812,
+    "finite": 0.018654190003871918
+  },
+  {
+    "step": 434,
+    "loss": 1.884043574333191,
+    "diagonal": 1.8676608800888062,
+    "finite": 0.016382649540901184
+  },
+  {
+    "step": 435,
+    "loss": 1.816213607788086,
+    "diagonal": 1.7971287965774536,
+    "finite": 0.01908479444682598
+  },
+  {
+    "step": 436,
+    "loss": 1.5485708713531494,
+    "diagonal": 1.530983328819275,
+    "finite": 0.017587585374712944
+  },
+  {
+    "step": 437,
+    "loss": 2.221130847930908,
+    "diagonal": 2.205498456954956,
+    "finite": 0.015632357448339462
+  },
+  {
+    "step": 438,
+    "loss": 1.793428659439087,
+    "diagonal": 1.7727664709091187,
+    "finite": 0.02066216617822647
+  },
+  {
+    "step": 439,
+    "loss": 1.5013816356658936,
+    "diagonal": 1.4816796779632568,
+    "finite": 0.01970195770263672
+  },
+  {
+    "step": 440,
+    "loss": 1.65483820438385,
+    "diagonal": 1.6298526525497437,
+    "finite": 0.02498551458120346
+  },
+  {
+    "step": 441,
+    "loss": 1.662293791770935,
+    "diagonal": 1.6418797969818115,
+    "finite": 0.020413963124155998
+  },
+  {
+    "step": 442,
+    "loss": 1.5198974609375,
+    "diagonal": 1.505827784538269,
+    "finite": 0.014069723896682262
+  },
+  {
+    "step": 443,
+    "loss": 1.4982551336288452,
+    "diagonal": 1.4852629899978638,
+    "finite": 0.0129921343177557
+  },
+  {
+    "step": 444,
+    "loss": 1.6090474128723145,
+    "diagonal": 1.5945565700531006,
+    "finite": 0.01449085958302021
+  },
+  {
+    "step": 445,
+    "loss": 1.9210293292999268,
+    "diagonal": 1.9062777757644653,
+    "finite": 0.014751567505300045
+  },
+  {
+    "step": 446,
+    "loss": 1.559322714805603,
+    "diagonal": 1.5449278354644775,
+    "finite": 0.014394853264093399
+  },
+  {
+    "step": 447,
+    "loss": 1.603129267692566,
+    "diagonal": 1.5841972827911377,
+    "finite": 0.018931973725557327
+  },
+  {
+    "step": 448,
+    "loss": 2.166700839996338,
+    "diagonal": 2.152177095413208,
+    "finite": 0.014523759484291077
+  },
+  {
+    "step": 449,
+    "loss": 1.9977422952651978,
+    "diagonal": 1.979684591293335,
+    "finite": 0.018057746812701225
+  },
+  {
+    "step": 450,
+    "loss": 2.1294684410095215,
+    "diagonal": 2.1126413345336914,
+    "finite": 0.0168270505964756
+  },
+  {
+    "step": 451,
+    "loss": 2.0014240741729736,
+    "diagonal": 1.9862418174743652,
+    "finite": 0.015182207338511944
+  },
+  {
+    "step": 452,
+    "loss": 1.8143056631088257,
+    "diagonal": 1.7999379634857178,
+    "finite": 0.014367684721946716
+  },
+  {
+    "step": 453,
+    "loss": 1.8474098443984985,
+    "diagonal": 1.837052822113037,
+    "finite": 0.010356989689171314
+  },
+  {
+    "step": 454,
+    "loss": 2.1326637268066406,
+    "diagonal": 2.120084524154663,
+    "finite": 0.012579116970300674
+  },
+  {
+    "step": 455,
+    "loss": 1.8975690603256226,
+    "diagonal": 1.8882743120193481,
+    "finite": 0.009294692426919937
+  },
+  {
+    "step": 456,
+    "loss": 1.8145760297775269,
+    "diagonal": 1.8021399974822998,
+    "finite": 0.012436013668775558
+  },
+  {
+    "step": 457,
+    "loss": 1.8537362813949585,
+    "diagonal": 1.8436611890792847,
+    "finite": 0.010075142607092857
+  },
+  {
+    "step": 458,
+    "loss": 1.7638099193572998,
+    "diagonal": 1.7485188245773315,
+    "finite": 0.015291087329387665
+  },
+  {
+    "step": 459,
+    "loss": 1.5446655750274658,
+    "diagonal": 1.531954288482666,
+    "finite": 0.012711303308606148
+  },
+  {
+    "step": 460,
+    "loss": 1.4927403926849365,
+    "diagonal": 1.4810981750488281,
+    "finite": 0.011642210185527802
+  },
+  {
+    "step": 461,
+    "loss": 2.1057984828948975,
+    "diagonal": 2.09745454788208,
+    "finite": 0.008343898691236973
+  },
+  {
+    "step": 462,
+    "loss": 1.5220681428909302,
+    "diagonal": 1.5078799724578857,
+    "finite": 0.01418820396065712
+  },
+  {
+    "step": 463,
+    "loss": 1.6919630765914917,
+    "diagonal": 1.673121452331543,
+    "finite": 0.01884157583117485
+  },
+  {
+    "step": 464,
+    "loss": 1.5150575637817383,
+    "diagonal": 1.5037696361541748,
+    "finite": 0.011287896893918514
+  },
+  {
+    "step": 465,
+    "loss": 1.5454072952270508,
+    "diagonal": 1.5291612148284912,
+    "finite": 0.01624603569507599
+  },
+  {
+    "step": 466,
+    "loss": 2.1819472312927246,
+    "diagonal": 2.151939630508423,
+    "finite": 0.030007652938365936
+  },
+  {
+    "step": 467,
+    "loss": 2.053743600845337,
+    "diagonal": 2.0282905101776123,
+    "finite": 0.0254531130194664
+  },
+  {
+    "step": 468,
+    "loss": 1.5603269338607788,
+    "diagonal": 1.5382195711135864,
+    "finite": 0.022107325494289398
+  },
+  {
+    "step": 469,
+    "loss": 2.127823829650879,
+    "diagonal": 2.0983474254608154,
+    "finite": 0.02947636879980564
+  },
+  {
+    "step": 470,
+    "loss": 2.2036783695220947,
+    "diagonal": 2.182344675064087,
+    "finite": 0.0213335994631052
+  },
+  {
+    "step": 471,
+    "loss": 1.8247839212417603,
+    "diagonal": 1.805643916130066,
+    "finite": 0.019140057265758514
+  },
+  {
+    "step": 472,
+    "loss": 1.8318018913269043,
+    "diagonal": 1.811866283416748,
+    "finite": 0.019935596734285355
+  },
+  {
+    "step": 473,
+    "loss": 1.4445381164550781,
+    "diagonal": 1.4232046604156494,
+    "finite": 0.0213334821164608
+  },
+  {
+    "step": 474,
+    "loss": 1.7002651691436768,
+    "diagonal": 1.6800999641418457,
+    "finite": 0.020165201276540756
+  },
+  {
+    "step": 475,
+    "loss": 1.9954302310943604,
+    "diagonal": 1.9830092191696167,
+    "finite": 0.01242106780409813
+  },
+  {
+    "step": 476,
+    "loss": 1.9752812385559082,
+    "diagonal": 1.9566750526428223,
+    "finite": 0.018606217578053474
+  },
+  {
+    "step": 477,
+    "loss": 1.5448335409164429,
+    "diagonal": 1.5282632112503052,
+    "finite": 0.016570299863815308
+  },
+  {
+    "step": 478,
+    "loss": 1.9725176095962524,
+    "diagonal": 1.9598007202148438,
+    "finite": 0.012716947123408318
+  },
+  {
+    "step": 479,
+    "loss": 1.1738502979278564,
+    "diagonal": 1.1574759483337402,
+    "finite": 0.016374362632632256
+  },
+  {
+    "step": 480,
+    "loss": 1.5067782402038574,
+    "diagonal": 1.489158034324646,
+    "finite": 0.017620207741856575
+  },
+  {
+    "step": 481,
+    "loss": 2.05694317817688,
+    "diagonal": 2.039289951324463,
+    "finite": 0.017653323709964752
+  },
+  {
+    "step": 482,
+    "loss": 1.8935433626174927,
+    "diagonal": 1.8816804885864258,
+    "finite": 0.01186290942132473
+  },
+  {
+    "step": 483,
+    "loss": 1.403369665145874,
+    "diagonal": 1.3928238153457642,
+    "finite": 0.010545840486884117
+  },
+  {
+    "step": 484,
+    "loss": 2.246873617172241,
+    "diagonal": 2.2301621437072754,
+    "finite": 0.016711415722966194
+  },
+  {
+    "step": 485,
+    "loss": 1.5093344449996948,
+    "diagonal": 1.495011806488037,
+    "finite": 0.014322593808174133
+  },
+  {
+    "step": 486,
+    "loss": 1.230455994606018,
+    "diagonal": 1.2151292562484741,
+    "finite": 0.015326743014156818
+  },
+  {
+    "step": 487,
+    "loss": 1.3265920877456665,
+    "diagonal": 1.3133999109268188,
+    "finite": 0.013192164711654186
+  },
+  {
+    "step": 488,
+    "loss": 1.7124079465866089,
+    "diagonal": 1.7001053094863892,
+    "finite": 0.012302660383284092
+  },
+  {
+    "step": 489,
+    "loss": 2.1030404567718506,
+    "diagonal": 2.0906784534454346,
+    "finite": 0.01236205268651247
+  },
+  {
+    "step": 490,
+    "loss": 1.0191351175308228,
+    "diagonal": 0.992995023727417,
+    "finite": 0.026140131056308746
+  },
+  {
+    "step": 491,
+    "loss": 1.5242522954940796,
+    "diagonal": 1.5084937810897827,
+    "finite": 0.015758536756038666
+  },
+  {
+    "step": 492,
+    "loss": 2.115725040435791,
+    "diagonal": 2.097158193588257,
+    "finite": 0.018566958606243134
+  },
+  {
+    "step": 493,
+    "loss": 1.9334840774536133,
+    "diagonal": 1.91002357006073,
+    "finite": 0.02346045710146427
+  },
+  {
+    "step": 494,
+    "loss": 2.225687265396118,
+    "diagonal": 2.209308385848999,
+    "finite": 0.016378900036215782
+  },
+  {
+    "step": 495,
+    "loss": 1.3670870065689087,
+    "diagonal": 1.3452692031860352,
+    "finite": 0.02181779034435749
+  },
+  {
+    "step": 496,
+    "loss": 2.0034217834472656,
+    "diagonal": 1.9745787382125854,
+    "finite": 0.028842942789196968
+  },
+  {
+    "step": 497,
+    "loss": 1.9037024974822998,
+    "diagonal": 1.879516839981079,
+    "finite": 0.024185672402381897
+  },
+  {
+    "step": 498,
+    "loss": 2.323575973510742,
+    "diagonal": 2.3015434741973877,
+    "finite": 0.02203238382935524
+  },
+  {
+    "step": 499,
+    "loss": 1.7099398374557495,
+    "diagonal": 1.6920056343078613,
+    "finite": 0.01793418824672699
+  },
+  {
+    "step": 500,
+    "loss": 2.095097303390503,
+    "diagonal": 2.074070692062378,
+    "finite": 0.021026672795414925
+  },
+  {
+    "step": 501,
+    "loss": 1.957358479499817,
+    "diagonal": 1.9356234073638916,
+    "finite": 0.021735064685344696
+  },
+  {
+    "step": 502,
+    "loss": 1.4968270063400269,
+    "diagonal": 1.4762015342712402,
+    "finite": 0.020625421777367592
+  },
+  {
+    "step": 503,
+    "loss": 1.799890398979187,
+    "diagonal": 1.778486967086792,
+    "finite": 0.021403439342975616
+  },
+  {
+    "step": 504,
+    "loss": 1.7615611553192139,
+    "diagonal": 1.7360879182815552,
+    "finite": 0.02547324262559414
+  },
+  {
+    "step": 505,
+    "loss": 1.6194267272949219,
+    "diagonal": 1.5960382223129272,
+    "finite": 0.02338854968547821
+  },
+  {
+    "step": 506,
+    "loss": 1.5941871404647827,
+    "diagonal": 1.5803697109222412,
+    "finite": 0.01381740067154169
+  },
+  {
+    "step": 507,
+    "loss": 1.720986247062683,
+    "diagonal": 1.7061362266540527,
+    "finite": 0.014850071631371975
+  },
+  {
+    "step": 508,
+    "loss": 1.593841791152954,
+    "diagonal": 1.5797927379608154,
+    "finite": 0.014049028977751732
+  },
+  {
+    "step": 509,
+    "loss": 1.3445993661880493,
+    "diagonal": 1.3295609951019287,
+    "finite": 0.015038391575217247
+  },
+  {
+    "step": 510,
+    "loss": 1.6506743431091309,
+    "diagonal": 1.6365426778793335,
+    "finite": 0.014131716452538967
+  },
+  {
+    "step": 511,
+    "loss": 1.500842809677124,
+    "diagonal": 1.4881569147109985,
+    "finite": 0.01268593966960907
+  },
+  {
+    "step": 512,
+    "loss": 1.7241441011428833,
+    "diagonal": 1.7055869102478027,
+    "finite": 0.01855718530714512
+  },
+  {
+    "step": 513,
+    "loss": 1.9967095851898193,
+    "diagonal": 1.971882939338684,
+    "finite": 0.024826636537909508
+  },
+  {
+    "step": 514,
+    "loss": 1.7286763191223145,
+    "diagonal": 1.70869779586792,
+    "finite": 0.019978532567620277
+  },
+  {
+    "step": 515,
+    "loss": 2.0738234519958496,
+    "diagonal": 2.0601518154144287,
+    "finite": 0.013671716675162315
+  },
+  {
+    "step": 516,
+    "loss": 1.4203397035598755,
+    "diagonal": 1.401994228363037,
+    "finite": 0.018345480784773827
+  },
+  {
+    "step": 517,
+    "loss": 1.7923591136932373,
+    "diagonal": 1.7760982513427734,
+    "finite": 0.016260916367173195
+  },
+  {
+    "step": 518,
+    "loss": 2.2127485275268555,
+    "diagonal": 2.196828842163086,
+    "finite": 0.015919754281640053
+  },
+  {
+    "step": 519,
+    "loss": 1.6443023681640625,
+    "diagonal": 1.6257379055023193,
+    "finite": 0.018564442172646523
+  },
+  {
+    "step": 520,
+    "loss": 1.171451210975647,
+    "diagonal": 1.1565269231796265,
+    "finite": 0.01492434460669756
+  },
+  {
+    "step": 521,
+    "loss": 1.469709873199463,
+    "diagonal": 1.4497251510620117,
+    "finite": 0.019984737038612366
+  },
+  {
+    "step": 522,
+    "loss": 1.9344722032546997,
+    "diagonal": 1.9173105955123901,
+    "finite": 0.017161626368761063
+  },
+  {
+    "step": 523,
+    "loss": 1.6279139518737793,
+    "diagonal": 1.6093811988830566,
+    "finite": 0.018532734364271164
+  },
+  {
+    "step": 524,
+    "loss": 1.6532938480377197,
+    "diagonal": 1.6285706758499146,
+    "finite": 0.02472321316599846
+  },
+  {
+    "step": 525,
+    "loss": 2.1386289596557617,
+    "diagonal": 2.121095657348633,
+    "finite": 0.01753319799900055
+  },
+  {
+    "step": 526,
+    "loss": 1.7188880443572998,
+    "diagonal": 1.6996582746505737,
+    "finite": 0.01922973431646824
+  },
+  {
+    "step": 527,
+    "loss": 1.3939313888549805,
+    "diagonal": 1.3702068328857422,
+    "finite": 0.02372453361749649
+  },
+  {
+    "step": 528,
+    "loss": 1.403851866722107,
+    "diagonal": 1.3837542533874512,
+    "finite": 0.02009756676852703
+  },
+  {
+    "step": 529,
+    "loss": 1.6750448942184448,
+    "diagonal": 1.6570019721984863,
+    "finite": 0.01804291270673275
+  },
+  {
+    "step": 530,
+    "loss": 1.7021297216415405,
+    "diagonal": 1.676210880279541,
+    "finite": 0.025918789207935333
+  },
+  {
+    "step": 531,
+    "loss": 2.1226866245269775,
+    "diagonal": 2.105229616165161,
+    "finite": 0.017457107082009315
+  },
+  {
+    "step": 532,
+    "loss": 1.7441374063491821,
+    "diagonal": 1.7242201566696167,
+    "finite": 0.01991729624569416
+  },
+  {
+    "step": 533,
+    "loss": 1.9990456104278564,
+    "diagonal": 1.9772827625274658,
+    "finite": 0.02176283299922943
+  },
+  {
+    "step": 534,
+    "loss": 1.433127760887146,
+    "diagonal": 1.4104359149932861,
+    "finite": 0.022691862657666206
+  },
+  {
+    "step": 535,
+    "loss": 2.0848283767700195,
+    "diagonal": 2.0574162006378174,
+    "finite": 0.027412110939621925
+  },
+  {
+    "step": 536,
+    "loss": 1.3028991222381592,
+    "diagonal": 1.2704604864120483,
+    "finite": 0.032438598573207855
+  },
+  {
+    "step": 537,
+    "loss": 1.7127420902252197,
+    "diagonal": 1.6792573928833008,
+    "finite": 0.033484719693660736
+  },
+  {
+    "step": 538,
+    "loss": 1.5287904739379883,
+    "diagonal": 1.4978121519088745,
+    "finite": 0.030978357419371605
+  },
+  {
+    "step": 539,
+    "loss": 1.6798433065414429,
+    "diagonal": 1.6612204313278198,
+    "finite": 0.01862289011478424
+  },
+  {
+    "step": 540,
+    "loss": 2.0607175827026367,
+    "diagonal": 2.0314440727233887,
+    "finite": 0.029273517429828644
+  },
+  {
+    "step": 541,
+    "loss": 2.128462791442871,
+    "diagonal": 2.099897861480713,
+    "finite": 0.028564883396029472
+  },
+  {
+    "step": 542,
+    "loss": 2.0811619758605957,
+    "diagonal": 2.0568318367004395,
+    "finite": 0.024330254644155502
+  },
+  {
+    "step": 543,
+    "loss": 1.7809652090072632,
+    "diagonal": 1.7644157409667969,
+    "finite": 0.016549425199627876
+  },
+  {
+    "step": 544,
+    "loss": 1.7767752408981323,
+    "diagonal": 1.760884165763855,
+    "finite": 0.015891123563051224
+  },
+  {
+    "step": 545,
+    "loss": 1.6477649211883545,
+    "diagonal": 1.6334458589553833,
+    "finite": 0.014319032430648804
+  },
+  {
+    "step": 546,
+    "loss": 1.4311891794204712,
+    "diagonal": 1.4173810482025146,
+    "finite": 0.0138081144541502
+  },
+  {
+    "step": 547,
+    "loss": 1.7002609968185425,
+    "diagonal": 1.673227310180664,
+    "finite": 0.027033744379878044
+  },
+  {
+    "step": 548,
+    "loss": 1.6228816509246826,
+    "diagonal": 1.6081935167312622,
+    "finite": 0.014688074588775635
+  },
+  {
+    "step": 549,
+    "loss": 1.9971297979354858,
+    "diagonal": 1.9859399795532227,
+    "finite": 0.011189790442585945
+  },
+  {
+    "step": 550,
+    "loss": 1.8285943269729614,
+    "diagonal": 1.8141512870788574,
+    "finite": 0.014443038031458855
+  },
+  {
+    "step": 551,
+    "loss": 1.682633638381958,
+    "diagonal": 1.6608383655548096,
+    "finite": 0.021795302629470825
+  },
+  {
+    "step": 552,
+    "loss": 1.895094871520996,
+    "diagonal": 1.872936487197876,
+    "finite": 0.022158440202474594
+  },
+  {
+    "step": 553,
+    "loss": 1.598995566368103,
+    "diagonal": 1.5807478427886963,
+    "finite": 0.01824776642024517
+  },
+  {
+    "step": 554,
+    "loss": 1.9976996183395386,
+    "diagonal": 1.9786779880523682,
+    "finite": 0.019021589308977127
+  },
+  {
+    "step": 555,
+    "loss": 1.395838737487793,
+    "diagonal": 1.3709303140640259,
+    "finite": 0.02490844577550888
+  },
+  {
+    "step": 556,
+    "loss": 1.6511058807373047,
+    "diagonal": 1.6249489784240723,
+    "finite": 0.026156911626458168
+  },
+  {
+    "step": 557,
+    "loss": 1.7460544109344482,
+    "diagonal": 1.7222191095352173,
+    "finite": 0.023835353553295135
+  },
+  {
+    "step": 558,
+    "loss": 1.1998777389526367,
+    "diagonal": 1.175255298614502,
+    "finite": 0.024622485041618347
+  },
+  {
+    "step": 559,
+    "loss": 1.8036412000656128,
+    "diagonal": 1.7720835208892822,
+    "finite": 0.03155772387981415
+  },
+  {
+    "step": 560,
+    "loss": 1.5840057134628296,
+    "diagonal": 1.5653384923934937,
+    "finite": 0.018667196854948997
+  },
+  {
+    "step": 561,
+    "loss": 1.8915637731552124,
+    "diagonal": 1.8698996305465698,
+    "finite": 0.0216640867292881
+  },
+  {
+    "step": 562,
+    "loss": 1.7090859413146973,
+    "diagonal": 1.683383584022522,
+    "finite": 0.025702357292175293
+  },
+  {
+    "step": 563,
+    "loss": 1.6221354007720947,
+    "diagonal": 1.6000053882598877,
+    "finite": 0.02213001623749733
+  },
+  {
+    "step": 564,
+    "loss": 1.5923453569412231,
+    "diagonal": 1.5739109516143799,
+    "finite": 0.018434379249811172
+  },
+  {
+    "step": 565,
+    "loss": 1.4613304138183594,
+    "diagonal": 1.4434034824371338,
+    "finite": 0.017926905304193497
+  },
+  {
+    "step": 566,
+    "loss": 2.003774881362915,
+    "diagonal": 1.9862768650054932,
+    "finite": 0.017497975379228592
+  },
+  {
+    "step": 567,
+    "loss": 1.2287086248397827,
+    "diagonal": 1.2098199129104614,
+    "finite": 0.01888873428106308
+  },
+  {
+    "step": 568,
+    "loss": 1.3300011157989502,
+    "diagonal": 1.3141124248504639,
+    "finite": 0.015888636931777
+  },
+  {
+    "step": 569,
+    "loss": 1.6767566204071045,
+    "diagonal": 1.6584460735321045,
+    "finite": 0.0183105431497097
+  },
+  {
+    "step": 570,
+    "loss": 1.4190900325775146,
+    "diagonal": 1.400711178779602,
+    "finite": 0.01837879791855812
+  },
+  {
+    "step": 571,
+    "loss": 2.1975648403167725,
+    "diagonal": 2.1794092655181885,
+    "finite": 0.018155623227357864
+  },
+  {
+    "step": 572,
+    "loss": 1.252416729927063,
+    "diagonal": 1.2299555540084839,
+    "finite": 0.022461185231804848
+  },
+  {
+    "step": 573,
+    "loss": 1.556684136390686,
+    "diagonal": 1.535278558731079,
+    "finite": 0.02140558511018753
+  },
+  {
+    "step": 574,
+    "loss": 1.6997711658477783,
+    "diagonal": 1.6788424253463745,
+    "finite": 0.020928720012307167
+  },
+  {
+    "step": 575,
+    "loss": 1.5369614362716675,
+    "diagonal": 1.514854073524475,
+    "finite": 0.022107310593128204
+  },
+  {
+    "step": 576,
+    "loss": 1.6007269620895386,
+    "diagonal": 1.5866262912750244,
+    "finite": 0.014100688509643078
+  },
+  {
+    "step": 577,
+    "loss": 1.4927494525909424,
+    "diagonal": 1.4721801280975342,
+    "finite": 0.02056937851011753
+  },
+  {
+    "step": 578,
+    "loss": 1.6262141466140747,
+    "diagonal": 1.6060007810592651,
+    "finite": 0.020213356241583824
+  },
+  {
+    "step": 579,
+    "loss": 1.7328499555587769,
+    "diagonal": 1.7135165929794312,
+    "finite": 0.01933332532644272
+  },
+  {
+    "step": 580,
+    "loss": 1.8418960571289062,
+    "diagonal": 1.825735092163086,
+    "finite": 0.01616097241640091
+  },
+  {
+    "step": 581,
+    "loss": 1.8026535511016846,
+    "diagonal": 1.7877596616744995,
+    "finite": 0.014893939718604088
+  },
+  {
+    "step": 582,
+    "loss": 1.5902197360992432,
+    "diagonal": 1.5676171779632568,
+    "finite": 0.022602595388889313
+  },
+  {
+    "step": 583,
+    "loss": 1.367847204208374,
+    "diagonal": 1.3542951345443726,
+    "finite": 0.013552114367485046
+  },
+  {
+    "step": 584,
+    "loss": 1.8911718130111694,
+    "diagonal": 1.8713723421096802,
+    "finite": 0.01979946717619896
+  },
+  {
+    "step": 585,
+    "loss": 1.8736655712127686,
+    "diagonal": 1.8592112064361572,
+    "finite": 0.014454323798418045
+  },
+  {
+    "step": 586,
+    "loss": 1.3055660724639893,
+    "diagonal": 1.2895805835723877,
+    "finite": 0.015985481441020966
+  },
+  {
+    "step": 587,
+    "loss": 1.6686488389968872,
+    "diagonal": 1.6491832733154297,
+    "finite": 0.019465524703264236
+  },
+  {
+    "step": 588,
+    "loss": 1.640288233757019,
+    "diagonal": 1.6229679584503174,
+    "finite": 0.01732032746076584
+  },
+  {
+    "step": 589,
+    "loss": 1.347477674484253,
+    "diagonal": 1.3317677974700928,
+    "finite": 0.01570988819003105
+  },
+  {
+    "step": 590,
+    "loss": 1.4082273244857788,
+    "diagonal": 1.3904985189437866,
+    "finite": 0.017728831619024277
+  },
+  {
+    "step": 591,
+    "loss": 1.950211524963379,
+    "diagonal": 1.935402750968933,
+    "finite": 0.014808827079832554
+  },
+  {
+    "step": 592,
+    "loss": 2.094852924346924,
+    "diagonal": 2.070744514465332,
+    "finite": 0.02410842292010784
+  },
+  {
+    "step": 593,
+    "loss": 1.5177509784698486,
+    "diagonal": 1.4933834075927734,
+    "finite": 0.02436758019030094
+  },
+  {
+    "step": 594,
+    "loss": 1.632956862449646,
+    "diagonal": 1.6078298091888428,
+    "finite": 0.025127047672867775
+  },
+  {
+    "step": 595,
+    "loss": 2.0269649028778076,
+    "diagonal": 2.0066606998443604,
+    "finite": 0.0203042384237051
+  },
+  {
+    "step": 596,
+    "loss": 1.328771948814392,
+    "diagonal": 1.3091716766357422,
+    "finite": 0.019600315019488335
+  },
+  {
+    "step": 597,
+    "loss": 1.741045594215393,
+    "diagonal": 1.7165182828903198,
+    "finite": 0.024527262896299362
+  },
+  {
+    "step": 598,
+    "loss": 1.5015159845352173,
+    "diagonal": 1.4799965620040894,
+    "finite": 0.021519416943192482
+  },
+  {
+    "step": 599,
+    "loss": 1.6016119718551636,
+    "diagonal": 1.5839602947235107,
+    "finite": 0.017651719972491264
+  },
+  {
+    "step": 600,
+    "loss": 1.7161920070648193,
+    "diagonal": 1.6973872184753418,
+    "finite": 0.018804745748639107
+  },
+  {
+    "step": 601,
+    "loss": 1.6584581136703491,
+    "diagonal": 1.641369342803955,
+    "finite": 0.017088795080780983
+  },
+  {
+    "step": 602,
+    "loss": 1.3283895254135132,
+    "diagonal": 1.315561294555664,
+    "finite": 0.012828215956687927
+  },
+  {
+    "step": 603,
+    "loss": 1.9694849252700806,
+    "diagonal": 1.9492177963256836,
+    "finite": 0.02026718482375145
+  },
+  {
+    "step": 604,
+    "loss": 1.6945775747299194,
+    "diagonal": 1.6786845922470093,
+    "finite": 0.015893036499619484
+  },
+  {
+    "step": 605,
+    "loss": 1.4101736545562744,
+    "diagonal": 1.3940304517745972,
+    "finite": 0.016143159940838814
+  },
+  {
+    "step": 606,
+    "loss": 1.7889999151229858,
+    "diagonal": 1.7701143026351929,
+    "finite": 0.0188856590539217
+  },
+  {
+    "step": 607,
+    "loss": 1.6721028089523315,
+    "diagonal": 1.6553828716278076,
+    "finite": 0.01671995408833027
+  },
+  {
+    "step": 608,
+    "loss": 1.4831364154815674,
+    "diagonal": 1.4701200723648071,
+    "finite": 0.013016367331147194
+  },
+  {
+    "step": 609,
+    "loss": 1.384550929069519,
+    "diagonal": 1.3668339252471924,
+    "finite": 0.017717061564326286
+  },
+  {
+    "step": 610,
+    "loss": 1.331800937652588,
+    "diagonal": 1.313710331916809,
+    "finite": 0.01809064857661724
+  },
+  {
+    "step": 611,
+    "loss": 1.3671590089797974,
+    "diagonal": 1.3497374057769775,
+    "finite": 0.017421608790755272
+  },
+  {
+    "step": 612,
+    "loss": 2.397193670272827,
+    "diagonal": 2.37906551361084,
+    "finite": 0.018128061667084694
+  },
+  {
+    "step": 613,
+    "loss": 1.8545583486557007,
+    "diagonal": 1.840965747833252,
+    "finite": 0.013592550531029701
+  },
+  {
+    "step": 614,
+    "loss": 1.2299293279647827,
+    "diagonal": 1.207130789756775,
+    "finite": 0.022798506543040276
+  },
+  {
+    "step": 615,
+    "loss": 1.7194840908050537,
+    "diagonal": 1.7001827955245972,
+    "finite": 0.019301244989037514
+  },
+  {
+    "step": 616,
+    "loss": 1.7302501201629639,
+    "diagonal": 1.7091994285583496,
+    "finite": 0.02105071023106575
+  },
+  {
+    "step": 617,
+    "loss": 1.5389894247055054,
+    "diagonal": 1.5178929567337036,
+    "finite": 0.021096497774124146
+  },
+  {
+    "step": 618,
+    "loss": 1.369721531867981,
+    "diagonal": 1.354630708694458,
+    "finite": 0.01509085763245821
+  },
+  {
+    "step": 619,
+    "loss": 1.8379098176956177,
+    "diagonal": 1.8158023357391357,
+    "finite": 0.022107470780611038
+  },
+  {
+    "step": 620,
+    "loss": 1.2485299110412598,
+    "diagonal": 1.2249294519424438,
+    "finite": 0.02360040508210659
+  },
+  {
+    "step": 621,
+    "loss": 1.7629358768463135,
+    "diagonal": 1.740328073501587,
+    "finite": 0.022607853636145592
+  },
+  {
+    "step": 622,
+    "loss": 1.502949833869934,
+    "diagonal": 1.4829130172729492,
+    "finite": 0.020036838948726654
+  },
+  {
+    "step": 623,
+    "loss": 1.8688254356384277,
+    "diagonal": 1.8510013818740845,
+    "finite": 0.01782401278614998
+  },
+  {
+    "step": 624,
+    "loss": 1.5154203176498413,
+    "diagonal": 1.4876995086669922,
+    "finite": 0.02772081084549427
+  },
+  {
+    "step": 625,
+    "loss": 1.5186598300933838,
+    "diagonal": 1.5027728080749512,
+    "finite": 0.015887008979916573
+  },
+  {
+    "step": 626,
+    "loss": 1.6995956897735596,
+    "diagonal": 1.6815683841705322,
+    "finite": 0.018027300015091896
+  },
+  {
+    "step": 627,
+    "loss": 1.5137889385223389,
+    "diagonal": 1.4918622970581055,
+    "finite": 0.02192658558487892
+  },
+  {
+    "step": 628,
+    "loss": 1.5024254322052002,
+    "diagonal": 1.4686211347579956,
+    "finite": 0.033804312348365784
+  },
+  {
+    "step": 629,
+    "loss": 1.6173992156982422,
+    "diagonal": 1.6053508520126343,
+    "finite": 0.012048340402543545
+  },
+  {
+    "step": 630,
+    "loss": 1.5829068422317505,
+    "diagonal": 1.5710158348083496,
+    "finite": 0.011891045607626438
+  },
+  {
+    "step": 631,
+    "loss": 1.66001296043396,
+    "diagonal": 1.643688678741455,
+    "finite": 0.016324292868375778
+  },
+  {
+    "step": 632,
+    "loss": 1.9593499898910522,
+    "diagonal": 1.9449745416641235,
+    "finite": 0.014375420287251472
+  },
+  {
+    "step": 633,
+    "loss": 1.5691524744033813,
+    "diagonal": 1.5588983297348022,
+    "finite": 0.010254179127514362
+  },
+  {
+    "step": 634,
+    "loss": 1.2812583446502686,
+    "diagonal": 1.2664704322814941,
+    "finite": 0.014787907712161541
+  },
+  {
+    "step": 635,
+    "loss": 1.590667486190796,
+    "diagonal": 1.5730522871017456,
+    "finite": 0.017615191638469696
+  },
+  {
+    "step": 636,
+    "loss": 1.3395055532455444,
+    "diagonal": 1.319994330406189,
+    "finite": 0.019511207938194275
+  },
+  {
+    "step": 637,
+    "loss": 1.8761940002441406,
+    "diagonal": 1.858099341392517,
+    "finite": 0.018094711005687714
+  },
+  {
+    "step": 638,
+    "loss": 1.812035083770752,
+    "diagonal": 1.7928920984268188,
+    "finite": 0.019142944365739822
+  },
+  {
+    "step": 639,
+    "loss": 1.2801073789596558,
+    "diagonal": 1.2553575038909912,
+    "finite": 0.024749882519245148
+  },
+  {
+    "step": 640,
+    "loss": 2.02374529838562,
+    "diagonal": 2.00500750541687,
+    "finite": 0.01873788610100746
+  },
+  {
+    "step": 641,
+    "loss": 1.7976213693618774,
+    "diagonal": 1.7748082876205444,
+    "finite": 0.022813070565462112
+  },
+  {
+    "step": 642,
+    "loss": 1.8907383680343628,
+    "diagonal": 1.871231198310852,
+    "finite": 0.01950717903673649
+  },
+  {
+    "step": 643,
+    "loss": 1.815154790878296,
+    "diagonal": 1.7985492944717407,
+    "finite": 0.01660553179681301
+  },
+  {
+    "step": 644,
+    "loss": 2.1020312309265137,
+    "diagonal": 2.085146427154541,
+    "finite": 0.01688476651906967
+  },
+  {
+    "step": 645,
+    "loss": 1.4506795406341553,
+    "diagonal": 1.4367811679840088,
+    "finite": 0.01389835774898529
+  },
+  {
+    "step": 646,
+    "loss": 1.5512973070144653,
+    "diagonal": 1.5269416570663452,
+    "finite": 0.024355696514248848
+  },
+  {
+    "step": 647,
+    "loss": 2.058765172958374,
+    "diagonal": 2.044924736022949,
+    "finite": 0.01384048257023096
+  },
+  {
+    "step": 648,
+    "loss": 1.4006427526474,
+    "diagonal": 1.379473090171814,
+    "finite": 0.02116965502500534
+  },
+  {
+    "step": 649,
+    "loss": 1.7620697021484375,
+    "diagonal": 1.7410036325454712,
+    "finite": 0.021066032350063324
+  },
+  {
+    "step": 650,
+    "loss": 1.489961862564087,
+    "diagonal": 1.471167802810669,
+    "finite": 0.018794016912579536
+  },
+  {
+    "step": 651,
+    "loss": 1.6678709983825684,
+    "diagonal": 1.6419212818145752,
+    "finite": 0.02594972774386406
+  },
+  {
+    "step": 652,
+    "loss": 2.0797762870788574,
+    "diagonal": 2.0492377281188965,
+    "finite": 0.03053848259150982
+  },
+  {
+    "step": 653,
+    "loss": 1.354400634765625,
+    "diagonal": 1.3307104110717773,
+    "finite": 0.02369016595184803
+  },
+  {
+    "step": 654,
+    "loss": 1.7446510791778564,
+    "diagonal": 1.7205898761749268,
+    "finite": 0.024061214178800583
+  },
+  {
+    "step": 655,
+    "loss": 1.2300969362258911,
+    "diagonal": 1.2105530500411987,
+    "finite": 0.01954387128353119
+  },
+  {
+    "step": 656,
+    "loss": 2.0060033798217773,
+    "diagonal": 1.9865202903747559,
+    "finite": 0.01948297768831253
+  },
+  {
+    "step": 657,
+    "loss": 1.7281886339187622,
+    "diagonal": 1.7130168676376343,
+    "finite": 0.015171820297837257
+  },
+  {
+    "step": 658,
+    "loss": 1.9335094690322876,
+    "diagonal": 1.9152013063430786,
+    "finite": 0.01830819435417652
+  },
+  {
+    "step": 659,
+    "loss": 1.6646069288253784,
+    "diagonal": 1.6431533098220825,
+    "finite": 0.02145366743206978
+  },
+  {
+    "step": 660,
+    "loss": 1.692661166191101,
+    "diagonal": 1.674691081047058,
+    "finite": 0.017970101907849312
+  },
+  {
+    "step": 661,
+    "loss": 1.5113073587417603,
+    "diagonal": 1.4920010566711426,
+    "finite": 0.01930631697177887
+  },
+  {
+    "step": 662,
+    "loss": 1.762817621231079,
+    "diagonal": 1.7394676208496094,
+    "finite": 0.023349961265921593
+  },
+  {
+    "step": 663,
+    "loss": 1.8215662240982056,
+    "diagonal": 1.8067400455474854,
+    "finite": 0.014826178550720215
+  },
+  {
+    "step": 664,
+    "loss": 1.5105441808700562,
+    "diagonal": 1.4950484037399292,
+    "finite": 0.015495791099965572
+  },
+  {
+    "step": 665,
+    "loss": 2.1989142894744873,
+    "diagonal": 2.178589344024658,
+    "finite": 0.020325053483247757
+  },
+  {
+    "step": 666,
+    "loss": 2.0494046211242676,
+    "diagonal": 2.0290565490722656,
+    "finite": 0.020348109304904938
+  },
+  {
+    "step": 667,
+    "loss": 1.7326674461364746,
+    "diagonal": 1.7128006219863892,
+    "finite": 0.019866809248924255
+  },
+  {
+    "step": 668,
+    "loss": 2.3484363555908203,
+    "diagonal": 2.3295271396636963,
+    "finite": 0.01890917494893074
+  },
+  {
+    "step": 669,
+    "loss": 1.9494985342025757,
+    "diagonal": 1.9349836111068726,
+    "finite": 0.014514921233057976
+  },
+  {
+    "step": 670,
+    "loss": 1.731793761253357,
+    "diagonal": 1.7097702026367188,
+    "finite": 0.022023607045412064
+  },
+  {
+    "step": 671,
+    "loss": 1.6811259984970093,
+    "diagonal": 1.662304162979126,
+    "finite": 0.01882179081439972
+  },
+  {
+    "step": 672,
+    "loss": 1.7091047763824463,
+    "diagonal": 1.6946278810501099,
+    "finite": 0.014476899988949299
+  },
+  {
+    "step": 673,
+    "loss": 2.016085386276245,
+    "diagonal": 1.9961485862731934,
+    "finite": 0.019936803728342056
+  },
+  {
+    "step": 674,
+    "loss": 1.1984487771987915,
+    "diagonal": 1.186651349067688,
+    "finite": 0.011797457933425903
+  },
+  {
+    "step": 675,
+    "loss": 1.3722904920578003,
+    "diagonal": 1.3556585311889648,
+    "finite": 0.016632014885544777
+  },
+  {
+    "step": 676,
+    "loss": 1.7977567911148071,
+    "diagonal": 1.7824265956878662,
+    "finite": 0.015330147929489613
+  },
+  {
+    "step": 677,
+    "loss": 1.7018423080444336,
+    "diagonal": 1.6872377395629883,
+    "finite": 0.01460458803921938
+  },
+  {
+    "step": 678,
+    "loss": 1.2997113466262817,
+    "diagonal": 1.2811437845230103,
+    "finite": 0.018567580729722977
+  },
+  {
+    "step": 679,
+    "loss": 1.7265487909317017,
+    "diagonal": 1.7130769491195679,
+    "finite": 0.01347178965806961
+  },
+  {
+    "step": 680,
+    "loss": 1.3478281497955322,
+    "diagonal": 1.3323265314102173,
+    "finite": 0.01550157181918621
+  },
+  {
+    "step": 681,
+    "loss": 1.6054767370224,
+    "diagonal": 1.5909106731414795,
+    "finite": 0.014566109515726566
+  },
+  {
+    "step": 682,
+    "loss": 1.7117506265640259,
+    "diagonal": 1.6950169801712036,
+    "finite": 0.016733650118112564
+  },
+  {
+    "step": 683,
+    "loss": 2.2291171550750732,
+    "diagonal": 2.2090396881103516,
+    "finite": 0.02007753774523735
+  },
+  {
+    "step": 684,
+    "loss": 1.5537042617797852,
+    "diagonal": 1.53327214717865,
+    "finite": 0.020432068035006523
+  },
+  {
+    "step": 685,
+    "loss": 1.7346326112747192,
+    "diagonal": 1.7148609161376953,
+    "finite": 0.019771642982959747
+  },
+  {
+    "step": 686,
+    "loss": 1.6219180822372437,
+    "diagonal": 1.604828119277954,
+    "finite": 0.017089931294322014
+  },
+  {
+    "step": 687,
+    "loss": 1.654593825340271,
+    "diagonal": 1.635174036026001,
+    "finite": 0.01941979117691517
+  },
+  {
+    "step": 688,
+    "loss": 1.9327892065048218,
+    "diagonal": 1.9139165878295898,
+    "finite": 0.018872570246458054
+  },
+  {
+    "step": 689,
+    "loss": 1.8291468620300293,
+    "diagonal": 1.808595895767212,
+    "finite": 0.02055102214217186
+  },
+  {
+    "step": 690,
+    "loss": 1.5139533281326294,
+    "diagonal": 1.4971740245819092,
+    "finite": 0.016779309138655663
+  },
+  {
+    "step": 691,
+    "loss": 1.484679937362671,
+    "diagonal": 1.4642002582550049,
+    "finite": 0.020479630678892136
+  },
+  {
+    "step": 692,
+    "loss": 1.4412235021591187,
+    "diagonal": 1.4242372512817383,
+    "finite": 0.016986265778541565
+  },
+  {
+    "step": 693,
+    "loss": 1.5837353467941284,
+    "diagonal": 1.5617581605911255,
+    "finite": 0.02197718247771263
+  },
+  {
+    "step": 694,
+    "loss": 1.7058025598526,
+    "diagonal": 1.6879677772521973,
+    "finite": 0.017834730446338654
+  },
+  {
+    "step": 695,
+    "loss": 2.1414921283721924,
+    "diagonal": 2.119002342224121,
+    "finite": 0.022489801049232483
+  },
+  {
+    "step": 696,
+    "loss": 1.9006550312042236,
+    "diagonal": 1.883958101272583,
+    "finite": 0.016696883365511894
+  },
+  {
+    "step": 697,
+    "loss": 1.877813458442688,
+    "diagonal": 1.861169695854187,
+    "finite": 0.016643786802887917
+  },
+  {
+    "step": 698,
+    "loss": 1.6867647171020508,
+    "diagonal": 1.6655521392822266,
+    "finite": 0.021212562918663025
+  },
+  {
+    "step": 699,
+    "loss": 1.7260994911193848,
+    "diagonal": 1.7052744626998901,
+    "finite": 0.020825030282139778
+  },
+  {
+    "step": 700,
+    "loss": 1.2514439821243286,
+    "diagonal": 1.2332100868225098,
+    "finite": 0.01823389157652855
+  },
+  {
+    "step": 701,
+    "loss": 1.427764654159546,
+    "diagonal": 1.4054670333862305,
+    "finite": 0.02229766920208931
+  },
+  {
+    "step": 702,
+    "loss": 1.7314990758895874,
+    "diagonal": 1.7131633758544922,
+    "finite": 0.018335750326514244
+  },
+  {
+    "step": 703,
+    "loss": 1.4878877401351929,
+    "diagonal": 1.4672646522521973,
+    "finite": 0.020623112097382545
+  },
+  {
+    "step": 704,
+    "loss": 1.9040509462356567,
+    "diagonal": 1.8900538682937622,
+    "finite": 0.013997072353959084
+  },
+  {
+    "step": 705,
+    "loss": 1.7186617851257324,
+    "diagonal": 1.7026640176773071,
+    "finite": 0.015997810289263725
+  },
+  {
+    "step": 706,
+    "loss": 1.5382075309753418,
+    "diagonal": 1.519627571105957,
+    "finite": 0.018579907715320587
+  },
+  {
+    "step": 707,
+    "loss": 2.3199756145477295,
+    "diagonal": 2.3069891929626465,
+    "finite": 0.012986531481146812
+  },
+  {
+    "step": 708,
+    "loss": 1.5433132648468018,
+    "diagonal": 1.5199449062347412,
+    "finite": 0.023368366062641144
+  },
+  {
+    "step": 709,
+    "loss": 2.027791976928711,
+    "diagonal": 2.0120089054107666,
+    "finite": 0.01578318513929844
+  },
+  {
+    "step": 710,
+    "loss": 1.9018141031265259,
+    "diagonal": 1.889367938041687,
+    "finite": 0.012446212582290173
+  },
+  {
+    "step": 711,
+    "loss": 1.3029367923736572,
+    "diagonal": 1.288495659828186,
+    "finite": 0.014441176317632198
+  },
+  {
+    "step": 712,
+    "loss": 1.7278169393539429,
+    "diagonal": 1.712886095046997,
+    "finite": 0.01493084616959095
+  },
+  {
+    "step": 713,
+    "loss": 1.0592257976531982,
+    "diagonal": 1.0402252674102783,
+    "finite": 0.019000552594661713
+  },
+  {
+    "step": 714,
+    "loss": 1.8084157705307007,
+    "diagonal": 1.7957673072814941,
+    "finite": 0.012648448348045349
+  },
+  {
+    "step": 715,
+    "loss": 1.2393462657928467,
+    "diagonal": 1.2265899181365967,
+    "finite": 0.01275638211518526
+  },
+  {
+    "step": 716,
+    "loss": 1.5754895210266113,
+    "diagonal": 1.561718463897705,
+    "finite": 0.013771109282970428
+  },
+  {
+    "step": 717,
+    "loss": 1.3274728059768677,
+    "diagonal": 1.3112530708312988,
+    "finite": 0.0162197258323431
+  },
+  {
+    "step": 718,
+    "loss": 1.1851704120635986,
+    "diagonal": 1.1693792343139648,
+    "finite": 0.015791159123182297
+  },
+  {
+    "step": 719,
+    "loss": 1.6293785572052002,
+    "diagonal": 1.6149917840957642,
+    "finite": 0.014386738650500774
+  },
+  {
+    "step": 720,
+    "loss": 1.6495956182479858,
+    "diagonal": 1.635532259941101,
+    "finite": 0.014063368551433086
+  },
+  {
+    "step": 721,
+    "loss": 1.39640212059021,
+    "diagonal": 1.3835499286651611,
+    "finite": 0.012852170504629612
+  },
+  {
+    "step": 722,
+    "loss": 1.4621407985687256,
+    "diagonal": 1.4494247436523438,
+    "finite": 0.012716050259768963
+  },
+  {
+    "step": 723,
+    "loss": 1.6607812643051147,
+    "diagonal": 1.6427956819534302,
+    "finite": 0.017985574901103973
+  },
+  {
+    "step": 724,
+    "loss": 1.6873201131820679,
+    "diagonal": 1.6723899841308594,
+    "finite": 0.014930100180208683
+  },
+  {
+    "step": 725,
+    "loss": 1.52420973777771,
+    "diagonal": 1.5048513412475586,
+    "finite": 0.01935839094221592
+  },
+  {
+    "step": 726,
+    "loss": 2.101121664047241,
+    "diagonal": 2.0851449966430664,
+    "finite": 0.015976671129465103
+  },
+  {
+    "step": 727,
+    "loss": 1.407179355621338,
+    "diagonal": 1.3927289247512817,
+    "finite": 0.0144504364579916
+  },
+  {
+    "step": 728,
+    "loss": 1.6421469449996948,
+    "diagonal": 1.6314412355422974,
+    "finite": 0.010705705732107162
+  },
+  {
+    "step": 729,
+    "loss": 1.613356351852417,
+    "diagonal": 1.600077509880066,
+    "finite": 0.01327888760715723
+  },
+  {
+    "step": 730,
+    "loss": 1.192371129989624,
+    "diagonal": 1.1814216375350952,
+    "finite": 0.010949540883302689
+  },
+  {
+    "step": 731,
+    "loss": 1.84800124168396,
+    "diagonal": 1.8375661373138428,
+    "finite": 0.010435124859213829
+  },
+  {
+    "step": 732,
+    "loss": 1.6094058752059937,
+    "diagonal": 1.599265217781067,
+    "finite": 0.010140600614249706
+  },
+  {
+    "step": 733,
+    "loss": 1.4703283309936523,
+    "diagonal": 1.4588655233383179,
+    "finite": 0.011462762951850891
+  },
+  {
+    "step": 734,
+    "loss": 1.7413952350616455,
+    "diagonal": 1.729280710220337,
+    "finite": 0.01211454439908266
+  },
+  {
+    "step": 735,
+    "loss": 1.11704683303833,
+    "diagonal": 1.102277159690857,
+    "finite": 0.014769692905247211
+  },
+  {
+    "step": 736,
+    "loss": 1.9226629734039307,
+    "diagonal": 1.9114476442337036,
+    "finite": 0.011215386912226677
+  },
+  {
+    "step": 737,
+    "loss": 1.5856242179870605,
+    "diagonal": 1.571744680404663,
+    "finite": 0.013879546895623207
+  },
+  {
+    "step": 738,
+    "loss": 1.4714019298553467,
+    "diagonal": 1.462220311164856,
+    "finite": 0.009181592613458633
+  },
+  {
+    "step": 739,
+    "loss": 1.4533870220184326,
+    "diagonal": 1.445276141166687,
+    "finite": 0.00811091810464859
+  },
+  {
+    "step": 740,
+    "loss": 2.101149559020996,
+    "diagonal": 2.0833568572998047,
+    "finite": 0.017792679369449615
+  },
+  {
+    "step": 741,
+    "loss": 1.795962929725647,
+    "diagonal": 1.7853822708129883,
+    "finite": 0.0105806989595294
+  },
+  {
+    "step": 742,
+    "loss": 1.3979542255401611,
+    "diagonal": 1.3860150575637817,
+    "finite": 0.01193914469331503
+  },
+  {
+    "step": 743,
+    "loss": 1.1696979999542236,
+    "diagonal": 1.1587705612182617,
+    "finite": 0.010927421040832996
+  },
+  {
+    "step": 744,
+    "loss": 1.6849493980407715,
+    "diagonal": 1.671083688735962,
+    "finite": 0.013865666463971138
+  },
+  {
+    "step": 745,
+    "loss": 1.2869186401367188,
+    "diagonal": 1.273069143295288,
+    "finite": 0.013849446550011635
+  },
+  {
+    "step": 746,
+    "loss": 1.8035569190979004,
+    "diagonal": 1.787798285484314,
+    "finite": 0.015758583322167397
+  },
+  {
+    "step": 747,
+    "loss": 1.1503093242645264,
+    "diagonal": 1.1331400871276855,
+    "finite": 0.017169255763292313
+  },
+  {
+    "step": 748,
+    "loss": 1.303629755973816,
+    "diagonal": 1.2878358364105225,
+    "finite": 0.015793906524777412
+  },
+  {
+    "step": 749,
+    "loss": 2.0099880695343018,
+    "diagonal": 1.9969371557235718,
+    "finite": 0.013050963170826435
+  },
+  {
+    "step": 750,
+    "loss": 1.5998836755752563,
+    "diagonal": 1.5794875621795654,
+    "finite": 0.020396076142787933
+  },
+  {
+    "step": 751,
+    "loss": 1.6754190921783447,
+    "diagonal": 1.659501075744629,
+    "finite": 0.015918053686618805
+  },
+  {
+    "step": 752,
+    "loss": 1.618118166923523,
+    "diagonal": 1.601737380027771,
+    "finite": 0.016380831599235535
+  },
+  {
+    "step": 753,
+    "loss": 1.7583420276641846,
+    "diagonal": 1.744377851486206,
+    "finite": 0.013964144513010979
+  },
+  {
+    "step": 754,
+    "loss": 1.2504816055297852,
+    "diagonal": 1.2346577644348145,
+    "finite": 0.01582382060587406
+  },
+  {
+    "step": 755,
+    "loss": 1.9653606414794922,
+    "diagonal": 1.9513208866119385,
+    "finite": 0.014039777219295502
+  },
+  {
+    "step": 756,
+    "loss": 1.575486660003662,
+    "diagonal": 1.5608806610107422,
+    "finite": 0.014606035314500332
+  },
+  {
+    "step": 757,
+    "loss": 1.4444001913070679,
+    "diagonal": 1.4291706085205078,
+    "finite": 0.015229560434818268
+  },
+  {
+    "step": 758,
+    "loss": 1.3674253225326538,
+    "diagonal": 1.3526347875595093,
+    "finite": 0.014790592715144157
+  },
+  {
+    "step": 759,
+    "loss": 1.9799537658691406,
+    "diagonal": 1.9690685272216797,
+    "finite": 0.01088524330407381
+  },
+  {
+    "step": 760,
+    "loss": 1.7442283630371094,
+    "diagonal": 1.7226001024246216,
+    "finite": 0.021628260612487793
+  },
+  {
+    "step": 761,
+    "loss": 1.2647244930267334,
+    "diagonal": 1.248655080795288,
+    "finite": 0.01606946811079979
+  },
+  {
+    "step": 762,
+    "loss": 2.0660276412963867,
+    "diagonal": 2.05377197265625,
+    "finite": 0.012255570851266384
+  },
+  {
+    "step": 763,
+    "loss": 1.1232855319976807,
+    "diagonal": 1.103484869003296,
+    "finite": 0.01980065181851387
+  },
+  {
+    "step": 764,
+    "loss": 1.5194761753082275,
+    "diagonal": 1.496451497077942,
+    "finite": 0.023024730384349823
+  },
+  {
+    "step": 765,
+    "loss": 1.2568520307540894,
+    "diagonal": 1.2386428117752075,
+    "finite": 0.01820923574268818
+  },
+  {
+    "step": 766,
+    "loss": 1.6700794696807861,
+    "diagonal": 1.6459325551986694,
+    "finite": 0.02414689213037491
+  },
+  {
+    "step": 767,
+    "loss": 1.3938250541687012,
+    "diagonal": 1.3762867450714111,
+    "finite": 0.017538297921419144
+  },
+  {
+    "step": 768,
+    "loss": 1.7381508350372314,
+    "diagonal": 1.720585584640503,
+    "finite": 0.0175652913749218
+  },
+  {
+    "step": 769,
+    "loss": 1.620068907737732,
+    "diagonal": 1.6041892766952515,
+    "finite": 0.01587958075106144
+  },
+  {
+    "step": 770,
+    "loss": 1.9147838354110718,
+    "diagonal": 1.900078296661377,
+    "finite": 0.014705541543662548
+  },
+  {
+    "step": 771,
+    "loss": 1.676988124847412,
+    "diagonal": 1.6589462757110596,
+    "finite": 0.01804179511964321
+  },
+  {
+    "step": 772,
+    "loss": 2.0148327350616455,
+    "diagonal": 2.0017662048339844,
+    "finite": 0.013066429644823074
+  },
+  {
+    "step": 773,
+    "loss": 1.8528624773025513,
+    "diagonal": 1.8424324989318848,
+    "finite": 0.01042996160686016
+  },
+  {
+    "step": 774,
+    "loss": 1.768033504486084,
+    "diagonal": 1.7502678632736206,
+    "finite": 0.017765620723366737
+  },
+  {
+    "step": 775,
+    "loss": 1.3007196187973022,
+    "diagonal": 1.283479928970337,
+    "finite": 0.017239674925804138
+  },
+  {
+    "step": 776,
+    "loss": 2.0066919326782227,
+    "diagonal": 1.991307258605957,
+    "finite": 0.015384720638394356
+  },
+  {
+    "step": 777,
+    "loss": 1.430749773979187,
+    "diagonal": 1.4143768548965454,
+    "finite": 0.01637296751141548
+  },
+  {
+    "step": 778,
+    "loss": 1.467279076576233,
+    "diagonal": 1.4463903903961182,
+    "finite": 0.020888736471533775
+  },
+  {
+    "step": 779,
+    "loss": 1.423026442527771,
+    "diagonal": 1.4064197540283203,
+    "finite": 0.016606681048870087
+  },
+  {
+    "step": 780,
+    "loss": 1.707370638847351,
+    "diagonal": 1.6957943439483643,
+    "finite": 0.011576253920793533
+  },
+  {
+    "step": 781,
+    "loss": 1.248893141746521,
+    "diagonal": 1.2336187362670898,
+    "finite": 0.015274398028850555
+  },
+  {
+    "step": 782,
+    "loss": 1.3400517702102661,
+    "diagonal": 1.3293267488479614,
+    "finite": 0.010725011117756367
+  },
+  {
+    "step": 783,
+    "loss": 1.5009626150131226,
+    "diagonal": 1.4903162717819214,
+    "finite": 0.010646352544426918
+  },
+  {
+    "step": 784,
+    "loss": 1.9077068567276,
+    "diagonal": 1.8943328857421875,
+    "finite": 0.013373954221606255
+  },
+  {
+    "step": 785,
+    "loss": 1.758048176765442,
+    "diagonal": 1.7450463771820068,
+    "finite": 0.013001758605241776
+  },
+  {
+    "step": 786,
+    "loss": 1.6095997095108032,
+    "diagonal": 1.596335530281067,
+    "finite": 0.013264141976833344
+  },
+  {
+    "step": 787,
+    "loss": 1.6223963499069214,
+    "diagonal": 1.6053483486175537,
+    "finite": 0.01704796962440014
+  },
+  {
+    "step": 788,
+    "loss": 1.5655547380447388,
+    "diagonal": 1.553473949432373,
+    "finite": 0.012080846354365349
+  },
+  {
+    "step": 789,
+    "loss": 1.1945712566375732,
+    "diagonal": 1.1846504211425781,
+    "finite": 0.009920790791511536
+  },
+  {
+    "step": 790,
+    "loss": 1.32438063621521,
+    "diagonal": 1.3080203533172607,
+    "finite": 0.016360340639948845
+  },
+  {
+    "step": 791,
+    "loss": 1.7375166416168213,
+    "diagonal": 1.7238507270812988,
+    "finite": 0.013665872626006603
+  },
+  {
+    "step": 792,
+    "loss": 1.7719314098358154,
+    "diagonal": 1.7579362392425537,
+    "finite": 0.013995145447552204
+  },
+  {
+    "step": 793,
+    "loss": 1.2667818069458008,
+    "diagonal": 1.2569434642791748,
+    "finite": 0.009838302619755268
+  },
+  {
+    "step": 794,
+    "loss": 1.3805820941925049,
+    "diagonal": 1.3621677160263062,
+    "finite": 0.018414337188005447
+  },
+  {
+    "step": 795,
+    "loss": 1.4286140203475952,
+    "diagonal": 1.4156733751296997,
+    "finite": 0.012940691784024239
+  },
+  {
+    "step": 796,
+    "loss": 1.6503031253814697,
+    "diagonal": 1.6375623941421509,
+    "finite": 0.012740758247673512
+  },
+  {
+    "step": 797,
+    "loss": 1.3978474140167236,
+    "diagonal": 1.3818938732147217,
+    "finite": 0.01595354825258255
+  },
+  {
+    "step": 798,
+    "loss": 1.6686968803405762,
+    "diagonal": 1.6506547927856445,
+    "finite": 0.018042054027318954
+  },
+  {
+    "step": 799,
+    "loss": 1.6815296411514282,
+    "diagonal": 1.6687219142913818,
+    "finite": 0.012807670049369335
+  },
+  {
+    "step": 800,
+    "loss": 1.2474822998046875,
+    "diagonal": 1.2351242303848267,
+    "finite": 0.012358095496892929
+  },
+  {
+    "step": 801,
+    "loss": 1.5107110738754272,
+    "diagonal": 1.4965964555740356,
+    "finite": 0.014114602468907833
+  },
+  {
+    "step": 802,
+    "loss": 0.9250317215919495,
+    "diagonal": 0.914050817489624,
+    "finite": 0.010980903171002865
+  },
+  {
+    "step": 803,
+    "loss": 1.4421348571777344,
+    "diagonal": 1.4329826831817627,
+    "finite": 0.009152191691100597
+  },
+  {
+    "step": 804,
+    "loss": 1.5352481603622437,
+    "diagonal": 1.5224231481552124,
+    "finite": 0.012825055047869682
+  },
+  {
+    "step": 805,
+    "loss": 1.0040850639343262,
+    "diagonal": 0.9954710602760315,
+    "finite": 0.008613972924649715
+  },
+  {
+    "step": 806,
+    "loss": 1.5846836566925049,
+    "diagonal": 1.5729365348815918,
+    "finite": 0.01174713484942913
+  },
+  {
+    "step": 807,
+    "loss": 1.5977863073349,
+    "diagonal": 1.58769953250885,
+    "finite": 0.010086766444146633
+  },
+  {
+    "step": 808,
+    "loss": 1.7499665021896362,
+    "diagonal": 1.7373573780059814,
+    "finite": 0.012609165161848068
+  },
+  {
+    "step": 809,
+    "loss": 1.4267804622650146,
+    "diagonal": 1.4155218601226807,
+    "finite": 0.011258658021688461
+  },
+  {
+    "step": 810,
+    "loss": 1.5596970319747925,
+    "diagonal": 1.5501883029937744,
+    "finite": 0.009508782997727394
+  },
+  {
+    "step": 811,
+    "loss": 1.4269869327545166,
+    "diagonal": 1.417487621307373,
+    "finite": 0.009499270468950272
+  },
+  {
+    "step": 812,
+    "loss": 1.2266998291015625,
+    "diagonal": 1.2138346433639526,
+    "finite": 0.012865218333899975
+  },
+  {
+    "step": 813,
+    "loss": 1.8471914529800415,
+    "diagonal": 1.8293927907943726,
+    "finite": 0.017798610031604767
+  },
+  {
+    "step": 814,
+    "loss": 0.8707544207572937,
+    "diagonal": 0.8514622449874878,
+    "finite": 0.01929219625890255
+  },
+  {
+    "step": 815,
+    "loss": 1.8034625053405762,
+    "diagonal": 1.7906720638275146,
+    "finite": 0.012790434062480927
+  },
+  {
+    "step": 816,
+    "loss": 1.2343097925186157,
+    "diagonal": 1.220245599746704,
+    "finite": 0.014064141549170017
+  },
+  {
+    "step": 817,
+    "loss": 1.627583622932434,
+    "diagonal": 1.6123204231262207,
+    "finite": 0.015263250097632408
+  },
+  {
+    "step": 818,
+    "loss": 1.5071872472763062,
+    "diagonal": 1.4947562217712402,
+    "finite": 0.012431036680936813
+  },
+  {
+    "step": 819,
+    "loss": 1.717527985572815,
+    "diagonal": 1.7063349485397339,
+    "finite": 0.011193027719855309
+  },
+  {
+    "step": 820,
+    "loss": 1.9305155277252197,
+    "diagonal": 1.9194116592407227,
+    "finite": 0.011103913187980652
+  },
+  {
+    "step": 821,
+    "loss": 1.5805662870407104,
+    "diagonal": 1.5675705671310425,
+    "finite": 0.01299575436860323
+  },
+  {
+    "step": 822,
+    "loss": 1.3354120254516602,
+    "diagonal": 1.3223143815994263,
+    "finite": 0.013097595423460007
+  },
+  {
+    "step": 823,
+    "loss": 1.7717000246047974,
+    "diagonal": 1.7591090202331543,
+    "finite": 0.012591022066771984
+  },
+  {
+    "step": 824,
+    "loss": 1.5985714197158813,
+    "diagonal": 1.5847240686416626,
+    "finite": 0.013847317546606064
+  },
+  {
+    "step": 825,
+    "loss": 1.670927882194519,
+    "diagonal": 1.6560345888137817,
+    "finite": 0.014893345534801483
+  },
+  {
+    "step": 826,
+    "loss": 1.3505722284317017,
+    "diagonal": 1.334681749343872,
+    "finite": 0.01589050516486168
+  },
+  {
+    "step": 827,
+    "loss": 1.677085041999817,
+    "diagonal": 1.6598317623138428,
+    "finite": 0.017253262922167778
+  },
+  {
+    "step": 828,
+    "loss": 1.586592674255371,
+    "diagonal": 1.5743967294692993,
+    "finite": 0.012195955961942673
+  },
+  {
+    "step": 829,
+    "loss": 1.1638957262039185,
+    "diagonal": 1.1408171653747559,
+    "finite": 0.023078564554452896
+  },
+  {
+    "step": 830,
+    "loss": 1.7071537971496582,
+    "diagonal": 1.6942520141601562,
+    "finite": 0.012901832349598408
+  },
+  {
+    "step": 831,
+    "loss": 1.5392887592315674,
+    "diagonal": 1.5299900770187378,
+    "finite": 0.009298639371991158
+  },
+  {
+    "step": 832,
+    "loss": 1.3970391750335693,
+    "diagonal": 1.3808761835098267,
+    "finite": 0.016163015738129616
+  },
+  {
+    "step": 833,
+    "loss": 1.8548638820648193,
+    "diagonal": 1.8425228595733643,
+    "finite": 0.01234107743948698
+  },
+  {
+    "step": 834,
+    "loss": 1.6756683588027954,
+    "diagonal": 1.664003849029541,
+    "finite": 0.011664561927318573
+  },
+  {
+    "step": 835,
+    "loss": 1.7553958892822266,
+    "diagonal": 1.7385716438293457,
+    "finite": 0.016824249178171158
+  },
+  {
+    "step": 836,
+    "loss": 1.5941946506500244,
+    "diagonal": 1.583083152770996,
+    "finite": 0.011111557483673096
+  },
+  {
+    "step": 837,
+    "loss": 1.6475692987442017,
+    "diagonal": 1.6354124546051025,
+    "finite": 0.01215679943561554
+  },
+  {
+    "step": 838,
+    "loss": 1.6611894369125366,
+    "diagonal": 1.6480854749679565,
+    "finite": 0.013103949837386608
+  },
+  {
+    "step": 839,
+    "loss": 1.667007327079773,
+    "diagonal": 1.6576796770095825,
+    "finite": 0.009327614679932594
+  },
+  {
+    "step": 840,
+    "loss": 1.8493672609329224,
+    "diagonal": 1.83603835105896,
+    "finite": 0.013328946195542812
+  },
+  {
+    "step": 841,
+    "loss": 1.459134817123413,
+    "diagonal": 1.4466943740844727,
+    "finite": 0.012440487742424011
+  },
+  {
+    "step": 842,
+    "loss": 0.994112491607666,
+    "diagonal": 0.982944905757904,
+    "finite": 0.011167574673891068
+  },
+  {
+    "step": 843,
+    "loss": 1.3994964361190796,
+    "diagonal": 1.3865185976028442,
+    "finite": 0.012977802194654942
+  },
+  {
+    "step": 844,
+    "loss": 1.5205934047698975,
+    "diagonal": 1.5119504928588867,
+    "finite": 0.008642910048365593
+  },
+  {
+    "step": 845,
+    "loss": 1.9570127725601196,
+    "diagonal": 1.9486641883850098,
+    "finite": 0.008348576724529266
+  },
+  {
+    "step": 846,
+    "loss": 1.6443753242492676,
+    "diagonal": 1.6343759298324585,
+    "finite": 0.009999364614486694
+  },
+  {
+    "step": 847,
+    "loss": 1.8099509477615356,
+    "diagonal": 1.7978549003601074,
+    "finite": 0.012096082791686058
+  },
+  {
+    "step": 848,
+    "loss": 1.6176520586013794,
+    "diagonal": 1.6084928512573242,
+    "finite": 0.009159154258668423
+  },
+  {
+    "step": 849,
+    "loss": 1.7995260953903198,
+    "diagonal": 1.7855000495910645,
+    "finite": 0.014026056043803692
+  },
+  {
+    "step": 850,
+    "loss": 1.8676939010620117,
+    "diagonal": 1.8547251224517822,
+    "finite": 0.012968813069164753
+  },
+  {
+    "step": 851,
+    "loss": 1.6362587213516235,
+    "diagonal": 1.6224921941757202,
+    "finite": 0.013766529969871044
+  },
+  {
+    "step": 852,
+    "loss": 1.1153050661087036,
+    "diagonal": 1.0984877347946167,
+    "finite": 0.016817323863506317
+  },
+  {
+    "step": 853,
+    "loss": 1.3628562688827515,
+    "diagonal": 1.3473891019821167,
+    "finite": 0.015467124059796333
+  },
+  {
+    "step": 854,
+    "loss": 2.2294516563415527,
+    "diagonal": 2.2182822227478027,
+    "finite": 0.011169485747814178
+  },
+  {
+    "step": 855,
+    "loss": 1.563577651977539,
+    "diagonal": 1.5488002300262451,
+    "finite": 0.014777394942939281
+  },
+  {
+    "step": 856,
+    "loss": 2.044987916946411,
+    "diagonal": 2.033848285675049,
+    "finite": 0.011139614507555962
+  },
+  {
+    "step": 857,
+    "loss": 1.5525013208389282,
+    "diagonal": 1.542656421661377,
+    "finite": 0.009844868443906307
+  },
+  {
+    "step": 858,
+    "loss": 1.7510854005813599,
+    "diagonal": 1.7431731224060059,
+    "finite": 0.007912304252386093
+  },
+  {
+    "step": 859,
+    "loss": 1.31319260597229,
+    "diagonal": 1.3036816120147705,
+    "finite": 0.009510965086519718
+  },
+  {
+    "step": 860,
+    "loss": 1.3128849267959595,
+    "diagonal": 1.303422212600708,
+    "finite": 0.009462720714509487
+  },
+  {
+    "step": 861,
+    "loss": 1.8752326965332031,
+    "diagonal": 1.865114450454712,
+    "finite": 0.01011823583394289
+  },
+  {
+    "step": 862,
+    "loss": 1.8300849199295044,
+    "diagonal": 1.819943904876709,
+    "finite": 0.010141054168343544
+  },
+  {
+    "step": 863,
+    "loss": 1.371350884437561,
+    "diagonal": 1.3627099990844727,
+    "finite": 0.008640923537313938
+  },
+  {
+    "step": 864,
+    "loss": 1.1401159763336182,
+    "diagonal": 1.1287133693695068,
+    "finite": 0.011402659118175507
+  },
+  {
+    "step": 865,
+    "loss": 1.0788023471832275,
+    "diagonal": 1.0680086612701416,
+    "finite": 0.010793634690344334
+  },
+  {
+    "step": 866,
+    "loss": 1.1154268980026245,
+    "diagonal": 1.104163408279419,
+    "finite": 0.01126345805823803
+  },
+  {
+    "step": 867,
+    "loss": 1.386883020401001,
+    "diagonal": 1.369697093963623,
+    "finite": 0.01718597114086151
+  },
+  {
+    "step": 868,
+    "loss": 1.4687539339065552,
+    "diagonal": 1.4565815925598145,
+    "finite": 0.012172340415418148
+  },
+  {
+    "step": 869,
+    "loss": 1.242180585861206,
+    "diagonal": 1.2287969589233398,
+    "finite": 0.013383639976382256
+  },
+  {
+    "step": 870,
+    "loss": 1.6648449897766113,
+    "diagonal": 1.6486377716064453,
+    "finite": 0.016207220032811165
+  },
+  {
+    "step": 871,
+    "loss": 1.4803264141082764,
+    "diagonal": 1.4656250476837158,
+    "finite": 0.01470132078975439
+  },
+  {
+    "step": 872,
+    "loss": 1.6849687099456787,
+    "diagonal": 1.6728014945983887,
+    "finite": 0.012167169712483883
+  },
+  {
+    "step": 873,
+    "loss": 1.3806432485580444,
+    "diagonal": 1.3661620616912842,
+    "finite": 0.01448121853172779
+  },
+  {
+    "step": 874,
+    "loss": 1.6295392513275146,
+    "diagonal": 1.6187176704406738,
+    "finite": 0.010821613483130932
+  },
+  {
+    "step": 875,
+    "loss": 1.4475562572479248,
+    "diagonal": 1.4341166019439697,
+    "finite": 0.013439683243632317
+  },
+  {
+    "step": 876,
+    "loss": 2.0101101398468018,
+    "diagonal": 1.9924184083938599,
+    "finite": 0.017691796645522118
+  },
+  {
+    "step": 877,
+    "loss": 1.3708094358444214,
+    "diagonal": 1.353783130645752,
+    "finite": 0.017026351764798164
+  },
+  {
+    "step": 878,
+    "loss": 1.7881927490234375,
+    "diagonal": 1.7757340669631958,
+    "finite": 0.012458651326596737
+  },
+  {
+    "step": 879,
+    "loss": 1.92266047000885,
+    "diagonal": 1.911484718322754,
+    "finite": 0.011175695806741714
+  },
+  {
+    "step": 880,
+    "loss": 1.650806188583374,
+    "diagonal": 1.639676809310913,
+    "finite": 0.011129389517009258
+  },
+  {
+    "step": 881,
+    "loss": 1.8107872009277344,
+    "diagonal": 1.796736717224121,
+    "finite": 0.014050469733774662
+  },
+  {
+    "step": 882,
+    "loss": 1.359190583229065,
+    "diagonal": 1.347874641418457,
+    "finite": 0.011315980926156044
+  },
+  {
+    "step": 883,
+    "loss": 1.0275979042053223,
+    "diagonal": 1.016765832901001,
+    "finite": 0.01083209365606308
+  },
+  {
+    "step": 884,
+    "loss": 1.8502579927444458,
+    "diagonal": 1.8419508934020996,
+    "finite": 0.008307131007313728
+  },
+  {
+    "step": 885,
+    "loss": 1.370584487915039,
+    "diagonal": 1.3573588132858276,
+    "finite": 0.013225732371211052
+  },
+  {
+    "step": 886,
+    "loss": 1.31410813331604,
+    "diagonal": 1.305834174156189,
+    "finite": 0.008273925632238388
+  },
+  {
+    "step": 887,
+    "loss": 1.784704566001892,
+    "diagonal": 1.7745987176895142,
+    "finite": 0.010105814784765244
+  },
+  {
+    "step": 888,
+    "loss": 1.5660845041275024,
+    "diagonal": 1.5550360679626465,
+    "finite": 0.011048460379242897
+  },
+  {
+    "step": 889,
+    "loss": 1.2778571844100952,
+    "diagonal": 1.2667028903961182,
+    "finite": 0.011154266074299812
+  },
+  {
+    "step": 890,
+    "loss": 1.770222544670105,
+    "diagonal": 1.7572742700576782,
+    "finite": 0.012948325835168362
+  },
+  {
+    "step": 891,
+    "loss": 1.4415767192840576,
+    "diagonal": 1.428967833518982,
+    "finite": 0.012608885765075684
+  },
+  {
+    "step": 892,
+    "loss": 1.3563414812088013,
+    "diagonal": 1.346960425376892,
+    "finite": 0.009381096810102463
+  },
+  {
+    "step": 893,
+    "loss": 1.4656260013580322,
+    "diagonal": 1.4546711444854736,
+    "finite": 0.010954913683235645
+  },
+  {
+    "step": 894,
+    "loss": 1.9071272611618042,
+    "diagonal": 1.8956401348114014,
+    "finite": 0.011487184092402458
+  },
+  {
+    "step": 895,
+    "loss": 1.6666479110717773,
+    "diagonal": 1.657382845878601,
+    "finite": 0.009265044704079628
+  },
+  {
+    "step": 896,
+    "loss": 1.7817450761795044,
+    "diagonal": 1.7722406387329102,
+    "finite": 0.009504461660981178
+  },
+  {
+    "step": 897,
+    "loss": 1.954017162322998,
+    "diagonal": 1.9471207857131958,
+    "finite": 0.006896421313285828
+  },
+  {
+    "step": 898,
+    "loss": 1.4325400590896606,
+    "diagonal": 1.4193588495254517,
+    "finite": 0.013181181624531746
+  },
+  {
+    "step": 899,
+    "loss": 1.2174018621444702,
+    "diagonal": 1.2086594104766846,
+    "finite": 0.008742461912333965
+  },
+  {
+    "step": 900,
+    "loss": 1.6341248750686646,
+    "diagonal": 1.6273897886276245,
+    "finite": 0.006735141389071941
+  },
+  {
+    "step": 901,
+    "loss": 1.8363664150238037,
+    "diagonal": 1.826934576034546,
+    "finite": 0.009431829676032066
+  },
+  {
+    "step": 902,
+    "loss": 1.6034456491470337,
+    "diagonal": 1.5950753688812256,
+    "finite": 0.008370274677872658
+  },
+  {
+    "step": 903,
+    "loss": 1.420591950416565,
+    "diagonal": 1.4101535081863403,
+    "finite": 0.010438383556902409
+  },
+  {
+    "step": 904,
+    "loss": 1.4673010110855103,
+    "diagonal": 1.4578052759170532,
+    "finite": 0.009495748206973076
+  },
+  {
+    "step": 905,
+    "loss": 1.7073968648910522,
+    "diagonal": 1.696094036102295,
+    "finite": 0.011302785947918892
+  },
+  {
+    "step": 906,
+    "loss": 1.3401800394058228,
+    "diagonal": 1.3281205892562866,
+    "finite": 0.012059479020535946
+  },
+  {
+    "step": 907,
+    "loss": 1.6829553842544556,
+    "diagonal": 1.6650230884552002,
+    "finite": 0.017932264134287834
+  },
+  {
+    "step": 908,
+    "loss": 1.4747039079666138,
+    "diagonal": 1.463990569114685,
+    "finite": 0.010713357478380203
+  },
+  {
+    "step": 909,
+    "loss": 1.4389891624450684,
+    "diagonal": 1.4254816770553589,
+    "finite": 0.013507437892258167
+  },
+  {
+    "step": 910,
+    "loss": 1.903977870941162,
+    "diagonal": 1.8935275077819824,
+    "finite": 0.010450323112308979
+  },
+  {
+    "step": 911,
+    "loss": 1.7042337656021118,
+    "diagonal": 1.6968536376953125,
+    "finite": 0.007380164694041014
+  },
+  {
+    "step": 912,
+    "loss": 1.281489372253418,
+    "diagonal": 1.2693887948989868,
+    "finite": 0.012100526131689548
+  },
+  {
+    "step": 913,
+    "loss": 1.6409461498260498,
+    "diagonal": 1.6278082132339478,
+    "finite": 0.013137927278876305
+  },
+  {
+    "step": 914,
+    "loss": 1.4797921180725098,
+    "diagonal": 1.4597790241241455,
+    "finite": 0.02001308463513851
+  },
+  {
+    "step": 915,
+    "loss": 0.99857097864151,
+    "diagonal": 0.9851177930831909,
+    "finite": 0.013453156687319279
+  },
+  {
+    "step": 916,
+    "loss": 1.8373476266860962,
+    "diagonal": 1.824108362197876,
+    "finite": 0.013239222578704357
+  },
+  {
+    "step": 917,
+    "loss": 1.126580834388733,
+    "diagonal": 1.114195466041565,
+    "finite": 0.012385356239974499
+  },
+  {
+    "step": 918,
+    "loss": 1.3640612363815308,
+    "diagonal": 1.3544632196426392,
+    "finite": 0.00959802232682705
+  },
+  {
+    "step": 919,
+    "loss": 1.7337570190429688,
+    "diagonal": 1.7212133407592773,
+    "finite": 0.01254361867904663
+  },
+  {
+    "step": 920,
+    "loss": 1.5778062343597412,
+    "diagonal": 1.5668195486068726,
+    "finite": 0.010986654087901115
+  },
+  {
+    "step": 921,
+    "loss": 1.7553633451461792,
+    "diagonal": 1.7471314668655396,
+    "finite": 0.008231839165091515
+  },
+  {
+    "step": 922,
+    "loss": 1.6292611360549927,
+    "diagonal": 1.6174813508987427,
+    "finite": 0.011779842898249626
+  },
+  {
+    "step": 923,
+    "loss": 1.5502941608428955,
+    "diagonal": 1.5402096509933472,
+    "finite": 0.010084496811032295
+  },
+  {
+    "step": 924,
+    "loss": 0.9145259261131287,
+    "diagonal": 0.9048751592636108,
+    "finite": 0.009650755673646927
+  },
+  {
+    "step": 925,
+    "loss": 1.5460141897201538,
+    "diagonal": 1.532922387123108,
+    "finite": 0.013091820292174816
+  },
+  {
+    "step": 926,
+    "loss": 1.8015470504760742,
+    "diagonal": 1.7933037281036377,
+    "finite": 0.008243272081017494
+  },
+  {
+    "step": 927,
+    "loss": 1.9664747714996338,
+    "diagonal": 1.9569542407989502,
+    "finite": 0.009520581923425198
+  },
+  {
+    "step": 928,
+    "loss": 1.5304808616638184,
+    "diagonal": 1.5180466175079346,
+    "finite": 0.012434237636625767
+  },
+  {
+    "step": 929,
+    "loss": 1.5785939693450928,
+    "diagonal": 1.567367434501648,
+    "finite": 0.011226563714444637
+  },
+  {
+    "step": 930,
+    "loss": 1.4348342418670654,
+    "diagonal": 1.4250344038009644,
+    "finite": 0.009799801744520664
+  },
+  {
+    "step": 931,
+    "loss": 1.578034520149231,
+    "diagonal": 1.5666980743408203,
+    "finite": 0.01133644673973322
+  },
+  {
+    "step": 932,
+    "loss": 1.1064881086349487,
+    "diagonal": 1.0961295366287231,
+    "finite": 0.010358534753322601
+  },
+  {
+    "step": 933,
+    "loss": 1.605224370956421,
+    "diagonal": 1.5957821607589722,
+    "finite": 0.009442185051739216
+  },
+  {
+    "step": 934,
+    "loss": 1.2615859508514404,
+    "diagonal": 1.2511695623397827,
+    "finite": 0.010416403412818909
+  },
+  {
+    "step": 935,
+    "loss": 1.616051197052002,
+    "diagonal": 1.6055883169174194,
+    "finite": 0.010462882928550243
+  },
+  {
+    "step": 936,
+    "loss": 1.4501497745513916,
+    "diagonal": 1.4388011693954468,
+    "finite": 0.011348624713718891
+  },
+  {
+    "step": 937,
+    "loss": 1.6244672536849976,
+    "diagonal": 1.6131045818328857,
+    "finite": 0.011362656950950623
+  },
+  {
+    "step": 938,
+    "loss": 1.5522689819335938,
+    "diagonal": 1.540671944618225,
+    "finite": 0.011596988886594772
+  },
+  {
+    "step": 939,
+    "loss": 1.1775238513946533,
+    "diagonal": 1.1665520668029785,
+    "finite": 0.010971770621836185
+  },
+  {
+    "step": 940,
+    "loss": 1.4454649686813354,
+    "diagonal": 1.4335877895355225,
+    "finite": 0.011877130717039108
+  },
+  {
+    "step": 941,
+    "loss": 1.4560794830322266,
+    "diagonal": 1.4457001686096191,
+    "finite": 0.010379301384091377
+  },
+  {
+    "step": 942,
+    "loss": 1.4683302640914917,
+    "diagonal": 1.4504770040512085,
+    "finite": 0.017853213474154472
+  },
+  {
+    "step": 943,
+    "loss": 1.467303991317749,
+    "diagonal": 1.4559234380722046,
+    "finite": 0.011380594223737717
+  },
+  {
+    "step": 944,
+    "loss": 1.536730170249939,
+    "diagonal": 1.5251643657684326,
+    "finite": 0.011565840803086758
+  },
+  {
+    "step": 945,
+    "loss": 1.312707781791687,
+    "diagonal": 1.3021533489227295,
+    "finite": 0.010554446838796139
+  },
+  {
+    "step": 946,
+    "loss": 1.3046602010726929,
+    "diagonal": 1.2914891242980957,
+    "finite": 0.013171033933758736
+  },
+  {
+    "step": 947,
+    "loss": 1.5819883346557617,
+    "diagonal": 1.5692999362945557,
+    "finite": 0.01268844585865736
+  },
+  {
+    "step": 948,
+    "loss": 1.680151343345642,
+    "diagonal": 1.6679872274398804,
+    "finite": 0.012164116837084293
+  },
+  {
+    "step": 949,
+    "loss": 1.7925786972045898,
+    "diagonal": 1.780956506729126,
+    "finite": 0.011622234247624874
+  },
+  {
+    "step": 950,
+    "loss": 1.5826060771942139,
+    "diagonal": 1.569654941558838,
+    "finite": 0.012951084412634373
+  },
+  {
+    "step": 951,
+    "loss": 1.7767243385314941,
+    "diagonal": 1.7647141218185425,
+    "finite": 0.012010197155177593
+  },
+  {
+    "step": 952,
+    "loss": 1.66484534740448,
+    "diagonal": 1.6547859907150269,
+    "finite": 0.01005934551358223
+  },
+  {
+    "step": 953,
+    "loss": 1.580422282218933,
+    "diagonal": 1.5625159740447998,
+    "finite": 0.017906298860907555
+  },
+  {
+    "step": 954,
+    "loss": 1.2367491722106934,
+    "diagonal": 1.22377610206604,
+    "finite": 0.012973015196621418
+  },
+  {
+    "step": 955,
+    "loss": 1.7240184545516968,
+    "diagonal": 1.7123421430587769,
+    "finite": 0.01167629286646843
+  },
+  {
+    "step": 956,
+    "loss": 1.4353309869766235,
+    "diagonal": 1.4281951189041138,
+    "finite": 0.007135861553251743
+  },
+  {
+    "step": 957,
+    "loss": 1.2848081588745117,
+    "diagonal": 1.2728646993637085,
+    "finite": 0.011943417601287365
+  },
+  {
+    "step": 958,
+    "loss": 1.5515882968902588,
+    "diagonal": 1.5410947799682617,
+    "finite": 0.01049345824867487
+  },
+  {
+    "step": 959,
+    "loss": 1.2117148637771606,
+    "diagonal": 1.2006211280822754,
+    "finite": 0.011093772947788239
+  },
+  {
+    "step": 960,
+    "loss": 1.617156982421875,
+    "diagonal": 1.608130693435669,
+    "finite": 0.00902628991752863
+  },
+  {
+    "step": 961,
+    "loss": 1.823947787284851,
+    "diagonal": 1.812185287475586,
+    "finite": 0.0117624681442976
+  },
+  {
+    "step": 962,
+    "loss": 1.4703788757324219,
+    "diagonal": 1.4580315351486206,
+    "finite": 0.012347341515123844
+  },
+  {
+    "step": 963,
+    "loss": 1.4831523895263672,
+    "diagonal": 1.4722840785980225,
+    "finite": 0.010868335142731667
+  },
+  {
+    "step": 964,
+    "loss": 1.3021128177642822,
+    "diagonal": 1.2882869243621826,
+    "finite": 0.01382586918771267
+  },
+  {
+    "step": 965,
+    "loss": 1.4034322500228882,
+    "diagonal": 1.3930693864822388,
+    "finite": 0.010362916626036167
+  },
+  {
+    "step": 966,
+    "loss": 1.8782645463943481,
+    "diagonal": 1.8657491207122803,
+    "finite": 0.012515460141003132
+  },
+  {
+    "step": 967,
+    "loss": 1.244925618171692,
+    "diagonal": 1.2274596691131592,
+    "finite": 0.01746595837175846
+  },
+  {
+    "step": 968,
+    "loss": 1.4000808000564575,
+    "diagonal": 1.388829231262207,
+    "finite": 0.011251583695411682
+  },
+  {
+    "step": 969,
+    "loss": 1.7451624870300293,
+    "diagonal": 1.7336905002593994,
+    "finite": 0.011471993289887905
+  },
+  {
+    "step": 970,
+    "loss": 1.1808640956878662,
+    "diagonal": 1.1683822870254517,
+    "finite": 0.012481828220188618
+  },
+  {
+    "step": 971,
+    "loss": 1.4364268779754639,
+    "diagonal": 1.4215564727783203,
+    "finite": 0.014870349317789078
+  },
+  {
+    "step": 972,
+    "loss": 1.2260819673538208,
+    "diagonal": 1.212153434753418,
+    "finite": 0.013928496278822422
+  },
+  {
+    "step": 973,
+    "loss": 1.6866589784622192,
+    "diagonal": 1.673459768295288,
+    "finite": 0.013199230656027794
+  },
+  {
+    "step": 974,
+    "loss": 1.2869048118591309,
+    "diagonal": 1.276890754699707,
+    "finite": 0.010014076717197895
+  },
+  {
+    "step": 975,
+    "loss": 1.3142194747924805,
+    "diagonal": 1.3024333715438843,
+    "finite": 0.011786107905209064
+  },
+  {
+    "step": 976,
+    "loss": 1.4329811334609985,
+    "diagonal": 1.4208083152770996,
+    "finite": 0.012172764167189598
+  },
+  {
+    "step": 977,
+    "loss": 1.267240047454834,
+    "diagonal": 1.252692699432373,
+    "finite": 0.01454737689346075
+  },
+  {
+    "step": 978,
+    "loss": 1.6191284656524658,
+    "diagonal": 1.6062602996826172,
+    "finite": 0.012868178077042103
+  },
+  {
+    "step": 979,
+    "loss": 1.7430675029754639,
+    "diagonal": 1.7317637205123901,
+    "finite": 0.011303759180009365
+  },
+  {
+    "step": 980,
+    "loss": 1.804638385772705,
+    "diagonal": 1.7914040088653564,
+    "finite": 0.013234386220574379
+  },
+  {
+    "step": 981,
+    "loss": 1.8807165622711182,
+    "diagonal": 1.8589928150177002,
+    "finite": 0.021723758429288864
+  },
+  {
+    "step": 982,
+    "loss": 1.2586305141448975,
+    "diagonal": 1.24540376663208,
+    "finite": 0.01322675310075283
+  },
+  {
+    "step": 983,
+    "loss": 1.5774874687194824,
+    "diagonal": 1.55953049659729,
+    "finite": 0.01795697957277298
+  },
+  {
+    "step": 984,
+    "loss": 1.434025764465332,
+    "diagonal": 1.4246189594268799,
+    "finite": 0.009406838566064835
+  },
+  {
+    "step": 985,
+    "loss": 1.395291805267334,
+    "diagonal": 1.3760406970977783,
+    "finite": 0.01925111748278141
+  },
+  {
+    "step": 986,
+    "loss": 1.3083462715148926,
+    "diagonal": 1.2960748672485352,
+    "finite": 0.012271457351744175
+  },
+  {
+    "step": 987,
+    "loss": 1.8161016702651978,
+    "diagonal": 1.8030376434326172,
+    "finite": 0.01306404173374176
+  },
+  {
+    "step": 988,
+    "loss": 1.5848900079727173,
+    "diagonal": 1.5740140676498413,
+    "finite": 0.010875887237489223
+  },
+  {
+    "step": 989,
+    "loss": 1.5864003896713257,
+    "diagonal": 1.5714555978775024,
+    "finite": 0.014944837428629398
+  },
+  {
+    "step": 990,
+    "loss": 1.5194449424743652,
+    "diagonal": 1.5082547664642334,
+    "finite": 0.011190160177648067
+  },
+  {
+    "step": 991,
+    "loss": 1.3973973989486694,
+    "diagonal": 1.3812777996063232,
+    "finite": 0.016119573265314102
+  },
+  {
+    "step": 992,
+    "loss": 1.6073291301727295,
+    "diagonal": 1.5941946506500244,
+    "finite": 0.013134434819221497
+  },
+  {
+    "step": 993,
+    "loss": 0.9474266767501831,
+    "diagonal": 0.9332826137542725,
+    "finite": 0.014144064858555794
+  },
+  {
+    "step": 994,
+    "loss": 1.5901778936386108,
+    "diagonal": 1.5735042095184326,
+    "finite": 0.016673695296049118
+  },
+  {
+    "step": 995,
+    "loss": 1.1700079441070557,
+    "diagonal": 1.1566864252090454,
+    "finite": 0.013321483507752419
+  },
+  {
+    "step": 996,
+    "loss": 1.5542638301849365,
+    "diagonal": 1.540337085723877,
+    "finite": 0.013926783576607704
+  },
+  {
+    "step": 997,
+    "loss": 1.9929472208023071,
+    "diagonal": 1.9811441898345947,
+    "finite": 0.011803047731518745
+  },
+  {
+    "step": 998,
+    "loss": 1.1867130994796753,
+    "diagonal": 1.1767488718032837,
+    "finite": 0.00996426586061716
+  },
+  {
+    "step": 999,
+    "loss": 1.4517956972122192,
+    "diagonal": 1.4401682615280151,
+    "finite": 0.011627462692558765
+  }
+]
diff --git a/lecture_6/verified_examples/meta/report.json b/lecture_6/verified_examples/meta/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..3ca8add03de69b393e51714005b9384c871965ab
--- /dev/null
+++ b/lecture_6/verified_examples/meta/report.json
@@ -0,0 +1,599 @@
+{
+  "method": "meta",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 3.0458434343338014,
+  "train_loss_last_20_mean": 1.5032016336917877,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "posterior_mean_rmse": 0.27705347537994385,
+  "posterior_variance_rmse": 0.48735880851745605,
+  "posterior_reference_mean": [
+    [
+      0.0,
+      0.0
+    ],
+    [
+      1.5137563943862915,
+      -1.3221392631530762
+    ],
+    [
+      -1.3908926248550415,
+      1.3908926248550415
+    ]
+  ],
+  "posterior_estimated_mean": [
+    [
+      -0.157099649310112,
+      -0.1464245617389679
+    ],
+    [
+      1.1796598434448242,
+      -0.7746201753616333
+    ],
+    [
+      -1.3402910232543945,
+      1.4126453399658203
+    ]
+  ],
+  "unconditional_mean_reward": -0.14134308695793152,
+  "guided_mean_reward": 0.7622178196907043,
+  "guided_distribution": {
+    "finite_samples": true,
+    "mean_distance_to_center": 0.6410579681396484,
+    "mode_fractions": [
+      0.015625,
+      0.0546875,
+      0.5078125,
+      0.421875
+    ],
+    "mode_entropy": 0.932124137878418,
+    "mean_target_log_density": -6.232669830322266
+  },
+  "posterior_steps": 4,
+  "particles": 32,
+  "importance_posterior_mean": [
+    [
+      1.3134080171585083,
+      -1.0870338678359985
+    ]
+  ],
+  "importance_effective_sample_size": [
+    87.88063049316406
+  ],
+  "posterior_value_context_gradient": [
+    [
+      0.4733681380748749,
+      0.002515168162062764
+    ]
+  ],
+  "finite_value_gradient": true,
+  "guided_samples": [
+    [
+      1.432874083518982,
+      -1.9540385007858276
+    ],
+    [
+      0.2208276093006134,
+      -0.04639088362455368
+    ],
+    [
+      1.979648470878601,
+      1.3869153261184692
+    ],
+    [
+      1.9227641820907593,
+      -1.5197793245315552
+    ],
+    [
+      2.124160051345825,
+      0.16127659380435944
+    ],
+    [
+      1.2938504219055176,
+      -1.8208990097045898
+    ],
+    [
+      0.8483301401138306,
+      1.1801302433013916
+    ],
+    [
+      2.000957489013672,
+      -1.7235546112060547
+    ],
+    [
+      1.698338508605957,
+      -1.9467189311981201
+    ],
+    [
+      1.3912973403930664,
+      -1.872453212738037
+    ],
+    [
+      1.1438207626342773,
+      -1.5401631593704224
+    ],
+    [
+      1.5465234518051147,
+      0.8512535095214844
+    ],
+    [
+      1.6385042667388916,
+      1.4052202701568604
+    ],
+    [
+      1.521420955657959,
+      0.5652914047241211
+    ],
+    [
+      1.9247902631759644,
+      1.5180368423461914
+    ],
+    [
+      1.8034380674362183,
+      1.7750799655914307
+    ],
+    [
+      -2.092954635620117,
+      -0.43861156702041626
+    ],
+    [
+      0.32258427143096924,
+      1.798687219619751
+    ],
+    [
+      1.7338910102844238,
+      1.1989892721176147
+    ],
+    [
+      0.9456591606140137,
+      -1.5983660221099854
+    ],
+    [
+      1.175989031791687,
+      -1.5632191896438599
+    ],
+    [
+      1.424456238746643,
+      1.1700040102005005
+    ],
+    [
+      0.8277812600135803,
+      1.0473628044128418
+    ],
+    [
+      1.4300353527069092,
+      1.5866093635559082
+    ],
+    [
+      1.670502781867981,
+      1.8120521306991577
+    ],
+    [
+      1.8810707330703735,
+      -1.624727487564087
+    ],
+    [
+      1.384511947631836,
+      -1.9195313453674316
+    ],
+    [
+      1.5273152589797974,
+      1.6956303119659424
+    ],
+    [
+      1.8767547607421875,
+      -1.8994884490966797
+    ],
+    [
+      1.857665777206421,
+      1.6681671142578125
+    ],
+    [
+      1.5546627044677734,
+      1.3074443340301514
+    ],
+    [
+      1.5416957139968872,
+      1.6860566139221191
+    ],
+    [
+      1.4616161584854126,
+      1.4331393241882324
+    ],
+    [
+      1.944293737411499,
+      1.2703872919082642
+    ],
+    [
+      1.879935383796692,
+      -1.026494026184082
+    ],
+    [
+      1.934020757675171,
+      -1.7339022159576416
+    ],
+    [
+      1.9083325862884521,
+      1.6035058498382568
+    ],
+    [
+      0.7840400338172913,
+      -1.852790117263794
+    ],
+    [
+      0.45498979091644287,
+      -0.15131686627864838
+    ],
+    [
+      1.9579304456710815,
+      1.2055346965789795
+    ],
+    [
+      -0.04084652662277222,
+      1.3847987651824951
+    ],
+    [
+      1.3900651931762695,
+      -1.3787974119186401
+    ],
+    [
+      -1.831339716911316,
+      1.7367851734161377
+    ],
+    [
+      1.8523409366607666,
+      -0.3262990713119507
+    ],
+    [
+      2.0067789554595947,
+      -1.3549904823303223
+    ],
+    [
+      1.414245367050171,
+      -0.6606642603874207
+    ],
+    [
+      1.6482794284820557,
+      -1.763962984085083
+    ],
+    [
+      1.965883493423462,
+      -0.9733855724334717
+    ],
+    [
+      1.2045841217041016,
+      -1.9775246381759644
+    ],
+    [
+      1.6554720401763916,
+      1.3468334674835205
+    ],
+    [
+      2.06345272064209,
+      -1.598726511001587
+    ],
+    [
+      1.5615274906158447,
+      -1.5594720840454102
+    ],
+    [
+      1.8998456001281738,
+      1.162188172340393
+    ],
+    [
+      1.4374051094055176,
+      -1.883378267288208
+    ],
+    [
+      1.640458583831787,
+      1.5289158821105957
+    ],
+    [
+      1.2299273014068604,
+      -1.8908863067626953
+    ],
+    [
+      1.6861473321914673,
+      -1.8475886583328247
+    ],
+    [
+      1.9658950567245483,
+      1.6793895959854126
+    ],
+    [
+      1.3812224864959717,
+      1.8047938346862793
+    ],
+    [
+      1.8473602533340454,
+      -1.9482097625732422
+    ],
+    [
+      1.2858154773712158,
+      -1.8881914615631104
+    ],
+    [
+      1.4477341175079346,
+      0.28412652015686035
+    ],
+    [
+      1.3478004932403564,
+      1.1183335781097412
+    ],
+    [
+      1.624673843383789,
+      -1.4096980094909668
+    ],
+    [
+      0.487331360578537,
+      0.4385218322277069
+    ],
+    [
+      0.8607577085494995,
+      1.8577219247817993
+    ],
+    [
+      1.5059430599212646,
+      -1.8200547695159912
+    ],
+    [
+      1.711211919784546,
+      -1.0476093292236328
+    ],
+    [
+      1.7383251190185547,
+      -1.5973925590515137
+    ],
+    [
+      1.9382457733154297,
+      -0.97356116771698
+    ],
+    [
+      1.75698983669281,
+      -2.0078370571136475
+    ],
+    [
+      1.6290740966796875,
+      -1.7874962091445923
+    ],
+    [
+      1.796375036239624,
+      0.5234100818634033
+    ],
+    [
+      1.5999326705932617,
+      1.2443598508834839
+    ],
+    [
+      1.850302815437317,
+      1.4281625747680664
+    ],
+    [
+      1.983588695526123,
+      0.45138734579086304
+    ],
+    [
+      1.293163776397705,
+      -1.8952271938323975
+    ],
+    [
+      1.8628308773040771,
+      -1.1983681917190552
+    ],
+    [
+      1.5650606155395508,
+      -1.902662992477417
+    ],
+    [
+      2.283637762069702,
+      0.09935762733221054
+    ],
+    [
+      -1.2044546604156494,
+      0.4875372052192688
+    ],
+    [
+      1.8968276977539062,
+      -0.33155375719070435
+    ],
+    [
+      1.5010015964508057,
+      -1.5839101076126099
+    ],
+    [
+      1.3440064191818237,
+      0.3072242736816406
+    ],
+    [
+      1.802398920059204,
+      -0.6630058288574219
+    ],
+    [
+      1.881528615951538,
+      -1.4837820529937744
+    ],
+    [
+      1.0239070653915405,
+      -1.9808070659637451
+    ],
+    [
+      1.5244547128677368,
+      0.8141316771507263
+    ],
+    [
+      0.32002905011177063,
+      -1.5569409132003784
+    ],
+    [
+      1.5200626850128174,
+      -0.25145983695983887
+    ],
+    [
+      0.2447371482849121,
+      -1.7817766666412354
+    ],
+    [
+      1.729570984840393,
+      -0.582362949848175
+    ],
+    [
+      1.6565954685211182,
+      1.5481932163238525
+    ],
+    [
+      1.739347219467163,
+      1.1911739110946655
+    ],
+    [
+      -0.39820170402526855,
+      0.30793625116348267
+    ],
+    [
+      1.1334669589996338,
+      1.2492892742156982
+    ],
+    [
+      -0.3003109097480774,
+      1.3871939182281494
+    ],
+    [
+      -1.3934688568115234,
+      1.4562675952911377
+    ],
+    [
+      1.1395008563995361,
+      -1.0350968837738037
+    ],
+    [
+      1.8361214399337769,
+      -1.884864330291748
+    ],
+    [
+      2.1193716526031494,
+      1.4756169319152832
+    ],
+    [
+      2.1061878204345703,
+      0.9368805289268494
+    ],
+    [
+      1.1800754070281982,
+      -0.1682790219783783
+    ],
+    [
+      1.8791199922561646,
+      0.7410354018211365
+    ],
+    [
+      1.4908061027526855,
+      -1.3782926797866821
+    ],
+    [
+      -0.927864670753479,
+      -1.0457499027252197
+    ],
+    [
+      1.3490841388702393,
+      -2.0117571353912354
+    ],
+    [
+      1.6318436861038208,
+      0.3625527620315552
+    ],
+    [
+      2.206484317779541,
+      1.363595962524414
+    ],
+    [
+      0.7087500095367432,
+      -1.834436058998108
+    ],
+    [
+      1.2797033786773682,
+      -1.7353260517120361
+    ],
+    [
+      1.5315409898757935,
+      -1.5559444427490234
+    ],
+    [
+      1.358616590499878,
+      0.20357294380664825
+    ],
+    [
+      1.9184476137161255,
+      1.464897632598877
+    ],
+    [
+      1.0342620611190796,
+      -0.08142930269241333
+    ],
+    [
+      0.6879051923751831,
+      -1.6877650022506714
+    ],
+    [
+      1.337918758392334,
+      1.6181681156158447
+    ],
+    [
+      0.9619367718696594,
+      -0.14192847907543182
+    ],
+    [
+      1.7112085819244385,
+      -1.7760181427001953
+    ],
+    [
+      1.640207290649414,
+      1.3012608289718628
+    ],
+    [
+      1.5726418495178223,
+      1.667948842048645
+    ],
+    [
+      0.8728251457214355,
+      0.8489036560058594
+    ],
+    [
+      1.5849840641021729,
+      0.37725794315338135
+    ],
+    [
+      2.017688035964966,
+      1.1252654790878296
+    ],
+    [
+      1.673474669456482,
+      -1.9042937755584717
+    ],
+    [
+      -1.781908392906189,
+      1.7424404621124268
+    ],
+    [
+      1.6836049556732178,
+      -0.2011474221944809
+    ],
+    [
+      1.8146699666976929,
+      -1.7402317523956299
+    ]
+  ],
+  "finite_samples": true,
+  "mean_distance_to_center": 0.9143958687782288,
+  "mode_fractions": [
+    0.3125,
+    0.2578125,
+    0.2578125,
+    0.171875
+  ],
+  "mode_entropy": 1.365095853805542,
+  "mean_target_log_density": -10.699212074279785,
+  "elapsed_seconds": 2.076603032001003
+}
diff --git a/lecture_6/verified_examples/meta/samples.txt b/lecture_6/verified_examples/meta/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..bb0431cbf06e8bb9dce52a0b3db17b89567e73be
--- /dev/null
+++ b/lecture_6/verified_examples/meta/samples.txt
@@ -0,0 +1,128 @@
+1.8235646 0.2840534
+-0.5814909 1.4675775
+-1.8262382 -0.5463361
+-2.1038854 -0.9290856
+-0.5743225 -1.8152400
+-2.2973895 1.6775420
+0.5299083 -2.1270809
+0.8204561 1.3323586
+0.6014575 -0.1730817
+-1.1869117 0.2184291
+-1.0309213 1.5909073
+0.5516089 0.6442144
+0.8404521 -1.0471361
+-1.9026124 -1.9249947
+-1.2030610 -1.3287936
+1.1189814 -0.8402100
+-0.4988412 1.0487860
+0.0658105 -1.7212564
+2.0743008 -1.6605499
+0.1236886 0.5871138
+-1.6329110 1.5222962
+-2.6675615 0.4633856
+-1.5704458 -0.6821549
+1.5613501 -1.8913007
+-2.6032236 -2.0263000
+-1.5067567 -0.3172832
+-1.9537389 -1.3581443
+0.6129556 -2.2514820
+1.4496561 1.2255797
+-0.1838326 -2.1546605
+-2.7607505 1.9977862
+-2.4884427 1.0715288
+0.8479332 -1.1511809
+0.5794094 -2.4070587
+-1.5050663 1.9545105
+-1.4026222 -1.5872152
+-1.7973433 -1.3198395
+-1.2342426 1.8729073
+1.9491110 0.8056205
+0.1061184 -2.2566013
+-0.3054272 0.5977394
+-1.6626368 -0.8267638
+-0.8401585 1.3837842
+2.2069483 -0.8624932
+-1.0141340 -1.8917056
+-0.3683970 -0.4894097
+1.5109534 1.5286602
+-0.4530666 1.2331275
+0.8551937 1.3678513
+-1.0781388 1.5701976
+1.7152305 0.9469091
+1.2406930 0.0315916
+-0.7125176 -1.2778836
+-0.4830938 1.0424199
+-1.1490767 1.7313992
+-2.0085611 0.7131109
+0.9569877 -2.0194778
+-1.0347059 -1.5298440
+-1.5424138 -0.9005758
+-1.4319432 2.2767177
+-1.4173055 -1.3439649
+0.4780815 0.6122875
+0.0199950 0.8457472
+1.4453430 2.0340047
+1.1257138 0.1471111
+1.2938999 -1.7328856
+2.0727005 -1.6808670
+-1.7246425 -1.6863568
+-0.3860345 -1.3310034
+-2.2909045 -0.4902134
+-0.1369570 -2.0212309
+-2.1521020 0.8427050
+-1.8755906 1.5917650
+1.6317800 1.2439458
+0.8764249 -2.0320723
+-0.2034333 -0.7536104
+-0.6149109 -1.3143404
+0.7797673 -1.7384816
+-0.8145548 0.3170268
+2.4403534 1.8561149
+-2.3181899 -1.4791181
+0.2916472 -1.1452258
+-1.2054375 2.2681451
+0.4937436 0.6093829
+-0.2878294 -2.5764925
+-1.1713526 -1.8817768
+0.8140897 2.1135807
+0.8390487 -1.8510487
+-2.1428463 -0.8781706
+1.4871042 -1.5311562
+0.9443722 -2.0985630
+-2.8753469 0.8312819
+1.3258595 -1.0892494
+-0.8831242 -1.9832208
+-2.1194906 -2.4844036
+-1.6342931 0.7363718
+1.2487797 -2.2321706
+0.5276757 -2.3629532
+-1.5941479 1.1652606
+-0.3122345 -2.1854608
+-0.7947186 0.6110249
+0.5482047 -1.6277281
+-0.2658420 1.3829620
+-1.5029284 0.7142269
+-1.6991533 -0.7421408
+-0.5590621 -2.1612377
+1.0103567 -0.1444041
+-0.7205022 -1.0651522
+-0.6758839 -0.4015428
+-2.1426892 1.8529508
+0.9843839 0.4604543
+2.4236128 -0.5857831
+0.2229572 -2.5284841
+-1.7341564 -1.7494152
+0.2604243 -0.5902460
+-0.9988738 -0.5933940
+1.7811785 1.3393323
+1.4884186 0.9384286
+0.7130125 -0.6618559
+-1.3420393 -1.5511777
+0.4685817 -1.4641353
+-0.8732074 1.0521674
+-0.0105790 0.5828336
+1.7100034 1.0594392
+0.1160956 -2.1494484
+-1.6675565 1.5062786
+-1.8025006 -2.5524969
+0.7404482 -2.6601062
diff --git a/lecture_6/verified_examples/numerical_checks.json b/lecture_6/verified_examples/numerical_checks.json
new file mode 100644
index 0000000000000000000000000000000000000000..2005af0046334299924bcfeff0d8f17dc1b36c0c
--- /dev/null
+++ b/lecture_6/verified_examples/numerical_checks.json
@@ -0,0 +1,128 @@
+{
+  "torch_version": "2.9.1+cpu",
+  "categorical": {
+    "mapped_state": [
+      0.0,
+      0.6666666666666666,
+      0.5
+    ],
+    "state_sum": 1.1666666666666665,
+    "target": [
+      0.40000003576278687,
+      0.6000000238418579
+    ]
+  },
+  "meanflow_jvp": {
+    "average": 1.278367031066925,
+    "identity_residual": 0.0
+  },
+  "posterior_value": {
+    "estimated_value": 0.1305124194458518,
+    "exact_value": 0.13082352941176473,
+    "gradient": 0.28235294117647053,
+    "exact_gradient": 0.28235294117647064
+  },
+  "expansion": {
+    "birth_times": [
+      0.5,
+      0.0,
+      0.20000000298023224,
+      0.5
+    ],
+    "local_times": [
+      0.5,
+      0.75,
+      0.6875,
+      0.5
+    ],
+    "expected_insertions": 2.0
+  },
+  "brownian": {
+    "coarse_coefficients": [
+      0.10000000149011612,
+      -0.14000000059604645
+    ],
+    "same_noise_endpoint": 1.5800000429153442,
+    "empirical_covariance": [
+      [
+        1.003127932548523,
+        -0.0006905767368152738
+      ],
+      [
+        -0.0006905767368152738,
+        0.3355097770690918
+      ]
+    ]
+  },
+  "meta_gradient": {
+    "surrogate_gradient": 1.0000001192092896,
+    "estimating_equation_gradient": 1.0000001192092896
+  },
+  "scalar_training": {
+    "endpoint_rmse": 0.011255002580583096,
+    "composition_rmse": 0.01107736025005579,
+    "iterations": 6000,
+    "history": [
+      {
+        "step": 0,
+        "diagonal": 3.162496566772461,
+        "composition": 4.519377398537472e-06
+      },
+      {
+        "step": 500,
+        "diagonal": 1.5179249203356449e-05,
+        "composition": 0.01775265485048294
+      },
+      {
+        "step": 1000,
+        "diagonal": 0.00010002867202274501,
+        "composition": 0.00012819103721994907
+      },
+      {
+        "step": 1500,
+        "diagonal": 6.0562782891793177e-05,
+        "composition": 0.00014529442705679685
+      },
+      {
+        "step": 2000,
+        "diagonal": 6.487423524959013e-05,
+        "composition": 8.228872320614755e-05
+      },
+      {
+        "step": 2500,
+        "diagonal": 5.7231511163990945e-05,
+        "composition": 7.150214514695108e-05
+      },
+      {
+        "step": 3000,
+        "diagonal": 5.7603479945100844e-05,
+        "composition": 9.848889021668583e-05
+      },
+      {
+        "step": 3500,
+        "diagonal": 2.9411256036837585e-05,
+        "composition": 8.328341209562495e-05
+      },
+      {
+        "step": 4000,
+        "diagonal": 2.8396823836374097e-05,
+        "composition": 4.5329699787544087e-05
+      },
+      {
+        "step": 4500,
+        "diagonal": 3.6659381294157356e-05,
+        "composition": 5.084354052087292e-05
+      },
+      {
+        "step": 5000,
+        "diagonal": 1.7919834135682322e-05,
+        "composition": 2.2748939954908565e-05
+      },
+      {
+        "step": 5500,
+        "diagonal": 3.836172982119024e-05,
+        "composition": 4.723470556200482e-05
+      }
+    ]
+  }
+}
\ No newline at end of file
diff --git a/lecture_6/verified_examples/self-distill/config.json b/lecture_6/verified_examples/self-distill/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..cac6ce05fc08a078e0296b11b6b5e6cc4aa38552
--- /dev/null
+++ b/lecture_6/verified_examples/self-distill/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "self-distill",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/self-distill"
+}
diff --git a/lecture_6/verified_examples/self-distill/losses.json b/lecture_6/verified_examples/self-distill/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..61e7b3bfa906c580a439502941d43a7a08c49123
--- /dev/null
+++ b/lecture_6/verified_examples/self-distill/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 3.3380019664764404,
+    "diagonal": 3.3380019664764404,
+    "finite": 4.728182830149308e-06
+  },
+  {
+    "step": 1,
+    "loss": 3.1514666080474854,
+    "diagonal": 3.151463031768799,
+    "finite": 0.00035523722181096673
+  },
+  {
+    "step": 2,
+    "loss": 3.3210978507995605,
+    "diagonal": 3.32108211517334,
+    "finite": 0.001047357451170683
+  },
+  {
+    "step": 3,
+    "loss": 3.772533655166626,
+    "diagonal": 3.7724833488464355,
+    "finite": 0.002513490617275238
+  },
+  {
+    "step": 4,
+    "loss": 3.2858798503875732,
+    "diagonal": 3.2857892513275146,
+    "finite": 0.003621601965278387
+  },
+  {
+    "step": 5,
+    "loss": 3.1518328189849854,
+    "diagonal": 3.151683807373047,
+    "finite": 0.004966087639331818
+  },
+  {
+    "step": 6,
+    "loss": 3.378674030303955,
+    "diagonal": 3.3783602714538574,
+    "finite": 0.008965418674051762
+  },
+  {
+    "step": 7,
+    "loss": 3.1121716499328613,
+    "diagonal": 3.111825704574585,
+    "finite": 0.008647104725241661
+  },
+  {
+    "step": 8,
+    "loss": 3.1235733032226562,
+    "diagonal": 3.12296724319458,
+    "finite": 0.013467516750097275
+  },
+  {
+    "step": 9,
+    "loss": 2.9266598224639893,
+    "diagonal": 2.925917148590088,
+    "finite": 0.014851987361907959
+  },
+  {
+    "step": 10,
+    "loss": 3.994819402694702,
+    "diagonal": 3.993950366973877,
+    "finite": 0.015800634399056435
+  },
+  {
+    "step": 11,
+    "loss": 3.2001945972442627,
+    "diagonal": 3.199022054672241,
+    "finite": 0.01954130083322525
+  },
+  {
+    "step": 12,
+    "loss": 3.3501689434051514,
+    "diagonal": 3.3482797145843506,
+    "finite": 0.029065201058983803
+  },
+  {
+    "step": 13,
+    "loss": 3.0788607597351074,
+    "diagonal": 3.076826810836792,
+    "finite": 0.02905501425266266
+  },
+  {
+    "step": 14,
+    "loss": 2.7859110832214355,
+    "diagonal": 2.783377170562744,
+    "finite": 0.0337856151163578
+  },
+  {
+    "step": 15,
+    "loss": 2.845197916030884,
+    "diagonal": 2.8419179916381836,
+    "finite": 0.04099925607442856
+  },
+  {
+    "step": 16,
+    "loss": 3.0067031383514404,
+    "diagonal": 3.003265857696533,
+    "finite": 0.040439385920763016
+  },
+  {
+    "step": 17,
+    "loss": 2.5906176567077637,
+    "diagonal": 2.5857887268066406,
+    "finite": 0.05365584045648575
+  },
+  {
+    "step": 18,
+    "loss": 3.1582276821136475,
+    "diagonal": 3.1536526679992676,
+    "finite": 0.04815799370408058
+  },
+  {
+    "step": 19,
+    "loss": 3.393378496170044,
+    "diagonal": 3.3863322734832764,
+    "finite": 0.07046335190534592
+  },
+  {
+    "step": 20,
+    "loss": 2.9530348777770996,
+    "diagonal": 2.9478235244750977,
+    "finite": 0.04963130131363869
+  },
+  {
+    "step": 21,
+    "loss": 2.9493415355682373,
+    "diagonal": 2.9422969818115234,
+    "finite": 0.06404069811105728
+  },
+  {
+    "step": 22,
+    "loss": 2.6825969219207764,
+    "diagonal": 2.675053596496582,
+    "finite": 0.06559497117996216
+  },
+  {
+    "step": 23,
+    "loss": 2.970998525619507,
+    "diagonal": 2.9628419876098633,
+    "finite": 0.06797121465206146
+  },
+  {
+    "step": 24,
+    "loss": 3.149895668029785,
+    "diagonal": 3.1408450603485107,
+    "finite": 0.07240551710128784
+  },
+  {
+    "step": 25,
+    "loss": 2.8518292903900146,
+    "diagonal": 2.841243267059326,
+    "finite": 0.08143022656440735
+  },
+  {
+    "step": 26,
+    "loss": 3.379718065261841,
+    "diagonal": 3.366621732711792,
+    "finite": 0.09701023995876312
+  },
+  {
+    "step": 27,
+    "loss": 3.741885185241699,
+    "diagonal": 3.730823278427124,
+    "finite": 0.07901395857334137
+  },
+  {
+    "step": 28,
+    "loss": 2.8301994800567627,
+    "diagonal": 2.816267728805542,
+    "finite": 0.09608173370361328
+  },
+  {
+    "step": 29,
+    "loss": 3.373037099838257,
+    "diagonal": 3.353325843811035,
+    "finite": 0.1314079314470291
+  },
+  {
+    "step": 30,
+    "loss": 3.5674757957458496,
+    "diagonal": 3.552032947540283,
+    "finite": 0.09963163733482361
+  },
+  {
+    "step": 31,
+    "loss": 2.839944839477539,
+    "diagonal": 2.8248209953308105,
+    "finite": 0.09452331811189651
+  },
+  {
+    "step": 32,
+    "loss": 2.9196579456329346,
+    "diagonal": 2.8977768421173096,
+    "finite": 0.13261213898658752
+  },
+  {
+    "step": 33,
+    "loss": 2.5578970909118652,
+    "diagonal": 2.538792848587036,
+    "finite": 0.11237798631191254
+  },
+  {
+    "step": 34,
+    "loss": 2.4417195320129395,
+    "diagonal": 2.4226431846618652,
+    "finite": 0.10900774598121643
+  },
+  {
+    "step": 35,
+    "loss": 3.6795103549957275,
+    "diagonal": 3.6609489917755127,
+    "finite": 0.10311917215585709
+  },
+  {
+    "step": 36,
+    "loss": 2.914029359817505,
+    "diagonal": 2.889071464538574,
+    "finite": 0.13490770757198334
+  },
+  {
+    "step": 37,
+    "loss": 3.1468966007232666,
+    "diagonal": 3.120748281478882,
+    "finite": 0.13762252032756805
+  },
+  {
+    "step": 38,
+    "loss": 3.1058032512664795,
+    "diagonal": 3.085524320602417,
+    "finite": 0.10399419814348221
+  },
+  {
+    "step": 39,
+    "loss": 2.6108357906341553,
+    "diagonal": 2.5839757919311523,
+    "finite": 0.13430041074752808
+  },
+  {
+    "step": 40,
+    "loss": 2.6540277004241943,
+    "diagonal": 2.633596658706665,
+    "finite": 0.09966327250003815
+  },
+  {
+    "step": 41,
+    "loss": 3.1256771087646484,
+    "diagonal": 3.0903148651123047,
+    "finite": 0.1683918833732605
+  },
+  {
+    "step": 42,
+    "loss": 3.1423118114471436,
+    "diagonal": 3.1156375408172607,
+    "finite": 0.12406677007675171
+  },
+  {
+    "step": 43,
+    "loss": 3.0025527477264404,
+    "diagonal": 2.968681812286377,
+    "finite": 0.15395885705947876
+  },
+  {
+    "step": 44,
+    "loss": 2.3203108310699463,
+    "diagonal": 2.2898032665252686,
+    "finite": 0.13558951020240784
+  },
+  {
+    "step": 45,
+    "loss": 3.5077738761901855,
+    "diagonal": 3.473581314086914,
+    "finite": 0.14866286516189575
+  },
+  {
+    "step": 46,
+    "loss": 3.513510227203369,
+    "diagonal": 3.4813649654388428,
+    "finite": 0.136788472533226
+  },
+  {
+    "step": 47,
+    "loss": 3.2955434322357178,
+    "diagonal": 3.257589817047119,
+    "finite": 0.15814024209976196
+  },
+  {
+    "step": 48,
+    "loss": 3.08830189704895,
+    "diagonal": 3.0514822006225586,
+    "finite": 0.15028442442417145
+  },
+  {
+    "step": 49,
+    "loss": 3.279731512069702,
+    "diagonal": 3.2446401119232178,
+    "finite": 0.14036552608013153
+  },
+  {
+    "step": 50,
+    "loss": 3.1153676509857178,
+    "diagonal": 3.0787858963012695,
+    "finite": 0.14345750212669373
+  },
+  {
+    "step": 51,
+    "loss": 2.7456767559051514,
+    "diagonal": 2.7104547023773193,
+    "finite": 0.13546936213970184
+  },
+  {
+    "step": 52,
+    "loss": 2.6139633655548096,
+    "diagonal": 2.575843334197998,
+    "finite": 0.1438494324684143
+  },
+  {
+    "step": 53,
+    "loss": 3.360395908355713,
+    "diagonal": 3.324699878692627,
+    "finite": 0.13220728933811188
+  },
+  {
+    "step": 54,
+    "loss": 2.6764400005340576,
+    "diagonal": 2.6381330490112305,
+    "finite": 0.1392982006072998
+  },
+  {
+    "step": 55,
+    "loss": 2.465507745742798,
+    "diagonal": 2.4329254627227783,
+    "finite": 0.11636500060558319
+  },
+  {
+    "step": 56,
+    "loss": 3.0449955463409424,
+    "diagonal": 3.0023486614227295,
+    "finite": 0.1496383398771286
+  },
+  {
+    "step": 57,
+    "loss": 3.7059872150421143,
+    "diagonal": 3.6616549491882324,
+    "finite": 0.15287017822265625
+  },
+  {
+    "step": 58,
+    "loss": 3.570039749145508,
+    "diagonal": 3.528444290161133,
+    "finite": 0.14100141823291779
+  },
+  {
+    "step": 59,
+    "loss": 2.648472309112549,
+    "diagonal": 2.612183094024658,
+    "finite": 0.12096389383077621
+  },
+  {
+    "step": 60,
+    "loss": 3.140780210494995,
+    "diagonal": 3.104485511779785,
+    "finite": 0.11899898201227188
+  },
+  {
+    "step": 61,
+    "loss": 2.7061829566955566,
+    "diagonal": 2.664477825164795,
+    "finite": 0.1345326155424118
+  },
+  {
+    "step": 62,
+    "loss": 3.2072691917419434,
+    "diagonal": 3.168354034423828,
+    "finite": 0.1235404685139656
+  },
+  {
+    "step": 63,
+    "loss": 2.7776737213134766,
+    "diagonal": 2.7270991802215576,
+    "finite": 0.15804524719715118
+  },
+  {
+    "step": 64,
+    "loss": 3.622138738632202,
+    "diagonal": 3.581561326980591,
+    "finite": 0.12485377490520477
+  },
+  {
+    "step": 65,
+    "loss": 2.9366867542266846,
+    "diagonal": 2.9001808166503906,
+    "finite": 0.11062376201152802
+  },
+  {
+    "step": 66,
+    "loss": 2.823063850402832,
+    "diagonal": 2.7826132774353027,
+    "finite": 0.12074801325798035
+  },
+  {
+    "step": 67,
+    "loss": 2.530045509338379,
+    "diagonal": 2.492706060409546,
+    "finite": 0.10982193797826767
+  },
+  {
+    "step": 68,
+    "loss": 2.7529053688049316,
+    "diagonal": 2.7074341773986816,
+    "finite": 0.13180069625377655
+  },
+  {
+    "step": 69,
+    "loss": 3.039750814437866,
+    "diagonal": 3.0015432834625244,
+    "finite": 0.10916423797607422
+  },
+  {
+    "step": 70,
+    "loss": 2.644646406173706,
+    "diagonal": 2.6180243492126465,
+    "finite": 0.07499188184738159
+  },
+  {
+    "step": 71,
+    "loss": 2.940946102142334,
+    "diagonal": 2.9130568504333496,
+    "finite": 0.07747012376785278
+  },
+  {
+    "step": 72,
+    "loss": 3.535933494567871,
+    "diagonal": 3.4994964599609375,
+    "finite": 0.09982758015394211
+  },
+  {
+    "step": 73,
+    "loss": 2.59324312210083,
+    "diagonal": 2.55831241607666,
+    "finite": 0.09440744668245316
+  },
+  {
+    "step": 74,
+    "loss": 3.1554977893829346,
+    "diagonal": 3.1218132972717285,
+    "finite": 0.08982554078102112
+  },
+  {
+    "step": 75,
+    "loss": 2.7715353965759277,
+    "diagonal": 2.7358827590942383,
+    "finite": 0.0938228964805603
+  },
+  {
+    "step": 76,
+    "loss": 2.8613624572753906,
+    "diagonal": 2.8142387866973877,
+    "finite": 0.12239903956651688
+  },
+  {
+    "step": 77,
+    "loss": 2.8749265670776367,
+    "diagonal": 2.8439619541168213,
+    "finite": 0.07939644902944565
+  },
+  {
+    "step": 78,
+    "loss": 2.4903147220611572,
+    "diagonal": 2.4485459327697754,
+    "finite": 0.10574358701705933
+  },
+  {
+    "step": 79,
+    "loss": 2.55422306060791,
+    "diagonal": 2.516901969909668,
+    "finite": 0.09330243617296219
+  },
+  {
+    "step": 80,
+    "loss": 2.8502399921417236,
+    "diagonal": 2.8088936805725098,
+    "finite": 0.1020897626876831
+  },
+  {
+    "step": 81,
+    "loss": 2.5888516902923584,
+    "diagonal": 2.5475594997406006,
+    "finite": 0.10071241855621338
+  },
+  {
+    "step": 82,
+    "loss": 2.3247597217559814,
+    "diagonal": 2.2906978130340576,
+    "finite": 0.082076795399189
+  },
+  {
+    "step": 83,
+    "loss": 3.0297179222106934,
+    "diagonal": 2.9861600399017334,
+    "finite": 0.10370947420597076
+  },
+  {
+    "step": 84,
+    "loss": 3.42775559425354,
+    "diagonal": 3.3932437896728516,
+    "finite": 0.08120421320199966
+  },
+  {
+    "step": 85,
+    "loss": 2.5589962005615234,
+    "diagonal": 2.524644136428833,
+    "finite": 0.07988864183425903
+  },
+  {
+    "step": 86,
+    "loss": 2.223142147064209,
+    "diagonal": 2.198875904083252,
+    "finite": 0.055784303694963455
+  },
+  {
+    "step": 87,
+    "loss": 2.117433786392212,
+    "diagonal": 2.0889945030212402,
+    "finite": 0.0646345317363739
+  },
+  {
+    "step": 88,
+    "loss": 2.6767125129699707,
+    "diagonal": 2.639803886413574,
+    "finite": 0.08294087648391724
+  },
+  {
+    "step": 89,
+    "loss": 2.9356229305267334,
+    "diagonal": 2.895681619644165,
+    "finite": 0.08875849097967148
+  },
+  {
+    "step": 90,
+    "loss": 3.443274974822998,
+    "diagonal": 3.4112696647644043,
+    "finite": 0.0703413337469101
+  },
+  {
+    "step": 91,
+    "loss": 2.8665037155151367,
+    "diagonal": 2.833081007003784,
+    "finite": 0.07265786081552505
+  },
+  {
+    "step": 92,
+    "loss": 3.7104384899139404,
+    "diagonal": 3.673851490020752,
+    "finite": 0.07868172228336334
+  },
+  {
+    "step": 93,
+    "loss": 2.8578758239746094,
+    "diagonal": 2.815544605255127,
+    "finite": 0.09006665647029877
+  },
+  {
+    "step": 94,
+    "loss": 2.6587135791778564,
+    "diagonal": 2.624843120574951,
+    "finite": 0.07130635529756546
+  },
+  {
+    "step": 95,
+    "loss": 2.6278927326202393,
+    "diagonal": 2.592702627182007,
+    "finite": 0.07331261783838272
+  },
+  {
+    "step": 96,
+    "loss": 2.737247943878174,
+    "diagonal": 2.707068920135498,
+    "finite": 0.062224820256233215
+  },
+  {
+    "step": 97,
+    "loss": 3.1597976684570312,
+    "diagonal": 3.130398750305176,
+    "finite": 0.05999774858355522
+  },
+  {
+    "step": 98,
+    "loss": 2.321859121322632,
+    "diagonal": 2.292922019958496,
+    "finite": 0.058458730578422546
+  },
+  {
+    "step": 99,
+    "loss": 2.2861244678497314,
+    "diagonal": 2.263162612915039,
+    "finite": 0.045923709869384766
+  },
+  {
+    "step": 100,
+    "loss": 2.784821033477783,
+    "diagonal": 2.7615811824798584,
+    "finite": 0.04601940140128136
+  },
+  {
+    "step": 101,
+    "loss": 3.161243200302124,
+    "diagonal": 3.135366201400757,
+    "finite": 0.05073923245072365
+  },
+  {
+    "step": 102,
+    "loss": 2.898433208465576,
+    "diagonal": 2.871875286102295,
+    "finite": 0.05156872421503067
+  },
+  {
+    "step": 103,
+    "loss": 2.2162482738494873,
+    "diagonal": 2.188504695892334,
+    "finite": 0.05335302650928497
+  },
+  {
+    "step": 104,
+    "loss": 2.9559667110443115,
+    "diagonal": 2.9326486587524414,
+    "finite": 0.04441537708044052
+  },
+  {
+    "step": 105,
+    "loss": 3.1337203979492188,
+    "diagonal": 3.10503888130188,
+    "finite": 0.05411584675312042
+  },
+  {
+    "step": 106,
+    "loss": 2.8948447704315186,
+    "diagonal": 2.872427463531494,
+    "finite": 0.04190147668123245
+  },
+  {
+    "step": 107,
+    "loss": 2.504779577255249,
+    "diagonal": 2.4773240089416504,
+    "finite": 0.05084346607327461
+  },
+  {
+    "step": 108,
+    "loss": 2.5572638511657715,
+    "diagonal": 2.52327561378479,
+    "finite": 0.062363822013139725
+  },
+  {
+    "step": 109,
+    "loss": 2.1965768337249756,
+    "diagonal": 2.155400276184082,
+    "finite": 0.07486645132303238
+  },
+  {
+    "step": 110,
+    "loss": 2.273023843765259,
+    "diagonal": 2.245319366455078,
+    "finite": 0.04991813376545906
+  },
+  {
+    "step": 111,
+    "loss": 2.4207890033721924,
+    "diagonal": 2.395308017730713,
+    "finite": 0.045501891523599625
+  },
+  {
+    "step": 112,
+    "loss": 2.9519786834716797,
+    "diagonal": 2.9155375957489014,
+    "finite": 0.06449753046035767
+  },
+  {
+    "step": 113,
+    "loss": 2.5868256092071533,
+    "diagonal": 2.5519375801086426,
+    "finite": 0.06120719388127327
+  },
+  {
+    "step": 114,
+    "loss": 3.2328743934631348,
+    "diagonal": 3.20013427734375,
+    "finite": 0.056939225643873215
+  },
+  {
+    "step": 115,
+    "loss": 3.2318904399871826,
+    "diagonal": 3.197564125061035,
+    "finite": 0.059183113276958466
+  },
+  {
+    "step": 116,
+    "loss": 2.8643670082092285,
+    "diagonal": 2.832481622695923,
+    "finite": 0.05450495332479477
+  },
+  {
+    "step": 117,
+    "loss": 2.6811530590057373,
+    "diagonal": 2.645698070526123,
+    "finite": 0.06009306758642197
+  },
+  {
+    "step": 118,
+    "loss": 3.011168956756592,
+    "diagonal": 2.9804975986480713,
+    "finite": 0.05154840275645256
+  },
+  {
+    "step": 119,
+    "loss": 2.58675479888916,
+    "diagonal": 2.5513854026794434,
+    "finite": 0.05894898623228073
+  },
+  {
+    "step": 120,
+    "loss": 3.3542046546936035,
+    "diagonal": 3.3262832164764404,
+    "finite": 0.046151094138622284
+  },
+  {
+    "step": 121,
+    "loss": 2.4393887519836426,
+    "diagonal": 2.410161018371582,
+    "finite": 0.047914329916238785
+  },
+  {
+    "step": 122,
+    "loss": 2.4184932708740234,
+    "diagonal": 2.388684034347534,
+    "finite": 0.04847029969096184
+  },
+  {
+    "step": 123,
+    "loss": 2.645756721496582,
+    "diagonal": 2.614691734313965,
+    "finite": 0.050104934722185135
+  },
+  {
+    "step": 124,
+    "loss": 2.563167095184326,
+    "diagonal": 2.536066770553589,
+    "finite": 0.043360333889722824
+  },
+  {
+    "step": 125,
+    "loss": 2.3428146839141846,
+    "diagonal": 2.308673858642578,
+    "finite": 0.054191961884498596
+  },
+  {
+    "step": 126,
+    "loss": 2.5060951709747314,
+    "diagonal": 2.474653482437134,
+    "finite": 0.04951443150639534
+  },
+  {
+    "step": 127,
+    "loss": 2.7527034282684326,
+    "diagonal": 2.7147438526153564,
+    "finite": 0.0593118742108345
+  },
+  {
+    "step": 128,
+    "loss": 3.1105196475982666,
+    "diagonal": 3.0809576511383057,
+    "finite": 0.045832641422748566
+  },
+  {
+    "step": 129,
+    "loss": 2.715036153793335,
+    "diagonal": 2.68239688873291,
+    "finite": 0.05021440610289574
+  },
+  {
+    "step": 130,
+    "loss": 3.1399128437042236,
+    "diagonal": 3.1082847118377686,
+    "finite": 0.048287056386470795
+  },
+  {
+    "step": 131,
+    "loss": 2.409303903579712,
+    "diagonal": 2.372983932495117,
+    "finite": 0.05503042787313461
+  },
+  {
+    "step": 132,
+    "loss": 2.4489028453826904,
+    "diagonal": 2.4199674129486084,
+    "finite": 0.04351196438074112
+  },
+  {
+    "step": 133,
+    "loss": 3.1412885189056396,
+    "diagonal": 3.1109094619750977,
+    "finite": 0.04534173756837845
+  },
+  {
+    "step": 134,
+    "loss": 3.090653896331787,
+    "diagonal": 3.061161994934082,
+    "finite": 0.04369187727570534
+  },
+  {
+    "step": 135,
+    "loss": 2.725813388824463,
+    "diagonal": 2.6945362091064453,
+    "finite": 0.0459958016872406
+  },
+  {
+    "step": 136,
+    "loss": 2.2553632259368896,
+    "diagonal": 2.2232043743133545,
+    "finite": 0.04694719240069389
+  },
+  {
+    "step": 137,
+    "loss": 2.7994439601898193,
+    "diagonal": 2.7681360244750977,
+    "finite": 0.045373689383268356
+  },
+  {
+    "step": 138,
+    "loss": 3.014155864715576,
+    "diagonal": 2.979344606399536,
+    "finite": 0.05008814111351967
+  },
+  {
+    "step": 139,
+    "loss": 3.1663577556610107,
+    "diagonal": 3.1357812881469727,
+    "finite": 0.043680597096681595
+  },
+  {
+    "step": 140,
+    "loss": 3.017085075378418,
+    "diagonal": 2.988452196121216,
+    "finite": 0.04061397910118103
+  },
+  {
+    "step": 141,
+    "loss": 2.23872709274292,
+    "diagonal": 2.210897922515869,
+    "finite": 0.039196036756038666
+  },
+  {
+    "step": 142,
+    "loss": 2.5845787525177,
+    "diagonal": 2.5456557273864746,
+    "finite": 0.05443768575787544
+  },
+  {
+    "step": 143,
+    "loss": 2.9304709434509277,
+    "diagonal": 2.9031033515930176,
+    "finite": 0.03801045939326286
+  },
+  {
+    "step": 144,
+    "loss": 2.7710506916046143,
+    "diagonal": 2.744816303253174,
+    "finite": 0.03618542104959488
+  },
+  {
+    "step": 145,
+    "loss": 2.512422561645508,
+    "diagonal": 2.4879579544067383,
+    "finite": 0.03351312503218651
+  },
+  {
+    "step": 146,
+    "loss": 2.791921854019165,
+    "diagonal": 2.773296594619751,
+    "finite": 0.025340620428323746
+  },
+  {
+    "step": 147,
+    "loss": 3.487886428833008,
+    "diagonal": 3.470698833465576,
+    "finite": 0.023226546123623848
+  },
+  {
+    "step": 148,
+    "loss": 2.3431544303894043,
+    "diagonal": 2.3251798152923584,
+    "finite": 0.024127118289470673
+  },
+  {
+    "step": 149,
+    "loss": 3.099975109100342,
+    "diagonal": 3.0807723999023438,
+    "finite": 0.025603516027331352
+  },
+  {
+    "step": 150,
+    "loss": 3.069657564163208,
+    "diagonal": 3.0524322986602783,
+    "finite": 0.022814923897385597
+  },
+  {
+    "step": 151,
+    "loss": 3.101334571838379,
+    "diagonal": 3.084836483001709,
+    "finite": 0.021707899868488312
+  },
+  {
+    "step": 152,
+    "loss": 2.9353647232055664,
+    "diagonal": 2.9204635620117188,
+    "finite": 0.019478753209114075
+  },
+  {
+    "step": 153,
+    "loss": 3.396026134490967,
+    "diagonal": 3.3787429332733154,
+    "finite": 0.02244577370584011
+  },
+  {
+    "step": 154,
+    "loss": 2.7408249378204346,
+    "diagonal": 2.726508378982544,
+    "finite": 0.018473107367753983
+  },
+  {
+    "step": 155,
+    "loss": 3.0839641094207764,
+    "diagonal": 3.068087100982666,
+    "finite": 0.020355157554149628
+  },
+  {
+    "step": 156,
+    "loss": 2.9074065685272217,
+    "diagonal": 2.892650842666626,
+    "finite": 0.018797075375914574
+  },
+  {
+    "step": 157,
+    "loss": 3.3671984672546387,
+    "diagonal": 3.346512794494629,
+    "finite": 0.026184523478150368
+  },
+  {
+    "step": 158,
+    "loss": 2.8002803325653076,
+    "diagonal": 2.784520149230957,
+    "finite": 0.01982424035668373
+  },
+  {
+    "step": 159,
+    "loss": 2.729705810546875,
+    "diagonal": 2.710536003112793,
+    "finite": 0.023962168022990227
+  },
+  {
+    "step": 160,
+    "loss": 2.878106117248535,
+    "diagonal": 2.861238718032837,
+    "finite": 0.02095332182943821
+  },
+  {
+    "step": 161,
+    "loss": 3.152148723602295,
+    "diagonal": 3.1381618976593018,
+    "finite": 0.01726779341697693
+  },
+  {
+    "step": 162,
+    "loss": 2.829887628555298,
+    "diagonal": 2.8120574951171875,
+    "finite": 0.02187749184668064
+  },
+  {
+    "step": 163,
+    "loss": 3.0184643268585205,
+    "diagonal": 3.005967140197754,
+    "finite": 0.015240497887134552
+  },
+  {
+    "step": 164,
+    "loss": 2.9691998958587646,
+    "diagonal": 2.9455721378326416,
+    "finite": 0.02863970585167408
+  },
+  {
+    "step": 165,
+    "loss": 2.880307912826538,
+    "diagonal": 2.8594460487365723,
+    "finite": 0.025134826079010963
+  },
+  {
+    "step": 166,
+    "loss": 3.421907901763916,
+    "diagonal": 3.4037115573883057,
+    "finite": 0.021792039275169373
+  },
+  {
+    "step": 167,
+    "loss": 2.9427037239074707,
+    "diagonal": 2.9222488403320312,
+    "finite": 0.02435111813247204
+  },
+  {
+    "step": 168,
+    "loss": 2.914600133895874,
+    "diagonal": 2.9024062156677246,
+    "finite": 0.014430679380893707
+  },
+  {
+    "step": 169,
+    "loss": 2.240858554840088,
+    "diagonal": 2.2229726314544678,
+    "finite": 0.021042345091700554
+  },
+  {
+    "step": 170,
+    "loss": 3.4039721488952637,
+    "diagonal": 3.3896846771240234,
+    "finite": 0.016710495576262474
+  },
+  {
+    "step": 171,
+    "loss": 2.5798771381378174,
+    "diagonal": 2.5685088634490967,
+    "finite": 0.0132188955321908
+  },
+  {
+    "step": 172,
+    "loss": 3.5165066719055176,
+    "diagonal": 3.5037648677825928,
+    "finite": 0.014730453491210938
+  },
+  {
+    "step": 173,
+    "loss": 3.481968879699707,
+    "diagonal": 3.4691686630249023,
+    "finite": 0.01471288688480854
+  },
+  {
+    "step": 174,
+    "loss": 2.658947706222534,
+    "diagonal": 2.646247386932373,
+    "finite": 0.014514565467834473
+  },
+  {
+    "step": 175,
+    "loss": 2.5997538566589355,
+    "diagonal": 2.5869839191436768,
+    "finite": 0.014511417597532272
+  },
+  {
+    "step": 176,
+    "loss": 2.5802009105682373,
+    "diagonal": 2.5680389404296875,
+    "finite": 0.013742327690124512
+  },
+  {
+    "step": 177,
+    "loss": 2.8098881244659424,
+    "diagonal": 2.7962021827697754,
+    "finite": 0.01537744514644146
+  },
+  {
+    "step": 178,
+    "loss": 2.6691439151763916,
+    "diagonal": 2.660597324371338,
+    "finite": 0.009549359790980816
+  },
+  {
+    "step": 179,
+    "loss": 2.475155830383301,
+    "diagonal": 2.460556745529175,
+    "finite": 0.016221173107624054
+  },
+  {
+    "step": 180,
+    "loss": 2.1633079051971436,
+    "diagonal": 2.1524624824523926,
+    "finite": 0.011983795091509819
+  },
+  {
+    "step": 181,
+    "loss": 3.2287936210632324,
+    "diagonal": 3.2152559757232666,
+    "finite": 0.01487664133310318
+  },
+  {
+    "step": 182,
+    "loss": 2.7817366123199463,
+    "diagonal": 2.7699790000915527,
+    "finite": 0.012849866412580013
+  },
+  {
+    "step": 183,
+    "loss": 3.1132261753082275,
+    "diagonal": 3.100051164627075,
+    "finite": 0.014320608228445053
+  },
+  {
+    "step": 184,
+    "loss": 2.6558971405029297,
+    "diagonal": 2.6426544189453125,
+    "finite": 0.01431658398360014
+  },
+  {
+    "step": 185,
+    "loss": 2.5646297931671143,
+    "diagonal": 2.5528972148895264,
+    "finite": 0.012615700252354145
+  },
+  {
+    "step": 186,
+    "loss": 2.6786108016967773,
+    "diagonal": 2.6652348041534424,
+    "finite": 0.014305955730378628
+  },
+  {
+    "step": 187,
+    "loss": 2.3942434787750244,
+    "diagonal": 2.3766191005706787,
+    "finite": 0.018749427050352097
+  },
+  {
+    "step": 188,
+    "loss": 2.268843650817871,
+    "diagonal": 2.2492597103118896,
+    "finite": 0.020723825320601463
+  },
+  {
+    "step": 189,
+    "loss": 2.26401948928833,
+    "diagonal": 2.2439115047454834,
+    "finite": 0.021166229620575905
+  },
+  {
+    "step": 190,
+    "loss": 2.6188299655914307,
+    "diagonal": 2.601729393005371,
+    "finite": 0.01790637895464897
+  },
+  {
+    "step": 191,
+    "loss": 2.3057432174682617,
+    "diagonal": 2.291809558868408,
+    "finite": 0.014514192007482052
+  },
+  {
+    "step": 192,
+    "loss": 2.7183921337127686,
+    "diagonal": 2.707981586456299,
+    "finite": 0.010788042098283768
+  },
+  {
+    "step": 193,
+    "loss": 2.665407180786133,
+    "diagonal": 2.653709650039673,
+    "finite": 0.012059228494763374
+  },
+  {
+    "step": 194,
+    "loss": 3.039119005203247,
+    "diagonal": 3.02227783203125,
+    "finite": 0.017273085191845894
+  },
+  {
+    "step": 195,
+    "loss": 2.6429905891418457,
+    "diagonal": 2.62857985496521,
+    "finite": 0.0147048095241189
+  },
+  {
+    "step": 196,
+    "loss": 2.8859519958496094,
+    "diagonal": 2.8677494525909424,
+    "finite": 0.01847982034087181
+  },
+  {
+    "step": 197,
+    "loss": 2.8265697956085205,
+    "diagonal": 2.8125782012939453,
+    "finite": 0.014132942073047161
+  },
+  {
+    "step": 198,
+    "loss": 2.388136386871338,
+    "diagonal": 2.3698012828826904,
+    "finite": 0.018427357077598572
+  },
+  {
+    "step": 199,
+    "loss": 2.9710419178009033,
+    "diagonal": 2.955562114715576,
+    "finite": 0.015479818917810917
+  },
+  {
+    "step": 200,
+    "loss": 2.736966609954834,
+    "diagonal": 2.7145066261291504,
+    "finite": 0.022460084408521652
+  },
+  {
+    "step": 201,
+    "loss": 2.7420997619628906,
+    "diagonal": 2.7203714847564697,
+    "finite": 0.021728193387389183
+  },
+  {
+    "step": 202,
+    "loss": 2.9358091354370117,
+    "diagonal": 2.9168436527252197,
+    "finite": 0.0189654678106308
+  },
+  {
+    "step": 203,
+    "loss": 3.0445666313171387,
+    "diagonal": 3.0178275108337402,
+    "finite": 0.026739194989204407
+  },
+  {
+    "step": 204,
+    "loss": 2.5906388759613037,
+    "diagonal": 2.5747997760772705,
+    "finite": 0.015838993713259697
+  },
+  {
+    "step": 205,
+    "loss": 2.400822639465332,
+    "diagonal": 2.385371685028076,
+    "finite": 0.015450878068804741
+  },
+  {
+    "step": 206,
+    "loss": 2.7822768688201904,
+    "diagonal": 2.7618112564086914,
+    "finite": 0.02046571858227253
+  },
+  {
+    "step": 207,
+    "loss": 2.916759729385376,
+    "diagonal": 2.906414031982422,
+    "finite": 0.0103457635268569
+  },
+  {
+    "step": 208,
+    "loss": 2.7531421184539795,
+    "diagonal": 2.7345216274261475,
+    "finite": 0.018620574846863747
+  },
+  {
+    "step": 209,
+    "loss": 3.069528102874756,
+    "diagonal": 3.0552635192871094,
+    "finite": 0.014264700002968311
+  },
+  {
+    "step": 210,
+    "loss": 2.2079005241394043,
+    "diagonal": 2.1982715129852295,
+    "finite": 0.009628891944885254
+  },
+  {
+    "step": 211,
+    "loss": 2.6801183223724365,
+    "diagonal": 2.662592887878418,
+    "finite": 0.017525384202599525
+  },
+  {
+    "step": 212,
+    "loss": 2.639012575149536,
+    "diagonal": 2.6231486797332764,
+    "finite": 0.01586395688354969
+  },
+  {
+    "step": 213,
+    "loss": 2.4287362098693848,
+    "diagonal": 2.420091152191162,
+    "finite": 0.008645080029964447
+  },
+  {
+    "step": 214,
+    "loss": 2.289268732070923,
+    "diagonal": 2.2769935131073,
+    "finite": 0.012275158427655697
+  },
+  {
+    "step": 215,
+    "loss": 2.6164064407348633,
+    "diagonal": 2.5959558486938477,
+    "finite": 0.02045070379972458
+  },
+  {
+    "step": 216,
+    "loss": 3.2600977420806885,
+    "diagonal": 3.2469491958618164,
+    "finite": 0.013148538768291473
+  },
+  {
+    "step": 217,
+    "loss": 2.531000852584839,
+    "diagonal": 2.520704746246338,
+    "finite": 0.010296155698597431
+  },
+  {
+    "step": 218,
+    "loss": 2.954817295074463,
+    "diagonal": 2.942671775817871,
+    "finite": 0.012145495042204857
+  },
+  {
+    "step": 219,
+    "loss": 2.544853925704956,
+    "diagonal": 2.5324294567108154,
+    "finite": 0.012424543499946594
+  },
+  {
+    "step": 220,
+    "loss": 2.5018718242645264,
+    "diagonal": 2.4909868240356445,
+    "finite": 0.010884980671107769
+  },
+  {
+    "step": 221,
+    "loss": 2.972114086151123,
+    "diagonal": 2.959521770477295,
+    "finite": 0.012592379003763199
+  },
+  {
+    "step": 222,
+    "loss": 2.6786000728607178,
+    "diagonal": 2.6636111736297607,
+    "finite": 0.014989003539085388
+  },
+  {
+    "step": 223,
+    "loss": 2.55672025680542,
+    "diagonal": 2.5439043045043945,
+    "finite": 0.012815931811928749
+  },
+  {
+    "step": 224,
+    "loss": 2.6105399131774902,
+    "diagonal": 2.5970935821533203,
+    "finite": 0.013446394354104996
+  },
+  {
+    "step": 225,
+    "loss": 2.3477442264556885,
+    "diagonal": 2.333890914916992,
+    "finite": 0.013853220269083977
+  },
+  {
+    "step": 226,
+    "loss": 2.127241373062134,
+    "diagonal": 2.1109566688537598,
+    "finite": 0.016284732148051262
+  },
+  {
+    "step": 227,
+    "loss": 2.4853320121765137,
+    "diagonal": 2.472555160522461,
+    "finite": 0.012776843272149563
+  },
+  {
+    "step": 228,
+    "loss": 3.081733465194702,
+    "diagonal": 3.071962594985962,
+    "finite": 0.009770783595740795
+  },
+  {
+    "step": 229,
+    "loss": 2.3700456619262695,
+    "diagonal": 2.3626809120178223,
+    "finite": 0.0073647452518343925
+  },
+  {
+    "step": 230,
+    "loss": 2.1609678268432617,
+    "diagonal": 2.14410400390625,
+    "finite": 0.01686372421681881
+  },
+  {
+    "step": 231,
+    "loss": 3.3711097240448,
+    "diagonal": 3.361241102218628,
+    "finite": 0.009868727996945381
+  },
+  {
+    "step": 232,
+    "loss": 3.1810781955718994,
+    "diagonal": 3.1630451679229736,
+    "finite": 0.018033040687441826
+  },
+  {
+    "step": 233,
+    "loss": 3.353605031967163,
+    "diagonal": 3.335487127304077,
+    "finite": 0.018117859959602356
+  },
+  {
+    "step": 234,
+    "loss": 2.8374478816986084,
+    "diagonal": 2.8199973106384277,
+    "finite": 0.0174506064504385
+  },
+  {
+    "step": 235,
+    "loss": 3.0654194355010986,
+    "diagonal": 3.049617290496826,
+    "finite": 0.01580207422375679
+  },
+  {
+    "step": 236,
+    "loss": 2.2878739833831787,
+    "diagonal": 2.2751400470733643,
+    "finite": 0.012734047137200832
+  },
+  {
+    "step": 237,
+    "loss": 2.141649007797241,
+    "diagonal": 2.1266989707946777,
+    "finite": 0.014950040727853775
+  },
+  {
+    "step": 238,
+    "loss": 3.1068344116210938,
+    "diagonal": 3.098104238510132,
+    "finite": 0.00873016007244587
+  },
+  {
+    "step": 239,
+    "loss": 2.5417730808258057,
+    "diagonal": 2.527039051055908,
+    "finite": 0.014734060503542423
+  },
+  {
+    "step": 240,
+    "loss": 2.542133092880249,
+    "diagonal": 2.5291242599487305,
+    "finite": 0.013008758425712585
+  },
+  {
+    "step": 241,
+    "loss": 3.1509859561920166,
+    "diagonal": 3.137538194656372,
+    "finite": 0.013447768054902554
+  },
+  {
+    "step": 242,
+    "loss": 2.795067071914673,
+    "diagonal": 2.7741243839263916,
+    "finite": 0.02094278670847416
+  },
+  {
+    "step": 243,
+    "loss": 3.099834680557251,
+    "diagonal": 3.088301658630371,
+    "finite": 0.011533111333847046
+  },
+  {
+    "step": 244,
+    "loss": 3.1919777393341064,
+    "diagonal": 3.1832473278045654,
+    "finite": 0.008730524219572544
+  },
+  {
+    "step": 245,
+    "loss": 3.0343735218048096,
+    "diagonal": 3.0245139598846436,
+    "finite": 0.009859630838036537
+  },
+  {
+    "step": 246,
+    "loss": 2.697540760040283,
+    "diagonal": 2.690580129623413,
+    "finite": 0.006960537284612656
+  },
+  {
+    "step": 247,
+    "loss": 2.812931776046753,
+    "diagonal": 2.799456834793091,
+    "finite": 0.013474959880113602
+  },
+  {
+    "step": 248,
+    "loss": 3.3328099250793457,
+    "diagonal": 3.3236894607543945,
+    "finite": 0.009120462462306023
+  },
+  {
+    "step": 249,
+    "loss": 2.739691734313965,
+    "diagonal": 2.7272932529449463,
+    "finite": 0.012398521415889263
+  },
+  {
+    "step": 250,
+    "loss": 2.7690746784210205,
+    "diagonal": 2.755732536315918,
+    "finite": 0.013342252001166344
+  },
+  {
+    "step": 251,
+    "loss": 2.3322670459747314,
+    "diagonal": 2.3210136890411377,
+    "finite": 0.01125343143939972
+  },
+  {
+    "step": 252,
+    "loss": 2.8368263244628906,
+    "diagonal": 2.82462477684021,
+    "finite": 0.01220166590064764
+  },
+  {
+    "step": 253,
+    "loss": 2.6759605407714844,
+    "diagonal": 2.6678543090820312,
+    "finite": 0.00810632947832346
+  },
+  {
+    "step": 254,
+    "loss": 2.409531593322754,
+    "diagonal": 2.3985438346862793,
+    "finite": 0.010987839661538601
+  },
+  {
+    "step": 255,
+    "loss": 2.9031200408935547,
+    "diagonal": 2.8952341079711914,
+    "finite": 0.007886026985943317
+  },
+  {
+    "step": 256,
+    "loss": 2.555025577545166,
+    "diagonal": 2.547045946121216,
+    "finite": 0.007979736663401127
+  },
+  {
+    "step": 257,
+    "loss": 2.033874750137329,
+    "diagonal": 2.023993730545044,
+    "finite": 0.009881081059575081
+  },
+  {
+    "step": 258,
+    "loss": 1.9813464879989624,
+    "diagonal": 1.9746381044387817,
+    "finite": 0.006708428263664246
+  },
+  {
+    "step": 259,
+    "loss": 3.163313150405884,
+    "diagonal": 3.1514015197753906,
+    "finite": 0.01191171258687973
+  },
+  {
+    "step": 260,
+    "loss": 2.484018564224243,
+    "diagonal": 2.474055528640747,
+    "finite": 0.00996306911110878
+  },
+  {
+    "step": 261,
+    "loss": 2.6783447265625,
+    "diagonal": 2.6687090396881104,
+    "finite": 0.009635605849325657
+  },
+  {
+    "step": 262,
+    "loss": 1.9616204500198364,
+    "diagonal": 1.9463951587677002,
+    "finite": 0.01522526703774929
+  },
+  {
+    "step": 263,
+    "loss": 2.3773505687713623,
+    "diagonal": 2.3671610355377197,
+    "finite": 0.010189637541770935
+  },
+  {
+    "step": 264,
+    "loss": 3.1063270568847656,
+    "diagonal": 3.0915446281433105,
+    "finite": 0.01478242315351963
+  },
+  {
+    "step": 265,
+    "loss": 2.503880023956299,
+    "diagonal": 2.4870283603668213,
+    "finite": 0.01685178279876709
+  },
+  {
+    "step": 266,
+    "loss": 2.298175811767578,
+    "diagonal": 2.280113935470581,
+    "finite": 0.018061961978673935
+  },
+  {
+    "step": 267,
+    "loss": 2.5146729946136475,
+    "diagonal": 2.507425308227539,
+    "finite": 0.0072477697394788265
+  },
+  {
+    "step": 268,
+    "loss": 2.7076919078826904,
+    "diagonal": 2.694730281829834,
+    "finite": 0.012961550615727901
+  },
+  {
+    "step": 269,
+    "loss": 3.3228790760040283,
+    "diagonal": 3.3077733516693115,
+    "finite": 0.015105743892490864
+  },
+  {
+    "step": 270,
+    "loss": 2.8122479915618896,
+    "diagonal": 2.8008522987365723,
+    "finite": 0.011395731009542942
+  },
+  {
+    "step": 271,
+    "loss": 2.408169984817505,
+    "diagonal": 2.395827531814575,
+    "finite": 0.012342526577413082
+  },
+  {
+    "step": 272,
+    "loss": 2.271034002304077,
+    "diagonal": 2.2617099285125732,
+    "finite": 0.00932404026389122
+  },
+  {
+    "step": 273,
+    "loss": 2.449864625930786,
+    "diagonal": 2.4381027221679688,
+    "finite": 0.011761789210140705
+  },
+  {
+    "step": 274,
+    "loss": 2.9424548149108887,
+    "diagonal": 2.933293581008911,
+    "finite": 0.009161208756268024
+  },
+  {
+    "step": 275,
+    "loss": 3.5095794200897217,
+    "diagonal": 3.4900760650634766,
+    "finite": 0.01950344629585743
+  },
+  {
+    "step": 276,
+    "loss": 2.464221715927124,
+    "diagonal": 2.4529733657836914,
+    "finite": 0.01124824583530426
+  },
+  {
+    "step": 277,
+    "loss": 2.399311065673828,
+    "diagonal": 2.390585422515869,
+    "finite": 0.008725638501346111
+  },
+  {
+    "step": 278,
+    "loss": 2.0561742782592773,
+    "diagonal": 2.046384334564209,
+    "finite": 0.00978995580226183
+  },
+  {
+    "step": 279,
+    "loss": 2.656677722930908,
+    "diagonal": 2.6486854553222656,
+    "finite": 0.007992359809577465
+  },
+  {
+    "step": 280,
+    "loss": 2.6441264152526855,
+    "diagonal": 2.6319470405578613,
+    "finite": 0.012179371900856495
+  },
+  {
+    "step": 281,
+    "loss": 2.4035465717315674,
+    "diagonal": 2.393202781677246,
+    "finite": 0.010343854315578938
+  },
+  {
+    "step": 282,
+    "loss": 2.8304691314697266,
+    "diagonal": 2.8175876140594482,
+    "finite": 0.012881437316536903
+  },
+  {
+    "step": 283,
+    "loss": 2.5867044925689697,
+    "diagonal": 2.5797293186187744,
+    "finite": 0.006975248921662569
+  },
+  {
+    "step": 284,
+    "loss": 1.7794352769851685,
+    "diagonal": 1.7693039178848267,
+    "finite": 0.010131318122148514
+  },
+  {
+    "step": 285,
+    "loss": 2.5030453205108643,
+    "diagonal": 2.494405508041382,
+    "finite": 0.0086398646235466
+  },
+  {
+    "step": 286,
+    "loss": 2.3861331939697266,
+    "diagonal": 2.3741402626037598,
+    "finite": 0.011992995627224445
+  },
+  {
+    "step": 287,
+    "loss": 2.2806334495544434,
+    "diagonal": 2.2696313858032227,
+    "finite": 0.01100213173776865
+  },
+  {
+    "step": 288,
+    "loss": 2.76460599899292,
+    "diagonal": 2.752224922180176,
+    "finite": 0.012381145730614662
+  },
+  {
+    "step": 289,
+    "loss": 2.8456485271453857,
+    "diagonal": 2.8282055854797363,
+    "finite": 0.01744283363223076
+  },
+  {
+    "step": 290,
+    "loss": 2.785245418548584,
+    "diagonal": 2.7732961177825928,
+    "finite": 0.01194925419986248
+  },
+  {
+    "step": 291,
+    "loss": 2.1325769424438477,
+    "diagonal": 2.121781826019287,
+    "finite": 0.010795040056109428
+  },
+  {
+    "step": 292,
+    "loss": 2.9640889167785645,
+    "diagonal": 2.9465246200561523,
+    "finite": 0.01756434142589569
+  },
+  {
+    "step": 293,
+    "loss": 2.303900718688965,
+    "diagonal": 2.2796120643615723,
+    "finite": 0.024288663640618324
+  },
+  {
+    "step": 294,
+    "loss": 3.0492749214172363,
+    "diagonal": 3.030745029449463,
+    "finite": 0.01852988824248314
+  },
+  {
+    "step": 295,
+    "loss": 2.9919493198394775,
+    "diagonal": 2.9726662635803223,
+    "finite": 0.019283132627606392
+  },
+  {
+    "step": 296,
+    "loss": 2.9974477291107178,
+    "diagonal": 2.975691556930542,
+    "finite": 0.02175607532262802
+  },
+  {
+    "step": 297,
+    "loss": 2.4499740600585938,
+    "diagonal": 2.4272468090057373,
+    "finite": 0.022727182134985924
+  },
+  {
+    "step": 298,
+    "loss": 2.564258575439453,
+    "diagonal": 2.547086238861084,
+    "finite": 0.01717241294682026
+  },
+  {
+    "step": 299,
+    "loss": 2.5098912715911865,
+    "diagonal": 2.492670774459839,
+    "finite": 0.017220407724380493
+  },
+  {
+    "step": 300,
+    "loss": 2.4510934352874756,
+    "diagonal": 2.4310057163238525,
+    "finite": 0.02008778229355812
+  },
+  {
+    "step": 301,
+    "loss": 2.6696670055389404,
+    "diagonal": 2.6498637199401855,
+    "finite": 0.019803214818239212
+  },
+  {
+    "step": 302,
+    "loss": 2.6813933849334717,
+    "diagonal": 2.6675612926483154,
+    "finite": 0.013831991702318192
+  },
+  {
+    "step": 303,
+    "loss": 2.6274502277374268,
+    "diagonal": 2.612560987472534,
+    "finite": 0.01488933339715004
+  },
+  {
+    "step": 304,
+    "loss": 3.065904378890991,
+    "diagonal": 3.048213005065918,
+    "finite": 0.01769140735268593
+  },
+  {
+    "step": 305,
+    "loss": 2.666668176651001,
+    "diagonal": 2.649751901626587,
+    "finite": 0.01691620424389839
+  },
+  {
+    "step": 306,
+    "loss": 2.552988052368164,
+    "diagonal": 2.541890859603882,
+    "finite": 0.011097078211605549
+  },
+  {
+    "step": 307,
+    "loss": 2.87536358833313,
+    "diagonal": 2.854930877685547,
+    "finite": 0.02043270692229271
+  },
+  {
+    "step": 308,
+    "loss": 2.590073823928833,
+    "diagonal": 2.563659191131592,
+    "finite": 0.026414748281240463
+  },
+  {
+    "step": 309,
+    "loss": 2.3926022052764893,
+    "diagonal": 2.374727249145508,
+    "finite": 0.01787489466369152
+  },
+  {
+    "step": 310,
+    "loss": 2.4780197143554688,
+    "diagonal": 2.4583847522735596,
+    "finite": 0.01963489130139351
+  },
+  {
+    "step": 311,
+    "loss": 2.6237504482269287,
+    "diagonal": 2.606776237487793,
+    "finite": 0.016974320635199547
+  },
+  {
+    "step": 312,
+    "loss": 2.775555372238159,
+    "diagonal": 2.756730079650879,
+    "finite": 0.01882535219192505
+  },
+  {
+    "step": 313,
+    "loss": 2.0587761402130127,
+    "diagonal": 2.0394256114959717,
+    "finite": 0.01935051940381527
+  },
+  {
+    "step": 314,
+    "loss": 2.4154717922210693,
+    "diagonal": 2.393209218978882,
+    "finite": 0.022262483835220337
+  },
+  {
+    "step": 315,
+    "loss": 2.6225686073303223,
+    "diagonal": 2.609666109085083,
+    "finite": 0.01290261559188366
+  },
+  {
+    "step": 316,
+    "loss": 3.0319247245788574,
+    "diagonal": 3.0120530128479004,
+    "finite": 0.01987174153327942
+  },
+  {
+    "step": 317,
+    "loss": 2.4224677085876465,
+    "diagonal": 2.403700113296509,
+    "finite": 0.018767600879073143
+  },
+  {
+    "step": 318,
+    "loss": 2.2859411239624023,
+    "diagonal": 2.26535701751709,
+    "finite": 0.02058412693440914
+  },
+  {
+    "step": 319,
+    "loss": 2.9183661937713623,
+    "diagonal": 2.898487091064453,
+    "finite": 0.01987914927303791
+  },
+  {
+    "step": 320,
+    "loss": 2.887664794921875,
+    "diagonal": 2.865224838256836,
+    "finite": 0.022439932450652122
+  },
+  {
+    "step": 321,
+    "loss": 2.57673978805542,
+    "diagonal": 2.5630762577056885,
+    "finite": 0.013663549907505512
+  },
+  {
+    "step": 322,
+    "loss": 2.394484758377075,
+    "diagonal": 2.373870849609375,
+    "finite": 0.02061392553150654
+  },
+  {
+    "step": 323,
+    "loss": 2.707272529602051,
+    "diagonal": 2.6743345260620117,
+    "finite": 0.032937996089458466
+  },
+  {
+    "step": 324,
+    "loss": 2.016047954559326,
+    "diagonal": 1.994813084602356,
+    "finite": 0.021234827116131783
+  },
+  {
+    "step": 325,
+    "loss": 2.224440097808838,
+    "diagonal": 2.198373556137085,
+    "finite": 0.026066459715366364
+  },
+  {
+    "step": 326,
+    "loss": 2.599313735961914,
+    "diagonal": 2.5655808448791504,
+    "finite": 0.033732928335666656
+  },
+  {
+    "step": 327,
+    "loss": 2.243192195892334,
+    "diagonal": 2.2149412631988525,
+    "finite": 0.028250878676772118
+  },
+  {
+    "step": 328,
+    "loss": 2.4951906204223633,
+    "diagonal": 2.4701011180877686,
+    "finite": 0.02508949674665928
+  },
+  {
+    "step": 329,
+    "loss": 2.783118963241577,
+    "diagonal": 2.743489980697632,
+    "finite": 0.039628997445106506
+  },
+  {
+    "step": 330,
+    "loss": 2.0222301483154297,
+    "diagonal": 1.988020658493042,
+    "finite": 0.03420957177877426
+  },
+  {
+    "step": 331,
+    "loss": 2.3112852573394775,
+    "diagonal": 2.2860968112945557,
+    "finite": 0.0251883827149868
+  },
+  {
+    "step": 332,
+    "loss": 2.466691255569458,
+    "diagonal": 2.4474494457244873,
+    "finite": 0.01924189180135727
+  },
+  {
+    "step": 333,
+    "loss": 2.162443161010742,
+    "diagonal": 2.141692876815796,
+    "finite": 0.02075018733739853
+  },
+  {
+    "step": 334,
+    "loss": 2.574559211730957,
+    "diagonal": 2.557621717453003,
+    "finite": 0.01693740114569664
+  },
+  {
+    "step": 335,
+    "loss": 2.2798895835876465,
+    "diagonal": 2.261749267578125,
+    "finite": 0.018140360713005066
+  },
+  {
+    "step": 336,
+    "loss": 2.9897494316101074,
+    "diagonal": 2.9695394039154053,
+    "finite": 0.020210137590765953
+  },
+  {
+    "step": 337,
+    "loss": 2.9593372344970703,
+    "diagonal": 2.9430267810821533,
+    "finite": 0.016310514882206917
+  },
+  {
+    "step": 338,
+    "loss": 2.6790847778320312,
+    "diagonal": 2.6631665229797363,
+    "finite": 0.015918349847197533
+  },
+  {
+    "step": 339,
+    "loss": 2.1516776084899902,
+    "diagonal": 2.124943256378174,
+    "finite": 0.026734357699751854
+  },
+  {
+    "step": 340,
+    "loss": 2.3699400424957275,
+    "diagonal": 2.3439364433288574,
+    "finite": 0.026003606617450714
+  },
+  {
+    "step": 341,
+    "loss": 2.6679999828338623,
+    "diagonal": 2.652539014816284,
+    "finite": 0.015461082570254803
+  },
+  {
+    "step": 342,
+    "loss": 3.0122225284576416,
+    "diagonal": 2.98553466796875,
+    "finite": 0.02668784186244011
+  },
+  {
+    "step": 343,
+    "loss": 2.0247302055358887,
+    "diagonal": 1.9949307441711426,
+    "finite": 0.02979934588074684
+  },
+  {
+    "step": 344,
+    "loss": 2.128457546234131,
+    "diagonal": 2.1128439903259277,
+    "finite": 0.015613664872944355
+  },
+  {
+    "step": 345,
+    "loss": 2.42826771736145,
+    "diagonal": 2.4162585735321045,
+    "finite": 0.01200914941728115
+  },
+  {
+    "step": 346,
+    "loss": 2.6818106174468994,
+    "diagonal": 2.662240505218506,
+    "finite": 0.019570181146264076
+  },
+  {
+    "step": 347,
+    "loss": 2.257538080215454,
+    "diagonal": 2.2382357120513916,
+    "finite": 0.019302284345030785
+  },
+  {
+    "step": 348,
+    "loss": 2.432727336883545,
+    "diagonal": 2.4169743061065674,
+    "finite": 0.015753094106912613
+  },
+  {
+    "step": 349,
+    "loss": 2.7972450256347656,
+    "diagonal": 2.7768337726593018,
+    "finite": 0.020411353558301926
+  },
+  {
+    "step": 350,
+    "loss": 2.417168140411377,
+    "diagonal": 2.3878514766693115,
+    "finite": 0.029316546395421028
+  },
+  {
+    "step": 351,
+    "loss": 2.3290481567382812,
+    "diagonal": 2.3069145679473877,
+    "finite": 0.022133581340312958
+  },
+  {
+    "step": 352,
+    "loss": 2.0148468017578125,
+    "diagonal": 1.9896901845932007,
+    "finite": 0.025156717747449875
+  },
+  {
+    "step": 353,
+    "loss": 2.384326696395874,
+    "diagonal": 2.368920087814331,
+    "finite": 0.015406494028866291
+  },
+  {
+    "step": 354,
+    "loss": 2.1812171936035156,
+    "diagonal": 2.1624157428741455,
+    "finite": 0.018801353871822357
+  },
+  {
+    "step": 355,
+    "loss": 2.1436734199523926,
+    "diagonal": 2.116762638092041,
+    "finite": 0.026910677552223206
+  },
+  {
+    "step": 356,
+    "loss": 1.9545422792434692,
+    "diagonal": 1.935915470123291,
+    "finite": 0.01862683892250061
+  },
+  {
+    "step": 357,
+    "loss": 2.6623458862304688,
+    "diagonal": 2.6406397819519043,
+    "finite": 0.021706191822886467
+  },
+  {
+    "step": 358,
+    "loss": 2.4968385696411133,
+    "diagonal": 2.471587896347046,
+    "finite": 0.025250669568777084
+  },
+  {
+    "step": 359,
+    "loss": 2.4681966304779053,
+    "diagonal": 2.4476208686828613,
+    "finite": 0.02057577483355999
+  },
+  {
+    "step": 360,
+    "loss": 2.5406997203826904,
+    "diagonal": 2.5170023441314697,
+    "finite": 0.023697445169091225
+  },
+  {
+    "step": 361,
+    "loss": 2.9393279552459717,
+    "diagonal": 2.9197473526000977,
+    "finite": 0.019580543041229248
+  },
+  {
+    "step": 362,
+    "loss": 2.3519046306610107,
+    "diagonal": 2.317718029022217,
+    "finite": 0.034186575561761856
+  },
+  {
+    "step": 363,
+    "loss": 2.4587104320526123,
+    "diagonal": 2.4361469745635986,
+    "finite": 0.022563433274626732
+  },
+  {
+    "step": 364,
+    "loss": 2.635934829711914,
+    "diagonal": 2.6060471534729004,
+    "finite": 0.029887711629271507
+  },
+  {
+    "step": 365,
+    "loss": 2.4347317218780518,
+    "diagonal": 2.4170055389404297,
+    "finite": 0.017726080492138863
+  },
+  {
+    "step": 366,
+    "loss": 2.320429801940918,
+    "diagonal": 2.2794668674468994,
+    "finite": 0.04096294194459915
+  },
+  {
+    "step": 367,
+    "loss": 2.2698147296905518,
+    "diagonal": 2.2495858669281006,
+    "finite": 0.020228758454322815
+  },
+  {
+    "step": 368,
+    "loss": 2.632786512374878,
+    "diagonal": 2.6153101921081543,
+    "finite": 0.017476387321949005
+  },
+  {
+    "step": 369,
+    "loss": 2.8418502807617188,
+    "diagonal": 2.8166937828063965,
+    "finite": 0.025156617164611816
+  },
+  {
+    "step": 370,
+    "loss": 2.512066125869751,
+    "diagonal": 2.485750675201416,
+    "finite": 0.026315458118915558
+  },
+  {
+    "step": 371,
+    "loss": 1.9169847965240479,
+    "diagonal": 1.899730920791626,
+    "finite": 0.017253883183002472
+  },
+  {
+    "step": 372,
+    "loss": 2.306356906890869,
+    "diagonal": 2.2666730880737305,
+    "finite": 0.03968386352062225
+  },
+  {
+    "step": 373,
+    "loss": 2.0829741954803467,
+    "diagonal": 2.0509114265441895,
+    "finite": 0.03206279128789902
+  },
+  {
+    "step": 374,
+    "loss": 2.680131196975708,
+    "diagonal": 2.6548805236816406,
+    "finite": 0.025250591337680817
+  },
+  {
+    "step": 375,
+    "loss": 2.759338140487671,
+    "diagonal": 2.7174196243286133,
+    "finite": 0.04191846400499344
+  },
+  {
+    "step": 376,
+    "loss": 1.9065359830856323,
+    "diagonal": 1.876851201057434,
+    "finite": 0.029684776440262794
+  },
+  {
+    "step": 377,
+    "loss": 2.325517177581787,
+    "diagonal": 2.3029677867889404,
+    "finite": 0.022549359127879143
+  },
+  {
+    "step": 378,
+    "loss": 2.582890033721924,
+    "diagonal": 2.565241813659668,
+    "finite": 0.017648186534643173
+  },
+  {
+    "step": 379,
+    "loss": 2.8729915618896484,
+    "diagonal": 2.8414907455444336,
+    "finite": 0.031500887125730515
+  },
+  {
+    "step": 380,
+    "loss": 2.9836020469665527,
+    "diagonal": 2.9558281898498535,
+    "finite": 0.027773747220635414
+  },
+  {
+    "step": 381,
+    "loss": 2.5902392864227295,
+    "diagonal": 2.5636332035064697,
+    "finite": 0.02660614252090454
+  },
+  {
+    "step": 382,
+    "loss": 2.2754464149475098,
+    "diagonal": 2.2545511722564697,
+    "finite": 0.02089523896574974
+  },
+  {
+    "step": 383,
+    "loss": 2.236215353012085,
+    "diagonal": 2.1730244159698486,
+    "finite": 0.06319093704223633
+  },
+  {
+    "step": 384,
+    "loss": 2.554453134536743,
+    "diagonal": 2.5167274475097656,
+    "finite": 0.03772559016942978
+  },
+  {
+    "step": 385,
+    "loss": 1.9715766906738281,
+    "diagonal": 1.939239263534546,
+    "finite": 0.032337434589862823
+  },
+  {
+    "step": 386,
+    "loss": 2.5706658363342285,
+    "diagonal": 2.552985668182373,
+    "finite": 0.017680156975984573
+  },
+  {
+    "step": 387,
+    "loss": 2.7261922359466553,
+    "diagonal": 2.683443784713745,
+    "finite": 0.04274837672710419
+  },
+  {
+    "step": 388,
+    "loss": 2.4502949714660645,
+    "diagonal": 2.4297432899475098,
+    "finite": 0.020551731809973717
+  },
+  {
+    "step": 389,
+    "loss": 2.379514694213867,
+    "diagonal": 2.3557801246643066,
+    "finite": 0.02373453974723816
+  },
+  {
+    "step": 390,
+    "loss": 2.2772414684295654,
+    "diagonal": 2.245542049407959,
+    "finite": 0.03169937804341316
+  },
+  {
+    "step": 391,
+    "loss": 2.7973690032958984,
+    "diagonal": 2.7814271450042725,
+    "finite": 0.015941785648465157
+  },
+  {
+    "step": 392,
+    "loss": 2.2226064205169678,
+    "diagonal": 2.1902177333831787,
+    "finite": 0.032388631254434586
+  },
+  {
+    "step": 393,
+    "loss": 2.501002073287964,
+    "diagonal": 2.4707586765289307,
+    "finite": 0.030243366956710815
+  },
+  {
+    "step": 394,
+    "loss": 2.9387707710266113,
+    "diagonal": 2.916102409362793,
+    "finite": 0.02266840636730194
+  },
+  {
+    "step": 395,
+    "loss": 2.659243583679199,
+    "diagonal": 2.6331870555877686,
+    "finite": 0.02605646476149559
+  },
+  {
+    "step": 396,
+    "loss": 2.120070457458496,
+    "diagonal": 2.0981850624084473,
+    "finite": 0.02188531868159771
+  },
+  {
+    "step": 397,
+    "loss": 2.7361831665039062,
+    "diagonal": 2.7136728763580322,
+    "finite": 0.022510375827550888
+  },
+  {
+    "step": 398,
+    "loss": 1.848612666130066,
+    "diagonal": 1.8143892288208008,
+    "finite": 0.03422338888049126
+  },
+  {
+    "step": 399,
+    "loss": 1.9365017414093018,
+    "diagonal": 1.9200212955474854,
+    "finite": 0.016480395570397377
+  },
+  {
+    "step": 400,
+    "loss": 2.761418104171753,
+    "diagonal": 2.742659091949463,
+    "finite": 0.01875891163945198
+  },
+  {
+    "step": 401,
+    "loss": 2.436488151550293,
+    "diagonal": 2.4101381301879883,
+    "finite": 0.02635013498365879
+  },
+  {
+    "step": 402,
+    "loss": 2.212871551513672,
+    "diagonal": 2.171854019165039,
+    "finite": 0.04101764038205147
+  },
+  {
+    "step": 403,
+    "loss": 2.3021087646484375,
+    "diagonal": 2.2576048374176025,
+    "finite": 0.04450399428606033
+  },
+  {
+    "step": 404,
+    "loss": 2.583158493041992,
+    "diagonal": 2.552116632461548,
+    "finite": 0.031041840091347694
+  },
+  {
+    "step": 405,
+    "loss": 2.6783525943756104,
+    "diagonal": 2.6619324684143066,
+    "finite": 0.016420073807239532
+  },
+  {
+    "step": 406,
+    "loss": 2.3127050399780273,
+    "diagonal": 2.263417959213257,
+    "finite": 0.04928700998425484
+  },
+  {
+    "step": 407,
+    "loss": 2.36057448387146,
+    "diagonal": 2.3350465297698975,
+    "finite": 0.025527970865368843
+  },
+  {
+    "step": 408,
+    "loss": 2.385451555252075,
+    "diagonal": 2.363499879837036,
+    "finite": 0.021951710805296898
+  },
+  {
+    "step": 409,
+    "loss": 2.6408631801605225,
+    "diagonal": 2.6103456020355225,
+    "finite": 0.030517466366291046
+  },
+  {
+    "step": 410,
+    "loss": 2.460874557495117,
+    "diagonal": 2.4346282482147217,
+    "finite": 0.02624623477458954
+  },
+  {
+    "step": 411,
+    "loss": 2.7613041400909424,
+    "diagonal": 2.7422168254852295,
+    "finite": 0.019087372347712517
+  },
+  {
+    "step": 412,
+    "loss": 2.350637912750244,
+    "diagonal": 2.3215835094451904,
+    "finite": 0.029054410755634308
+  },
+  {
+    "step": 413,
+    "loss": 2.6339967250823975,
+    "diagonal": 2.608734130859375,
+    "finite": 0.025262491777539253
+  },
+  {
+    "step": 414,
+    "loss": 2.7386417388916016,
+    "diagonal": 2.716050386428833,
+    "finite": 0.02259136363863945
+  },
+  {
+    "step": 415,
+    "loss": 2.287243127822876,
+    "diagonal": 2.2636399269104004,
+    "finite": 0.023603254929184914
+  },
+  {
+    "step": 416,
+    "loss": 1.9976441860198975,
+    "diagonal": 1.9761863946914673,
+    "finite": 0.02145773358643055
+  },
+  {
+    "step": 417,
+    "loss": 2.6573896408081055,
+    "diagonal": 2.6390373706817627,
+    "finite": 0.01835235208272934
+  },
+  {
+    "step": 418,
+    "loss": 2.2702364921569824,
+    "diagonal": 2.2471859455108643,
+    "finite": 0.023050442337989807
+  },
+  {
+    "step": 419,
+    "loss": 2.525864601135254,
+    "diagonal": 2.502393960952759,
+    "finite": 0.023470574989914894
+  },
+  {
+    "step": 420,
+    "loss": 2.341801881790161,
+    "diagonal": 2.3240885734558105,
+    "finite": 0.017713382840156555
+  },
+  {
+    "step": 421,
+    "loss": 2.5820183753967285,
+    "diagonal": 2.5518651008605957,
+    "finite": 0.03015335090458393
+  },
+  {
+    "step": 422,
+    "loss": 2.19335675239563,
+    "diagonal": 2.173156976699829,
+    "finite": 0.02019982971251011
+  },
+  {
+    "step": 423,
+    "loss": 2.6017329692840576,
+    "diagonal": 2.585383176803589,
+    "finite": 0.01634976640343666
+  },
+  {
+    "step": 424,
+    "loss": 2.126086950302124,
+    "diagonal": 2.108991861343384,
+    "finite": 0.017095163464546204
+  },
+  {
+    "step": 425,
+    "loss": 2.080256938934326,
+    "diagonal": 2.0641791820526123,
+    "finite": 0.016077648848295212
+  },
+  {
+    "step": 426,
+    "loss": 2.0929598808288574,
+    "diagonal": 2.0812950134277344,
+    "finite": 0.011664771474897861
+  },
+  {
+    "step": 427,
+    "loss": 1.963409662246704,
+    "diagonal": 1.9432930946350098,
+    "finite": 0.020116567611694336
+  },
+  {
+    "step": 428,
+    "loss": 2.785489559173584,
+    "diagonal": 2.7696447372436523,
+    "finite": 0.015844739973545074
+  },
+  {
+    "step": 429,
+    "loss": 2.27799916267395,
+    "diagonal": 2.255491256713867,
+    "finite": 0.022507978603243828
+  },
+  {
+    "step": 430,
+    "loss": 2.4927871227264404,
+    "diagonal": 2.481069564819336,
+    "finite": 0.011717526242136955
+  },
+  {
+    "step": 431,
+    "loss": 2.005403757095337,
+    "diagonal": 1.9898039102554321,
+    "finite": 0.01559985987842083
+  },
+  {
+    "step": 432,
+    "loss": 2.145001173019409,
+    "diagonal": 2.1057302951812744,
+    "finite": 0.03927084058523178
+  },
+  {
+    "step": 433,
+    "loss": 2.4732303619384766,
+    "diagonal": 2.440415143966675,
+    "finite": 0.03281530737876892
+  },
+  {
+    "step": 434,
+    "loss": 2.463834762573242,
+    "diagonal": 2.4472193717956543,
+    "finite": 0.016615290194749832
+  },
+  {
+    "step": 435,
+    "loss": 2.400049924850464,
+    "diagonal": 2.3885021209716797,
+    "finite": 0.01154776569455862
+  },
+  {
+    "step": 436,
+    "loss": 2.881603956222534,
+    "diagonal": 2.8625121116638184,
+    "finite": 0.019091838970780373
+  },
+  {
+    "step": 437,
+    "loss": 2.697925329208374,
+    "diagonal": 2.6800742149353027,
+    "finite": 0.017851101234555244
+  },
+  {
+    "step": 438,
+    "loss": 2.402255058288574,
+    "diagonal": 2.3869667053222656,
+    "finite": 0.015288358554244041
+  },
+  {
+    "step": 439,
+    "loss": 1.9143368005752563,
+    "diagonal": 1.8881624937057495,
+    "finite": 0.026174351572990417
+  },
+  {
+    "step": 440,
+    "loss": 2.757874011993408,
+    "diagonal": 2.742699384689331,
+    "finite": 0.015174707397818565
+  },
+  {
+    "step": 441,
+    "loss": 2.6737616062164307,
+    "diagonal": 2.6582119464874268,
+    "finite": 0.015549736097455025
+  },
+  {
+    "step": 442,
+    "loss": 2.227421998977661,
+    "diagonal": 2.1982507705688477,
+    "finite": 0.02917134203016758
+  },
+  {
+    "step": 443,
+    "loss": 2.2881054878234863,
+    "diagonal": 2.257514715194702,
+    "finite": 0.030590714886784554
+  },
+  {
+    "step": 444,
+    "loss": 2.3754472732543945,
+    "diagonal": 2.355984687805176,
+    "finite": 0.01946249231696129
+  },
+  {
+    "step": 445,
+    "loss": 2.5975441932678223,
+    "diagonal": 2.5832531452178955,
+    "finite": 0.014290973544120789
+  },
+  {
+    "step": 446,
+    "loss": 2.806967258453369,
+    "diagonal": 2.7895607948303223,
+    "finite": 0.017406392842531204
+  },
+  {
+    "step": 447,
+    "loss": 2.8707525730133057,
+    "diagonal": 2.857783794403076,
+    "finite": 0.01296878233551979
+  },
+  {
+    "step": 448,
+    "loss": 2.325453042984009,
+    "diagonal": 2.2944321632385254,
+    "finite": 0.031020846217870712
+  },
+  {
+    "step": 449,
+    "loss": 2.224703788757324,
+    "diagonal": 2.207085371017456,
+    "finite": 0.017618313431739807
+  },
+  {
+    "step": 450,
+    "loss": 2.254141330718994,
+    "diagonal": 2.235194444656372,
+    "finite": 0.018946891650557518
+  },
+  {
+    "step": 451,
+    "loss": 2.916132688522339,
+    "diagonal": 2.8862526416778564,
+    "finite": 0.02987997978925705
+  },
+  {
+    "step": 452,
+    "loss": 2.2756195068359375,
+    "diagonal": 2.256155014038086,
+    "finite": 0.01946447789669037
+  },
+  {
+    "step": 453,
+    "loss": 2.5493314266204834,
+    "diagonal": 2.518796920776367,
+    "finite": 0.0305344145745039
+  },
+  {
+    "step": 454,
+    "loss": 2.0224387645721436,
+    "diagonal": 1.992209553718567,
+    "finite": 0.030229292809963226
+  },
+  {
+    "step": 455,
+    "loss": 2.1210744380950928,
+    "diagonal": 2.099865436553955,
+    "finite": 0.02120889350771904
+  },
+  {
+    "step": 456,
+    "loss": 2.673598527908325,
+    "diagonal": 2.6483495235443115,
+    "finite": 0.025248944759368896
+  },
+  {
+    "step": 457,
+    "loss": 2.3155925273895264,
+    "diagonal": 2.2811226844787598,
+    "finite": 0.034469831734895706
+  },
+  {
+    "step": 458,
+    "loss": 2.3941032886505127,
+    "diagonal": 2.3660550117492676,
+    "finite": 0.02804817445576191
+  },
+  {
+    "step": 459,
+    "loss": 2.5658059120178223,
+    "diagonal": 2.5515685081481934,
+    "finite": 0.014237476512789726
+  },
+  {
+    "step": 460,
+    "loss": 1.9157822132110596,
+    "diagonal": 1.8959858417510986,
+    "finite": 0.019796352833509445
+  },
+  {
+    "step": 461,
+    "loss": 2.707364559173584,
+    "diagonal": 2.6785528659820557,
+    "finite": 0.02881161868572235
+  },
+  {
+    "step": 462,
+    "loss": 2.335437059402466,
+    "diagonal": 2.3064277172088623,
+    "finite": 0.02900930866599083
+  },
+  {
+    "step": 463,
+    "loss": 2.2865138053894043,
+    "diagonal": 2.2608463764190674,
+    "finite": 0.025667525827884674
+  },
+  {
+    "step": 464,
+    "loss": 2.1400303840637207,
+    "diagonal": 2.1088526248931885,
+    "finite": 0.03117767535150051
+  },
+  {
+    "step": 465,
+    "loss": 2.355607509613037,
+    "diagonal": 2.325742721557617,
+    "finite": 0.029864784330129623
+  },
+  {
+    "step": 466,
+    "loss": 2.482421398162842,
+    "diagonal": 2.456669330596924,
+    "finite": 0.02575208619236946
+  },
+  {
+    "step": 467,
+    "loss": 3.0462851524353027,
+    "diagonal": 3.0212655067443848,
+    "finite": 0.025019625201821327
+  },
+  {
+    "step": 468,
+    "loss": 2.0748727321624756,
+    "diagonal": 2.0545401573181152,
+    "finite": 0.020332634449005127
+  },
+  {
+    "step": 469,
+    "loss": 2.2474029064178467,
+    "diagonal": 2.2109274864196777,
+    "finite": 0.036475326865911484
+  },
+  {
+    "step": 470,
+    "loss": 1.9466495513916016,
+    "diagonal": 1.929999589920044,
+    "finite": 0.016649989411234856
+  },
+  {
+    "step": 471,
+    "loss": 1.9419516324996948,
+    "diagonal": 1.9202522039413452,
+    "finite": 0.021699370816349983
+  },
+  {
+    "step": 472,
+    "loss": 2.071229934692383,
+    "diagonal": 2.046842336654663,
+    "finite": 0.02438763529062271
+  },
+  {
+    "step": 473,
+    "loss": 3.0377566814422607,
+    "diagonal": 3.020817756652832,
+    "finite": 0.016938989982008934
+  },
+  {
+    "step": 474,
+    "loss": 2.4252564907073975,
+    "diagonal": 2.4124178886413574,
+    "finite": 0.012838632799685001
+  },
+  {
+    "step": 475,
+    "loss": 2.3004393577575684,
+    "diagonal": 2.28944730758667,
+    "finite": 0.010992040857672691
+  },
+  {
+    "step": 476,
+    "loss": 2.354071855545044,
+    "diagonal": 2.3375024795532227,
+    "finite": 0.01656937599182129
+  },
+  {
+    "step": 477,
+    "loss": 2.174729347229004,
+    "diagonal": 2.157597064971924,
+    "finite": 0.01713220402598381
+  },
+  {
+    "step": 478,
+    "loss": 2.743210554122925,
+    "diagonal": 2.720336675643921,
+    "finite": 0.022873826324939728
+  },
+  {
+    "step": 479,
+    "loss": 2.6496434211730957,
+    "diagonal": 2.6338653564453125,
+    "finite": 0.015778150409460068
+  },
+  {
+    "step": 480,
+    "loss": 2.4065027236938477,
+    "diagonal": 2.3903234004974365,
+    "finite": 0.01617923565208912
+  },
+  {
+    "step": 481,
+    "loss": 2.8843960762023926,
+    "diagonal": 2.8615775108337402,
+    "finite": 0.022818461060523987
+  },
+  {
+    "step": 482,
+    "loss": 2.337017297744751,
+    "diagonal": 2.3143434524536133,
+    "finite": 0.022673962637782097
+  },
+  {
+    "step": 483,
+    "loss": 2.1346867084503174,
+    "diagonal": 2.1139233112335205,
+    "finite": 0.020763427019119263
+  },
+  {
+    "step": 484,
+    "loss": 2.6650660037994385,
+    "diagonal": 2.633174180984497,
+    "finite": 0.03189186751842499
+  },
+  {
+    "step": 485,
+    "loss": 2.700792074203491,
+    "diagonal": 2.680119752883911,
+    "finite": 0.02067234180867672
+  },
+  {
+    "step": 486,
+    "loss": 2.3022332191467285,
+    "diagonal": 2.2756452560424805,
+    "finite": 0.026587994769215584
+  },
+  {
+    "step": 487,
+    "loss": 1.9034628868103027,
+    "diagonal": 1.8787057399749756,
+    "finite": 0.024757198989391327
+  },
+  {
+    "step": 488,
+    "loss": 2.5727365016937256,
+    "diagonal": 2.537292003631592,
+    "finite": 0.035444475710392
+  },
+  {
+    "step": 489,
+    "loss": 2.248227834701538,
+    "diagonal": 2.2312393188476562,
+    "finite": 0.016988545656204224
+  },
+  {
+    "step": 490,
+    "loss": 2.4429333209991455,
+    "diagonal": 2.4262707233428955,
+    "finite": 0.016662590205669403
+  },
+  {
+    "step": 491,
+    "loss": 2.4492053985595703,
+    "diagonal": 2.433389663696289,
+    "finite": 0.015815624967217445
+  },
+  {
+    "step": 492,
+    "loss": 2.2141618728637695,
+    "diagonal": 2.193995952606201,
+    "finite": 0.02016592025756836
+  },
+  {
+    "step": 493,
+    "loss": 2.521477460861206,
+    "diagonal": 2.506315231323242,
+    "finite": 0.015162277035415173
+  },
+  {
+    "step": 494,
+    "loss": 2.913203001022339,
+    "diagonal": 2.8982582092285156,
+    "finite": 0.014944697730243206
+  },
+  {
+    "step": 495,
+    "loss": 2.5105385780334473,
+    "diagonal": 2.492044448852539,
+    "finite": 0.01849421113729477
+  },
+  {
+    "step": 496,
+    "loss": 2.2370455265045166,
+    "diagonal": 2.223390579223633,
+    "finite": 0.013654929585754871
+  },
+  {
+    "step": 497,
+    "loss": 2.4281911849975586,
+    "diagonal": 2.3981170654296875,
+    "finite": 0.03007400780916214
+  },
+  {
+    "step": 498,
+    "loss": 2.765442132949829,
+    "diagonal": 2.74025821685791,
+    "finite": 0.025183985009789467
+  },
+  {
+    "step": 499,
+    "loss": 1.971266269683838,
+    "diagonal": 1.9561896324157715,
+    "finite": 0.015076645649969578
+  },
+  {
+    "step": 500,
+    "loss": 2.6849563121795654,
+    "diagonal": 2.6561179161071777,
+    "finite": 0.028838463127613068
+  },
+  {
+    "step": 501,
+    "loss": 2.0479812622070312,
+    "diagonal": 2.0323188304901123,
+    "finite": 0.015662478283047676
+  },
+  {
+    "step": 502,
+    "loss": 2.321371555328369,
+    "diagonal": 2.3095784187316895,
+    "finite": 0.011793176643550396
+  },
+  {
+    "step": 503,
+    "loss": 2.009314775466919,
+    "diagonal": 1.9817231893539429,
+    "finite": 0.027591647580266
+  },
+  {
+    "step": 504,
+    "loss": 2.017315626144409,
+    "diagonal": 1.9971166849136353,
+    "finite": 0.020198844373226166
+  },
+  {
+    "step": 505,
+    "loss": 1.996233582496643,
+    "diagonal": 1.9776179790496826,
+    "finite": 0.018615633249282837
+  },
+  {
+    "step": 506,
+    "loss": 2.003746271133423,
+    "diagonal": 1.9847147464752197,
+    "finite": 0.019031591713428497
+  },
+  {
+    "step": 507,
+    "loss": 2.822500467300415,
+    "diagonal": 2.7981719970703125,
+    "finite": 0.024328485131263733
+  },
+  {
+    "step": 508,
+    "loss": 2.317882537841797,
+    "diagonal": 2.299785852432251,
+    "finite": 0.018096769228577614
+  },
+  {
+    "step": 509,
+    "loss": 1.996217966079712,
+    "diagonal": 1.9654008150100708,
+    "finite": 0.0308171845972538
+  },
+  {
+    "step": 510,
+    "loss": 2.4540154933929443,
+    "diagonal": 2.4219436645507812,
+    "finite": 0.03207193687558174
+  },
+  {
+    "step": 511,
+    "loss": 1.995147943496704,
+    "diagonal": 1.9737058877944946,
+    "finite": 0.021442051976919174
+  },
+  {
+    "step": 512,
+    "loss": 2.259932041168213,
+    "diagonal": 2.2400472164154053,
+    "finite": 0.019884781911969185
+  },
+  {
+    "step": 513,
+    "loss": 2.2505345344543457,
+    "diagonal": 2.2227847576141357,
+    "finite": 0.02774978056550026
+  },
+  {
+    "step": 514,
+    "loss": 2.1330370903015137,
+    "diagonal": 2.1123502254486084,
+    "finite": 0.020686905831098557
+  },
+  {
+    "step": 515,
+    "loss": 2.834379196166992,
+    "diagonal": 2.8136167526245117,
+    "finite": 0.020762445405125618
+  },
+  {
+    "step": 516,
+    "loss": 2.0666511058807373,
+    "diagonal": 2.0538785457611084,
+    "finite": 0.012772597372531891
+  },
+  {
+    "step": 517,
+    "loss": 2.20107102394104,
+    "diagonal": 2.1909682750701904,
+    "finite": 0.010102636180818081
+  },
+  {
+    "step": 518,
+    "loss": 2.4381778240203857,
+    "diagonal": 2.425178050994873,
+    "finite": 0.012999668717384338
+  },
+  {
+    "step": 519,
+    "loss": 2.1245741844177246,
+    "diagonal": 2.1064248085021973,
+    "finite": 0.01814945787191391
+  },
+  {
+    "step": 520,
+    "loss": 2.5568230152130127,
+    "diagonal": 2.5375006198883057,
+    "finite": 0.019322434440255165
+  },
+  {
+    "step": 521,
+    "loss": 2.2406275272369385,
+    "diagonal": 2.2256970405578613,
+    "finite": 0.014930394478142262
+  },
+  {
+    "step": 522,
+    "loss": 2.2518563270568848,
+    "diagonal": 2.2360455989837646,
+    "finite": 0.015810688957571983
+  },
+  {
+    "step": 523,
+    "loss": 2.06402850151062,
+    "diagonal": 2.0436954498291016,
+    "finite": 0.020333077758550644
+  },
+  {
+    "step": 524,
+    "loss": 2.7973997592926025,
+    "diagonal": 2.771460771560669,
+    "finite": 0.02593895047903061
+  },
+  {
+    "step": 525,
+    "loss": 2.4447286128997803,
+    "diagonal": 2.4278206825256348,
+    "finite": 0.016907988116145134
+  },
+  {
+    "step": 526,
+    "loss": 2.1307272911071777,
+    "diagonal": 2.1128387451171875,
+    "finite": 0.017888518050312996
+  },
+  {
+    "step": 527,
+    "loss": 2.1707043647766113,
+    "diagonal": 2.154172420501709,
+    "finite": 0.016531899571418762
+  },
+  {
+    "step": 528,
+    "loss": 2.0448529720306396,
+    "diagonal": 2.024573802947998,
+    "finite": 0.02027926594018936
+  },
+  {
+    "step": 529,
+    "loss": 2.684896469116211,
+    "diagonal": 2.6689395904541016,
+    "finite": 0.015956861898303032
+  },
+  {
+    "step": 530,
+    "loss": 2.3607771396636963,
+    "diagonal": 2.343346357345581,
+    "finite": 0.017430800944566727
+  },
+  {
+    "step": 531,
+    "loss": 2.388446092605591,
+    "diagonal": 2.3751776218414307,
+    "finite": 0.013268393464386463
+  },
+  {
+    "step": 532,
+    "loss": 2.0534892082214355,
+    "diagonal": 2.0313994884490967,
+    "finite": 0.022089805454015732
+  },
+  {
+    "step": 533,
+    "loss": 1.716591715812683,
+    "diagonal": 1.7032217979431152,
+    "finite": 0.013369932770729065
+  },
+  {
+    "step": 534,
+    "loss": 2.6129567623138428,
+    "diagonal": 2.5943872928619385,
+    "finite": 0.018569452688097954
+  },
+  {
+    "step": 535,
+    "loss": 2.6992499828338623,
+    "diagonal": 2.6822304725646973,
+    "finite": 0.01701953075826168
+  },
+  {
+    "step": 536,
+    "loss": 2.1225125789642334,
+    "diagonal": 2.102982521057129,
+    "finite": 0.019530130550265312
+  },
+  {
+    "step": 537,
+    "loss": 2.1292521953582764,
+    "diagonal": 2.1067118644714355,
+    "finite": 0.022540220990777016
+  },
+  {
+    "step": 538,
+    "loss": 2.4583256244659424,
+    "diagonal": 2.4457483291625977,
+    "finite": 0.01257738284766674
+  },
+  {
+    "step": 539,
+    "loss": 2.406777858734131,
+    "diagonal": 2.3826422691345215,
+    "finite": 0.024135522544384003
+  },
+  {
+    "step": 540,
+    "loss": 2.520303964614868,
+    "diagonal": 2.5040926933288574,
+    "finite": 0.016211381182074547
+  },
+  {
+    "step": 541,
+    "loss": 2.0765607357025146,
+    "diagonal": 2.0671474933624268,
+    "finite": 0.009413315914571285
+  },
+  {
+    "step": 542,
+    "loss": 1.7906557321548462,
+    "diagonal": 1.7740485668182373,
+    "finite": 0.016607116907835007
+  },
+  {
+    "step": 543,
+    "loss": 2.4595329761505127,
+    "diagonal": 2.4446895122528076,
+    "finite": 0.01484348252415657
+  },
+  {
+    "step": 544,
+    "loss": 2.9186441898345947,
+    "diagonal": 2.9032142162323,
+    "finite": 0.015430059283971786
+  },
+  {
+    "step": 545,
+    "loss": 2.436173677444458,
+    "diagonal": 2.4185314178466797,
+    "finite": 0.017642365768551826
+  },
+  {
+    "step": 546,
+    "loss": 2.461867094039917,
+    "diagonal": 2.4506380558013916,
+    "finite": 0.011229069903492928
+  },
+  {
+    "step": 547,
+    "loss": 2.4290099143981934,
+    "diagonal": 2.4091193675994873,
+    "finite": 0.019890476018190384
+  },
+  {
+    "step": 548,
+    "loss": 2.400855779647827,
+    "diagonal": 2.387665033340454,
+    "finite": 0.013190674595534801
+  },
+  {
+    "step": 549,
+    "loss": 2.2960827350616455,
+    "diagonal": 2.2630536556243896,
+    "finite": 0.033029064536094666
+  },
+  {
+    "step": 550,
+    "loss": 2.798163890838623,
+    "diagonal": 2.779160261154175,
+    "finite": 0.01900356449186802
+  },
+  {
+    "step": 551,
+    "loss": 2.8312339782714844,
+    "diagonal": 2.8181426525115967,
+    "finite": 0.013091444969177246
+  },
+  {
+    "step": 552,
+    "loss": 2.7798166275024414,
+    "diagonal": 2.7558200359344482,
+    "finite": 0.023996679112315178
+  },
+  {
+    "step": 553,
+    "loss": 2.5415477752685547,
+    "diagonal": 2.530135154724121,
+    "finite": 0.011412566527724266
+  },
+  {
+    "step": 554,
+    "loss": 2.212205171585083,
+    "diagonal": 2.1931965351104736,
+    "finite": 0.01900862529873848
+  },
+  {
+    "step": 555,
+    "loss": 1.9279526472091675,
+    "diagonal": 1.9139270782470703,
+    "finite": 0.014025622047483921
+  },
+  {
+    "step": 556,
+    "loss": 2.383876085281372,
+    "diagonal": 2.370090961456299,
+    "finite": 0.013785100542008877
+  },
+  {
+    "step": 557,
+    "loss": 1.6799696683883667,
+    "diagonal": 1.6663711071014404,
+    "finite": 0.013598503544926643
+  },
+  {
+    "step": 558,
+    "loss": 2.504155158996582,
+    "diagonal": 2.490553617477417,
+    "finite": 0.013601621612906456
+  },
+  {
+    "step": 559,
+    "loss": 1.8622303009033203,
+    "diagonal": 1.8429434299468994,
+    "finite": 0.019286924973130226
+  },
+  {
+    "step": 560,
+    "loss": 2.139847993850708,
+    "diagonal": 2.125309944152832,
+    "finite": 0.014537971466779709
+  },
+  {
+    "step": 561,
+    "loss": 2.366098165512085,
+    "diagonal": 2.3456764221191406,
+    "finite": 0.020421786233782768
+  },
+  {
+    "step": 562,
+    "loss": 1.9464094638824463,
+    "diagonal": 1.932418942451477,
+    "finite": 0.013990558683872223
+  },
+  {
+    "step": 563,
+    "loss": 2.0294010639190674,
+    "diagonal": 2.00793194770813,
+    "finite": 0.021469110623002052
+  },
+  {
+    "step": 564,
+    "loss": 2.323385715484619,
+    "diagonal": 2.3112998008728027,
+    "finite": 0.012085945345461369
+  },
+  {
+    "step": 565,
+    "loss": 2.402048349380493,
+    "diagonal": 2.3833367824554443,
+    "finite": 0.018711522221565247
+  },
+  {
+    "step": 566,
+    "loss": 2.2974441051483154,
+    "diagonal": 2.27563214302063,
+    "finite": 0.02181193418800831
+  },
+  {
+    "step": 567,
+    "loss": 1.8968868255615234,
+    "diagonal": 1.8818198442459106,
+    "finite": 0.015066968277096748
+  },
+  {
+    "step": 568,
+    "loss": 2.2694032192230225,
+    "diagonal": 2.2543301582336426,
+    "finite": 0.015073101967573166
+  },
+  {
+    "step": 569,
+    "loss": 2.1096696853637695,
+    "diagonal": 2.087435722351074,
+    "finite": 0.022233983501791954
+  },
+  {
+    "step": 570,
+    "loss": 2.623372793197632,
+    "diagonal": 2.6025161743164062,
+    "finite": 0.020856589078903198
+  },
+  {
+    "step": 571,
+    "loss": 2.4444196224212646,
+    "diagonal": 2.419569969177246,
+    "finite": 0.02484956569969654
+  },
+  {
+    "step": 572,
+    "loss": 2.237363338470459,
+    "diagonal": 2.226966142654419,
+    "finite": 0.010397224687039852
+  },
+  {
+    "step": 573,
+    "loss": 2.264801263809204,
+    "diagonal": 2.2502145767211914,
+    "finite": 0.014586735516786575
+  },
+  {
+    "step": 574,
+    "loss": 2.3744657039642334,
+    "diagonal": 2.347939968109131,
+    "finite": 0.02652565948665142
+  },
+  {
+    "step": 575,
+    "loss": 2.4233593940734863,
+    "diagonal": 2.3993706703186035,
+    "finite": 0.02398865483701229
+  },
+  {
+    "step": 576,
+    "loss": 2.276900291442871,
+    "diagonal": 2.2346158027648926,
+    "finite": 0.04228457435965538
+  },
+  {
+    "step": 577,
+    "loss": 2.1251065731048584,
+    "diagonal": 2.1034772396087646,
+    "finite": 0.02162935957312584
+  },
+  {
+    "step": 578,
+    "loss": 2.4617276191711426,
+    "diagonal": 2.4357054233551025,
+    "finite": 0.026022130623459816
+  },
+  {
+    "step": 579,
+    "loss": 2.266543388366699,
+    "diagonal": 2.25148868560791,
+    "finite": 0.015054764226078987
+  },
+  {
+    "step": 580,
+    "loss": 2.3231170177459717,
+    "diagonal": 2.309934139251709,
+    "finite": 0.013182979077100754
+  },
+  {
+    "step": 581,
+    "loss": 2.508373498916626,
+    "diagonal": 2.4924960136413574,
+    "finite": 0.01587756723165512
+  },
+  {
+    "step": 582,
+    "loss": 2.5540597438812256,
+    "diagonal": 2.526557207107544,
+    "finite": 0.02750260755419731
+  },
+  {
+    "step": 583,
+    "loss": 2.206704616546631,
+    "diagonal": 2.175509214401245,
+    "finite": 0.03119533136487007
+  },
+  {
+    "step": 584,
+    "loss": 2.3354499340057373,
+    "diagonal": 2.327349901199341,
+    "finite": 0.008099921979010105
+  },
+  {
+    "step": 585,
+    "loss": 1.6385730504989624,
+    "diagonal": 1.623419165611267,
+    "finite": 0.015153865329921246
+  },
+  {
+    "step": 586,
+    "loss": 2.5433404445648193,
+    "diagonal": 2.5309677124023438,
+    "finite": 0.01237278152257204
+  },
+  {
+    "step": 587,
+    "loss": 2.4189975261688232,
+    "diagonal": 2.396045207977295,
+    "finite": 0.02295224368572235
+  },
+  {
+    "step": 588,
+    "loss": 2.4050233364105225,
+    "diagonal": 2.3816475868225098,
+    "finite": 0.02337585762143135
+  },
+  {
+    "step": 589,
+    "loss": 2.445484161376953,
+    "diagonal": 2.4225306510925293,
+    "finite": 0.022953547537326813
+  },
+  {
+    "step": 590,
+    "loss": 2.5223958492279053,
+    "diagonal": 2.507749080657959,
+    "finite": 0.014646686613559723
+  },
+  {
+    "step": 591,
+    "loss": 2.7184135913848877,
+    "diagonal": 2.6971230506896973,
+    "finite": 0.02129046432673931
+  },
+  {
+    "step": 592,
+    "loss": 2.361006736755371,
+    "diagonal": 2.3387529850006104,
+    "finite": 0.02225382812321186
+  },
+  {
+    "step": 593,
+    "loss": 2.0153145790100098,
+    "diagonal": 1.9919922351837158,
+    "finite": 0.023322228342294693
+  },
+  {
+    "step": 594,
+    "loss": 1.8402845859527588,
+    "diagonal": 1.8291701078414917,
+    "finite": 0.011114448308944702
+  },
+  {
+    "step": 595,
+    "loss": 2.2431600093841553,
+    "diagonal": 2.227065086364746,
+    "finite": 0.01609485037624836
+  },
+  {
+    "step": 596,
+    "loss": 2.215707302093506,
+    "diagonal": 2.2012736797332764,
+    "finite": 0.014433641918003559
+  },
+  {
+    "step": 597,
+    "loss": 2.0136468410491943,
+    "diagonal": 2.001166343688965,
+    "finite": 0.012480444274842739
+  },
+  {
+    "step": 598,
+    "loss": 2.44045090675354,
+    "diagonal": 2.4307332038879395,
+    "finite": 0.00971763115376234
+  },
+  {
+    "step": 599,
+    "loss": 2.1324594020843506,
+    "diagonal": 2.11159348487854,
+    "finite": 0.020865928381681442
+  },
+  {
+    "step": 600,
+    "loss": 2.1966192722320557,
+    "diagonal": 2.1865198612213135,
+    "finite": 0.010099313221871853
+  },
+  {
+    "step": 601,
+    "loss": 1.811847448348999,
+    "diagonal": 1.7990262508392334,
+    "finite": 0.012821224518120289
+  },
+  {
+    "step": 602,
+    "loss": 2.0177459716796875,
+    "diagonal": 1.9998400211334229,
+    "finite": 0.017906036227941513
+  },
+  {
+    "step": 603,
+    "loss": 2.082803249359131,
+    "diagonal": 2.06227970123291,
+    "finite": 0.02052347920835018
+  },
+  {
+    "step": 604,
+    "loss": 1.9329063892364502,
+    "diagonal": 1.9240108728408813,
+    "finite": 0.008895459584891796
+  },
+  {
+    "step": 605,
+    "loss": 2.153907537460327,
+    "diagonal": 2.138552665710449,
+    "finite": 0.015354933217167854
+  },
+  {
+    "step": 606,
+    "loss": 2.246922731399536,
+    "diagonal": 2.2277934551239014,
+    "finite": 0.01912938430905342
+  },
+  {
+    "step": 607,
+    "loss": 2.1734442710876465,
+    "diagonal": 2.1610212326049805,
+    "finite": 0.012423139996826649
+  },
+  {
+    "step": 608,
+    "loss": 2.6499969959259033,
+    "diagonal": 2.637483596801758,
+    "finite": 0.012513473629951477
+  },
+  {
+    "step": 609,
+    "loss": 2.357023000717163,
+    "diagonal": 2.348769187927246,
+    "finite": 0.008253770880401134
+  },
+  {
+    "step": 610,
+    "loss": 2.0923848152160645,
+    "diagonal": 2.081707000732422,
+    "finite": 0.010677909478545189
+  },
+  {
+    "step": 611,
+    "loss": 2.2255325317382812,
+    "diagonal": 2.2175464630126953,
+    "finite": 0.00798606313765049
+  },
+  {
+    "step": 612,
+    "loss": 2.1615092754364014,
+    "diagonal": 2.1517391204833984,
+    "finite": 0.009770088829100132
+  },
+  {
+    "step": 613,
+    "loss": 2.614255666732788,
+    "diagonal": 2.6049647331237793,
+    "finite": 0.009290958754718304
+  },
+  {
+    "step": 614,
+    "loss": 1.9213958978652954,
+    "diagonal": 1.9144935607910156,
+    "finite": 0.006902297493070364
+  },
+  {
+    "step": 615,
+    "loss": 2.388852596282959,
+    "diagonal": 2.3790242671966553,
+    "finite": 0.009828300215303898
+  },
+  {
+    "step": 616,
+    "loss": 2.6063873767852783,
+    "diagonal": 2.598543643951416,
+    "finite": 0.007843675091862679
+  },
+  {
+    "step": 617,
+    "loss": 2.0627188682556152,
+    "diagonal": 2.05139422416687,
+    "finite": 0.011324653401970863
+  },
+  {
+    "step": 618,
+    "loss": 2.241727352142334,
+    "diagonal": 2.2365012168884277,
+    "finite": 0.00522604351863265
+  },
+  {
+    "step": 619,
+    "loss": 2.3979036808013916,
+    "diagonal": 2.3892762660980225,
+    "finite": 0.00862745102494955
+  },
+  {
+    "step": 620,
+    "loss": 2.780034303665161,
+    "diagonal": 2.767821788787842,
+    "finite": 0.012212618254125118
+  },
+  {
+    "step": 621,
+    "loss": 2.606853485107422,
+    "diagonal": 2.590007781982422,
+    "finite": 0.016845719888806343
+  },
+  {
+    "step": 622,
+    "loss": 2.723344564437866,
+    "diagonal": 2.7152152061462402,
+    "finite": 0.00812937319278717
+  },
+  {
+    "step": 623,
+    "loss": 2.1472744941711426,
+    "diagonal": 2.1273891925811768,
+    "finite": 0.019885269924998283
+  },
+  {
+    "step": 624,
+    "loss": 1.6831594705581665,
+    "diagonal": 1.6685465574264526,
+    "finite": 0.014612938277423382
+  },
+  {
+    "step": 625,
+    "loss": 2.1040778160095215,
+    "diagonal": 2.0812807083129883,
+    "finite": 0.022797003388404846
+  },
+  {
+    "step": 626,
+    "loss": 2.7665586471557617,
+    "diagonal": 2.745335340499878,
+    "finite": 0.021223338320851326
+  },
+  {
+    "step": 627,
+    "loss": 2.3621397018432617,
+    "diagonal": 2.3435842990875244,
+    "finite": 0.018555477261543274
+  },
+  {
+    "step": 628,
+    "loss": 1.8292815685272217,
+    "diagonal": 1.8146140575408936,
+    "finite": 0.014667537063360214
+  },
+  {
+    "step": 629,
+    "loss": 2.1038975715637207,
+    "diagonal": 2.0758912563323975,
+    "finite": 0.028006434440612793
+  },
+  {
+    "step": 630,
+    "loss": 2.278015613555908,
+    "diagonal": 2.2568700313568115,
+    "finite": 0.02114563062787056
+  },
+  {
+    "step": 631,
+    "loss": 2.3471145629882812,
+    "diagonal": 2.335721254348755,
+    "finite": 0.011393277905881405
+  },
+  {
+    "step": 632,
+    "loss": 2.115725517272949,
+    "diagonal": 2.1030759811401367,
+    "finite": 0.012649579904973507
+  },
+  {
+    "step": 633,
+    "loss": 1.9652410745620728,
+    "diagonal": 1.95253324508667,
+    "finite": 0.012707789428532124
+  },
+  {
+    "step": 634,
+    "loss": 2.4449734687805176,
+    "diagonal": 2.4210052490234375,
+    "finite": 0.023968104273080826
+  },
+  {
+    "step": 635,
+    "loss": 2.2887747287750244,
+    "diagonal": 2.280470371246338,
+    "finite": 0.008304380811750889
+  },
+  {
+    "step": 636,
+    "loss": 2.262274742126465,
+    "diagonal": 2.252302646636963,
+    "finite": 0.009972212836146355
+  },
+  {
+    "step": 637,
+    "loss": 2.159696578979492,
+    "diagonal": 2.15101957321167,
+    "finite": 0.008676971308887005
+  },
+  {
+    "step": 638,
+    "loss": 2.3103368282318115,
+    "diagonal": 2.2949037551879883,
+    "finite": 0.015433105640113354
+  },
+  {
+    "step": 639,
+    "loss": 2.375349998474121,
+    "diagonal": 2.3593695163726807,
+    "finite": 0.015980441123247147
+  },
+  {
+    "step": 640,
+    "loss": 2.332778215408325,
+    "diagonal": 2.3208858966827393,
+    "finite": 0.011892247945070267
+  },
+  {
+    "step": 641,
+    "loss": 2.2513086795806885,
+    "diagonal": 2.234347105026245,
+    "finite": 0.01696166582405567
+  },
+  {
+    "step": 642,
+    "loss": 2.2491238117218018,
+    "diagonal": 2.2333269119262695,
+    "finite": 0.01579679362475872
+  },
+  {
+    "step": 643,
+    "loss": 1.8176199197769165,
+    "diagonal": 1.8057239055633545,
+    "finite": 0.011895970441401005
+  },
+  {
+    "step": 644,
+    "loss": 2.0304713249206543,
+    "diagonal": 2.0152699947357178,
+    "finite": 0.01520122867077589
+  },
+  {
+    "step": 645,
+    "loss": 1.6579922437667847,
+    "diagonal": 1.6425695419311523,
+    "finite": 0.015422659926116467
+  },
+  {
+    "step": 646,
+    "loss": 2.225977897644043,
+    "diagonal": 2.214841604232788,
+    "finite": 0.01113634742796421
+  },
+  {
+    "step": 647,
+    "loss": 1.8179575204849243,
+    "diagonal": 1.8043277263641357,
+    "finite": 0.013629773631691933
+  },
+  {
+    "step": 648,
+    "loss": 2.32378888130188,
+    "diagonal": 2.314155340194702,
+    "finite": 0.009633556008338928
+  },
+  {
+    "step": 649,
+    "loss": 2.3159313201904297,
+    "diagonal": 2.3016891479492188,
+    "finite": 0.014242220669984818
+  },
+  {
+    "step": 650,
+    "loss": 1.9779640436172485,
+    "diagonal": 1.9671039581298828,
+    "finite": 0.010860135778784752
+  },
+  {
+    "step": 651,
+    "loss": 2.5995500087738037,
+    "diagonal": 2.5863192081451416,
+    "finite": 0.013230760581791401
+  },
+  {
+    "step": 652,
+    "loss": 2.042691707611084,
+    "diagonal": 2.0172884464263916,
+    "finite": 0.025403380393981934
+  },
+  {
+    "step": 653,
+    "loss": 2.3901846408843994,
+    "diagonal": 2.375807285308838,
+    "finite": 0.014377284795045853
+  },
+  {
+    "step": 654,
+    "loss": 1.8067203760147095,
+    "diagonal": 1.7940903902053833,
+    "finite": 0.012630036100745201
+  },
+  {
+    "step": 655,
+    "loss": 2.1338322162628174,
+    "diagonal": 2.122713327407837,
+    "finite": 0.011118789203464985
+  },
+  {
+    "step": 656,
+    "loss": 2.0162618160247803,
+    "diagonal": 2.0034940242767334,
+    "finite": 0.01276783924549818
+  },
+  {
+    "step": 657,
+    "loss": 2.095435619354248,
+    "diagonal": 2.074336528778076,
+    "finite": 0.021099112927913666
+  },
+  {
+    "step": 658,
+    "loss": 2.2187838554382324,
+    "diagonal": 2.2053964138031006,
+    "finite": 0.013387484475970268
+  },
+  {
+    "step": 659,
+    "loss": 2.0894243717193604,
+    "diagonal": 2.067203998565674,
+    "finite": 0.022220443934202194
+  },
+  {
+    "step": 660,
+    "loss": 2.8848462104797363,
+    "diagonal": 2.8752222061157227,
+    "finite": 0.009623956866562366
+  },
+  {
+    "step": 661,
+    "loss": 2.5496439933776855,
+    "diagonal": 2.53853178024292,
+    "finite": 0.011112158186733723
+  },
+  {
+    "step": 662,
+    "loss": 2.5582101345062256,
+    "diagonal": 2.5450620651245117,
+    "finite": 0.013148151338100433
+  },
+  {
+    "step": 663,
+    "loss": 2.3383140563964844,
+    "diagonal": 2.3279449939727783,
+    "finite": 0.010368973948061466
+  },
+  {
+    "step": 664,
+    "loss": 2.1718122959136963,
+    "diagonal": 2.161205291748047,
+    "finite": 0.01060698926448822
+  },
+  {
+    "step": 665,
+    "loss": 2.084902286529541,
+    "diagonal": 2.0588643550872803,
+    "finite": 0.02603781782090664
+  },
+  {
+    "step": 666,
+    "loss": 2.5584661960601807,
+    "diagonal": 2.5339431762695312,
+    "finite": 0.024523131549358368
+  },
+  {
+    "step": 667,
+    "loss": 2.534654140472412,
+    "diagonal": 2.5285325050354004,
+    "finite": 0.006121520884335041
+  },
+  {
+    "step": 668,
+    "loss": 2.157658576965332,
+    "diagonal": 2.139533042907715,
+    "finite": 0.018125442788004875
+  },
+  {
+    "step": 669,
+    "loss": 2.6524815559387207,
+    "diagonal": 2.6269586086273193,
+    "finite": 0.02552291378378868
+  },
+  {
+    "step": 670,
+    "loss": 1.918746829032898,
+    "diagonal": 1.9088468551635742,
+    "finite": 0.00989995151758194
+  },
+  {
+    "step": 671,
+    "loss": 2.41965651512146,
+    "diagonal": 2.398437738418579,
+    "finite": 0.021218858659267426
+  },
+  {
+    "step": 672,
+    "loss": 2.222475528717041,
+    "diagonal": 2.211967706680298,
+    "finite": 0.010507858358323574
+  },
+  {
+    "step": 673,
+    "loss": 2.0796635150909424,
+    "diagonal": 2.0605082511901855,
+    "finite": 0.019155332818627357
+  },
+  {
+    "step": 674,
+    "loss": 2.4368155002593994,
+    "diagonal": 2.4155051708221436,
+    "finite": 0.021310269832611084
+  },
+  {
+    "step": 675,
+    "loss": 2.1989803314208984,
+    "diagonal": 2.180595874786377,
+    "finite": 0.01838441751897335
+  },
+  {
+    "step": 676,
+    "loss": 1.986437439918518,
+    "diagonal": 1.9531559944152832,
+    "finite": 0.03328142315149307
+  },
+  {
+    "step": 677,
+    "loss": 2.0426621437072754,
+    "diagonal": 2.0253686904907227,
+    "finite": 0.017293373122811317
+  },
+  {
+    "step": 678,
+    "loss": 2.6214966773986816,
+    "diagonal": 2.6011056900024414,
+    "finite": 0.020391101017594337
+  },
+  {
+    "step": 679,
+    "loss": 2.413933038711548,
+    "diagonal": 2.3929474353790283,
+    "finite": 0.020985662937164307
+  },
+  {
+    "step": 680,
+    "loss": 2.158397912979126,
+    "diagonal": 2.1389899253845215,
+    "finite": 0.019408077001571655
+  },
+  {
+    "step": 681,
+    "loss": 2.4191224575042725,
+    "diagonal": 2.393465280532837,
+    "finite": 0.02565726637840271
+  },
+  {
+    "step": 682,
+    "loss": 2.3936028480529785,
+    "diagonal": 2.3698906898498535,
+    "finite": 0.02371225319802761
+  },
+  {
+    "step": 683,
+    "loss": 2.2052395343780518,
+    "diagonal": 2.1877996921539307,
+    "finite": 0.0174398273229599
+  },
+  {
+    "step": 684,
+    "loss": 2.025033950805664,
+    "diagonal": 2.001544952392578,
+    "finite": 0.02348901331424713
+  },
+  {
+    "step": 685,
+    "loss": 2.5150668621063232,
+    "diagonal": 2.490401268005371,
+    "finite": 0.024665668606758118
+  },
+  {
+    "step": 686,
+    "loss": 2.341033697128296,
+    "diagonal": 2.3281502723693848,
+    "finite": 0.01288331113755703
+  },
+  {
+    "step": 687,
+    "loss": 1.8563591241836548,
+    "diagonal": 1.8206055164337158,
+    "finite": 0.03575356677174568
+  },
+  {
+    "step": 688,
+    "loss": 2.1760149002075195,
+    "diagonal": 2.159818649291992,
+    "finite": 0.01619631052017212
+  },
+  {
+    "step": 689,
+    "loss": 2.3887009620666504,
+    "diagonal": 2.3777759075164795,
+    "finite": 0.01092494186013937
+  },
+  {
+    "step": 690,
+    "loss": 1.9245575666427612,
+    "diagonal": 1.9184314012527466,
+    "finite": 0.006126157008111477
+  },
+  {
+    "step": 691,
+    "loss": 2.223961353302002,
+    "diagonal": 2.204540491104126,
+    "finite": 0.019420752301812172
+  },
+  {
+    "step": 692,
+    "loss": 2.2196903228759766,
+    "diagonal": 2.202608108520508,
+    "finite": 0.017082324251532555
+  },
+  {
+    "step": 693,
+    "loss": 2.165371894836426,
+    "diagonal": 2.1470563411712646,
+    "finite": 0.018315434455871582
+  },
+  {
+    "step": 694,
+    "loss": 2.16943097114563,
+    "diagonal": 2.1288602352142334,
+    "finite": 0.04057072475552559
+  },
+  {
+    "step": 695,
+    "loss": 2.3455865383148193,
+    "diagonal": 2.33071231842041,
+    "finite": 0.014874241314828396
+  },
+  {
+    "step": 696,
+    "loss": 2.7594187259674072,
+    "diagonal": 2.744493246078491,
+    "finite": 0.01492541003972292
+  },
+  {
+    "step": 697,
+    "loss": 1.9229322671890259,
+    "diagonal": 1.9132649898529053,
+    "finite": 0.00966730248183012
+  },
+  {
+    "step": 698,
+    "loss": 1.7822157144546509,
+    "diagonal": 1.7563539743423462,
+    "finite": 0.025861728936433792
+  },
+  {
+    "step": 699,
+    "loss": 1.7838983535766602,
+    "diagonal": 1.7590203285217285,
+    "finite": 0.024878021329641342
+  },
+  {
+    "step": 700,
+    "loss": 2.216499090194702,
+    "diagonal": 2.202887773513794,
+    "finite": 0.013611220754683018
+  },
+  {
+    "step": 701,
+    "loss": 2.8190054893493652,
+    "diagonal": 2.805042266845703,
+    "finite": 0.013963278383016586
+  },
+  {
+    "step": 702,
+    "loss": 2.6955816745758057,
+    "diagonal": 2.6809964179992676,
+    "finite": 0.014585291966795921
+  },
+  {
+    "step": 703,
+    "loss": 2.282219886779785,
+    "diagonal": 2.2679011821746826,
+    "finite": 0.01431878749281168
+  },
+  {
+    "step": 704,
+    "loss": 1.7699975967407227,
+    "diagonal": 1.7507662773132324,
+    "finite": 0.019231367856264114
+  },
+  {
+    "step": 705,
+    "loss": 2.85666561126709,
+    "diagonal": 2.845832347869873,
+    "finite": 0.010833237320184708
+  },
+  {
+    "step": 706,
+    "loss": 1.693625569343567,
+    "diagonal": 1.6750366687774658,
+    "finite": 0.018588853999972343
+  },
+  {
+    "step": 707,
+    "loss": 2.202568292617798,
+    "diagonal": 2.181709051132202,
+    "finite": 0.020859334617853165
+  },
+  {
+    "step": 708,
+    "loss": 1.672196388244629,
+    "diagonal": 1.654702067375183,
+    "finite": 0.017494305968284607
+  },
+  {
+    "step": 709,
+    "loss": 2.266303777694702,
+    "diagonal": 2.252958297729492,
+    "finite": 0.013345506973564625
+  },
+  {
+    "step": 710,
+    "loss": 2.2303433418273926,
+    "diagonal": 2.2162773609161377,
+    "finite": 0.01406586542725563
+  },
+  {
+    "step": 711,
+    "loss": 2.4773035049438477,
+    "diagonal": 2.4659876823425293,
+    "finite": 0.01131576206535101
+  },
+  {
+    "step": 712,
+    "loss": 2.303053140640259,
+    "diagonal": 2.2894840240478516,
+    "finite": 0.013569020666182041
+  },
+  {
+    "step": 713,
+    "loss": 2.4508681297302246,
+    "diagonal": 2.4408156871795654,
+    "finite": 0.010052451863884926
+  },
+  {
+    "step": 714,
+    "loss": 2.3610033988952637,
+    "diagonal": 2.3401541709899902,
+    "finite": 0.020849213004112244
+  },
+  {
+    "step": 715,
+    "loss": 2.4025654792785645,
+    "diagonal": 2.377124547958374,
+    "finite": 0.025440821424126625
+  },
+  {
+    "step": 716,
+    "loss": 2.4083852767944336,
+    "diagonal": 2.3921446800231934,
+    "finite": 0.01624058559536934
+  },
+  {
+    "step": 717,
+    "loss": 2.4704606533050537,
+    "diagonal": 2.45735239982605,
+    "finite": 0.01310836710035801
+  },
+  {
+    "step": 718,
+    "loss": 1.947988510131836,
+    "diagonal": 1.9340418577194214,
+    "finite": 0.01394667662680149
+  },
+  {
+    "step": 719,
+    "loss": 2.055257797241211,
+    "diagonal": 2.033231258392334,
+    "finite": 0.022026624530553818
+  },
+  {
+    "step": 720,
+    "loss": 2.3340296745300293,
+    "diagonal": 2.315321922302246,
+    "finite": 0.01870770752429962
+  },
+  {
+    "step": 721,
+    "loss": 2.4083704948425293,
+    "diagonal": 2.3877949714660645,
+    "finite": 0.020575620234012604
+  },
+  {
+    "step": 722,
+    "loss": 2.2625741958618164,
+    "diagonal": 2.240516185760498,
+    "finite": 0.02205796167254448
+  },
+  {
+    "step": 723,
+    "loss": 2.303762197494507,
+    "diagonal": 2.2827835083007812,
+    "finite": 0.02097858302295208
+  },
+  {
+    "step": 724,
+    "loss": 2.174971342086792,
+    "diagonal": 2.1284542083740234,
+    "finite": 0.046517230570316315
+  },
+  {
+    "step": 725,
+    "loss": 2.39510178565979,
+    "diagonal": 2.3698959350585938,
+    "finite": 0.02520589530467987
+  },
+  {
+    "step": 726,
+    "loss": 2.121258497238159,
+    "diagonal": 2.10329008102417,
+    "finite": 0.017968405038118362
+  },
+  {
+    "step": 727,
+    "loss": 2.0847160816192627,
+    "diagonal": 2.057802200317383,
+    "finite": 0.026913832873106003
+  },
+  {
+    "step": 728,
+    "loss": 2.0479960441589355,
+    "diagonal": 2.0294313430786133,
+    "finite": 0.018564652651548386
+  },
+  {
+    "step": 729,
+    "loss": 1.85936439037323,
+    "diagonal": 1.8478927612304688,
+    "finite": 0.01147159468382597
+  },
+  {
+    "step": 730,
+    "loss": 2.138725519180298,
+    "diagonal": 2.1233062744140625,
+    "finite": 0.015419293195009232
+  },
+  {
+    "step": 731,
+    "loss": 2.1009151935577393,
+    "diagonal": 2.0822694301605225,
+    "finite": 0.01864566095173359
+  },
+  {
+    "step": 732,
+    "loss": 1.9514411687850952,
+    "diagonal": 1.942826509475708,
+    "finite": 0.008614630438387394
+  },
+  {
+    "step": 733,
+    "loss": 2.0778143405914307,
+    "diagonal": 2.0692074298858643,
+    "finite": 0.008607020601630211
+  },
+  {
+    "step": 734,
+    "loss": 2.6167266368865967,
+    "diagonal": 2.607351779937744,
+    "finite": 0.009374958463013172
+  },
+  {
+    "step": 735,
+    "loss": 2.577622413635254,
+    "diagonal": 2.5557668209075928,
+    "finite": 0.021855521947145462
+  },
+  {
+    "step": 736,
+    "loss": 2.0693531036376953,
+    "diagonal": 2.0587968826293945,
+    "finite": 0.010556231252849102
+  },
+  {
+    "step": 737,
+    "loss": 2.4331161975860596,
+    "diagonal": 2.386852502822876,
+    "finite": 0.04626370593905449
+  },
+  {
+    "step": 738,
+    "loss": 2.6507766246795654,
+    "diagonal": 2.6404881477355957,
+    "finite": 0.010288450866937637
+  },
+  {
+    "step": 739,
+    "loss": 2.0209484100341797,
+    "diagonal": 1.9992114305496216,
+    "finite": 0.02173708565533161
+  },
+  {
+    "step": 740,
+    "loss": 2.386441946029663,
+    "diagonal": 2.3726797103881836,
+    "finite": 0.013762158341705799
+  },
+  {
+    "step": 741,
+    "loss": 2.2598094940185547,
+    "diagonal": 2.2433321475982666,
+    "finite": 0.016477396711707115
+  },
+  {
+    "step": 742,
+    "loss": 2.1684279441833496,
+    "diagonal": 2.151707649230957,
+    "finite": 0.01672019064426422
+  },
+  {
+    "step": 743,
+    "loss": 2.113069534301758,
+    "diagonal": 2.1044070720672607,
+    "finite": 0.008662521839141846
+  },
+  {
+    "step": 744,
+    "loss": 2.3130738735198975,
+    "diagonal": 2.299163341522217,
+    "finite": 0.013910528272390366
+  },
+  {
+    "step": 745,
+    "loss": 1.3905138969421387,
+    "diagonal": 1.3778462409973145,
+    "finite": 0.01266760565340519
+  },
+  {
+    "step": 746,
+    "loss": 2.3153300285339355,
+    "diagonal": 2.2995874881744385,
+    "finite": 0.015742547810077667
+  },
+  {
+    "step": 747,
+    "loss": 2.042973041534424,
+    "diagonal": 2.02777361869812,
+    "finite": 0.01519953552633524
+  },
+  {
+    "step": 748,
+    "loss": 1.907092571258545,
+    "diagonal": 1.8950741291046143,
+    "finite": 0.012018416076898575
+  },
+  {
+    "step": 749,
+    "loss": 2.021864652633667,
+    "diagonal": 2.006046772003174,
+    "finite": 0.015817830339074135
+  },
+  {
+    "step": 750,
+    "loss": 1.770300030708313,
+    "diagonal": 1.7546565532684326,
+    "finite": 0.015643514692783356
+  },
+  {
+    "step": 751,
+    "loss": 1.7834886312484741,
+    "diagonal": 1.744537591934204,
+    "finite": 0.03895100578665733
+  },
+  {
+    "step": 752,
+    "loss": 2.5196726322174072,
+    "diagonal": 2.507960557937622,
+    "finite": 0.011711983010172844
+  },
+  {
+    "step": 753,
+    "loss": 2.709367036819458,
+    "diagonal": 2.700108528137207,
+    "finite": 0.009258546866476536
+  },
+  {
+    "step": 754,
+    "loss": 2.590118408203125,
+    "diagonal": 2.5766472816467285,
+    "finite": 0.013471133075654507
+  },
+  {
+    "step": 755,
+    "loss": 2.8435401916503906,
+    "diagonal": 2.8336293697357178,
+    "finite": 0.009910781867802143
+  },
+  {
+    "step": 756,
+    "loss": 1.9348888397216797,
+    "diagonal": 1.9277727603912354,
+    "finite": 0.007116125896573067
+  },
+  {
+    "step": 757,
+    "loss": 2.130133867263794,
+    "diagonal": 2.1209921836853027,
+    "finite": 0.009141579270362854
+  },
+  {
+    "step": 758,
+    "loss": 1.6410857439041138,
+    "diagonal": 1.6271992921829224,
+    "finite": 0.013886434957385063
+  },
+  {
+    "step": 759,
+    "loss": 2.3463830947875977,
+    "diagonal": 2.335681915283203,
+    "finite": 0.010701253078877926
+  },
+  {
+    "step": 760,
+    "loss": 1.8968342542648315,
+    "diagonal": 1.8802549839019775,
+    "finite": 0.016579313203692436
+  },
+  {
+    "step": 761,
+    "loss": 2.6087634563446045,
+    "diagonal": 2.5895228385925293,
+    "finite": 0.01924072578549385
+  },
+  {
+    "step": 762,
+    "loss": 1.4329557418823242,
+    "diagonal": 1.4193204641342163,
+    "finite": 0.013635321520268917
+  },
+  {
+    "step": 763,
+    "loss": 2.1600286960601807,
+    "diagonal": 2.1406807899475098,
+    "finite": 0.019347980618476868
+  },
+  {
+    "step": 764,
+    "loss": 1.850568413734436,
+    "diagonal": 1.8233528137207031,
+    "finite": 0.02721559628844261
+  },
+  {
+    "step": 765,
+    "loss": 2.5095086097717285,
+    "diagonal": 2.488083839416504,
+    "finite": 0.02142483927309513
+  },
+  {
+    "step": 766,
+    "loss": 2.1055991649627686,
+    "diagonal": 2.083223342895508,
+    "finite": 0.022375717759132385
+  },
+  {
+    "step": 767,
+    "loss": 2.7717552185058594,
+    "diagonal": 2.7414674758911133,
+    "finite": 0.03028777427971363
+  },
+  {
+    "step": 768,
+    "loss": 2.005476236343384,
+    "diagonal": 1.9957540035247803,
+    "finite": 0.009722298942506313
+  },
+  {
+    "step": 769,
+    "loss": 1.860551357269287,
+    "diagonal": 1.8435527086257935,
+    "finite": 0.01699870266020298
+  },
+  {
+    "step": 770,
+    "loss": 1.5972192287445068,
+    "diagonal": 1.5889829397201538,
+    "finite": 0.00823625735938549
+  },
+  {
+    "step": 771,
+    "loss": 2.1161959171295166,
+    "diagonal": 2.1065375804901123,
+    "finite": 0.00965831521898508
+  },
+  {
+    "step": 772,
+    "loss": 2.3780829906463623,
+    "diagonal": 2.3724217414855957,
+    "finite": 0.005661186762154102
+  },
+  {
+    "step": 773,
+    "loss": 2.133608102798462,
+    "diagonal": 2.1202428340911865,
+    "finite": 0.013365195132791996
+  },
+  {
+    "step": 774,
+    "loss": 1.8081698417663574,
+    "diagonal": 1.7963368892669678,
+    "finite": 0.01183299906551838
+  },
+  {
+    "step": 775,
+    "loss": 2.304194927215576,
+    "diagonal": 2.2861528396606445,
+    "finite": 0.01804204285144806
+  },
+  {
+    "step": 776,
+    "loss": 2.220648765563965,
+    "diagonal": 2.2108566761016846,
+    "finite": 0.009792136959731579
+  },
+  {
+    "step": 777,
+    "loss": 2.4491655826568604,
+    "diagonal": 2.435128688812256,
+    "finite": 0.01403679046779871
+  },
+  {
+    "step": 778,
+    "loss": 2.1629786491394043,
+    "diagonal": 2.1487977504730225,
+    "finite": 0.014180945232510567
+  },
+  {
+    "step": 779,
+    "loss": 2.2957282066345215,
+    "diagonal": 2.2771549224853516,
+    "finite": 0.018573325127363205
+  },
+  {
+    "step": 780,
+    "loss": 2.407480001449585,
+    "diagonal": 2.388704776763916,
+    "finite": 0.018775178119540215
+  },
+  {
+    "step": 781,
+    "loss": 2.2061092853546143,
+    "diagonal": 2.1910407543182373,
+    "finite": 0.01506858877837658
+  },
+  {
+    "step": 782,
+    "loss": 2.4440815448760986,
+    "diagonal": 2.412362575531006,
+    "finite": 0.0317189060151577
+  },
+  {
+    "step": 783,
+    "loss": 2.4294986724853516,
+    "diagonal": 2.4183826446533203,
+    "finite": 0.0111160259693861
+  },
+  {
+    "step": 784,
+    "loss": 2.0313384532928467,
+    "diagonal": 2.0218396186828613,
+    "finite": 0.009498861618340015
+  },
+  {
+    "step": 785,
+    "loss": 2.0445802211761475,
+    "diagonal": 2.0295984745025635,
+    "finite": 0.014981798827648163
+  },
+  {
+    "step": 786,
+    "loss": 2.3447225093841553,
+    "diagonal": 2.3227646350860596,
+    "finite": 0.02195778116583824
+  },
+  {
+    "step": 787,
+    "loss": 2.1284849643707275,
+    "diagonal": 2.1145055294036865,
+    "finite": 0.013979393988847733
+  },
+  {
+    "step": 788,
+    "loss": 1.8357399702072144,
+    "diagonal": 1.823633074760437,
+    "finite": 0.012106855399906635
+  },
+  {
+    "step": 789,
+    "loss": 1.9871739149093628,
+    "diagonal": 1.9755487442016602,
+    "finite": 0.011625158600509167
+  },
+  {
+    "step": 790,
+    "loss": 2.4532952308654785,
+    "diagonal": 2.437103748321533,
+    "finite": 0.016191542148590088
+  },
+  {
+    "step": 791,
+    "loss": 2.27480149269104,
+    "diagonal": 2.261277198791504,
+    "finite": 0.01352424081414938
+  },
+  {
+    "step": 792,
+    "loss": 1.8271548748016357,
+    "diagonal": 1.812261939048767,
+    "finite": 0.014892877079546452
+  },
+  {
+    "step": 793,
+    "loss": 2.2821085453033447,
+    "diagonal": 2.266179323196411,
+    "finite": 0.01592915505170822
+  },
+  {
+    "step": 794,
+    "loss": 1.5920419692993164,
+    "diagonal": 1.5788836479187012,
+    "finite": 0.013158364221453667
+  },
+  {
+    "step": 795,
+    "loss": 2.316948652267456,
+    "diagonal": 2.3064322471618652,
+    "finite": 0.01051643118262291
+  },
+  {
+    "step": 796,
+    "loss": 2.2872276306152344,
+    "diagonal": 2.277087450027466,
+    "finite": 0.01014024205505848
+  },
+  {
+    "step": 797,
+    "loss": 2.077946424484253,
+    "diagonal": 2.069840431213379,
+    "finite": 0.008106033317744732
+  },
+  {
+    "step": 798,
+    "loss": 2.0930898189544678,
+    "diagonal": 2.0826616287231445,
+    "finite": 0.010428182780742645
+  },
+  {
+    "step": 799,
+    "loss": 2.171828269958496,
+    "diagonal": 2.166415214538574,
+    "finite": 0.005413117352873087
+  },
+  {
+    "step": 800,
+    "loss": 2.609450578689575,
+    "diagonal": 2.6017537117004395,
+    "finite": 0.007696825545281172
+  },
+  {
+    "step": 801,
+    "loss": 2.0097599029541016,
+    "diagonal": 1.9909229278564453,
+    "finite": 0.018837062641978264
+  },
+  {
+    "step": 802,
+    "loss": 2.0762345790863037,
+    "diagonal": 2.0541110038757324,
+    "finite": 0.02212356962263584
+  },
+  {
+    "step": 803,
+    "loss": 2.2309868335723877,
+    "diagonal": 2.2191481590270996,
+    "finite": 0.011838728561997414
+  },
+  {
+    "step": 804,
+    "loss": 2.3493399620056152,
+    "diagonal": 2.340301990509033,
+    "finite": 0.009037993848323822
+  },
+  {
+    "step": 805,
+    "loss": 2.1153981685638428,
+    "diagonal": 2.101363182067871,
+    "finite": 0.014035063795745373
+  },
+  {
+    "step": 806,
+    "loss": 2.353132724761963,
+    "diagonal": 2.3418080806732178,
+    "finite": 0.011324699968099594
+  },
+  {
+    "step": 807,
+    "loss": 2.479313850402832,
+    "diagonal": 2.472289562225342,
+    "finite": 0.007024304009974003
+  },
+  {
+    "step": 808,
+    "loss": 2.4249496459960938,
+    "diagonal": 2.411907911300659,
+    "finite": 0.013041741214692593
+  },
+  {
+    "step": 809,
+    "loss": 1.9295125007629395,
+    "diagonal": 1.917728066444397,
+    "finite": 0.01178439799696207
+  },
+  {
+    "step": 810,
+    "loss": 2.4001729488372803,
+    "diagonal": 2.389040946960449,
+    "finite": 0.011132052168250084
+  },
+  {
+    "step": 811,
+    "loss": 2.2565836906433105,
+    "diagonal": 2.2472691535949707,
+    "finite": 0.009314554743468761
+  },
+  {
+    "step": 812,
+    "loss": 2.0154850482940674,
+    "diagonal": 2.0088489055633545,
+    "finite": 0.006636171601712704
+  },
+  {
+    "step": 813,
+    "loss": 2.079240560531616,
+    "diagonal": 2.056042194366455,
+    "finite": 0.023198358714580536
+  },
+  {
+    "step": 814,
+    "loss": 2.1904149055480957,
+    "diagonal": 2.1817450523376465,
+    "finite": 0.00866980291903019
+  },
+  {
+    "step": 815,
+    "loss": 2.2678232192993164,
+    "diagonal": 2.2554898262023926,
+    "finite": 0.01233331486582756
+  },
+  {
+    "step": 816,
+    "loss": 1.9269853830337524,
+    "diagonal": 1.9103542566299438,
+    "finite": 0.01663115620613098
+  },
+  {
+    "step": 817,
+    "loss": 2.207902193069458,
+    "diagonal": 2.1879518032073975,
+    "finite": 0.019950496032834053
+  },
+  {
+    "step": 818,
+    "loss": 2.3252034187316895,
+    "diagonal": 2.312429666519165,
+    "finite": 0.012773706577718258
+  },
+  {
+    "step": 819,
+    "loss": 2.4969496726989746,
+    "diagonal": 2.483802318572998,
+    "finite": 0.013147318735718727
+  },
+  {
+    "step": 820,
+    "loss": 2.1397881507873535,
+    "diagonal": 2.1265437602996826,
+    "finite": 0.013244479894638062
+  },
+  {
+    "step": 821,
+    "loss": 2.1200571060180664,
+    "diagonal": 2.108907461166382,
+    "finite": 0.011149667203426361
+  },
+  {
+    "step": 822,
+    "loss": 2.6189846992492676,
+    "diagonal": 2.6041719913482666,
+    "finite": 0.01481262780725956
+  },
+  {
+    "step": 823,
+    "loss": 1.9034992456436157,
+    "diagonal": 1.8909540176391602,
+    "finite": 0.012545283883810043
+  },
+  {
+    "step": 824,
+    "loss": 2.2321841716766357,
+    "diagonal": 2.21931529045105,
+    "finite": 0.012868986465036869
+  },
+  {
+    "step": 825,
+    "loss": 2.030029058456421,
+    "diagonal": 2.019064426422119,
+    "finite": 0.010964682325720787
+  },
+  {
+    "step": 826,
+    "loss": 2.3313417434692383,
+    "diagonal": 2.312394618988037,
+    "finite": 0.01894722506403923
+  },
+  {
+    "step": 827,
+    "loss": 2.0296273231506348,
+    "diagonal": 2.0192346572875977,
+    "finite": 0.010392677038908005
+  },
+  {
+    "step": 828,
+    "loss": 2.3427317142486572,
+    "diagonal": 2.3295609951019287,
+    "finite": 0.01317068375647068
+  },
+  {
+    "step": 829,
+    "loss": 2.2508769035339355,
+    "diagonal": 2.2412118911743164,
+    "finite": 0.009664958342909813
+  },
+  {
+    "step": 830,
+    "loss": 2.1522715091705322,
+    "diagonal": 2.138740062713623,
+    "finite": 0.01353134959936142
+  },
+  {
+    "step": 831,
+    "loss": 1.870557188987732,
+    "diagonal": 1.8617252111434937,
+    "finite": 0.00883202999830246
+  },
+  {
+    "step": 832,
+    "loss": 2.3514933586120605,
+    "diagonal": 2.3452534675598145,
+    "finite": 0.006239837035536766
+  },
+  {
+    "step": 833,
+    "loss": 1.9228872060775757,
+    "diagonal": 1.916134238243103,
+    "finite": 0.006753002293407917
+  },
+  {
+    "step": 834,
+    "loss": 1.7947192192077637,
+    "diagonal": 1.7866305112838745,
+    "finite": 0.008088667877018452
+  },
+  {
+    "step": 835,
+    "loss": 1.9316058158874512,
+    "diagonal": 1.9248286485671997,
+    "finite": 0.006777185946702957
+  },
+  {
+    "step": 836,
+    "loss": 2.0094947814941406,
+    "diagonal": 1.999145269393921,
+    "finite": 0.01034947857260704
+  },
+  {
+    "step": 837,
+    "loss": 2.195726156234741,
+    "diagonal": 2.182433843612671,
+    "finite": 0.013292305171489716
+  },
+  {
+    "step": 838,
+    "loss": 2.8853695392608643,
+    "diagonal": 2.8638246059417725,
+    "finite": 0.021544858813285828
+  },
+  {
+    "step": 839,
+    "loss": 2.283698320388794,
+    "diagonal": 2.2631425857543945,
+    "finite": 0.020555727183818817
+  },
+  {
+    "step": 840,
+    "loss": 2.1308059692382812,
+    "diagonal": 2.1099491119384766,
+    "finite": 0.020856792107224464
+  },
+  {
+    "step": 841,
+    "loss": 2.48064923286438,
+    "diagonal": 2.4566144943237305,
+    "finite": 0.02403479814529419
+  },
+  {
+    "step": 842,
+    "loss": 2.603281259536743,
+    "diagonal": 2.5905072689056396,
+    "finite": 0.012773880735039711
+  },
+  {
+    "step": 843,
+    "loss": 2.5710296630859375,
+    "diagonal": 2.5569827556610107,
+    "finite": 0.014046951197087765
+  },
+  {
+    "step": 844,
+    "loss": 2.3943464756011963,
+    "diagonal": 2.3788928985595703,
+    "finite": 0.015453506261110306
+  },
+  {
+    "step": 845,
+    "loss": 1.9163049459457397,
+    "diagonal": 1.9029065370559692,
+    "finite": 0.013398393988609314
+  },
+  {
+    "step": 846,
+    "loss": 2.218900442123413,
+    "diagonal": 2.196768045425415,
+    "finite": 0.022132469341158867
+  },
+  {
+    "step": 847,
+    "loss": 3.079160213470459,
+    "diagonal": 3.0568082332611084,
+    "finite": 0.02235187217593193
+  },
+  {
+    "step": 848,
+    "loss": 2.343034029006958,
+    "diagonal": 2.3263814449310303,
+    "finite": 0.01665261946618557
+  },
+  {
+    "step": 849,
+    "loss": 2.0401651859283447,
+    "diagonal": 2.0282626152038574,
+    "finite": 0.011902561411261559
+  },
+  {
+    "step": 850,
+    "loss": 2.247326612472534,
+    "diagonal": 2.238227605819702,
+    "finite": 0.009098963811993599
+  },
+  {
+    "step": 851,
+    "loss": 1.804109811782837,
+    "diagonal": 1.7684447765350342,
+    "finite": 0.03566506505012512
+  },
+  {
+    "step": 852,
+    "loss": 2.2013540267944336,
+    "diagonal": 2.176520586013794,
+    "finite": 0.024833407253026962
+  },
+  {
+    "step": 853,
+    "loss": 2.142530918121338,
+    "diagonal": 2.110517978668213,
+    "finite": 0.032012827694416046
+  },
+  {
+    "step": 854,
+    "loss": 2.086251974105835,
+    "diagonal": 2.0744924545288086,
+    "finite": 0.011759523302316666
+  },
+  {
+    "step": 855,
+    "loss": 2.3500118255615234,
+    "diagonal": 2.327526092529297,
+    "finite": 0.02248571813106537
+  },
+  {
+    "step": 856,
+    "loss": 2.0750367641448975,
+    "diagonal": 2.0628345012664795,
+    "finite": 0.012202205136418343
+  },
+  {
+    "step": 857,
+    "loss": 2.148350238800049,
+    "diagonal": 2.1361143589019775,
+    "finite": 0.012235860340297222
+  },
+  {
+    "step": 858,
+    "loss": 2.1978869438171387,
+    "diagonal": 2.187490463256836,
+    "finite": 0.010396566241979599
+  },
+  {
+    "step": 859,
+    "loss": 2.4811453819274902,
+    "diagonal": 2.4689698219299316,
+    "finite": 0.012175540439784527
+  },
+  {
+    "step": 860,
+    "loss": 2.2432138919830322,
+    "diagonal": 2.223771095275879,
+    "finite": 0.01944284327328205
+  },
+  {
+    "step": 861,
+    "loss": 1.880401611328125,
+    "diagonal": 1.8657742738723755,
+    "finite": 0.014627394266426563
+  },
+  {
+    "step": 862,
+    "loss": 2.8615882396698,
+    "diagonal": 2.8459866046905518,
+    "finite": 0.015601727180182934
+  },
+  {
+    "step": 863,
+    "loss": 2.2974581718444824,
+    "diagonal": 2.2857728004455566,
+    "finite": 0.011685390025377274
+  },
+  {
+    "step": 864,
+    "loss": 1.798643708229065,
+    "diagonal": 1.7899932861328125,
+    "finite": 0.008650446310639381
+  },
+  {
+    "step": 865,
+    "loss": 1.9094502925872803,
+    "diagonal": 1.8964414596557617,
+    "finite": 0.013008849695324898
+  },
+  {
+    "step": 866,
+    "loss": 1.9544398784637451,
+    "diagonal": 1.9430577754974365,
+    "finite": 0.011382113210856915
+  },
+  {
+    "step": 867,
+    "loss": 2.011970043182373,
+    "diagonal": 1.9984441995620728,
+    "finite": 0.013525879010558128
+  },
+  {
+    "step": 868,
+    "loss": 2.347700595855713,
+    "diagonal": 2.320361614227295,
+    "finite": 0.027338998392224312
+  },
+  {
+    "step": 869,
+    "loss": 2.367405414581299,
+    "diagonal": 2.3364310264587402,
+    "finite": 0.030974436551332474
+  },
+  {
+    "step": 870,
+    "loss": 1.8987879753112793,
+    "diagonal": 1.8752901554107666,
+    "finite": 0.023497773334383965
+  },
+  {
+    "step": 871,
+    "loss": 2.2879714965820312,
+    "diagonal": 2.254457473754883,
+    "finite": 0.03351390361785889
+  },
+  {
+    "step": 872,
+    "loss": 2.138136625289917,
+    "diagonal": 2.1239304542541504,
+    "finite": 0.014206193387508392
+  },
+  {
+    "step": 873,
+    "loss": 2.252662181854248,
+    "diagonal": 2.244729518890381,
+    "finite": 0.007932561449706554
+  },
+  {
+    "step": 874,
+    "loss": 1.9904212951660156,
+    "diagonal": 1.971754789352417,
+    "finite": 0.01866648532450199
+  },
+  {
+    "step": 875,
+    "loss": 1.9215335845947266,
+    "diagonal": 1.9089455604553223,
+    "finite": 0.012588055804371834
+  },
+  {
+    "step": 876,
+    "loss": 1.9881808757781982,
+    "diagonal": 1.9774795770645142,
+    "finite": 0.010701321065425873
+  },
+  {
+    "step": 877,
+    "loss": 2.5208213329315186,
+    "diagonal": 2.509416103363037,
+    "finite": 0.011405286379158497
+  },
+  {
+    "step": 878,
+    "loss": 1.7669283151626587,
+    "diagonal": 1.7462865114212036,
+    "finite": 0.020641854032874107
+  },
+  {
+    "step": 879,
+    "loss": 1.7921174764633179,
+    "diagonal": 1.7753769159317017,
+    "finite": 0.016740553081035614
+  },
+  {
+    "step": 880,
+    "loss": 2.2684481143951416,
+    "diagonal": 2.2492804527282715,
+    "finite": 0.019167641177773476
+  },
+  {
+    "step": 881,
+    "loss": 2.3997271060943604,
+    "diagonal": 2.380361318588257,
+    "finite": 0.019365787506103516
+  },
+  {
+    "step": 882,
+    "loss": 2.205125331878662,
+    "diagonal": 2.16591739654541,
+    "finite": 0.03920789808034897
+  },
+  {
+    "step": 883,
+    "loss": 2.3921141624450684,
+    "diagonal": 2.372293710708618,
+    "finite": 0.019820477813482285
+  },
+  {
+    "step": 884,
+    "loss": 2.3529551029205322,
+    "diagonal": 2.3410263061523438,
+    "finite": 0.011928800493478775
+  },
+  {
+    "step": 885,
+    "loss": 2.117189884185791,
+    "diagonal": 2.1016666889190674,
+    "finite": 0.015523162670433521
+  },
+  {
+    "step": 886,
+    "loss": 1.630377173423767,
+    "diagonal": 1.621943712234497,
+    "finite": 0.008433450944721699
+  },
+  {
+    "step": 887,
+    "loss": 1.9984869956970215,
+    "diagonal": 1.9846932888031006,
+    "finite": 0.013793714344501495
+  },
+  {
+    "step": 888,
+    "loss": 1.7730406522750854,
+    "diagonal": 1.7582935094833374,
+    "finite": 0.014747168868780136
+  },
+  {
+    "step": 889,
+    "loss": 1.811240553855896,
+    "diagonal": 1.7867697477340698,
+    "finite": 0.02447078563272953
+  },
+  {
+    "step": 890,
+    "loss": 1.8492485284805298,
+    "diagonal": 1.8389027118682861,
+    "finite": 0.01034585665911436
+  },
+  {
+    "step": 891,
+    "loss": 2.742396831512451,
+    "diagonal": 2.7338924407958984,
+    "finite": 0.008504493162035942
+  },
+  {
+    "step": 892,
+    "loss": 2.1754326820373535,
+    "diagonal": 2.1665358543395996,
+    "finite": 0.008896884508430958
+  },
+  {
+    "step": 893,
+    "loss": 2.568716287612915,
+    "diagonal": 2.555319309234619,
+    "finite": 0.01339694857597351
+  },
+  {
+    "step": 894,
+    "loss": 2.618016004562378,
+    "diagonal": 2.6063718795776367,
+    "finite": 0.011644048616290092
+  },
+  {
+    "step": 895,
+    "loss": 2.6894214153289795,
+    "diagonal": 2.6840262413024902,
+    "finite": 0.005395126529037952
+  },
+  {
+    "step": 896,
+    "loss": 1.9836252927780151,
+    "diagonal": 1.9756494760513306,
+    "finite": 0.007975811138749123
+  },
+  {
+    "step": 897,
+    "loss": 2.189702272415161,
+    "diagonal": 2.1787326335906982,
+    "finite": 0.010969573631882668
+  },
+  {
+    "step": 898,
+    "loss": 1.905127763748169,
+    "diagonal": 1.8964011669158936,
+    "finite": 0.00872653815895319
+  },
+  {
+    "step": 899,
+    "loss": 2.7303013801574707,
+    "diagonal": 2.719322681427002,
+    "finite": 0.010978654026985168
+  },
+  {
+    "step": 900,
+    "loss": 2.3209118843078613,
+    "diagonal": 2.307753086090088,
+    "finite": 0.013158878311514854
+  },
+  {
+    "step": 901,
+    "loss": 2.4818968772888184,
+    "diagonal": 2.46484637260437,
+    "finite": 0.017050571739673615
+  },
+  {
+    "step": 902,
+    "loss": 2.455146312713623,
+    "diagonal": 2.4271910190582275,
+    "finite": 0.027955319732427597
+  },
+  {
+    "step": 903,
+    "loss": 2.094015121459961,
+    "diagonal": 2.076327323913574,
+    "finite": 0.0176878422498703
+  },
+  {
+    "step": 904,
+    "loss": 2.2882490158081055,
+    "diagonal": 2.2753241062164307,
+    "finite": 0.012924889102578163
+  },
+  {
+    "step": 905,
+    "loss": 1.9932986497879028,
+    "diagonal": 1.9863876104354858,
+    "finite": 0.0069110882468521595
+  },
+  {
+    "step": 906,
+    "loss": 2.292703866958618,
+    "diagonal": 2.285902738571167,
+    "finite": 0.006801124662160873
+  },
+  {
+    "step": 907,
+    "loss": 1.89283287525177,
+    "diagonal": 1.874107003211975,
+    "finite": 0.018725905567407608
+  },
+  {
+    "step": 908,
+    "loss": 2.4876089096069336,
+    "diagonal": 2.4724302291870117,
+    "finite": 0.015178711153566837
+  },
+  {
+    "step": 909,
+    "loss": 2.1961116790771484,
+    "diagonal": 2.186272144317627,
+    "finite": 0.009839492850005627
+  },
+  {
+    "step": 910,
+    "loss": 2.448815107345581,
+    "diagonal": 2.4341187477111816,
+    "finite": 0.014696434140205383
+  },
+  {
+    "step": 911,
+    "loss": 1.7325148582458496,
+    "diagonal": 1.7147772312164307,
+    "finite": 0.017737608402967453
+  },
+  {
+    "step": 912,
+    "loss": 2.3493971824645996,
+    "diagonal": 2.3320374488830566,
+    "finite": 0.017359845340251923
+  },
+  {
+    "step": 913,
+    "loss": 2.6059017181396484,
+    "diagonal": 2.5966169834136963,
+    "finite": 0.009284844622015953
+  },
+  {
+    "step": 914,
+    "loss": 2.3571431636810303,
+    "diagonal": 2.3494222164154053,
+    "finite": 0.007720950525254011
+  },
+  {
+    "step": 915,
+    "loss": 1.988844871520996,
+    "diagonal": 1.971693992614746,
+    "finite": 0.01715085469186306
+  },
+  {
+    "step": 916,
+    "loss": 1.9579992294311523,
+    "diagonal": 1.9483731985092163,
+    "finite": 0.00962601788341999
+  },
+  {
+    "step": 917,
+    "loss": 2.0175485610961914,
+    "diagonal": 2.00673246383667,
+    "finite": 0.010816169902682304
+  },
+  {
+    "step": 918,
+    "loss": 2.194584608078003,
+    "diagonal": 2.1813950538635254,
+    "finite": 0.013189457356929779
+  },
+  {
+    "step": 919,
+    "loss": 2.1088991165161133,
+    "diagonal": 2.0903921127319336,
+    "finite": 0.018506933003664017
+  },
+  {
+    "step": 920,
+    "loss": 2.116264820098877,
+    "diagonal": 2.103198766708374,
+    "finite": 0.013066167011857033
+  },
+  {
+    "step": 921,
+    "loss": 2.4437825679779053,
+    "diagonal": 2.427053451538086,
+    "finite": 0.016729125753045082
+  },
+  {
+    "step": 922,
+    "loss": 2.482360601425171,
+    "diagonal": 2.471097946166992,
+    "finite": 0.011262691579759121
+  },
+  {
+    "step": 923,
+    "loss": 2.209861993789673,
+    "diagonal": 2.185307025909424,
+    "finite": 0.024554960429668427
+  },
+  {
+    "step": 924,
+    "loss": 2.239762306213379,
+    "diagonal": 2.2300827503204346,
+    "finite": 0.009679474867880344
+  },
+  {
+    "step": 925,
+    "loss": 1.6226335763931274,
+    "diagonal": 1.6078420877456665,
+    "finite": 0.014791455119848251
+  },
+  {
+    "step": 926,
+    "loss": 2.5610013008117676,
+    "diagonal": 2.5511510372161865,
+    "finite": 0.009850206784904003
+  },
+  {
+    "step": 927,
+    "loss": 2.7043039798736572,
+    "diagonal": 2.698498010635376,
+    "finite": 0.0058059897273778915
+  },
+  {
+    "step": 928,
+    "loss": 2.176492929458618,
+    "diagonal": 2.1681556701660156,
+    "finite": 0.008337149396538734
+  },
+  {
+    "step": 929,
+    "loss": 2.310558795928955,
+    "diagonal": 2.2926697731018066,
+    "finite": 0.01788894459605217
+  },
+  {
+    "step": 930,
+    "loss": 2.2444660663604736,
+    "diagonal": 2.2346370220184326,
+    "finite": 0.00982902105897665
+  },
+  {
+    "step": 931,
+    "loss": 2.3616819381713867,
+    "diagonal": 2.346210479736328,
+    "finite": 0.01547153852880001
+  },
+  {
+    "step": 932,
+    "loss": 2.6474368572235107,
+    "diagonal": 2.6349847316741943,
+    "finite": 0.012452065013349056
+  },
+  {
+    "step": 933,
+    "loss": 1.9823107719421387,
+    "diagonal": 1.9754548072814941,
+    "finite": 0.00685602193698287
+  },
+  {
+    "step": 934,
+    "loss": 2.018854856491089,
+    "diagonal": 2.009917736053467,
+    "finite": 0.00893723126500845
+  },
+  {
+    "step": 935,
+    "loss": 2.340564727783203,
+    "diagonal": 2.3296711444854736,
+    "finite": 0.0108936857432127
+  },
+  {
+    "step": 936,
+    "loss": 2.4380099773406982,
+    "diagonal": 2.4302124977111816,
+    "finite": 0.007797464728355408
+  },
+  {
+    "step": 937,
+    "loss": 2.259265899658203,
+    "diagonal": 2.239933967590332,
+    "finite": 0.01933198980987072
+  },
+  {
+    "step": 938,
+    "loss": 2.2154808044433594,
+    "diagonal": 2.1980249881744385,
+    "finite": 0.017455890774726868
+  },
+  {
+    "step": 939,
+    "loss": 1.8869459629058838,
+    "diagonal": 1.8786840438842773,
+    "finite": 0.008261940442025661
+  },
+  {
+    "step": 940,
+    "loss": 2.1413638591766357,
+    "diagonal": 2.1270291805267334,
+    "finite": 0.014334574341773987
+  },
+  {
+    "step": 941,
+    "loss": 1.8757213354110718,
+    "diagonal": 1.8653373718261719,
+    "finite": 0.010383929125964642
+  },
+  {
+    "step": 942,
+    "loss": 2.3794960975646973,
+    "diagonal": 2.365269422531128,
+    "finite": 0.014226687140762806
+  },
+  {
+    "step": 943,
+    "loss": 2.204218626022339,
+    "diagonal": 2.184713363647461,
+    "finite": 0.019505197182297707
+  },
+  {
+    "step": 944,
+    "loss": 2.61842942237854,
+    "diagonal": 2.601170301437378,
+    "finite": 0.01725906692445278
+  },
+  {
+    "step": 945,
+    "loss": 2.294933795928955,
+    "diagonal": 2.2765445709228516,
+    "finite": 0.018389306962490082
+  },
+  {
+    "step": 946,
+    "loss": 2.3063735961914062,
+    "diagonal": 2.287410259246826,
+    "finite": 0.018963290378451347
+  },
+  {
+    "step": 947,
+    "loss": 2.007768392562866,
+    "diagonal": 1.9966046810150146,
+    "finite": 0.011163636110723019
+  },
+  {
+    "step": 948,
+    "loss": 2.427885055541992,
+    "diagonal": 2.4171864986419678,
+    "finite": 0.010698635131120682
+  },
+  {
+    "step": 949,
+    "loss": 1.7213077545166016,
+    "diagonal": 1.7111538648605347,
+    "finite": 0.01015384029597044
+  },
+  {
+    "step": 950,
+    "loss": 2.15765643119812,
+    "diagonal": 2.147106647491455,
+    "finite": 0.01054967287927866
+  },
+  {
+    "step": 951,
+    "loss": 1.9405022859573364,
+    "diagonal": 1.9289299249649048,
+    "finite": 0.01157233864068985
+  },
+  {
+    "step": 952,
+    "loss": 2.4267754554748535,
+    "diagonal": 2.413898468017578,
+    "finite": 0.01287706010043621
+  },
+  {
+    "step": 953,
+    "loss": 1.6148325204849243,
+    "diagonal": 1.5917061567306519,
+    "finite": 0.023126322776079178
+  },
+  {
+    "step": 954,
+    "loss": 1.8724582195281982,
+    "diagonal": 1.852637529373169,
+    "finite": 0.01982065849006176
+  },
+  {
+    "step": 955,
+    "loss": 1.933716058731079,
+    "diagonal": 1.9144026041030884,
+    "finite": 0.019313495606184006
+  },
+  {
+    "step": 956,
+    "loss": 2.035311222076416,
+    "diagonal": 2.016061782836914,
+    "finite": 0.019249336794018745
+  },
+  {
+    "step": 957,
+    "loss": 2.0635159015655518,
+    "diagonal": 2.0469565391540527,
+    "finite": 0.01655934378504753
+  },
+  {
+    "step": 958,
+    "loss": 2.4645979404449463,
+    "diagonal": 2.4512181282043457,
+    "finite": 0.013379727490246296
+  },
+  {
+    "step": 959,
+    "loss": 2.2515039443969727,
+    "diagonal": 2.229560136795044,
+    "finite": 0.021943889558315277
+  },
+  {
+    "step": 960,
+    "loss": 1.8652044534683228,
+    "diagonal": 1.849959373474121,
+    "finite": 0.015245093032717705
+  },
+  {
+    "step": 961,
+    "loss": 2.1450111865997314,
+    "diagonal": 2.13399600982666,
+    "finite": 0.01101511437445879
+  },
+  {
+    "step": 962,
+    "loss": 2.491631269454956,
+    "diagonal": 2.4824373722076416,
+    "finite": 0.009193780831992626
+  },
+  {
+    "step": 963,
+    "loss": 2.0867042541503906,
+    "diagonal": 2.077091932296753,
+    "finite": 0.009612388908863068
+  },
+  {
+    "step": 964,
+    "loss": 2.0386033058166504,
+    "diagonal": 2.0220940113067627,
+    "finite": 0.016509337350726128
+  },
+  {
+    "step": 965,
+    "loss": 1.826367735862732,
+    "diagonal": 1.809370994567871,
+    "finite": 0.016996758058667183
+  },
+  {
+    "step": 966,
+    "loss": 2.454319953918457,
+    "diagonal": 2.4316694736480713,
+    "finite": 0.02265055663883686
+  },
+  {
+    "step": 967,
+    "loss": 2.059061288833618,
+    "diagonal": 2.027831554412842,
+    "finite": 0.031229661777615547
+  },
+  {
+    "step": 968,
+    "loss": 1.7313270568847656,
+    "diagonal": 1.7070200443267822,
+    "finite": 0.02430698648095131
+  },
+  {
+    "step": 969,
+    "loss": 2.065819025039673,
+    "diagonal": 2.0374112129211426,
+    "finite": 0.028407778590917587
+  },
+  {
+    "step": 970,
+    "loss": 2.504955530166626,
+    "diagonal": 2.483283519744873,
+    "finite": 0.021671941503882408
+  },
+  {
+    "step": 971,
+    "loss": 2.1881988048553467,
+    "diagonal": 2.1667110919952393,
+    "finite": 0.02148778736591339
+  },
+  {
+    "step": 972,
+    "loss": 2.0065951347351074,
+    "diagonal": 1.986806035041809,
+    "finite": 0.01978921703994274
+  },
+  {
+    "step": 973,
+    "loss": 2.376896619796753,
+    "diagonal": 2.363246202468872,
+    "finite": 0.013650408014655113
+  },
+  {
+    "step": 974,
+    "loss": 2.5273118019104004,
+    "diagonal": 2.520228624343872,
+    "finite": 0.007083119358867407
+  },
+  {
+    "step": 975,
+    "loss": 2.4639599323272705,
+    "diagonal": 2.460050106048584,
+    "finite": 0.003909829072654247
+  },
+  {
+    "step": 976,
+    "loss": 2.61936354637146,
+    "diagonal": 2.6067473888397217,
+    "finite": 0.012616103515028954
+  },
+  {
+    "step": 977,
+    "loss": 1.9274847507476807,
+    "diagonal": 1.9131979942321777,
+    "finite": 0.014286712743341923
+  },
+  {
+    "step": 978,
+    "loss": 1.9548646211624146,
+    "diagonal": 1.942577838897705,
+    "finite": 0.01228675153106451
+  },
+  {
+    "step": 979,
+    "loss": 1.95100998878479,
+    "diagonal": 1.9330998659133911,
+    "finite": 0.017910074442625046
+  },
+  {
+    "step": 980,
+    "loss": 2.234837770462036,
+    "diagonal": 2.2095119953155518,
+    "finite": 0.025325866416096687
+  },
+  {
+    "step": 981,
+    "loss": 2.807223320007324,
+    "diagonal": 2.783296585083008,
+    "finite": 0.023926669731736183
+  },
+  {
+    "step": 982,
+    "loss": 2.0567071437835693,
+    "diagonal": 2.0329933166503906,
+    "finite": 0.023713944479823112
+  },
+  {
+    "step": 983,
+    "loss": 2.249234676361084,
+    "diagonal": 2.221874475479126,
+    "finite": 0.027360238134860992
+  },
+  {
+    "step": 984,
+    "loss": 1.9078220129013062,
+    "diagonal": 1.8809163570404053,
+    "finite": 0.026905616745352745
+  },
+  {
+    "step": 985,
+    "loss": 2.4713432788848877,
+    "diagonal": 2.4494056701660156,
+    "finite": 0.021937521174550056
+  },
+  {
+    "step": 986,
+    "loss": 2.0179243087768555,
+    "diagonal": 2.0022947788238525,
+    "finite": 0.01562952995300293
+  },
+  {
+    "step": 987,
+    "loss": 2.3461263179779053,
+    "diagonal": 2.333414077758789,
+    "finite": 0.012712220661342144
+  },
+  {
+    "step": 988,
+    "loss": 1.7455203533172607,
+    "diagonal": 1.738448143005371,
+    "finite": 0.007072200067341328
+  },
+  {
+    "step": 989,
+    "loss": 2.3144690990448,
+    "diagonal": 2.3009073734283447,
+    "finite": 0.013561824336647987
+  },
+  {
+    "step": 990,
+    "loss": 2.6536307334899902,
+    "diagonal": 2.642026901245117,
+    "finite": 0.011603830382227898
+  },
+  {
+    "step": 991,
+    "loss": 2.2785658836364746,
+    "diagonal": 2.2566230297088623,
+    "finite": 0.02194289118051529
+  },
+  {
+    "step": 992,
+    "loss": 2.146533250808716,
+    "diagonal": 2.133744478225708,
+    "finite": 0.012788665480911732
+  },
+  {
+    "step": 993,
+    "loss": 1.9233012199401855,
+    "diagonal": 1.9121626615524292,
+    "finite": 0.01113853882998228
+  },
+  {
+    "step": 994,
+    "loss": 2.0185415744781494,
+    "diagonal": 2.0036065578460693,
+    "finite": 0.014934916980564594
+  },
+  {
+    "step": 995,
+    "loss": 2.1657485961914062,
+    "diagonal": 2.153021812438965,
+    "finite": 0.012726804241538048
+  },
+  {
+    "step": 996,
+    "loss": 1.9521684646606445,
+    "diagonal": 1.939345121383667,
+    "finite": 0.01282337587326765
+  },
+  {
+    "step": 997,
+    "loss": 2.058502674102783,
+    "diagonal": 2.04767107963562,
+    "finite": 0.010831523686647415
+  },
+  {
+    "step": 998,
+    "loss": 1.982990026473999,
+    "diagonal": 1.9720792770385742,
+    "finite": 0.010910751298069954
+  },
+  {
+    "step": 999,
+    "loss": 2.330812931060791,
+    "diagonal": 2.31876802444458,
+    "finite": 0.012044812552630901
+  }
+]
diff --git a/lecture_6/verified_examples/self-distill/report.json b/lecture_6/verified_examples/self-distill/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..40d25342fb382d93d29aa40e1a62f775c8f824c5
--- /dev/null
+++ b/lecture_6/verified_examples/self-distill/report.json
@@ -0,0 +1,24 @@
+{
+  "method": "self-distill",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 3.1982985615730284,
+  "train_loss_last_20_mean": 2.1831001818180082,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "composition_rmse": 0.19764021039009094,
+  "finite_samples": true,
+  "mean_distance_to_center": 0.7285744547843933,
+  "mode_fractions": [
+    0.21875,
+    0.2421875,
+    0.2890625,
+    0.25
+  ],
+  "mode_entropy": 1.3812267780303955,
+  "mean_target_log_density": -7.429709434509277,
+  "elapsed_seconds": 1.9765548720024526
+}
diff --git a/lecture_6/verified_examples/self-distill/samples.txt b/lecture_6/verified_examples/self-distill/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..c2739f8edf3ee38256536ae9813235c7c113c163
--- /dev/null
+++ b/lecture_6/verified_examples/self-distill/samples.txt
@@ -0,0 +1,128 @@
+-0.9284421 1.8392183
+-1.6477040 1.6713676
+-1.9473152 -1.6112877
+-1.6306666 0.4192069
+0.6399608 -1.3958774
+-1.4291388 1.7282896
+1.7094322 -1.9439218
+-1.5412738 -1.9527099
+-1.6330578 -1.4278703
+1.0314312 1.8644843
+0.3426302 1.3405173
+2.0595107 -0.7629291
+1.8696756 0.8212715
+0.7419077 -0.0307919
+-1.1981131 -1.6432227
+1.9324136 -1.7695559
+1.2376468 1.5806096
+1.3305537 -1.9580168
+0.5657494 0.9059644
+1.6080422 -1.6691725
+-1.7829281 1.7064493
+-1.6209080 -0.7101488
+-1.5606453 -1.8678753
+-1.2038226 -1.9443513
+0.3956786 -1.8123521
+-1.8914748 0.7783750
+1.0635465 0.3485735
+-0.1695375 -1.8723568
+-1.8175259 1.3840199
+-0.1213996 -1.9369066
+-0.9259942 -1.2872193
+-2.0944946 -1.4933759
+0.0995864 -2.0962462
+-1.5104321 -1.6702683
+1.7996030 1.7404656
+0.1078852 -1.6038828
+1.7731172 1.4199071
+0.0423037 1.8414115
+1.5865527 2.0193448
+1.6409237 -0.2698512
+0.4032059 1.6798528
+-1.8971258 -0.3924381
+0.0127822 -1.3367780
+2.0595438 1.1772804
+-1.6810530 -1.5827298
+-0.3660624 1.6429956
+-1.2473857 -1.3922608
+1.6668609 -1.7933972
+1.3368994 1.9521387
+-1.8004477 1.2572632
+0.6083227 1.7377954
+0.1928892 -0.3680722
+1.0342965 -1.0673100
+0.8659589 1.6064650
+-0.1451121 1.8970433
+-2.1338875 1.3006233
+1.2067065 -1.1232735
+-0.2343452 1.2233527
+-1.7960091 -1.0709549
+-1.9103211 2.0309060
+-1.7843570 -0.1293027
+1.1218878 1.7960209
+0.5427696 1.6582404
+1.8783908 0.8393625
+2.0497041 -1.8118227
+1.6538697 -2.0394902
+0.2194639 -1.0502311
+1.9443212 -1.6928722
+-1.5165161 -1.5572690
+-1.9245443 -0.5509647
+1.5760703 1.3403246
+1.5321250 0.4684105
+0.2026380 -0.1455084
+-0.3307628 1.3497976
+1.6182359 1.7113538
+0.3522663 -1.8907278
+1.6171470 -1.9104543
+2.0052137 -1.5846951
+1.5797888 1.5749456
+2.0955029 -1.4200714
+-0.7227395 1.8758467
+1.5659885 1.2929235
+1.3216963 1.9369587
+-1.4787927 2.1653788
+-1.0796064 -0.6582189
+-2.0384753 -0.6114639
+2.3256056 1.6245567
+-0.1669392 1.4005810
+-2.0382845 1.6647731
+0.0097879 -0.1565060
+2.0755310 1.3137645
+-2.1475143 1.4753124
+2.2050457 -1.7751333
+1.2966810 1.6059535
+-1.8907071 0.8247542
+-0.7148989 1.4243455
+-0.2894276 1.2258832
+1.3697762 -1.7279644
+-1.7922496 0.3113209
+1.1377604 -1.7234209
+-1.8542989 -1.4731785
+-1.6637251 1.0043147
+-0.4918224 1.8359137
+-2.0798345 -0.9164868
+-1.5414699 -1.8277234
+-1.8919625 1.6069696
+0.9774088 -1.8603312
+1.3209593 -1.8241727
+-2.0743740 -1.5734932
+-0.8371863 1.4853660
+-0.4098786 -1.7542486
+2.1050363 1.2361633
+0.7727712 1.0125462
+1.2853181 -1.7834774
+1.9686362 -1.5666203
+-1.3100722 -0.9169855
+1.3974836 1.9346356
+1.9973819 1.5824246
+1.1226487 -0.7535407
+-1.9046669 -1.5235262
+2.2211583 -1.7276855
+-2.1122422 0.5362056
+-1.7965605 1.5116541
+1.5474104 1.8858541
+1.3527994 -1.7902814
+-2.1842859 1.6462744
+-1.0702779 1.2277584
+1.9946494 -1.7379880
diff --git a/lecture_6/verified_examples/shortcut/config.json b/lecture_6/verified_examples/shortcut/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..e69ef43b0e16e61f7101e35c3fc8219add531442
--- /dev/null
+++ b/lecture_6/verified_examples/shortcut/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "shortcut",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/shortcut"
+}
diff --git a/lecture_6/verified_examples/shortcut/losses.json b/lecture_6/verified_examples/shortcut/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..2486c934cf8942daf079934505eacb1e4acd34f6
--- /dev/null
+++ b/lecture_6/verified_examples/shortcut/losses.json
@@ -0,0 +1,6002 @@
+[
+  {
+    "step": 0,
+    "loss": 3.338006019592285,
+    "diagonal": 3.3380019664764404,
+    "shortcut": 4.116117452213075e-06
+  },
+  {
+    "step": 1,
+    "loss": 3.151857614517212,
+    "diagonal": 3.151486396789551,
+    "shortcut": 0.00037126216921024024
+  },
+  {
+    "step": 2,
+    "loss": 3.3223657608032227,
+    "diagonal": 3.3211307525634766,
+    "shortcut": 0.0012349436292424798
+  },
+  {
+    "step": 3,
+    "loss": 3.7751898765563965,
+    "diagonal": 3.7725799083709717,
+    "shortcut": 0.002610026393085718
+  },
+  {
+    "step": 4,
+    "loss": 3.289638042449951,
+    "diagonal": 3.2860493659973145,
+    "shortcut": 0.0035885951947420835
+  },
+  {
+    "step": 5,
+    "loss": 3.157104969024658,
+    "diagonal": 3.1524200439453125,
+    "shortcut": 0.004684890620410442
+  },
+  {
+    "step": 6,
+    "loss": 3.389794111251831,
+    "diagonal": 3.381255865097046,
+    "shortcut": 0.00853813998401165
+  },
+  {
+    "step": 7,
+    "loss": 3.1260857582092285,
+    "diagonal": 3.1166908740997314,
+    "shortcut": 0.00939492043107748
+  },
+  {
+    "step": 8,
+    "loss": 3.1394083499908447,
+    "diagonal": 3.125406265258789,
+    "shortcut": 0.01400216668844223
+  },
+  {
+    "step": 9,
+    "loss": 2.9441401958465576,
+    "diagonal": 2.9280953407287598,
+    "shortcut": 0.016044892370700836
+  },
+  {
+    "step": 10,
+    "loss": 4.01138973236084,
+    "diagonal": 3.997040271759033,
+    "shortcut": 0.014349463395774364
+  },
+  {
+    "step": 11,
+    "loss": 3.2204372882843018,
+    "diagonal": 3.1998817920684814,
+    "shortcut": 0.020555416122078896
+  },
+  {
+    "step": 12,
+    "loss": 3.3782286643981934,
+    "diagonal": 3.349717378616333,
+    "shortcut": 0.028511393815279007
+  },
+  {
+    "step": 13,
+    "loss": 3.109921932220459,
+    "diagonal": 3.0826637744903564,
+    "shortcut": 0.027258161455392838
+  },
+  {
+    "step": 14,
+    "loss": 2.8276944160461426,
+    "diagonal": 2.794663429260254,
+    "shortcut": 0.03303099423646927
+  },
+  {
+    "step": 15,
+    "loss": 2.892622709274292,
+    "diagonal": 2.855752944946289,
+    "shortcut": 0.03686969727277756
+  },
+  {
+    "step": 16,
+    "loss": 3.059861183166504,
+    "diagonal": 3.015134811401367,
+    "shortcut": 0.04472646117210388
+  },
+  {
+    "step": 17,
+    "loss": 2.666555166244507,
+    "diagonal": 2.619849920272827,
+    "shortcut": 0.046705178916454315
+  },
+  {
+    "step": 18,
+    "loss": 3.188570737838745,
+    "diagonal": 3.144418478012085,
+    "shortcut": 0.04415220394730568
+  },
+  {
+    "step": 19,
+    "loss": 3.4504282474517822,
+    "diagonal": 3.3997766971588135,
+    "shortcut": 0.050651535391807556
+  },
+  {
+    "step": 20,
+    "loss": 2.98594331741333,
+    "diagonal": 2.9442272186279297,
+    "shortcut": 0.04171598330140114
+  },
+  {
+    "step": 21,
+    "loss": 3.016998291015625,
+    "diagonal": 2.963719129562378,
+    "shortcut": 0.053279075771570206
+  },
+  {
+    "step": 22,
+    "loss": 2.7310972213745117,
+    "diagonal": 2.6718759536743164,
+    "shortcut": 0.059221185743808746
+  },
+  {
+    "step": 23,
+    "loss": 3.0346572399139404,
+    "diagonal": 2.970027208328247,
+    "shortcut": 0.06463003158569336
+  },
+  {
+    "step": 24,
+    "loss": 3.21610164642334,
+    "diagonal": 3.1585159301757812,
+    "shortcut": 0.0575857013463974
+  },
+  {
+    "step": 25,
+    "loss": 2.911116361618042,
+    "diagonal": 2.8516194820404053,
+    "shortcut": 0.059496812522411346
+  },
+  {
+    "step": 26,
+    "loss": 3.433122396469116,
+    "diagonal": 3.3680102825164795,
+    "shortcut": 0.06511200964450836
+  },
+  {
+    "step": 27,
+    "loss": 3.7519352436065674,
+    "diagonal": 3.6900343894958496,
+    "shortcut": 0.061900943517684937
+  },
+  {
+    "step": 28,
+    "loss": 2.962280035018921,
+    "diagonal": 2.8834457397460938,
+    "shortcut": 0.07883436977863312
+  },
+  {
+    "step": 29,
+    "loss": 3.4662280082702637,
+    "diagonal": 3.382966995239258,
+    "shortcut": 0.08326089382171631
+  },
+  {
+    "step": 30,
+    "loss": 3.6392741203308105,
+    "diagonal": 3.548861026763916,
+    "shortcut": 0.09041306376457214
+  },
+  {
+    "step": 31,
+    "loss": 2.9308667182922363,
+    "diagonal": 2.8656842708587646,
+    "shortcut": 0.06518243998289108
+  },
+  {
+    "step": 32,
+    "loss": 2.99434232711792,
+    "diagonal": 2.9055216312408447,
+    "shortcut": 0.08882070332765579
+  },
+  {
+    "step": 33,
+    "loss": 2.6452064514160156,
+    "diagonal": 2.5585625171661377,
+    "shortcut": 0.08664390444755554
+  },
+  {
+    "step": 34,
+    "loss": 2.5386955738067627,
+    "diagonal": 2.4680352210998535,
+    "shortcut": 0.07066045701503754
+  },
+  {
+    "step": 35,
+    "loss": 3.7437150478363037,
+    "diagonal": 3.673750638961792,
+    "shortcut": 0.06996436417102814
+  },
+  {
+    "step": 36,
+    "loss": 3.024799108505249,
+    "diagonal": 2.949309825897217,
+    "shortcut": 0.07548929750919342
+  },
+  {
+    "step": 37,
+    "loss": 3.216989040374756,
+    "diagonal": 3.141432046890259,
+    "shortcut": 0.0755569189786911
+  },
+  {
+    "step": 38,
+    "loss": 3.127302408218384,
+    "diagonal": 3.0592541694641113,
+    "shortcut": 0.06804820895195007
+  },
+  {
+    "step": 39,
+    "loss": 2.7073471546173096,
+    "diagonal": 2.62650990486145,
+    "shortcut": 0.0808371901512146
+  },
+  {
+    "step": 40,
+    "loss": 2.744354724884033,
+    "diagonal": 2.6833877563476562,
+    "shortcut": 0.06096699833869934
+  },
+  {
+    "step": 41,
+    "loss": 3.3000717163085938,
+    "diagonal": 3.20068359375,
+    "shortcut": 0.09938821196556091
+  },
+  {
+    "step": 42,
+    "loss": 3.187903881072998,
+    "diagonal": 3.107086181640625,
+    "shortcut": 0.08081761747598648
+  },
+  {
+    "step": 43,
+    "loss": 3.182111978530884,
+    "diagonal": 3.1010494232177734,
+    "shortcut": 0.08106256276369095
+  },
+  {
+    "step": 44,
+    "loss": 2.492009401321411,
+    "diagonal": 2.419377088546753,
+    "shortcut": 0.07263220846652985
+  },
+  {
+    "step": 45,
+    "loss": 3.558196783065796,
+    "diagonal": 3.474846601486206,
+    "shortcut": 0.0833502858877182
+  },
+  {
+    "step": 46,
+    "loss": 3.5492136478424072,
+    "diagonal": 3.469519853591919,
+    "shortcut": 0.07969389110803604
+  },
+  {
+    "step": 47,
+    "loss": 3.414811611175537,
+    "diagonal": 3.3250813484191895,
+    "shortcut": 0.08973021805286407
+  },
+  {
+    "step": 48,
+    "loss": 3.0902316570281982,
+    "diagonal": 3.011715888977051,
+    "shortcut": 0.07851577550172806
+  },
+  {
+    "step": 49,
+    "loss": 3.3858802318573,
+    "diagonal": 3.3012990951538086,
+    "shortcut": 0.08458109200000763
+  },
+  {
+    "step": 50,
+    "loss": 3.211111068725586,
+    "diagonal": 3.134091854095459,
+    "shortcut": 0.07701914012432098
+  },
+  {
+    "step": 51,
+    "loss": 2.856898069381714,
+    "diagonal": 2.7769322395324707,
+    "shortcut": 0.07996592670679092
+  },
+  {
+    "step": 52,
+    "loss": 2.8056490421295166,
+    "diagonal": 2.7176413536071777,
+    "shortcut": 0.08800776302814484
+  },
+  {
+    "step": 53,
+    "loss": 3.334807872772217,
+    "diagonal": 3.274132013320923,
+    "shortcut": 0.06067579239606857
+  },
+  {
+    "step": 54,
+    "loss": 2.853114366531372,
+    "diagonal": 2.7709763050079346,
+    "shortcut": 0.08213795721530914
+  },
+  {
+    "step": 55,
+    "loss": 2.5390915870666504,
+    "diagonal": 2.4807188510894775,
+    "shortcut": 0.058372851461172104
+  },
+  {
+    "step": 56,
+    "loss": 3.1329498291015625,
+    "diagonal": 3.050570011138916,
+    "shortcut": 0.0823797807097435
+  },
+  {
+    "step": 57,
+    "loss": 3.7376670837402344,
+    "diagonal": 3.6710331439971924,
+    "shortcut": 0.06663389503955841
+  },
+  {
+    "step": 58,
+    "loss": 3.587761402130127,
+    "diagonal": 3.5255930423736572,
+    "shortcut": 0.06216840445995331
+  },
+  {
+    "step": 59,
+    "loss": 2.759385108947754,
+    "diagonal": 2.702976942062378,
+    "shortcut": 0.056408271193504333
+  },
+  {
+    "step": 60,
+    "loss": 3.295520067214966,
+    "diagonal": 3.2290196418762207,
+    "shortcut": 0.0665004700422287
+  },
+  {
+    "step": 61,
+    "loss": 2.825639009475708,
+    "diagonal": 2.760127067565918,
+    "shortcut": 0.0655120387673378
+  },
+  {
+    "step": 62,
+    "loss": 3.227036476135254,
+    "diagonal": 3.1551949977874756,
+    "shortcut": 0.07184159755706787
+  },
+  {
+    "step": 63,
+    "loss": 2.893552303314209,
+    "diagonal": 2.8179678916931152,
+    "shortcut": 0.0755843073129654
+  },
+  {
+    "step": 64,
+    "loss": 3.594733953475952,
+    "diagonal": 3.531525135040283,
+    "shortcut": 0.0632089152932167
+  },
+  {
+    "step": 65,
+    "loss": 2.964406967163086,
+    "diagonal": 2.8996973037719727,
+    "shortcut": 0.06470957398414612
+  },
+  {
+    "step": 66,
+    "loss": 2.8826537132263184,
+    "diagonal": 2.8338019847869873,
+    "shortcut": 0.04885180667042732
+  },
+  {
+    "step": 67,
+    "loss": 2.621704339981079,
+    "diagonal": 2.557009696960449,
+    "shortcut": 0.06469469517469406
+  },
+  {
+    "step": 68,
+    "loss": 2.832326889038086,
+    "diagonal": 2.7701072692871094,
+    "shortcut": 0.0622195340692997
+  },
+  {
+    "step": 69,
+    "loss": 3.1095144748687744,
+    "diagonal": 3.0488364696502686,
+    "shortcut": 0.060677915811538696
+  },
+  {
+    "step": 70,
+    "loss": 2.798924207687378,
+    "diagonal": 2.751039981842041,
+    "shortcut": 0.047884177416563034
+  },
+  {
+    "step": 71,
+    "loss": 3.048130750656128,
+    "diagonal": 3.00036358833313,
+    "shortcut": 0.04776725172996521
+  },
+  {
+    "step": 72,
+    "loss": 3.587092161178589,
+    "diagonal": 3.5316662788391113,
+    "shortcut": 0.05542580038309097
+  },
+  {
+    "step": 73,
+    "loss": 2.6914117336273193,
+    "diagonal": 2.6370689868927,
+    "shortcut": 0.054342806339263916
+  },
+  {
+    "step": 74,
+    "loss": 3.2159409523010254,
+    "diagonal": 3.1598291397094727,
+    "shortcut": 0.05611184984445572
+  },
+  {
+    "step": 75,
+    "loss": 2.801608085632324,
+    "diagonal": 2.738638162612915,
+    "shortcut": 0.0629698857665062
+  },
+  {
+    "step": 76,
+    "loss": 2.917560338973999,
+    "diagonal": 2.8546364307403564,
+    "shortcut": 0.06292387843132019
+  },
+  {
+    "step": 77,
+    "loss": 2.9464683532714844,
+    "diagonal": 2.8979687690734863,
+    "shortcut": 0.04849958419799805
+  },
+  {
+    "step": 78,
+    "loss": 2.5942351818084717,
+    "diagonal": 2.5388057231903076,
+    "shortcut": 0.05542946606874466
+  },
+  {
+    "step": 79,
+    "loss": 2.6242082118988037,
+    "diagonal": 2.5546441078186035,
+    "shortcut": 0.0695640966296196
+  },
+  {
+    "step": 80,
+    "loss": 2.90653920173645,
+    "diagonal": 2.8440306186676025,
+    "shortcut": 0.06250860542058945
+  },
+  {
+    "step": 81,
+    "loss": 2.659519910812378,
+    "diagonal": 2.588404893875122,
+    "shortcut": 0.07111499458551407
+  },
+  {
+    "step": 82,
+    "loss": 2.3863930702209473,
+    "diagonal": 2.3279781341552734,
+    "shortcut": 0.05841497704386711
+  },
+  {
+    "step": 83,
+    "loss": 3.0708582401275635,
+    "diagonal": 2.999779224395752,
+    "shortcut": 0.07107903808355331
+  },
+  {
+    "step": 84,
+    "loss": 3.439098596572876,
+    "diagonal": 3.3845512866973877,
+    "shortcut": 0.05454730615019798
+  },
+  {
+    "step": 85,
+    "loss": 2.6399035453796387,
+    "diagonal": 2.582557439804077,
+    "shortcut": 0.05734620988368988
+  },
+  {
+    "step": 86,
+    "loss": 2.30110502243042,
+    "diagonal": 2.25199818611145,
+    "shortcut": 0.04910675436258316
+  },
+  {
+    "step": 87,
+    "loss": 2.174940347671509,
+    "diagonal": 2.1237149238586426,
+    "shortcut": 0.05122542753815651
+  },
+  {
+    "step": 88,
+    "loss": 2.7734525203704834,
+    "diagonal": 2.7225942611694336,
+    "shortcut": 0.05085837468504906
+  },
+  {
+    "step": 89,
+    "loss": 2.9624674320220947,
+    "diagonal": 2.8921167850494385,
+    "shortcut": 0.07035069167613983
+  },
+  {
+    "step": 90,
+    "loss": 3.4901490211486816,
+    "diagonal": 3.4359843730926514,
+    "shortcut": 0.05416464805603027
+  },
+  {
+    "step": 91,
+    "loss": 2.8749797344207764,
+    "diagonal": 2.822435140609741,
+    "shortcut": 0.052544545382261276
+  },
+  {
+    "step": 92,
+    "loss": 3.7215373516082764,
+    "diagonal": 3.6641998291015625,
+    "shortcut": 0.05733758956193924
+  },
+  {
+    "step": 93,
+    "loss": 2.916285514831543,
+    "diagonal": 2.85054874420166,
+    "shortcut": 0.06573685258626938
+  },
+  {
+    "step": 94,
+    "loss": 2.6714203357696533,
+    "diagonal": 2.6164627075195312,
+    "shortcut": 0.05495751276612282
+  },
+  {
+    "step": 95,
+    "loss": 2.698272943496704,
+    "diagonal": 2.6513521671295166,
+    "shortcut": 0.046920862048864365
+  },
+  {
+    "step": 96,
+    "loss": 2.756681442260742,
+    "diagonal": 2.7108640670776367,
+    "shortcut": 0.04581735283136368
+  },
+  {
+    "step": 97,
+    "loss": 3.2225382328033447,
+    "diagonal": 3.1770951747894287,
+    "shortcut": 0.04544307664036751
+  },
+  {
+    "step": 98,
+    "loss": 2.347463369369507,
+    "diagonal": 2.3079562187194824,
+    "shortcut": 0.039507053792476654
+  },
+  {
+    "step": 99,
+    "loss": 2.3735694885253906,
+    "diagonal": 2.334624767303467,
+    "shortcut": 0.038944825530052185
+  },
+  {
+    "step": 100,
+    "loss": 2.854724407196045,
+    "diagonal": 2.81766939163208,
+    "shortcut": 0.037055082619190216
+  },
+  {
+    "step": 101,
+    "loss": 3.13818621635437,
+    "diagonal": 3.095498561859131,
+    "shortcut": 0.0426875576376915
+  },
+  {
+    "step": 102,
+    "loss": 2.921144723892212,
+    "diagonal": 2.876490831375122,
+    "shortcut": 0.04465378448367119
+  },
+  {
+    "step": 103,
+    "loss": 2.321681261062622,
+    "diagonal": 2.279447078704834,
+    "shortcut": 0.04223426431417465
+  },
+  {
+    "step": 104,
+    "loss": 3.010150909423828,
+    "diagonal": 2.9733335971832275,
+    "shortcut": 0.03681742399930954
+  },
+  {
+    "step": 105,
+    "loss": 3.2138447761535645,
+    "diagonal": 3.1719517707824707,
+    "shortcut": 0.041893068701028824
+  },
+  {
+    "step": 106,
+    "loss": 2.9577622413635254,
+    "diagonal": 2.922879695892334,
+    "shortcut": 0.03488245606422424
+  },
+  {
+    "step": 107,
+    "loss": 2.5547916889190674,
+    "diagonal": 2.5080361366271973,
+    "shortcut": 0.04675547033548355
+  },
+  {
+    "step": 108,
+    "loss": 2.636096715927124,
+    "diagonal": 2.592216730117798,
+    "shortcut": 0.043879881501197815
+  },
+  {
+    "step": 109,
+    "loss": 2.2669546604156494,
+    "diagonal": 2.209238290786743,
+    "shortcut": 0.05771636962890625
+  },
+  {
+    "step": 110,
+    "loss": 2.3456366062164307,
+    "diagonal": 2.3046839237213135,
+    "shortcut": 0.04095267131924629
+  },
+  {
+    "step": 111,
+    "loss": 2.4379730224609375,
+    "diagonal": 2.3993735313415527,
+    "shortcut": 0.038599517196416855
+  },
+  {
+    "step": 112,
+    "loss": 2.947157859802246,
+    "diagonal": 2.894613265991211,
+    "shortcut": 0.052544690668582916
+  },
+  {
+    "step": 113,
+    "loss": 2.657013177871704,
+    "diagonal": 2.600891590118408,
+    "shortcut": 0.05612162873148918
+  },
+  {
+    "step": 114,
+    "loss": 3.2576375007629395,
+    "diagonal": 3.2090444564819336,
+    "shortcut": 0.04859302565455437
+  },
+  {
+    "step": 115,
+    "loss": 3.2051117420196533,
+    "diagonal": 3.1586644649505615,
+    "shortcut": 0.04644734412431717
+  },
+  {
+    "step": 116,
+    "loss": 2.871614456176758,
+    "diagonal": 2.8204970359802246,
+    "shortcut": 0.05111739784479141
+  },
+  {
+    "step": 117,
+    "loss": 2.7513253688812256,
+    "diagonal": 2.69683575630188,
+    "shortcut": 0.054489653557538986
+  },
+  {
+    "step": 118,
+    "loss": 3.037172794342041,
+    "diagonal": 2.98228120803833,
+    "shortcut": 0.05489156395196915
+  },
+  {
+    "step": 119,
+    "loss": 2.637211322784424,
+    "diagonal": 2.5869219303131104,
+    "shortcut": 0.05028947442770004
+  },
+  {
+    "step": 120,
+    "loss": 3.3359920978546143,
+    "diagonal": 3.2747397422790527,
+    "shortcut": 0.06125238537788391
+  },
+  {
+    "step": 121,
+    "loss": 2.495398759841919,
+    "diagonal": 2.4454329013824463,
+    "shortcut": 0.04996577650308609
+  },
+  {
+    "step": 122,
+    "loss": 2.4930639266967773,
+    "diagonal": 2.438530921936035,
+    "shortcut": 0.05453290790319443
+  },
+  {
+    "step": 123,
+    "loss": 2.7226686477661133,
+    "diagonal": 2.681091070175171,
+    "shortcut": 0.04157749190926552
+  },
+  {
+    "step": 124,
+    "loss": 2.6280763149261475,
+    "diagonal": 2.581890821456909,
+    "shortcut": 0.04618547111749649
+  },
+  {
+    "step": 125,
+    "loss": 2.393101692199707,
+    "diagonal": 2.342609167098999,
+    "shortcut": 0.05049256980419159
+  },
+  {
+    "step": 126,
+    "loss": 2.568898916244507,
+    "diagonal": 2.5241715908050537,
+    "shortcut": 0.04472728073596954
+  },
+  {
+    "step": 127,
+    "loss": 2.7976956367492676,
+    "diagonal": 2.747697114944458,
+    "shortcut": 0.04999848082661629
+  },
+  {
+    "step": 128,
+    "loss": 3.1442296504974365,
+    "diagonal": 3.0931317806243896,
+    "shortcut": 0.05109798163175583
+  },
+  {
+    "step": 129,
+    "loss": 2.74992036819458,
+    "diagonal": 2.693455696105957,
+    "shortcut": 0.05646466836333275
+  },
+  {
+    "step": 130,
+    "loss": 3.1344552040100098,
+    "diagonal": 3.0849761962890625,
+    "shortcut": 0.04947889968752861
+  },
+  {
+    "step": 131,
+    "loss": 2.45556378364563,
+    "diagonal": 2.405376672744751,
+    "shortcut": 0.0501871258020401
+  },
+  {
+    "step": 132,
+    "loss": 2.489346742630005,
+    "diagonal": 2.4462459087371826,
+    "shortcut": 0.04310080036520958
+  },
+  {
+    "step": 133,
+    "loss": 3.129056215286255,
+    "diagonal": 3.0798439979553223,
+    "shortcut": 0.049212150275707245
+  },
+  {
+    "step": 134,
+    "loss": 3.1072354316711426,
+    "diagonal": 3.072892189025879,
+    "shortcut": 0.03434329479932785
+  },
+  {
+    "step": 135,
+    "loss": 2.7623939514160156,
+    "diagonal": 2.7145028114318848,
+    "shortcut": 0.04789105802774429
+  },
+  {
+    "step": 136,
+    "loss": 2.3172266483306885,
+    "diagonal": 2.2690818309783936,
+    "shortcut": 0.048144806176424026
+  },
+  {
+    "step": 137,
+    "loss": 2.8201849460601807,
+    "diagonal": 2.7809314727783203,
+    "shortcut": 0.039253465831279755
+  },
+  {
+    "step": 138,
+    "loss": 3.024897813796997,
+    "diagonal": 2.9816524982452393,
+    "shortcut": 0.04324522241950035
+  },
+  {
+    "step": 139,
+    "loss": 3.1749603748321533,
+    "diagonal": 3.128044605255127,
+    "shortcut": 0.04691571742296219
+  },
+  {
+    "step": 140,
+    "loss": 3.0014989376068115,
+    "diagonal": 2.956613779067993,
+    "shortcut": 0.04488513246178627
+  },
+  {
+    "step": 141,
+    "loss": 2.316525936126709,
+    "diagonal": 2.2664313316345215,
+    "shortcut": 0.05009467527270317
+  },
+  {
+    "step": 142,
+    "loss": 2.612177848815918,
+    "diagonal": 2.567375659942627,
+    "shortcut": 0.044802188873291016
+  },
+  {
+    "step": 143,
+    "loss": 2.954343318939209,
+    "diagonal": 2.9214601516723633,
+    "shortcut": 0.032883159816265106
+  },
+  {
+    "step": 144,
+    "loss": 2.7765426635742188,
+    "diagonal": 2.7290124893188477,
+    "shortcut": 0.04753026366233826
+  },
+  {
+    "step": 145,
+    "loss": 2.5177223682403564,
+    "diagonal": 2.4807939529418945,
+    "shortcut": 0.03692847117781639
+  },
+  {
+    "step": 146,
+    "loss": 2.7849302291870117,
+    "diagonal": 2.7563562393188477,
+    "shortcut": 0.02857394516468048
+  },
+  {
+    "step": 147,
+    "loss": 3.47163987159729,
+    "diagonal": 3.4448041915893555,
+    "shortcut": 0.026835717260837555
+  },
+  {
+    "step": 148,
+    "loss": 2.4040071964263916,
+    "diagonal": 2.3738722801208496,
+    "shortcut": 0.03013492003083229
+  },
+  {
+    "step": 149,
+    "loss": 3.089001178741455,
+    "diagonal": 3.058488607406616,
+    "shortcut": 0.030512511730194092
+  },
+  {
+    "step": 150,
+    "loss": 3.12304425239563,
+    "diagonal": 3.0990538597106934,
+    "shortcut": 0.023990439251065254
+  },
+  {
+    "step": 151,
+    "loss": 3.1423981189727783,
+    "diagonal": 3.1221606731414795,
+    "shortcut": 0.020237531512975693
+  },
+  {
+    "step": 152,
+    "loss": 2.939988613128662,
+    "diagonal": 2.914184331893921,
+    "shortcut": 0.025804322212934494
+  },
+  {
+    "step": 153,
+    "loss": 3.385003089904785,
+    "diagonal": 3.355703592300415,
+    "shortcut": 0.029299508780241013
+  },
+  {
+    "step": 154,
+    "loss": 2.776310920715332,
+    "diagonal": 2.7561357021331787,
+    "shortcut": 0.020175322890281677
+  },
+  {
+    "step": 155,
+    "loss": 3.1066741943359375,
+    "diagonal": 3.076429843902588,
+    "shortcut": 0.03024427779018879
+  },
+  {
+    "step": 156,
+    "loss": 2.9289286136627197,
+    "diagonal": 2.899902820587158,
+    "shortcut": 0.02902587130665779
+  },
+  {
+    "step": 157,
+    "loss": 3.3519439697265625,
+    "diagonal": 3.3226370811462402,
+    "shortcut": 0.02930677868425846
+  },
+  {
+    "step": 158,
+    "loss": 2.81343412399292,
+    "diagonal": 2.791072368621826,
+    "shortcut": 0.022361746057868004
+  },
+  {
+    "step": 159,
+    "loss": 2.75868821144104,
+    "diagonal": 2.7251996994018555,
+    "shortcut": 0.033488593995571136
+  },
+  {
+    "step": 160,
+    "loss": 2.878758192062378,
+    "diagonal": 2.8534915447235107,
+    "shortcut": 0.025266757234930992
+  },
+  {
+    "step": 161,
+    "loss": 3.1588733196258545,
+    "diagonal": 3.132888078689575,
+    "shortcut": 0.02598535642027855
+  },
+  {
+    "step": 162,
+    "loss": 2.8411355018615723,
+    "diagonal": 2.8215367794036865,
+    "shortcut": 0.019598765298724174
+  },
+  {
+    "step": 163,
+    "loss": 3.0425405502319336,
+    "diagonal": 3.0169312953948975,
+    "shortcut": 0.02560930699110031
+  },
+  {
+    "step": 164,
+    "loss": 2.9829859733581543,
+    "diagonal": 2.9503753185272217,
+    "shortcut": 0.03261073678731918
+  },
+  {
+    "step": 165,
+    "loss": 2.8791656494140625,
+    "diagonal": 2.853381395339966,
+    "shortcut": 0.0257842056453228
+  },
+  {
+    "step": 166,
+    "loss": 3.421346664428711,
+    "diagonal": 3.394249439239502,
+    "shortcut": 0.027097150683403015
+  },
+  {
+    "step": 167,
+    "loss": 2.9579226970672607,
+    "diagonal": 2.9218904972076416,
+    "shortcut": 0.036032095551490784
+  },
+  {
+    "step": 168,
+    "loss": 2.9050230979919434,
+    "diagonal": 2.881854295730591,
+    "shortcut": 0.023168768733739853
+  },
+  {
+    "step": 169,
+    "loss": 2.2406165599823,
+    "diagonal": 2.210312843322754,
+    "shortcut": 0.030303727835416794
+  },
+  {
+    "step": 170,
+    "loss": 3.3822920322418213,
+    "diagonal": 3.3609418869018555,
+    "shortcut": 0.021350128576159477
+  },
+  {
+    "step": 171,
+    "loss": 2.582881212234497,
+    "diagonal": 2.5616705417633057,
+    "shortcut": 0.021210607141256332
+  },
+  {
+    "step": 172,
+    "loss": 3.495828628540039,
+    "diagonal": 3.4750382900238037,
+    "shortcut": 0.020790444687008858
+  },
+  {
+    "step": 173,
+    "loss": 3.4579670429229736,
+    "diagonal": 3.4358301162719727,
+    "shortcut": 0.022136885672807693
+  },
+  {
+    "step": 174,
+    "loss": 2.6636178493499756,
+    "diagonal": 2.6385393142700195,
+    "shortcut": 0.025078484788537025
+  },
+  {
+    "step": 175,
+    "loss": 2.5972888469696045,
+    "diagonal": 2.5792222023010254,
+    "shortcut": 0.018066730350255966
+  },
+  {
+    "step": 176,
+    "loss": 2.614619255065918,
+    "diagonal": 2.5959200859069824,
+    "shortcut": 0.01869908533990383
+  },
+  {
+    "step": 177,
+    "loss": 2.8112287521362305,
+    "diagonal": 2.7915937900543213,
+    "shortcut": 0.019634921103715897
+  },
+  {
+    "step": 178,
+    "loss": 2.681640625,
+    "diagonal": 2.6603052616119385,
+    "shortcut": 0.021335376426577568
+  },
+  {
+    "step": 179,
+    "loss": 2.4651029109954834,
+    "diagonal": 2.437593460083008,
+    "shortcut": 0.027509454637765884
+  },
+  {
+    "step": 180,
+    "loss": 2.1872236728668213,
+    "diagonal": 2.1678466796875,
+    "shortcut": 0.019376996904611588
+  },
+  {
+    "step": 181,
+    "loss": 3.2220683097839355,
+    "diagonal": 3.192970037460327,
+    "shortcut": 0.029098298400640488
+  },
+  {
+    "step": 182,
+    "loss": 2.780792713165283,
+    "diagonal": 2.7637863159179688,
+    "shortcut": 0.01700650528073311
+  },
+  {
+    "step": 183,
+    "loss": 3.10650372505188,
+    "diagonal": 3.077634334564209,
+    "shortcut": 0.02886943891644478
+  },
+  {
+    "step": 184,
+    "loss": 2.6496193408966064,
+    "diagonal": 2.629307746887207,
+    "shortcut": 0.02031150460243225
+  },
+  {
+    "step": 185,
+    "loss": 2.5797436237335205,
+    "diagonal": 2.559337615966797,
+    "shortcut": 0.020406043156981468
+  },
+  {
+    "step": 186,
+    "loss": 2.684998035430908,
+    "diagonal": 2.6632182598114014,
+    "shortcut": 0.021779783070087433
+  },
+  {
+    "step": 187,
+    "loss": 2.380549430847168,
+    "diagonal": 2.3453569412231445,
+    "shortcut": 0.03519251197576523
+  },
+  {
+    "step": 188,
+    "loss": 2.2728312015533447,
+    "diagonal": 2.2494750022888184,
+    "shortcut": 0.023356251418590546
+  },
+  {
+    "step": 189,
+    "loss": 2.2609121799468994,
+    "diagonal": 2.2349889278411865,
+    "shortcut": 0.025923172011971474
+  },
+  {
+    "step": 190,
+    "loss": 2.614938735961914,
+    "diagonal": 2.5946977138519287,
+    "shortcut": 0.02024094946682453
+  },
+  {
+    "step": 191,
+    "loss": 2.306034803390503,
+    "diagonal": 2.2854392528533936,
+    "shortcut": 0.020595552399754524
+  },
+  {
+    "step": 192,
+    "loss": 2.701483726501465,
+    "diagonal": 2.6822948455810547,
+    "shortcut": 0.019188808277249336
+  },
+  {
+    "step": 193,
+    "loss": 2.645643711090088,
+    "diagonal": 2.6277077198028564,
+    "shortcut": 0.017935937270522118
+  },
+  {
+    "step": 194,
+    "loss": 3.022582530975342,
+    "diagonal": 2.996133804321289,
+    "shortcut": 0.026448767632246017
+  },
+  {
+    "step": 195,
+    "loss": 2.651165008544922,
+    "diagonal": 2.626511573791504,
+    "shortcut": 0.024653451517224312
+  },
+  {
+    "step": 196,
+    "loss": 2.8627169132232666,
+    "diagonal": 2.8296451568603516,
+    "shortcut": 0.033071719110012054
+  },
+  {
+    "step": 197,
+    "loss": 2.838609457015991,
+    "diagonal": 2.8143198490142822,
+    "shortcut": 0.024289658293128014
+  },
+  {
+    "step": 198,
+    "loss": 2.395371913909912,
+    "diagonal": 2.3674144744873047,
+    "shortcut": 0.027957357466220856
+  },
+  {
+    "step": 199,
+    "loss": 2.9775078296661377,
+    "diagonal": 2.9471325874328613,
+    "shortcut": 0.030375245958566666
+  },
+  {
+    "step": 200,
+    "loss": 2.752662181854248,
+    "diagonal": 2.728027820587158,
+    "shortcut": 0.024634378030896187
+  },
+  {
+    "step": 201,
+    "loss": 2.732093572616577,
+    "diagonal": 2.704763174057007,
+    "shortcut": 0.027330420911312103
+  },
+  {
+    "step": 202,
+    "loss": 2.939758062362671,
+    "diagonal": 2.904024124145508,
+    "shortcut": 0.035734012722969055
+  },
+  {
+    "step": 203,
+    "loss": 3.011091470718384,
+    "diagonal": 2.9850308895111084,
+    "shortcut": 0.026060637086629868
+  },
+  {
+    "step": 204,
+    "loss": 2.5676381587982178,
+    "diagonal": 2.5459399223327637,
+    "shortcut": 0.02169813960790634
+  },
+  {
+    "step": 205,
+    "loss": 2.397022247314453,
+    "diagonal": 2.37855863571167,
+    "shortcut": 0.018463511019945145
+  },
+  {
+    "step": 206,
+    "loss": 2.793041467666626,
+    "diagonal": 2.7634806632995605,
+    "shortcut": 0.029560847207903862
+  },
+  {
+    "step": 207,
+    "loss": 2.895810604095459,
+    "diagonal": 2.8815457820892334,
+    "shortcut": 0.014264899305999279
+  },
+  {
+    "step": 208,
+    "loss": 2.7186572551727295,
+    "diagonal": 2.6945018768310547,
+    "shortcut": 0.024155303835868835
+  },
+  {
+    "step": 209,
+    "loss": 3.057659864425659,
+    "diagonal": 3.0237574577331543,
+    "shortcut": 0.033902447670698166
+  },
+  {
+    "step": 210,
+    "loss": 2.213454484939575,
+    "diagonal": 2.1891231536865234,
+    "shortcut": 0.024331266060471535
+  },
+  {
+    "step": 211,
+    "loss": 2.679765462875366,
+    "diagonal": 2.650075674057007,
+    "shortcut": 0.029689904302358627
+  },
+  {
+    "step": 212,
+    "loss": 2.6411521434783936,
+    "diagonal": 2.6104896068573,
+    "shortcut": 0.03066256269812584
+  },
+  {
+    "step": 213,
+    "loss": 2.4112610816955566,
+    "diagonal": 2.3885531425476074,
+    "shortcut": 0.022707946598529816
+  },
+  {
+    "step": 214,
+    "loss": 2.2889695167541504,
+    "diagonal": 2.2736685276031494,
+    "shortcut": 0.015300958417356014
+  },
+  {
+    "step": 215,
+    "loss": 2.6059353351593018,
+    "diagonal": 2.5855014324188232,
+    "shortcut": 0.020433789119124413
+  },
+  {
+    "step": 216,
+    "loss": 3.212036371231079,
+    "diagonal": 3.1857364177703857,
+    "shortcut": 0.026300033554434776
+  },
+  {
+    "step": 217,
+    "loss": 2.5182693004608154,
+    "diagonal": 2.498142957687378,
+    "shortcut": 0.02012624219059944
+  },
+  {
+    "step": 218,
+    "loss": 2.9429898262023926,
+    "diagonal": 2.925485372543335,
+    "shortcut": 0.017504440620541573
+  },
+  {
+    "step": 219,
+    "loss": 2.5541272163391113,
+    "diagonal": 2.528716564178467,
+    "shortcut": 0.025410620495676994
+  },
+  {
+    "step": 220,
+    "loss": 2.5047969818115234,
+    "diagonal": 2.4709036350250244,
+    "shortcut": 0.03389326483011246
+  },
+  {
+    "step": 221,
+    "loss": 2.951395034790039,
+    "diagonal": 2.9293065071105957,
+    "shortcut": 0.022088542580604553
+  },
+  {
+    "step": 222,
+    "loss": 2.6507728099823,
+    "diagonal": 2.621934652328491,
+    "shortcut": 0.028838135302066803
+  },
+  {
+    "step": 223,
+    "loss": 2.539426326751709,
+    "diagonal": 2.5241658687591553,
+    "shortcut": 0.015260562300682068
+  },
+  {
+    "step": 224,
+    "loss": 2.600339889526367,
+    "diagonal": 2.5809545516967773,
+    "shortcut": 0.019385313615202904
+  },
+  {
+    "step": 225,
+    "loss": 2.34806227684021,
+    "diagonal": 2.3249926567077637,
+    "shortcut": 0.02306952513754368
+  },
+  {
+    "step": 226,
+    "loss": 2.1433308124542236,
+    "diagonal": 2.1082003116607666,
+    "shortcut": 0.0351305790245533
+  },
+  {
+    "step": 227,
+    "loss": 2.4495410919189453,
+    "diagonal": 2.424027681350708,
+    "shortcut": 0.02551330253481865
+  },
+  {
+    "step": 228,
+    "loss": 3.035766839981079,
+    "diagonal": 3.0204710960388184,
+    "shortcut": 0.015295657329261303
+  },
+  {
+    "step": 229,
+    "loss": 2.3451735973358154,
+    "diagonal": 2.324629545211792,
+    "shortcut": 0.02054412290453911
+  },
+  {
+    "step": 230,
+    "loss": 2.153806209564209,
+    "diagonal": 2.129316806793213,
+    "shortcut": 0.024489378556609154
+  },
+  {
+    "step": 231,
+    "loss": 3.3180549144744873,
+    "diagonal": 3.304206371307373,
+    "shortcut": 0.013848476111888885
+  },
+  {
+    "step": 232,
+    "loss": 3.1516449451446533,
+    "diagonal": 3.12322735786438,
+    "shortcut": 0.028417494148015976
+  },
+  {
+    "step": 233,
+    "loss": 3.2691729068756104,
+    "diagonal": 3.248868703842163,
+    "shortcut": 0.020304210484027863
+  },
+  {
+    "step": 234,
+    "loss": 2.837244987487793,
+    "diagonal": 2.8082382678985596,
+    "shortcut": 0.029006633907556534
+  },
+  {
+    "step": 235,
+    "loss": 3.0226290225982666,
+    "diagonal": 2.998149871826172,
+    "shortcut": 0.024479134008288383
+  },
+  {
+    "step": 236,
+    "loss": 2.2781097888946533,
+    "diagonal": 2.257707357406616,
+    "shortcut": 0.02040245197713375
+  },
+  {
+    "step": 237,
+    "loss": 2.144413471221924,
+    "diagonal": 2.1174521446228027,
+    "shortcut": 0.026961438357830048
+  },
+  {
+    "step": 238,
+    "loss": 3.065143346786499,
+    "diagonal": 3.0480918884277344,
+    "shortcut": 0.017051387578248978
+  },
+  {
+    "step": 239,
+    "loss": 2.550248384475708,
+    "diagonal": 2.5250954627990723,
+    "shortcut": 0.0251529011875391
+  },
+  {
+    "step": 240,
+    "loss": 2.530951499938965,
+    "diagonal": 2.510406255722046,
+    "shortcut": 0.020545214414596558
+  },
+  {
+    "step": 241,
+    "loss": 3.1370346546173096,
+    "diagonal": 3.0973060131073,
+    "shortcut": 0.039728548377752304
+  },
+  {
+    "step": 242,
+    "loss": 2.7425923347473145,
+    "diagonal": 2.7247140407562256,
+    "shortcut": 0.017878280952572823
+  },
+  {
+    "step": 243,
+    "loss": 3.042840003967285,
+    "diagonal": 3.0233042240142822,
+    "shortcut": 0.019535865634679794
+  },
+  {
+    "step": 244,
+    "loss": 3.1672818660736084,
+    "diagonal": 3.146402359008789,
+    "shortcut": 0.020879413932561874
+  },
+  {
+    "step": 245,
+    "loss": 3.020301103591919,
+    "diagonal": 3.0026071071624756,
+    "shortcut": 0.017693977802991867
+  },
+  {
+    "step": 246,
+    "loss": 2.672785758972168,
+    "diagonal": 2.6536755561828613,
+    "shortcut": 0.01911010965704918
+  },
+  {
+    "step": 247,
+    "loss": 2.8006656169891357,
+    "diagonal": 2.770573616027832,
+    "shortcut": 0.03009198233485222
+  },
+  {
+    "step": 248,
+    "loss": 3.2922518253326416,
+    "diagonal": 3.2665374279022217,
+    "shortcut": 0.025714363902807236
+  },
+  {
+    "step": 249,
+    "loss": 2.7385122776031494,
+    "diagonal": 2.713139295578003,
+    "shortcut": 0.025372963398694992
+  },
+  {
+    "step": 250,
+    "loss": 2.7536609172821045,
+    "diagonal": 2.7357044219970703,
+    "shortcut": 0.01795659214258194
+  },
+  {
+    "step": 251,
+    "loss": 2.317797899246216,
+    "diagonal": 2.301973581314087,
+    "shortcut": 0.015824321657419205
+  },
+  {
+    "step": 252,
+    "loss": 2.8069334030151367,
+    "diagonal": 2.7838215827941895,
+    "shortcut": 0.02311193197965622
+  },
+  {
+    "step": 253,
+    "loss": 2.631289005279541,
+    "diagonal": 2.6109819412231445,
+    "shortcut": 0.020307131111621857
+  },
+  {
+    "step": 254,
+    "loss": 2.3891172409057617,
+    "diagonal": 2.362226963043213,
+    "shortcut": 0.026890240609645844
+  },
+  {
+    "step": 255,
+    "loss": 2.8692171573638916,
+    "diagonal": 2.855069398880005,
+    "shortcut": 0.014147786423563957
+  },
+  {
+    "step": 256,
+    "loss": 2.5265660285949707,
+    "diagonal": 2.5098865032196045,
+    "shortcut": 0.01667945832014084
+  },
+  {
+    "step": 257,
+    "loss": 2.0301921367645264,
+    "diagonal": 2.0087850093841553,
+    "shortcut": 0.021407073363661766
+  },
+  {
+    "step": 258,
+    "loss": 1.9665791988372803,
+    "diagonal": 1.9455784559249878,
+    "shortcut": 0.021000787615776062
+  },
+  {
+    "step": 259,
+    "loss": 3.108668565750122,
+    "diagonal": 3.0850024223327637,
+    "shortcut": 0.0236662570387125
+  },
+  {
+    "step": 260,
+    "loss": 2.47798490524292,
+    "diagonal": 2.4483377933502197,
+    "shortcut": 0.029647180810570717
+  },
+  {
+    "step": 261,
+    "loss": 2.673220634460449,
+    "diagonal": 2.646074056625366,
+    "shortcut": 0.02714654430747032
+  },
+  {
+    "step": 262,
+    "loss": 1.941575527191162,
+    "diagonal": 1.9105541706085205,
+    "shortcut": 0.031021296977996826
+  },
+  {
+    "step": 263,
+    "loss": 2.3952579498291016,
+    "diagonal": 2.3655598163604736,
+    "shortcut": 0.029698017984628677
+  },
+  {
+    "step": 264,
+    "loss": 3.0200271606445312,
+    "diagonal": 2.988076686859131,
+    "shortcut": 0.03195059299468994
+  },
+  {
+    "step": 265,
+    "loss": 2.5014195442199707,
+    "diagonal": 2.4707188606262207,
+    "shortcut": 0.030700765550136566
+  },
+  {
+    "step": 266,
+    "loss": 2.2952959537506104,
+    "diagonal": 2.2669296264648438,
+    "shortcut": 0.028366398066282272
+  },
+  {
+    "step": 267,
+    "loss": 2.4600682258605957,
+    "diagonal": 2.440901041030884,
+    "shortcut": 0.019167255610227585
+  },
+  {
+    "step": 268,
+    "loss": 2.69111704826355,
+    "diagonal": 2.6707763671875,
+    "shortcut": 0.020340582355856895
+  },
+  {
+    "step": 269,
+    "loss": 3.2714741230010986,
+    "diagonal": 3.250683069229126,
+    "shortcut": 0.02079097181558609
+  },
+  {
+    "step": 270,
+    "loss": 2.764604330062866,
+    "diagonal": 2.7420241832733154,
+    "shortcut": 0.022580081596970558
+  },
+  {
+    "step": 271,
+    "loss": 2.4140007495880127,
+    "diagonal": 2.3773157596588135,
+    "shortcut": 0.03668488934636116
+  },
+  {
+    "step": 272,
+    "loss": 2.2641420364379883,
+    "diagonal": 2.238863706588745,
+    "shortcut": 0.02527839131653309
+  },
+  {
+    "step": 273,
+    "loss": 2.4340343475341797,
+    "diagonal": 2.4048595428466797,
+    "shortcut": 0.02917490154504776
+  },
+  {
+    "step": 274,
+    "loss": 2.9055726528167725,
+    "diagonal": 2.8887085914611816,
+    "shortcut": 0.016863998025655746
+  },
+  {
+    "step": 275,
+    "loss": 3.455878734588623,
+    "diagonal": 3.431438446044922,
+    "shortcut": 0.024440260604023933
+  },
+  {
+    "step": 276,
+    "loss": 2.450714349746704,
+    "diagonal": 2.435049057006836,
+    "shortcut": 0.015665203332901
+  },
+  {
+    "step": 277,
+    "loss": 2.3989672660827637,
+    "diagonal": 2.376828908920288,
+    "shortcut": 0.02213830128312111
+  },
+  {
+    "step": 278,
+    "loss": 2.0541512966156006,
+    "diagonal": 2.031769037246704,
+    "shortcut": 0.02238234505057335
+  },
+  {
+    "step": 279,
+    "loss": 2.641785144805908,
+    "diagonal": 2.6258127689361572,
+    "shortcut": 0.01597237028181553
+  },
+  {
+    "step": 280,
+    "loss": 2.6308183670043945,
+    "diagonal": 2.6095118522644043,
+    "shortcut": 0.021306531503796577
+  },
+  {
+    "step": 281,
+    "loss": 2.3824422359466553,
+    "diagonal": 2.3560400009155273,
+    "shortcut": 0.026402175426483154
+  },
+  {
+    "step": 282,
+    "loss": 2.8080825805664062,
+    "diagonal": 2.7944159507751465,
+    "shortcut": 0.01366655994206667
+  },
+  {
+    "step": 283,
+    "loss": 2.5684165954589844,
+    "diagonal": 2.5369272232055664,
+    "shortcut": 0.031489286571741104
+  },
+  {
+    "step": 284,
+    "loss": 1.7884982824325562,
+    "diagonal": 1.7655607461929321,
+    "shortcut": 0.022937577217817307
+  },
+  {
+    "step": 285,
+    "loss": 2.4889514446258545,
+    "diagonal": 2.4596827030181885,
+    "shortcut": 0.029268687590956688
+  },
+  {
+    "step": 286,
+    "loss": 2.3690640926361084,
+    "diagonal": 2.3495993614196777,
+    "shortcut": 0.019464734941720963
+  },
+  {
+    "step": 287,
+    "loss": 2.27146577835083,
+    "diagonal": 2.2419416904449463,
+    "shortcut": 0.029524073004722595
+  },
+  {
+    "step": 288,
+    "loss": 2.73771333694458,
+    "diagonal": 2.713292121887207,
+    "shortcut": 0.02442110888659954
+  },
+  {
+    "step": 289,
+    "loss": 2.8202364444732666,
+    "diagonal": 2.789579153060913,
+    "shortcut": 0.030657203868031502
+  },
+  {
+    "step": 290,
+    "loss": 2.770998954772949,
+    "diagonal": 2.7329609394073486,
+    "shortcut": 0.03803807497024536
+  },
+  {
+    "step": 291,
+    "loss": 2.1182501316070557,
+    "diagonal": 2.0997512340545654,
+    "shortcut": 0.018498936668038368
+  },
+  {
+    "step": 292,
+    "loss": 2.922441244125366,
+    "diagonal": 2.894627571105957,
+    "shortcut": 0.02781369909644127
+  },
+  {
+    "step": 293,
+    "loss": 2.2771964073181152,
+    "diagonal": 2.2581722736358643,
+    "shortcut": 0.019024208188056946
+  },
+  {
+    "step": 294,
+    "loss": 3.010795831680298,
+    "diagonal": 2.9897725582122803,
+    "shortcut": 0.021023323759436607
+  },
+  {
+    "step": 295,
+    "loss": 2.988736152648926,
+    "diagonal": 2.9466564655303955,
+    "shortcut": 0.04207971319556236
+  },
+  {
+    "step": 296,
+    "loss": 2.9731884002685547,
+    "diagonal": 2.938717842102051,
+    "shortcut": 0.03447066247463226
+  },
+  {
+    "step": 297,
+    "loss": 2.42643666267395,
+    "diagonal": 2.4004571437835693,
+    "shortcut": 0.025979597121477127
+  },
+  {
+    "step": 298,
+    "loss": 2.562899589538574,
+    "diagonal": 2.5312750339508057,
+    "shortcut": 0.031624581664800644
+  },
+  {
+    "step": 299,
+    "loss": 2.5052521228790283,
+    "diagonal": 2.4769670963287354,
+    "shortcut": 0.028285134583711624
+  },
+  {
+    "step": 300,
+    "loss": 2.431086301803589,
+    "diagonal": 2.399467945098877,
+    "shortcut": 0.0316183865070343
+  },
+  {
+    "step": 301,
+    "loss": 2.631696939468384,
+    "diagonal": 2.6121532917022705,
+    "shortcut": 0.01954353041946888
+  },
+  {
+    "step": 302,
+    "loss": 2.6783154010772705,
+    "diagonal": 2.643218517303467,
+    "shortcut": 0.035096995532512665
+  },
+  {
+    "step": 303,
+    "loss": 2.6041111946105957,
+    "diagonal": 2.572838306427002,
+    "shortcut": 0.03127279132604599
+  },
+  {
+    "step": 304,
+    "loss": 3.027273416519165,
+    "diagonal": 2.999329090118408,
+    "shortcut": 0.02794433757662773
+  },
+  {
+    "step": 305,
+    "loss": 2.665668249130249,
+    "diagonal": 2.6287147998809814,
+    "shortcut": 0.03695348650217056
+  },
+  {
+    "step": 306,
+    "loss": 2.528956651687622,
+    "diagonal": 2.508500576019287,
+    "shortcut": 0.020456166937947273
+  },
+  {
+    "step": 307,
+    "loss": 2.820033073425293,
+    "diagonal": 2.801431179046631,
+    "shortcut": 0.018601929768919945
+  },
+  {
+    "step": 308,
+    "loss": 2.5343430042266846,
+    "diagonal": 2.5095245838165283,
+    "shortcut": 0.024818483740091324
+  },
+  {
+    "step": 309,
+    "loss": 2.391474485397339,
+    "diagonal": 2.373760938644409,
+    "shortcut": 0.01771353743970394
+  },
+  {
+    "step": 310,
+    "loss": 2.4841854572296143,
+    "diagonal": 2.44999623298645,
+    "shortcut": 0.034189123660326004
+  },
+  {
+    "step": 311,
+    "loss": 2.5975794792175293,
+    "diagonal": 2.5743677616119385,
+    "shortcut": 0.023211734369397163
+  },
+  {
+    "step": 312,
+    "loss": 2.757200002670288,
+    "diagonal": 2.7291722297668457,
+    "shortcut": 0.02802785485982895
+  },
+  {
+    "step": 313,
+    "loss": 2.059014320373535,
+    "diagonal": 2.021679162979126,
+    "shortcut": 0.037335190922021866
+  },
+  {
+    "step": 314,
+    "loss": 2.3801889419555664,
+    "diagonal": 2.3497228622436523,
+    "shortcut": 0.03046603873372078
+  },
+  {
+    "step": 315,
+    "loss": 2.6168227195739746,
+    "diagonal": 2.589327573776245,
+    "shortcut": 0.0274951308965683
+  },
+  {
+    "step": 316,
+    "loss": 2.99755597114563,
+    "diagonal": 2.973872423171997,
+    "shortcut": 0.02368365228176117
+  },
+  {
+    "step": 317,
+    "loss": 2.40234637260437,
+    "diagonal": 2.372716188430786,
+    "shortcut": 0.029630247503519058
+  },
+  {
+    "step": 318,
+    "loss": 2.2678050994873047,
+    "diagonal": 2.243189811706543,
+    "shortcut": 0.0246153324842453
+  },
+  {
+    "step": 319,
+    "loss": 2.9028854370117188,
+    "diagonal": 2.8792543411254883,
+    "shortcut": 0.023631088435649872
+  },
+  {
+    "step": 320,
+    "loss": 2.8544304370880127,
+    "diagonal": 2.820992946624756,
+    "shortcut": 0.03343752771615982
+  },
+  {
+    "step": 321,
+    "loss": 2.5427491664886475,
+    "diagonal": 2.5187859535217285,
+    "shortcut": 0.02396320179104805
+  },
+  {
+    "step": 322,
+    "loss": 2.3833794593811035,
+    "diagonal": 2.3546290397644043,
+    "shortcut": 0.028750378638505936
+  },
+  {
+    "step": 323,
+    "loss": 2.6825599670410156,
+    "diagonal": 2.6531906127929688,
+    "shortcut": 0.029369255527853966
+  },
+  {
+    "step": 324,
+    "loss": 2.024296998977661,
+    "diagonal": 1.9913406372070312,
+    "shortcut": 0.032956451177597046
+  },
+  {
+    "step": 325,
+    "loss": 2.2202036380767822,
+    "diagonal": 2.1876606941223145,
+    "shortcut": 0.03254290670156479
+  },
+  {
+    "step": 326,
+    "loss": 2.550867795944214,
+    "diagonal": 2.5058650970458984,
+    "shortcut": 0.045002784579992294
+  },
+  {
+    "step": 327,
+    "loss": 2.2169909477233887,
+    "diagonal": 2.1810903549194336,
+    "shortcut": 0.03590049967169762
+  },
+  {
+    "step": 328,
+    "loss": 2.468411445617676,
+    "diagonal": 2.433403968811035,
+    "shortcut": 0.03500744327902794
+  },
+  {
+    "step": 329,
+    "loss": 2.744194507598877,
+    "diagonal": 2.7019805908203125,
+    "shortcut": 0.042213890701532364
+  },
+  {
+    "step": 330,
+    "loss": 2.017426013946533,
+    "diagonal": 1.9801602363586426,
+    "shortcut": 0.03726588189601898
+  },
+  {
+    "step": 331,
+    "loss": 2.3211708068847656,
+    "diagonal": 2.280132293701172,
+    "shortcut": 0.04103853926062584
+  },
+  {
+    "step": 332,
+    "loss": 2.4486911296844482,
+    "diagonal": 2.4205901622772217,
+    "shortcut": 0.02810094505548477
+  },
+  {
+    "step": 333,
+    "loss": 2.1397111415863037,
+    "diagonal": 2.1144425868988037,
+    "shortcut": 0.02526848390698433
+  },
+  {
+    "step": 334,
+    "loss": 2.556774377822876,
+    "diagonal": 2.5353245735168457,
+    "shortcut": 0.021449849009513855
+  },
+  {
+    "step": 335,
+    "loss": 2.2437424659729004,
+    "diagonal": 2.218742847442627,
+    "shortcut": 0.024999693036079407
+  },
+  {
+    "step": 336,
+    "loss": 2.9669885635375977,
+    "diagonal": 2.937436103820801,
+    "shortcut": 0.029552383348345757
+  },
+  {
+    "step": 337,
+    "loss": 2.94203519821167,
+    "diagonal": 2.913465976715088,
+    "shortcut": 0.028569189831614494
+  },
+  {
+    "step": 338,
+    "loss": 2.6712584495544434,
+    "diagonal": 2.644977569580078,
+    "shortcut": 0.02628091722726822
+  },
+  {
+    "step": 339,
+    "loss": 2.1624081134796143,
+    "diagonal": 2.125513792037964,
+    "shortcut": 0.036894261837005615
+  },
+  {
+    "step": 340,
+    "loss": 2.3682050704956055,
+    "diagonal": 2.3355255126953125,
+    "shortcut": 0.032679613679647446
+  },
+  {
+    "step": 341,
+    "loss": 2.6486666202545166,
+    "diagonal": 2.6133265495300293,
+    "shortcut": 0.03534000366926193
+  },
+  {
+    "step": 342,
+    "loss": 2.9778032302856445,
+    "diagonal": 2.9379587173461914,
+    "shortcut": 0.03984450548887253
+  },
+  {
+    "step": 343,
+    "loss": 2.014545202255249,
+    "diagonal": 1.9746439456939697,
+    "shortcut": 0.03990115225315094
+  },
+  {
+    "step": 344,
+    "loss": 2.1324448585510254,
+    "diagonal": 2.108057975769043,
+    "shortcut": 0.024386903271079063
+  },
+  {
+    "step": 345,
+    "loss": 2.41595721244812,
+    "diagonal": 2.3913118839263916,
+    "shortcut": 0.024645311757922173
+  },
+  {
+    "step": 346,
+    "loss": 2.6486337184906006,
+    "diagonal": 2.62838077545166,
+    "shortcut": 0.020253021270036697
+  },
+  {
+    "step": 347,
+    "loss": 2.267066717147827,
+    "diagonal": 2.2295045852661133,
+    "shortcut": 0.03756216913461685
+  },
+  {
+    "step": 348,
+    "loss": 2.4221689701080322,
+    "diagonal": 2.382161855697632,
+    "shortcut": 0.040007006376981735
+  },
+  {
+    "step": 349,
+    "loss": 2.7679131031036377,
+    "diagonal": 2.7401325702667236,
+    "shortcut": 0.02778058871626854
+  },
+  {
+    "step": 350,
+    "loss": 2.387350082397461,
+    "diagonal": 2.3561642169952393,
+    "shortcut": 0.031185850501060486
+  },
+  {
+    "step": 351,
+    "loss": 2.3205502033233643,
+    "diagonal": 2.2944133281707764,
+    "shortcut": 0.026136774569749832
+  },
+  {
+    "step": 352,
+    "loss": 2.00885009765625,
+    "diagonal": 1.9823410511016846,
+    "shortcut": 0.026508938521146774
+  },
+  {
+    "step": 353,
+    "loss": 2.4006295204162598,
+    "diagonal": 2.3661484718322754,
+    "shortcut": 0.03448111563920975
+  },
+  {
+    "step": 354,
+    "loss": 2.153700351715088,
+    "diagonal": 2.128645181655884,
+    "shortcut": 0.0250550527125597
+  },
+  {
+    "step": 355,
+    "loss": 2.1324820518493652,
+    "diagonal": 2.1083321571350098,
+    "shortcut": 0.02414984069764614
+  },
+  {
+    "step": 356,
+    "loss": 1.9559171199798584,
+    "diagonal": 1.9281214475631714,
+    "shortcut": 0.027795642614364624
+  },
+  {
+    "step": 357,
+    "loss": 2.6408889293670654,
+    "diagonal": 2.6162309646606445,
+    "shortcut": 0.02465788461267948
+  },
+  {
+    "step": 358,
+    "loss": 2.4704062938690186,
+    "diagonal": 2.4461379051208496,
+    "shortcut": 0.02426840551197529
+  },
+  {
+    "step": 359,
+    "loss": 2.468012809753418,
+    "diagonal": 2.437256336212158,
+    "shortcut": 0.030756380409002304
+  },
+  {
+    "step": 360,
+    "loss": 2.5522496700286865,
+    "diagonal": 2.497978925704956,
+    "shortcut": 0.05427074432373047
+  },
+  {
+    "step": 361,
+    "loss": 2.9329657554626465,
+    "diagonal": 2.8976926803588867,
+    "shortcut": 0.03527314215898514
+  },
+  {
+    "step": 362,
+    "loss": 2.3336610794067383,
+    "diagonal": 2.3001389503479004,
+    "shortcut": 0.03352221101522446
+  },
+  {
+    "step": 363,
+    "loss": 2.4507954120635986,
+    "diagonal": 2.4191970825195312,
+    "shortcut": 0.03159826621413231
+  },
+  {
+    "step": 364,
+    "loss": 2.616619110107422,
+    "diagonal": 2.5782699584960938,
+    "shortcut": 0.03834906965494156
+  },
+  {
+    "step": 365,
+    "loss": 2.4151713848114014,
+    "diagonal": 2.3862979412078857,
+    "shortcut": 0.028873510658740997
+  },
+  {
+    "step": 366,
+    "loss": 2.2970736026763916,
+    "diagonal": 2.2672202587127686,
+    "shortcut": 0.02985324151813984
+  },
+  {
+    "step": 367,
+    "loss": 2.2741200923919678,
+    "diagonal": 2.241935968399048,
+    "shortcut": 0.032184042036533356
+  },
+  {
+    "step": 368,
+    "loss": 2.622826337814331,
+    "diagonal": 2.59316349029541,
+    "shortcut": 0.029662862420082092
+  },
+  {
+    "step": 369,
+    "loss": 2.7998037338256836,
+    "diagonal": 2.777360200881958,
+    "shortcut": 0.02244359254837036
+  },
+  {
+    "step": 370,
+    "loss": 2.4781296253204346,
+    "diagonal": 2.4562106132507324,
+    "shortcut": 0.021918926388025284
+  },
+  {
+    "step": 371,
+    "loss": 1.9280263185501099,
+    "diagonal": 1.8887196779251099,
+    "shortcut": 0.03930668905377388
+  },
+  {
+    "step": 372,
+    "loss": 2.2876555919647217,
+    "diagonal": 2.24464750289917,
+    "shortcut": 0.04300811514258385
+  },
+  {
+    "step": 373,
+    "loss": 2.046577215194702,
+    "diagonal": 2.0244524478912354,
+    "shortcut": 0.022124741226434708
+  },
+  {
+    "step": 374,
+    "loss": 2.6808042526245117,
+    "diagonal": 2.6423795223236084,
+    "shortcut": 0.038424715399742126
+  },
+  {
+    "step": 375,
+    "loss": 2.717970609664917,
+    "diagonal": 2.6882805824279785,
+    "shortcut": 0.029689950868487358
+  },
+  {
+    "step": 376,
+    "loss": 1.8883755207061768,
+    "diagonal": 1.8623262643814087,
+    "shortcut": 0.026049263775348663
+  },
+  {
+    "step": 377,
+    "loss": 2.331157922744751,
+    "diagonal": 2.2968454360961914,
+    "shortcut": 0.03431249409914017
+  },
+  {
+    "step": 378,
+    "loss": 2.569648504257202,
+    "diagonal": 2.543910503387451,
+    "shortcut": 0.025737956166267395
+  },
+  {
+    "step": 379,
+    "loss": 2.852618455886841,
+    "diagonal": 2.818223476409912,
+    "shortcut": 0.03439496457576752
+  },
+  {
+    "step": 380,
+    "loss": 2.969689130783081,
+    "diagonal": 2.936699867248535,
+    "shortcut": 0.0329892598092556
+  },
+  {
+    "step": 381,
+    "loss": 2.577723979949951,
+    "diagonal": 2.550513505935669,
+    "shortcut": 0.02721053920686245
+  },
+  {
+    "step": 382,
+    "loss": 2.2701759338378906,
+    "diagonal": 2.2447385787963867,
+    "shortcut": 0.0254372451454401
+  },
+  {
+    "step": 383,
+    "loss": 2.2619423866271973,
+    "diagonal": 2.167693853378296,
+    "shortcut": 0.09424841403961182
+  },
+  {
+    "step": 384,
+    "loss": 2.525242805480957,
+    "diagonal": 2.5006964206695557,
+    "shortcut": 0.02454649657011032
+  },
+  {
+    "step": 385,
+    "loss": 1.9651126861572266,
+    "diagonal": 1.9227981567382812,
+    "shortcut": 0.042314495891332626
+  },
+  {
+    "step": 386,
+    "loss": 2.5707123279571533,
+    "diagonal": 2.545006513595581,
+    "shortcut": 0.025705762207508087
+  },
+  {
+    "step": 387,
+    "loss": 2.701282501220703,
+    "diagonal": 2.672794818878174,
+    "shortcut": 0.028487756848335266
+  },
+  {
+    "step": 388,
+    "loss": 2.451307773590088,
+    "diagonal": 2.427435874938965,
+    "shortcut": 0.023871852084994316
+  },
+  {
+    "step": 389,
+    "loss": 2.3788750171661377,
+    "diagonal": 2.347261428833008,
+    "shortcut": 0.03161366283893585
+  },
+  {
+    "step": 390,
+    "loss": 2.2890048027038574,
+    "diagonal": 2.2403366565704346,
+    "shortcut": 0.048668086528778076
+  },
+  {
+    "step": 391,
+    "loss": 2.783642530441284,
+    "diagonal": 2.754793405532837,
+    "shortcut": 0.028849037364125252
+  },
+  {
+    "step": 392,
+    "loss": 2.2129831314086914,
+    "diagonal": 2.1755001544952393,
+    "shortcut": 0.03748290240764618
+  },
+  {
+    "step": 393,
+    "loss": 2.489781618118286,
+    "diagonal": 2.459425210952759,
+    "shortcut": 0.03035634383559227
+  },
+  {
+    "step": 394,
+    "loss": 2.897773265838623,
+    "diagonal": 2.8774609565734863,
+    "shortcut": 0.020312275737524033
+  },
+  {
+    "step": 395,
+    "loss": 2.609335422515869,
+    "diagonal": 2.5872223377227783,
+    "shortcut": 0.022113189101219177
+  },
+  {
+    "step": 396,
+    "loss": 2.1181929111480713,
+    "diagonal": 2.088632106781006,
+    "shortcut": 0.029560880735516548
+  },
+  {
+    "step": 397,
+    "loss": 2.689890146255493,
+    "diagonal": 2.6710686683654785,
+    "shortcut": 0.018821388483047485
+  },
+  {
+    "step": 398,
+    "loss": 1.8473058938980103,
+    "diagonal": 1.818692684173584,
+    "shortcut": 0.028613174334168434
+  },
+  {
+    "step": 399,
+    "loss": 1.9372203350067139,
+    "diagonal": 1.9178882837295532,
+    "shortcut": 0.01933206617832184
+  },
+  {
+    "step": 400,
+    "loss": 2.7357754707336426,
+    "diagonal": 2.7160685062408447,
+    "shortcut": 0.019707046449184418
+  },
+  {
+    "step": 401,
+    "loss": 2.4291961193084717,
+    "diagonal": 2.4051713943481445,
+    "shortcut": 0.02402471750974655
+  },
+  {
+    "step": 402,
+    "loss": 2.2001452445983887,
+    "diagonal": 2.167019844055176,
+    "shortcut": 0.033125460147857666
+  },
+  {
+    "step": 403,
+    "loss": 2.2785890102386475,
+    "diagonal": 2.238443613052368,
+    "shortcut": 0.040145471692085266
+  },
+  {
+    "step": 404,
+    "loss": 2.575866937637329,
+    "diagonal": 2.5472021102905273,
+    "shortcut": 0.02866474911570549
+  },
+  {
+    "step": 405,
+    "loss": 2.6729843616485596,
+    "diagonal": 2.6472108364105225,
+    "shortcut": 0.02577354945242405
+  },
+  {
+    "step": 406,
+    "loss": 2.284834146499634,
+    "diagonal": 2.2598235607147217,
+    "shortcut": 0.025010546669363976
+  },
+  {
+    "step": 407,
+    "loss": 2.350229024887085,
+    "diagonal": 2.322815418243408,
+    "shortcut": 0.027413634583353996
+  },
+  {
+    "step": 408,
+    "loss": 2.3787682056427,
+    "diagonal": 2.3448941707611084,
+    "shortcut": 0.03387405723333359
+  },
+  {
+    "step": 409,
+    "loss": 2.637434244155884,
+    "diagonal": 2.6043474674224854,
+    "shortcut": 0.03308670595288277
+  },
+  {
+    "step": 410,
+    "loss": 2.4525580406188965,
+    "diagonal": 2.421037435531616,
+    "shortcut": 0.0315205417573452
+  },
+  {
+    "step": 411,
+    "loss": 2.742441177368164,
+    "diagonal": 2.7276065349578857,
+    "shortcut": 0.01483472902327776
+  },
+  {
+    "step": 412,
+    "loss": 2.369112014770508,
+    "diagonal": 2.320589065551758,
+    "shortcut": 0.048522889614105225
+  },
+  {
+    "step": 413,
+    "loss": 2.632582664489746,
+    "diagonal": 2.6059367656707764,
+    "shortcut": 0.02664579637348652
+  },
+  {
+    "step": 414,
+    "loss": 2.734694242477417,
+    "diagonal": 2.7106781005859375,
+    "shortcut": 0.024016249924898148
+  },
+  {
+    "step": 415,
+    "loss": 2.2786948680877686,
+    "diagonal": 2.2564809322357178,
+    "shortcut": 0.022213933989405632
+  },
+  {
+    "step": 416,
+    "loss": 1.9982209205627441,
+    "diagonal": 1.9740397930145264,
+    "shortcut": 0.024181105196475983
+  },
+  {
+    "step": 417,
+    "loss": 2.657360553741455,
+    "diagonal": 2.630481719970703,
+    "shortcut": 0.026878932490944862
+  },
+  {
+    "step": 418,
+    "loss": 2.2620348930358887,
+    "diagonal": 2.2423624992370605,
+    "shortcut": 0.019672492519021034
+  },
+  {
+    "step": 419,
+    "loss": 2.5078959465026855,
+    "diagonal": 2.4827065467834473,
+    "shortcut": 0.025189507752656937
+  },
+  {
+    "step": 420,
+    "loss": 2.3273932933807373,
+    "diagonal": 2.3110151290893555,
+    "shortcut": 0.01637827605009079
+  },
+  {
+    "step": 421,
+    "loss": 2.57647705078125,
+    "diagonal": 2.5353941917419434,
+    "shortcut": 0.041082751005887985
+  },
+  {
+    "step": 422,
+    "loss": 2.1746127605438232,
+    "diagonal": 2.152661085128784,
+    "shortcut": 0.02195175178349018
+  },
+  {
+    "step": 423,
+    "loss": 2.5880086421966553,
+    "diagonal": 2.567525863647461,
+    "shortcut": 0.02048267424106598
+  },
+  {
+    "step": 424,
+    "loss": 2.122178554534912,
+    "diagonal": 2.1040537357330322,
+    "shortcut": 0.01812484860420227
+  },
+  {
+    "step": 425,
+    "loss": 2.0930368900299072,
+    "diagonal": 2.068514347076416,
+    "shortcut": 0.024522535502910614
+  },
+  {
+    "step": 426,
+    "loss": 2.103998899459839,
+    "diagonal": 2.079585075378418,
+    "shortcut": 0.024413786828517914
+  },
+  {
+    "step": 427,
+    "loss": 1.9605557918548584,
+    "diagonal": 1.9409921169281006,
+    "shortcut": 0.019563643261790276
+  },
+  {
+    "step": 428,
+    "loss": 2.7682485580444336,
+    "diagonal": 2.7548069953918457,
+    "shortcut": 0.01344162318855524
+  },
+  {
+    "step": 429,
+    "loss": 2.277696371078491,
+    "diagonal": 2.248197317123413,
+    "shortcut": 0.029499150812625885
+  },
+  {
+    "step": 430,
+    "loss": 2.49145245552063,
+    "diagonal": 2.463865280151367,
+    "shortcut": 0.027587292715907097
+  },
+  {
+    "step": 431,
+    "loss": 2.010591745376587,
+    "diagonal": 1.9803794622421265,
+    "shortcut": 0.030212240293622017
+  },
+  {
+    "step": 432,
+    "loss": 2.110538959503174,
+    "diagonal": 2.0873682498931885,
+    "shortcut": 0.02317064255475998
+  },
+  {
+    "step": 433,
+    "loss": 2.469235420227051,
+    "diagonal": 2.4319770336151123,
+    "shortcut": 0.03725845366716385
+  },
+  {
+    "step": 434,
+    "loss": 2.4599969387054443,
+    "diagonal": 2.4392333030700684,
+    "shortcut": 0.020763615146279335
+  },
+  {
+    "step": 435,
+    "loss": 2.4059906005859375,
+    "diagonal": 2.3887970447540283,
+    "shortcut": 0.017193570733070374
+  },
+  {
+    "step": 436,
+    "loss": 2.849658966064453,
+    "diagonal": 2.833723545074463,
+    "shortcut": 0.015935314819216728
+  },
+  {
+    "step": 437,
+    "loss": 2.6859970092773438,
+    "diagonal": 2.6654696464538574,
+    "shortcut": 0.020527269691228867
+  },
+  {
+    "step": 438,
+    "loss": 2.3791186809539795,
+    "diagonal": 2.366480827331543,
+    "shortcut": 0.012637736275792122
+  },
+  {
+    "step": 439,
+    "loss": 1.900335669517517,
+    "diagonal": 1.883819818496704,
+    "shortcut": 0.016515890136361122
+  },
+  {
+    "step": 440,
+    "loss": 2.7555224895477295,
+    "diagonal": 2.737790584564209,
+    "shortcut": 0.01773199625313282
+  },
+  {
+    "step": 441,
+    "loss": 2.661630392074585,
+    "diagonal": 2.644965648651123,
+    "shortcut": 0.016664674505591393
+  },
+  {
+    "step": 442,
+    "loss": 2.2089617252349854,
+    "diagonal": 2.1886773109436035,
+    "shortcut": 0.02028435468673706
+  },
+  {
+    "step": 443,
+    "loss": 2.275662422180176,
+    "diagonal": 2.2465500831604004,
+    "shortcut": 0.029112260788679123
+  },
+  {
+    "step": 444,
+    "loss": 2.3703813552856445,
+    "diagonal": 2.353971004486084,
+    "shortcut": 0.01641034334897995
+  },
+  {
+    "step": 445,
+    "loss": 2.606227397918701,
+    "diagonal": 2.5763416290283203,
+    "shortcut": 0.029885783791542053
+  },
+  {
+    "step": 446,
+    "loss": 2.7917463779449463,
+    "diagonal": 2.771318197250366,
+    "shortcut": 0.020428113639354706
+  },
+  {
+    "step": 447,
+    "loss": 2.8762476444244385,
+    "diagonal": 2.852321147918701,
+    "shortcut": 0.023926429450511932
+  },
+  {
+    "step": 448,
+    "loss": 2.316066265106201,
+    "diagonal": 2.2768492698669434,
+    "shortcut": 0.03921687975525856
+  },
+  {
+    "step": 449,
+    "loss": 2.225487232208252,
+    "diagonal": 2.199220657348633,
+    "shortcut": 0.026266591623425484
+  },
+  {
+    "step": 450,
+    "loss": 2.2489850521087646,
+    "diagonal": 2.228447914123535,
+    "shortcut": 0.020537061616778374
+  },
+  {
+    "step": 451,
+    "loss": 2.907125234603882,
+    "diagonal": 2.879866123199463,
+    "shortcut": 0.027259163558483124
+  },
+  {
+    "step": 452,
+    "loss": 2.271162271499634,
+    "diagonal": 2.254713535308838,
+    "shortcut": 0.016448739916086197
+  },
+  {
+    "step": 453,
+    "loss": 2.544389486312866,
+    "diagonal": 2.5108649730682373,
+    "shortcut": 0.03352444991469383
+  },
+  {
+    "step": 454,
+    "loss": 2.011432647705078,
+    "diagonal": 1.9918913841247559,
+    "shortcut": 0.01954125612974167
+  },
+  {
+    "step": 455,
+    "loss": 2.117143154144287,
+    "diagonal": 2.0939953327178955,
+    "shortcut": 0.023147735744714737
+  },
+  {
+    "step": 456,
+    "loss": 2.66288161277771,
+    "diagonal": 2.6387906074523926,
+    "shortcut": 0.024091031402349472
+  },
+  {
+    "step": 457,
+    "loss": 2.3102102279663086,
+    "diagonal": 2.2748117446899414,
+    "shortcut": 0.03539855778217316
+  },
+  {
+    "step": 458,
+    "loss": 2.37774920463562,
+    "diagonal": 2.3587374687194824,
+    "shortcut": 0.019011788070201874
+  },
+  {
+    "step": 459,
+    "loss": 2.560323476791382,
+    "diagonal": 2.544799566268921,
+    "shortcut": 0.01552384253591299
+  },
+  {
+    "step": 460,
+    "loss": 1.913011074066162,
+    "diagonal": 1.8952677249908447,
+    "shortcut": 0.017743363976478577
+  },
+  {
+    "step": 461,
+    "loss": 2.6968541145324707,
+    "diagonal": 2.6644527912139893,
+    "shortcut": 0.032401394098997116
+  },
+  {
+    "step": 462,
+    "loss": 2.3282041549682617,
+    "diagonal": 2.304293632507324,
+    "shortcut": 0.023910490795969963
+  },
+  {
+    "step": 463,
+    "loss": 2.2769901752471924,
+    "diagonal": 2.250464677810669,
+    "shortcut": 0.026525411754846573
+  },
+  {
+    "step": 464,
+    "loss": 2.1331701278686523,
+    "diagonal": 2.101393699645996,
+    "shortcut": 0.03177647292613983
+  },
+  {
+    "step": 465,
+    "loss": 2.3451080322265625,
+    "diagonal": 2.3164491653442383,
+    "shortcut": 0.028658971190452576
+  },
+  {
+    "step": 466,
+    "loss": 2.465773105621338,
+    "diagonal": 2.443704605102539,
+    "shortcut": 0.022068604826927185
+  },
+  {
+    "step": 467,
+    "loss": 3.0291662216186523,
+    "diagonal": 3.001758337020874,
+    "shortcut": 0.027407905086874962
+  },
+  {
+    "step": 468,
+    "loss": 2.0853912830352783,
+    "diagonal": 2.051560163497925,
+    "shortcut": 0.03383101522922516
+  },
+  {
+    "step": 469,
+    "loss": 2.2305943965911865,
+    "diagonal": 2.1925477981567383,
+    "shortcut": 0.03804665431380272
+  },
+  {
+    "step": 470,
+    "loss": 1.9409123659133911,
+    "diagonal": 1.9227088689804077,
+    "shortcut": 0.01820346713066101
+  },
+  {
+    "step": 471,
+    "loss": 1.937381386756897,
+    "diagonal": 1.919089674949646,
+    "shortcut": 0.018291661515831947
+  },
+  {
+    "step": 472,
+    "loss": 2.0760276317596436,
+    "diagonal": 2.049436569213867,
+    "shortcut": 0.026591161265969276
+  },
+  {
+    "step": 473,
+    "loss": 3.0255560874938965,
+    "diagonal": 3.0078678131103516,
+    "shortcut": 0.017688296735286713
+  },
+  {
+    "step": 474,
+    "loss": 2.418367385864258,
+    "diagonal": 2.40317964553833,
+    "shortcut": 0.0151876425370574
+  },
+  {
+    "step": 475,
+    "loss": 2.290581703186035,
+    "diagonal": 2.2792439460754395,
+    "shortcut": 0.011337710544466972
+  },
+  {
+    "step": 476,
+    "loss": 2.349339485168457,
+    "diagonal": 2.328792095184326,
+    "shortcut": 0.020547350868582726
+  },
+  {
+    "step": 477,
+    "loss": 2.1687793731689453,
+    "diagonal": 2.156832218170166,
+    "shortcut": 0.011947078630328178
+  },
+  {
+    "step": 478,
+    "loss": 2.7384626865386963,
+    "diagonal": 2.7141501903533936,
+    "shortcut": 0.02431250363588333
+  },
+  {
+    "step": 479,
+    "loss": 2.637192726135254,
+    "diagonal": 2.6223766803741455,
+    "shortcut": 0.014815928414463997
+  },
+  {
+    "step": 480,
+    "loss": 2.416212797164917,
+    "diagonal": 2.3837645053863525,
+    "shortcut": 0.032448288053274155
+  },
+  {
+    "step": 481,
+    "loss": 2.883650064468384,
+    "diagonal": 2.8579745292663574,
+    "shortcut": 0.025675524026155472
+  },
+  {
+    "step": 482,
+    "loss": 2.3239805698394775,
+    "diagonal": 2.3080196380615234,
+    "shortcut": 0.015960829332470894
+  },
+  {
+    "step": 483,
+    "loss": 2.125704050064087,
+    "diagonal": 2.1073508262634277,
+    "shortcut": 0.018353233113884926
+  },
+  {
+    "step": 484,
+    "loss": 2.653965950012207,
+    "diagonal": 2.629474639892578,
+    "shortcut": 0.024491390213370323
+  },
+  {
+    "step": 485,
+    "loss": 2.7012813091278076,
+    "diagonal": 2.678107976913452,
+    "shortcut": 0.023173237219452858
+  },
+  {
+    "step": 486,
+    "loss": 2.3031821250915527,
+    "diagonal": 2.2771036624908447,
+    "shortcut": 0.026078540831804276
+  },
+  {
+    "step": 487,
+    "loss": 1.9019678831100464,
+    "diagonal": 1.8759877681732178,
+    "shortcut": 0.02598010003566742
+  },
+  {
+    "step": 488,
+    "loss": 2.5627338886260986,
+    "diagonal": 2.530719041824341,
+    "shortcut": 0.03201473131775856
+  },
+  {
+    "step": 489,
+    "loss": 2.248258352279663,
+    "diagonal": 2.229213237762451,
+    "shortcut": 0.019045092165470123
+  },
+  {
+    "step": 490,
+    "loss": 2.4473516941070557,
+    "diagonal": 2.421567678451538,
+    "shortcut": 0.025783967226743698
+  },
+  {
+    "step": 491,
+    "loss": 2.446197032928467,
+    "diagonal": 2.4334893226623535,
+    "shortcut": 0.012707713060081005
+  },
+  {
+    "step": 492,
+    "loss": 2.209564208984375,
+    "diagonal": 2.193794012069702,
+    "shortcut": 0.01577027700841427
+  },
+  {
+    "step": 493,
+    "loss": 2.5287790298461914,
+    "diagonal": 2.5017638206481934,
+    "shortcut": 0.027015328407287598
+  },
+  {
+    "step": 494,
+    "loss": 2.906395673751831,
+    "diagonal": 2.8910632133483887,
+    "shortcut": 0.015332412905991077
+  },
+  {
+    "step": 495,
+    "loss": 2.5021002292633057,
+    "diagonal": 2.475682020187378,
+    "shortcut": 0.02641824632883072
+  },
+  {
+    "step": 496,
+    "loss": 2.243041515350342,
+    "diagonal": 2.2264697551727295,
+    "shortcut": 0.016571756452322006
+  },
+  {
+    "step": 497,
+    "loss": 2.4033162593841553,
+    "diagonal": 2.3792710304260254,
+    "shortcut": 0.02404523454606533
+  },
+  {
+    "step": 498,
+    "loss": 2.7617039680480957,
+    "diagonal": 2.7357892990112305,
+    "shortcut": 0.025914711877703667
+  },
+  {
+    "step": 499,
+    "loss": 1.974802017211914,
+    "diagonal": 1.954790472984314,
+    "shortcut": 0.020011501386761665
+  },
+  {
+    "step": 500,
+    "loss": 2.6705429553985596,
+    "diagonal": 2.646804094314575,
+    "shortcut": 0.023738833144307137
+  },
+  {
+    "step": 501,
+    "loss": 2.038729667663574,
+    "diagonal": 2.0199389457702637,
+    "shortcut": 0.01879068650305271
+  },
+  {
+    "step": 502,
+    "loss": 2.320948600769043,
+    "diagonal": 2.305267095565796,
+    "shortcut": 0.015681417658925056
+  },
+  {
+    "step": 503,
+    "loss": 1.9857051372528076,
+    "diagonal": 1.972658395767212,
+    "shortcut": 0.013046793639659882
+  },
+  {
+    "step": 504,
+    "loss": 2.023247241973877,
+    "diagonal": 1.9962124824523926,
+    "shortcut": 0.027034737169742584
+  },
+  {
+    "step": 505,
+    "loss": 1.9967559576034546,
+    "diagonal": 1.974178671836853,
+    "shortcut": 0.02257726527750492
+  },
+  {
+    "step": 506,
+    "loss": 2.005317449569702,
+    "diagonal": 1.974247694015503,
+    "shortcut": 0.03106974996626377
+  },
+  {
+    "step": 507,
+    "loss": 2.83247709274292,
+    "diagonal": 2.79597806930542,
+    "shortcut": 0.03649891912937164
+  },
+  {
+    "step": 508,
+    "loss": 2.317817211151123,
+    "diagonal": 2.2992005348205566,
+    "shortcut": 0.018616601824760437
+  },
+  {
+    "step": 509,
+    "loss": 2.0036301612854004,
+    "diagonal": 1.9542393684387207,
+    "shortcut": 0.0493907630443573
+  },
+  {
+    "step": 510,
+    "loss": 2.4370806217193604,
+    "diagonal": 2.4132471084594727,
+    "shortcut": 0.023833483457565308
+  },
+  {
+    "step": 511,
+    "loss": 1.9956544637680054,
+    "diagonal": 1.9700706005096436,
+    "shortcut": 0.025583883747458458
+  },
+  {
+    "step": 512,
+    "loss": 2.247109889984131,
+    "diagonal": 2.2265517711639404,
+    "shortcut": 0.020558061078190804
+  },
+  {
+    "step": 513,
+    "loss": 2.2444372177124023,
+    "diagonal": 2.2201120853424072,
+    "shortcut": 0.02432517148554325
+  },
+  {
+    "step": 514,
+    "loss": 2.1370601654052734,
+    "diagonal": 2.1130151748657227,
+    "shortcut": 0.02404509112238884
+  },
+  {
+    "step": 515,
+    "loss": 2.840562343597412,
+    "diagonal": 2.814531087875366,
+    "shortcut": 0.0260312519967556
+  },
+  {
+    "step": 516,
+    "loss": 2.0615646839141846,
+    "diagonal": 2.0446760654449463,
+    "shortcut": 0.0168886948376894
+  },
+  {
+    "step": 517,
+    "loss": 2.2004313468933105,
+    "diagonal": 2.188328266143799,
+    "shortcut": 0.012103100307285786
+  },
+  {
+    "step": 518,
+    "loss": 2.4354896545410156,
+    "diagonal": 2.4263782501220703,
+    "shortcut": 0.009111322462558746
+  },
+  {
+    "step": 519,
+    "loss": 2.1168367862701416,
+    "diagonal": 2.098371744155884,
+    "shortcut": 0.018465155735611916
+  },
+  {
+    "step": 520,
+    "loss": 2.554288625717163,
+    "diagonal": 2.5342793464660645,
+    "shortcut": 0.020009320229291916
+  },
+  {
+    "step": 521,
+    "loss": 2.2350642681121826,
+    "diagonal": 2.224010944366455,
+    "shortcut": 0.011053349822759628
+  },
+  {
+    "step": 522,
+    "loss": 2.239041805267334,
+    "diagonal": 2.223937511444092,
+    "shortcut": 0.01510426215827465
+  },
+  {
+    "step": 523,
+    "loss": 2.059948682785034,
+    "diagonal": 2.0392801761627197,
+    "shortcut": 0.020668519660830498
+  },
+  {
+    "step": 524,
+    "loss": 2.7859292030334473,
+    "diagonal": 2.756161689758301,
+    "shortcut": 0.02976754866540432
+  },
+  {
+    "step": 525,
+    "loss": 2.439769983291626,
+    "diagonal": 2.422273874282837,
+    "shortcut": 0.01749608851969242
+  },
+  {
+    "step": 526,
+    "loss": 2.12444806098938,
+    "diagonal": 2.1102101802825928,
+    "shortcut": 0.014237948693335056
+  },
+  {
+    "step": 527,
+    "loss": 2.172243356704712,
+    "diagonal": 2.154214859008789,
+    "shortcut": 0.01802840083837509
+  },
+  {
+    "step": 528,
+    "loss": 2.03629469871521,
+    "diagonal": 2.0171313285827637,
+    "shortcut": 0.019163379445672035
+  },
+  {
+    "step": 529,
+    "loss": 2.6830713748931885,
+    "diagonal": 2.66064190864563,
+    "shortcut": 0.022429386153817177
+  },
+  {
+    "step": 530,
+    "loss": 2.3503904342651367,
+    "diagonal": 2.3350985050201416,
+    "shortcut": 0.015291960909962654
+  },
+  {
+    "step": 531,
+    "loss": 2.3807408809661865,
+    "diagonal": 2.368385076522827,
+    "shortcut": 0.012355868704617023
+  },
+  {
+    "step": 532,
+    "loss": 2.0480921268463135,
+    "diagonal": 2.0329017639160156,
+    "shortcut": 0.015190479345619678
+  },
+  {
+    "step": 533,
+    "loss": 1.7126728296279907,
+    "diagonal": 1.6991108655929565,
+    "shortcut": 0.013561933301389217
+  },
+  {
+    "step": 534,
+    "loss": 2.6024606227874756,
+    "diagonal": 2.5880210399627686,
+    "shortcut": 0.014439640566706657
+  },
+  {
+    "step": 535,
+    "loss": 2.6938743591308594,
+    "diagonal": 2.673241376876831,
+    "shortcut": 0.020633026957511902
+  },
+  {
+    "step": 536,
+    "loss": 2.12705135345459,
+    "diagonal": 2.1008212566375732,
+    "shortcut": 0.02623019367456436
+  },
+  {
+    "step": 537,
+    "loss": 2.122141122817993,
+    "diagonal": 2.0991146564483643,
+    "shortcut": 0.02302650548517704
+  },
+  {
+    "step": 538,
+    "loss": 2.4618587493896484,
+    "diagonal": 2.439333915710449,
+    "shortcut": 0.022524768486618996
+  },
+  {
+    "step": 539,
+    "loss": 2.3891146183013916,
+    "diagonal": 2.3737568855285645,
+    "shortcut": 0.015357635915279388
+  },
+  {
+    "step": 540,
+    "loss": 2.514324903488159,
+    "diagonal": 2.499220132827759,
+    "shortcut": 0.015104821883141994
+  },
+  {
+    "step": 541,
+    "loss": 2.079533100128174,
+    "diagonal": 2.063995599746704,
+    "shortcut": 0.015537485480308533
+  },
+  {
+    "step": 542,
+    "loss": 1.782410979270935,
+    "diagonal": 1.769781231880188,
+    "shortcut": 0.012629799544811249
+  },
+  {
+    "step": 543,
+    "loss": 2.4527108669281006,
+    "diagonal": 2.4433681964874268,
+    "shortcut": 0.009342552162706852
+  },
+  {
+    "step": 544,
+    "loss": 2.9176154136657715,
+    "diagonal": 2.9056243896484375,
+    "shortcut": 0.011991079896688461
+  },
+  {
+    "step": 545,
+    "loss": 2.421689510345459,
+    "diagonal": 2.4060494899749756,
+    "shortcut": 0.015640025958418846
+  },
+  {
+    "step": 546,
+    "loss": 2.4646427631378174,
+    "diagonal": 2.4458374977111816,
+    "shortcut": 0.018805168569087982
+  },
+  {
+    "step": 547,
+    "loss": 2.432332754135132,
+    "diagonal": 2.412982940673828,
+    "shortcut": 0.019349727779626846
+  },
+  {
+    "step": 548,
+    "loss": 2.393923282623291,
+    "diagonal": 2.3833670616149902,
+    "shortcut": 0.010556129738688469
+  },
+  {
+    "step": 549,
+    "loss": 2.2858734130859375,
+    "diagonal": 2.2608296871185303,
+    "shortcut": 0.02504372037947178
+  },
+  {
+    "step": 550,
+    "loss": 2.800609588623047,
+    "diagonal": 2.777261257171631,
+    "shortcut": 0.02334841527044773
+  },
+  {
+    "step": 551,
+    "loss": 2.832399368286133,
+    "diagonal": 2.8140223026275635,
+    "shortcut": 0.01837705820798874
+  },
+  {
+    "step": 552,
+    "loss": 2.79606294631958,
+    "diagonal": 2.750659227371216,
+    "shortcut": 0.045403800904750824
+  },
+  {
+    "step": 553,
+    "loss": 2.5427565574645996,
+    "diagonal": 2.5284664630889893,
+    "shortcut": 0.014289996586740017
+  },
+  {
+    "step": 554,
+    "loss": 2.214132308959961,
+    "diagonal": 2.1969854831695557,
+    "shortcut": 0.017146805301308632
+  },
+  {
+    "step": 555,
+    "loss": 1.9250601530075073,
+    "diagonal": 1.9129438400268555,
+    "shortcut": 0.012116358615458012
+  },
+  {
+    "step": 556,
+    "loss": 2.3775644302368164,
+    "diagonal": 2.360030174255371,
+    "shortcut": 0.01753419265151024
+  },
+  {
+    "step": 557,
+    "loss": 1.6825640201568604,
+    "diagonal": 1.6648077964782715,
+    "shortcut": 0.017756249755620956
+  },
+  {
+    "step": 558,
+    "loss": 2.493540048599243,
+    "diagonal": 2.47912859916687,
+    "shortcut": 0.014411337673664093
+  },
+  {
+    "step": 559,
+    "loss": 1.8589074611663818,
+    "diagonal": 1.8369553089141846,
+    "shortcut": 0.021952129900455475
+  },
+  {
+    "step": 560,
+    "loss": 2.1332216262817383,
+    "diagonal": 2.1158599853515625,
+    "shortcut": 0.017361562699079514
+  },
+  {
+    "step": 561,
+    "loss": 2.3657546043395996,
+    "diagonal": 2.3470842838287354,
+    "shortcut": 0.01867043413221836
+  },
+  {
+    "step": 562,
+    "loss": 1.947572946548462,
+    "diagonal": 1.931352138519287,
+    "shortcut": 0.016220824792981148
+  },
+  {
+    "step": 563,
+    "loss": 2.024770498275757,
+    "diagonal": 2.005465269088745,
+    "shortcut": 0.01930522732436657
+  },
+  {
+    "step": 564,
+    "loss": 2.3201465606689453,
+    "diagonal": 2.30452299118042,
+    "shortcut": 0.015623681247234344
+  },
+  {
+    "step": 565,
+    "loss": 2.384028196334839,
+    "diagonal": 2.367767095565796,
+    "shortcut": 0.016261011362075806
+  },
+  {
+    "step": 566,
+    "loss": 2.296304702758789,
+    "diagonal": 2.2753260135650635,
+    "shortcut": 0.020978644490242004
+  },
+  {
+    "step": 567,
+    "loss": 1.8959490060806274,
+    "diagonal": 1.8780866861343384,
+    "shortcut": 0.01786234974861145
+  },
+  {
+    "step": 568,
+    "loss": 2.2746493816375732,
+    "diagonal": 2.25590181350708,
+    "shortcut": 0.018747515976428986
+  },
+  {
+    "step": 569,
+    "loss": 2.1010379791259766,
+    "diagonal": 2.0796236991882324,
+    "shortcut": 0.021414194256067276
+  },
+  {
+    "step": 570,
+    "loss": 2.628659248352051,
+    "diagonal": 2.5984034538269043,
+    "shortcut": 0.030255883932113647
+  },
+  {
+    "step": 571,
+    "loss": 2.4415814876556396,
+    "diagonal": 2.418430805206299,
+    "shortcut": 0.02315058559179306
+  },
+  {
+    "step": 572,
+    "loss": 2.2365875244140625,
+    "diagonal": 2.2224936485290527,
+    "shortcut": 0.014093986712396145
+  },
+  {
+    "step": 573,
+    "loss": 2.2549333572387695,
+    "diagonal": 2.2432632446289062,
+    "shortcut": 0.011670226231217384
+  },
+  {
+    "step": 574,
+    "loss": 2.362563371658325,
+    "diagonal": 2.3454010486602783,
+    "shortcut": 0.017162209376692772
+  },
+  {
+    "step": 575,
+    "loss": 2.4087164402008057,
+    "diagonal": 2.390202522277832,
+    "shortcut": 0.018513957038521767
+  },
+  {
+    "step": 576,
+    "loss": 2.2716245651245117,
+    "diagonal": 2.233924627304077,
+    "shortcut": 0.037699952721595764
+  },
+  {
+    "step": 577,
+    "loss": 2.1295244693756104,
+    "diagonal": 2.1066415309906006,
+    "shortcut": 0.022882835939526558
+  },
+  {
+    "step": 578,
+    "loss": 2.46124005317688,
+    "diagonal": 2.4379875659942627,
+    "shortcut": 0.023252399638295174
+  },
+  {
+    "step": 579,
+    "loss": 2.2612650394439697,
+    "diagonal": 2.2444748878479004,
+    "shortcut": 0.01679004170000553
+  },
+  {
+    "step": 580,
+    "loss": 2.3205642700195312,
+    "diagonal": 2.306680202484131,
+    "shortcut": 0.013883971609175205
+  },
+  {
+    "step": 581,
+    "loss": 2.512784004211426,
+    "diagonal": 2.489445924758911,
+    "shortcut": 0.0233381949365139
+  },
+  {
+    "step": 582,
+    "loss": 2.5459494590759277,
+    "diagonal": 2.515998125076294,
+    "shortcut": 0.029951386153697968
+  },
+  {
+    "step": 583,
+    "loss": 2.202760696411133,
+    "diagonal": 2.1784956455230713,
+    "shortcut": 0.024265088140964508
+  },
+  {
+    "step": 584,
+    "loss": 2.337949275970459,
+    "diagonal": 2.3255512714385986,
+    "shortcut": 0.012397934682667255
+  },
+  {
+    "step": 585,
+    "loss": 1.6377066373825073,
+    "diagonal": 1.6251682043075562,
+    "shortcut": 0.012538457289338112
+  },
+  {
+    "step": 586,
+    "loss": 2.5428240299224854,
+    "diagonal": 2.5319061279296875,
+    "shortcut": 0.010917887091636658
+  },
+  {
+    "step": 587,
+    "loss": 2.40975022315979,
+    "diagonal": 2.3909785747528076,
+    "shortcut": 0.018771566450595856
+  },
+  {
+    "step": 588,
+    "loss": 2.4231529235839844,
+    "diagonal": 2.3811182975769043,
+    "shortcut": 0.04203468933701515
+  },
+  {
+    "step": 589,
+    "loss": 2.439889430999756,
+    "diagonal": 2.416332721710205,
+    "shortcut": 0.02355673909187317
+  },
+  {
+    "step": 590,
+    "loss": 2.5220396518707275,
+    "diagonal": 2.505237340927124,
+    "shortcut": 0.016802288591861725
+  },
+  {
+    "step": 591,
+    "loss": 2.7188525199890137,
+    "diagonal": 2.695094585418701,
+    "shortcut": 0.02375796250998974
+  },
+  {
+    "step": 592,
+    "loss": 2.363895893096924,
+    "diagonal": 2.3355371952056885,
+    "shortcut": 0.028358615934848785
+  },
+  {
+    "step": 593,
+    "loss": 2.006747245788574,
+    "diagonal": 1.987659215927124,
+    "shortcut": 0.019087914377450943
+  },
+  {
+    "step": 594,
+    "loss": 1.8326528072357178,
+    "diagonal": 1.8196721076965332,
+    "shortcut": 0.012980666942894459
+  },
+  {
+    "step": 595,
+    "loss": 2.234689235687256,
+    "diagonal": 2.2218966484069824,
+    "shortcut": 0.012792489491403103
+  },
+  {
+    "step": 596,
+    "loss": 2.223944902420044,
+    "diagonal": 2.200510025024414,
+    "shortcut": 0.023434802889823914
+  },
+  {
+    "step": 597,
+    "loss": 2.008134126663208,
+    "diagonal": 1.9982826709747314,
+    "shortcut": 0.00985143706202507
+  },
+  {
+    "step": 598,
+    "loss": 2.4430036544799805,
+    "diagonal": 2.4298458099365234,
+    "shortcut": 0.013157881796360016
+  },
+  {
+    "step": 599,
+    "loss": 2.1419811248779297,
+    "diagonal": 2.1134192943573,
+    "shortcut": 0.02856188826262951
+  },
+  {
+    "step": 600,
+    "loss": 2.2074201107025146,
+    "diagonal": 2.1865134239196777,
+    "shortcut": 0.020906765013933182
+  },
+  {
+    "step": 601,
+    "loss": 1.8162535429000854,
+    "diagonal": 1.7988402843475342,
+    "shortcut": 0.017413277179002762
+  },
+  {
+    "step": 602,
+    "loss": 2.010672092437744,
+    "diagonal": 1.9949744939804077,
+    "shortcut": 0.01569768600165844
+  },
+  {
+    "step": 603,
+    "loss": 2.0726633071899414,
+    "diagonal": 2.05430006980896,
+    "shortcut": 0.018363166600465775
+  },
+  {
+    "step": 604,
+    "loss": 1.928165316581726,
+    "diagonal": 1.9189064502716064,
+    "shortcut": 0.009258856065571308
+  },
+  {
+    "step": 605,
+    "loss": 2.1494367122650146,
+    "diagonal": 2.13392972946167,
+    "shortcut": 0.01550697535276413
+  },
+  {
+    "step": 606,
+    "loss": 2.245851516723633,
+    "diagonal": 2.2250030040740967,
+    "shortcut": 0.020848408341407776
+  },
+  {
+    "step": 607,
+    "loss": 2.1841514110565186,
+    "diagonal": 2.1635193824768066,
+    "shortcut": 0.020631954073905945
+  },
+  {
+    "step": 608,
+    "loss": 2.6469154357910156,
+    "diagonal": 2.6359760761260986,
+    "shortcut": 0.01093925442546606
+  },
+  {
+    "step": 609,
+    "loss": 2.3613929748535156,
+    "diagonal": 2.3488402366638184,
+    "shortcut": 0.012552741914987564
+  },
+  {
+    "step": 610,
+    "loss": 2.0960381031036377,
+    "diagonal": 2.0853958129882812,
+    "shortcut": 0.010642354376614094
+  },
+  {
+    "step": 611,
+    "loss": 2.2238800525665283,
+    "diagonal": 2.2111382484436035,
+    "shortcut": 0.01274173054844141
+  },
+  {
+    "step": 612,
+    "loss": 2.1686325073242188,
+    "diagonal": 2.146425247192383,
+    "shortcut": 0.02220718190073967
+  },
+  {
+    "step": 613,
+    "loss": 2.610093832015991,
+    "diagonal": 2.599226951599121,
+    "shortcut": 0.010866892524063587
+  },
+  {
+    "step": 614,
+    "loss": 1.9218260049819946,
+    "diagonal": 1.9113690853118896,
+    "shortcut": 0.010456901043653488
+  },
+  {
+    "step": 615,
+    "loss": 2.389976739883423,
+    "diagonal": 2.3807413578033447,
+    "shortcut": 0.009235376492142677
+  },
+  {
+    "step": 616,
+    "loss": 2.6057703495025635,
+    "diagonal": 2.5963282585144043,
+    "shortcut": 0.009442072361707687
+  },
+  {
+    "step": 617,
+    "loss": 2.05989670753479,
+    "diagonal": 2.043499231338501,
+    "shortcut": 0.016397526487708092
+  },
+  {
+    "step": 618,
+    "loss": 2.2408013343811035,
+    "diagonal": 2.235334634780884,
+    "shortcut": 0.005466689355671406
+  },
+  {
+    "step": 619,
+    "loss": 2.4008028507232666,
+    "diagonal": 2.389183282852173,
+    "shortcut": 0.011619591154158115
+  },
+  {
+    "step": 620,
+    "loss": 2.7720625400543213,
+    "diagonal": 2.7627673149108887,
+    "shortcut": 0.009295238181948662
+  },
+  {
+    "step": 621,
+    "loss": 2.6147358417510986,
+    "diagonal": 2.5874736309051514,
+    "shortcut": 0.027262156829237938
+  },
+  {
+    "step": 622,
+    "loss": 2.730073928833008,
+    "diagonal": 2.720271110534668,
+    "shortcut": 0.009802735410630703
+  },
+  {
+    "step": 623,
+    "loss": 2.1390717029571533,
+    "diagonal": 2.124380111694336,
+    "shortcut": 0.01469152420759201
+  },
+  {
+    "step": 624,
+    "loss": 1.6836599111557007,
+    "diagonal": 1.6656538248062134,
+    "shortcut": 0.01800612360239029
+  },
+  {
+    "step": 625,
+    "loss": 2.1020843982696533,
+    "diagonal": 2.0807321071624756,
+    "shortcut": 0.021352408453822136
+  },
+  {
+    "step": 626,
+    "loss": 2.764735698699951,
+    "diagonal": 2.735058069229126,
+    "shortcut": 0.029677599668502808
+  },
+  {
+    "step": 627,
+    "loss": 2.359755277633667,
+    "diagonal": 2.3444724082946777,
+    "shortcut": 0.015282860025763512
+  },
+  {
+    "step": 628,
+    "loss": 1.8263622522354126,
+    "diagonal": 1.813644528388977,
+    "shortcut": 0.0127177145332098
+  },
+  {
+    "step": 629,
+    "loss": 2.094850778579712,
+    "diagonal": 2.074167251586914,
+    "shortcut": 0.020683517679572105
+  },
+  {
+    "step": 630,
+    "loss": 2.2846264839172363,
+    "diagonal": 2.2583253383636475,
+    "shortcut": 0.02630108967423439
+  },
+  {
+    "step": 631,
+    "loss": 2.350472927093506,
+    "diagonal": 2.3390820026397705,
+    "shortcut": 0.011390967294573784
+  },
+  {
+    "step": 632,
+    "loss": 2.1238741874694824,
+    "diagonal": 2.103823184967041,
+    "shortcut": 0.020051034167408943
+  },
+  {
+    "step": 633,
+    "loss": 1.953413963317871,
+    "diagonal": 1.9425678253173828,
+    "shortcut": 0.010846102610230446
+  },
+  {
+    "step": 634,
+    "loss": 2.4211506843566895,
+    "diagonal": 2.413886547088623,
+    "shortcut": 0.007264029700309038
+  },
+  {
+    "step": 635,
+    "loss": 2.281775951385498,
+    "diagonal": 2.2759923934936523,
+    "shortcut": 0.005783453118056059
+  },
+  {
+    "step": 636,
+    "loss": 2.254819631576538,
+    "diagonal": 2.2392544746398926,
+    "shortcut": 0.01556523609906435
+  },
+  {
+    "step": 637,
+    "loss": 2.1598613262176514,
+    "diagonal": 2.1526827812194824,
+    "shortcut": 0.007178621366620064
+  },
+  {
+    "step": 638,
+    "loss": 2.307220458984375,
+    "diagonal": 2.2877960205078125,
+    "shortcut": 0.019424425438046455
+  },
+  {
+    "step": 639,
+    "loss": 2.383557081222534,
+    "diagonal": 2.368614912033081,
+    "shortcut": 0.01494227722287178
+  },
+  {
+    "step": 640,
+    "loss": 2.3406457901000977,
+    "diagonal": 2.3233959674835205,
+    "shortcut": 0.01724986545741558
+  },
+  {
+    "step": 641,
+    "loss": 2.2566373348236084,
+    "diagonal": 2.238860607147217,
+    "shortcut": 0.017776815220713615
+  },
+  {
+    "step": 642,
+    "loss": 2.239739418029785,
+    "diagonal": 2.229130744934082,
+    "shortcut": 0.010608590207993984
+  },
+  {
+    "step": 643,
+    "loss": 1.8243541717529297,
+    "diagonal": 1.810774803161621,
+    "shortcut": 0.01357937790453434
+  },
+  {
+    "step": 644,
+    "loss": 2.0363175868988037,
+    "diagonal": 2.0142738819122314,
+    "shortcut": 0.022043727338314056
+  },
+  {
+    "step": 645,
+    "loss": 1.6576337814331055,
+    "diagonal": 1.6424874067306519,
+    "shortcut": 0.015146339312195778
+  },
+  {
+    "step": 646,
+    "loss": 2.2364988327026367,
+    "diagonal": 2.2207183837890625,
+    "shortcut": 0.01578056439757347
+  },
+  {
+    "step": 647,
+    "loss": 1.8158960342407227,
+    "diagonal": 1.803072452545166,
+    "shortcut": 0.012823615223169327
+  },
+  {
+    "step": 648,
+    "loss": 2.3248486518859863,
+    "diagonal": 2.30820631980896,
+    "shortcut": 0.016642361879348755
+  },
+  {
+    "step": 649,
+    "loss": 2.3354456424713135,
+    "diagonal": 2.3013360500335693,
+    "shortcut": 0.03410961106419563
+  },
+  {
+    "step": 650,
+    "loss": 1.9716644287109375,
+    "diagonal": 1.9599182605743408,
+    "shortcut": 0.011746130883693695
+  },
+  {
+    "step": 651,
+    "loss": 2.6159183979034424,
+    "diagonal": 2.597719669342041,
+    "shortcut": 0.01819874718785286
+  },
+  {
+    "step": 652,
+    "loss": 2.034593343734741,
+    "diagonal": 2.010277509689331,
+    "shortcut": 0.024315759539604187
+  },
+  {
+    "step": 653,
+    "loss": 2.385998249053955,
+    "diagonal": 2.3734447956085205,
+    "shortcut": 0.012553507462143898
+  },
+  {
+    "step": 654,
+    "loss": 1.8015000820159912,
+    "diagonal": 1.7896270751953125,
+    "shortcut": 0.0118730328977108
+  },
+  {
+    "step": 655,
+    "loss": 2.1316730976104736,
+    "diagonal": 2.1185696125030518,
+    "shortcut": 0.013103392906486988
+  },
+  {
+    "step": 656,
+    "loss": 2.01638126373291,
+    "diagonal": 2.0052454471588135,
+    "shortcut": 0.011135698296129704
+  },
+  {
+    "step": 657,
+    "loss": 2.083705186843872,
+    "diagonal": 2.067849636077881,
+    "shortcut": 0.01585562154650688
+  },
+  {
+    "step": 658,
+    "loss": 2.2315335273742676,
+    "diagonal": 2.209743022918701,
+    "shortcut": 0.0217905156314373
+  },
+  {
+    "step": 659,
+    "loss": 2.0856316089630127,
+    "diagonal": 2.0640385150909424,
+    "shortcut": 0.02159300073981285
+  },
+  {
+    "step": 660,
+    "loss": 2.88914155960083,
+    "diagonal": 2.8772101402282715,
+    "shortcut": 0.011931350454688072
+  },
+  {
+    "step": 661,
+    "loss": 2.549457550048828,
+    "diagonal": 2.538874626159668,
+    "shortcut": 0.010582982562482357
+  },
+  {
+    "step": 662,
+    "loss": 2.564117431640625,
+    "diagonal": 2.5543134212493896,
+    "shortcut": 0.009803995490074158
+  },
+  {
+    "step": 663,
+    "loss": 2.3337888717651367,
+    "diagonal": 2.3245749473571777,
+    "shortcut": 0.009214019402861595
+  },
+  {
+    "step": 664,
+    "loss": 2.178375005722046,
+    "diagonal": 2.163604259490967,
+    "shortcut": 0.01477079652249813
+  },
+  {
+    "step": 665,
+    "loss": 2.1002748012542725,
+    "diagonal": 2.0543484687805176,
+    "shortcut": 0.04592640697956085
+  },
+  {
+    "step": 666,
+    "loss": 2.560969352722168,
+    "diagonal": 2.5337679386138916,
+    "shortcut": 0.027201328426599503
+  },
+  {
+    "step": 667,
+    "loss": 2.534245252609253,
+    "diagonal": 2.5272412300109863,
+    "shortcut": 0.0070039862766861916
+  },
+  {
+    "step": 668,
+    "loss": 2.1494946479797363,
+    "diagonal": 2.1337990760803223,
+    "shortcut": 0.015695586800575256
+  },
+  {
+    "step": 669,
+    "loss": 2.6413486003875732,
+    "diagonal": 2.6225972175598145,
+    "shortcut": 0.01875140890479088
+  },
+  {
+    "step": 670,
+    "loss": 1.9215211868286133,
+    "diagonal": 1.910001516342163,
+    "shortcut": 0.011519639752805233
+  },
+  {
+    "step": 671,
+    "loss": 2.4201133251190186,
+    "diagonal": 2.4016997814178467,
+    "shortcut": 0.018413426354527473
+  },
+  {
+    "step": 672,
+    "loss": 2.227785110473633,
+    "diagonal": 2.2121026515960693,
+    "shortcut": 0.01568255014717579
+  },
+  {
+    "step": 673,
+    "loss": 2.0727438926696777,
+    "diagonal": 2.0555834770202637,
+    "shortcut": 0.017160408198833466
+  },
+  {
+    "step": 674,
+    "loss": 2.4379303455352783,
+    "diagonal": 2.4150288105010986,
+    "shortcut": 0.022901633754372597
+  },
+  {
+    "step": 675,
+    "loss": 2.203091859817505,
+    "diagonal": 2.184570789337158,
+    "shortcut": 0.01852116733789444
+  },
+  {
+    "step": 676,
+    "loss": 1.9942282438278198,
+    "diagonal": 1.9593660831451416,
+    "shortcut": 0.03486214205622673
+  },
+  {
+    "step": 677,
+    "loss": 2.0468451976776123,
+    "diagonal": 2.0239686965942383,
+    "shortcut": 0.02287653461098671
+  },
+  {
+    "step": 678,
+    "loss": 2.6222422122955322,
+    "diagonal": 2.6012165546417236,
+    "shortcut": 0.021025540307164192
+  },
+  {
+    "step": 679,
+    "loss": 2.4207918643951416,
+    "diagonal": 2.397517442703247,
+    "shortcut": 0.023274309933185577
+  },
+  {
+    "step": 680,
+    "loss": 2.157456636428833,
+    "diagonal": 2.138676404953003,
+    "shortcut": 0.01878034509718418
+  },
+  {
+    "step": 681,
+    "loss": 2.4205148220062256,
+    "diagonal": 2.3980629444122314,
+    "shortcut": 0.022451793774962425
+  },
+  {
+    "step": 682,
+    "loss": 2.3820526599884033,
+    "diagonal": 2.3610997200012207,
+    "shortcut": 0.02095290645956993
+  },
+  {
+    "step": 683,
+    "loss": 2.2007651329040527,
+    "diagonal": 2.181450366973877,
+    "shortcut": 0.01931484416127205
+  },
+  {
+    "step": 684,
+    "loss": 2.021554708480835,
+    "diagonal": 2.004477024078369,
+    "shortcut": 0.017077786847949028
+  },
+  {
+    "step": 685,
+    "loss": 2.5074620246887207,
+    "diagonal": 2.4846644401550293,
+    "shortcut": 0.02279752865433693
+  },
+  {
+    "step": 686,
+    "loss": 2.3387553691864014,
+    "diagonal": 2.324700355529785,
+    "shortcut": 0.014055092819035053
+  },
+  {
+    "step": 687,
+    "loss": 1.8318995237350464,
+    "diagonal": 1.8161888122558594,
+    "shortcut": 0.015710730105638504
+  },
+  {
+    "step": 688,
+    "loss": 2.1800947189331055,
+    "diagonal": 2.1656386852264404,
+    "shortcut": 0.014456065371632576
+  },
+  {
+    "step": 689,
+    "loss": 2.387125253677368,
+    "diagonal": 2.3735220432281494,
+    "shortcut": 0.01360329706221819
+  },
+  {
+    "step": 690,
+    "loss": 1.9286327362060547,
+    "diagonal": 1.9192068576812744,
+    "shortcut": 0.009425868280231953
+  },
+  {
+    "step": 691,
+    "loss": 2.229832172393799,
+    "diagonal": 2.202819585800171,
+    "shortcut": 0.027012497186660767
+  },
+  {
+    "step": 692,
+    "loss": 2.2142391204833984,
+    "diagonal": 2.1965601444244385,
+    "shortcut": 0.017678862437605858
+  },
+  {
+    "step": 693,
+    "loss": 2.1737585067749023,
+    "diagonal": 2.147780418395996,
+    "shortcut": 0.025978071615099907
+  },
+  {
+    "step": 694,
+    "loss": 2.1630125045776367,
+    "diagonal": 2.125868558883667,
+    "shortcut": 0.037144050002098083
+  },
+  {
+    "step": 695,
+    "loss": 2.352725028991699,
+    "diagonal": 2.3293182849884033,
+    "shortcut": 0.023406725376844406
+  },
+  {
+    "step": 696,
+    "loss": 2.751739978790283,
+    "diagonal": 2.740333318710327,
+    "shortcut": 0.01140676997601986
+  },
+  {
+    "step": 697,
+    "loss": 1.9249491691589355,
+    "diagonal": 1.915872573852539,
+    "shortcut": 0.009076613001525402
+  },
+  {
+    "step": 698,
+    "loss": 1.783402919769287,
+    "diagonal": 1.7556352615356445,
+    "shortcut": 0.027767710387706757
+  },
+  {
+    "step": 699,
+    "loss": 1.778883457183838,
+    "diagonal": 1.755996823310852,
+    "shortcut": 0.022886620834469795
+  },
+  {
+    "step": 700,
+    "loss": 2.2127981185913086,
+    "diagonal": 2.2001430988311768,
+    "shortcut": 0.012655037455260754
+  },
+  {
+    "step": 701,
+    "loss": 2.822436809539795,
+    "diagonal": 2.803426504135132,
+    "shortcut": 0.019010210409760475
+  },
+  {
+    "step": 702,
+    "loss": 2.6915462017059326,
+    "diagonal": 2.6720759868621826,
+    "shortcut": 0.01947017014026642
+  },
+  {
+    "step": 703,
+    "loss": 2.285367965698242,
+    "diagonal": 2.268939256668091,
+    "shortcut": 0.01642868109047413
+  },
+  {
+    "step": 704,
+    "loss": 1.7679780721664429,
+    "diagonal": 1.7493112087249756,
+    "shortcut": 0.018666831776499748
+  },
+  {
+    "step": 705,
+    "loss": 2.854133129119873,
+    "diagonal": 2.8409252166748047,
+    "shortcut": 0.013207873329520226
+  },
+  {
+    "step": 706,
+    "loss": 1.6929216384887695,
+    "diagonal": 1.6727772951126099,
+    "shortcut": 0.020144399255514145
+  },
+  {
+    "step": 707,
+    "loss": 2.2024638652801514,
+    "diagonal": 2.1851680278778076,
+    "shortcut": 0.01729576848447323
+  },
+  {
+    "step": 708,
+    "loss": 1.6693482398986816,
+    "diagonal": 1.653958797454834,
+    "shortcut": 0.01538949366658926
+  },
+  {
+    "step": 709,
+    "loss": 2.2654225826263428,
+    "diagonal": 2.253023624420166,
+    "shortcut": 0.012398927472531796
+  },
+  {
+    "step": 710,
+    "loss": 2.2673568725585938,
+    "diagonal": 2.220285654067993,
+    "shortcut": 0.047071147710084915
+  },
+  {
+    "step": 711,
+    "loss": 2.4742064476013184,
+    "diagonal": 2.46549391746521,
+    "shortcut": 0.008712581358850002
+  },
+  {
+    "step": 712,
+    "loss": 2.3019895553588867,
+    "diagonal": 2.2858071327209473,
+    "shortcut": 0.01618245244026184
+  },
+  {
+    "step": 713,
+    "loss": 2.4455792903900146,
+    "diagonal": 2.4348177909851074,
+    "shortcut": 0.010761559940874577
+  },
+  {
+    "step": 714,
+    "loss": 2.351627826690674,
+    "diagonal": 2.328226089477539,
+    "shortcut": 0.023401763290166855
+  },
+  {
+    "step": 715,
+    "loss": 2.3894972801208496,
+    "diagonal": 2.3773882389068604,
+    "shortcut": 0.012109074741601944
+  },
+  {
+    "step": 716,
+    "loss": 2.4054696559906006,
+    "diagonal": 2.3886961936950684,
+    "shortcut": 0.01677335798740387
+  },
+  {
+    "step": 717,
+    "loss": 2.4707679748535156,
+    "diagonal": 2.4566056728363037,
+    "shortcut": 0.014162206090986729
+  },
+  {
+    "step": 718,
+    "loss": 1.9496616125106812,
+    "diagonal": 1.9336810111999512,
+    "shortcut": 0.01598062738776207
+  },
+  {
+    "step": 719,
+    "loss": 2.055128574371338,
+    "diagonal": 2.0276987552642822,
+    "shortcut": 0.027429888024926186
+  },
+  {
+    "step": 720,
+    "loss": 2.32991886138916,
+    "diagonal": 2.315110206604004,
+    "shortcut": 0.014808567240834236
+  },
+  {
+    "step": 721,
+    "loss": 2.3971757888793945,
+    "diagonal": 2.381333351135254,
+    "shortcut": 0.015842463821172714
+  },
+  {
+    "step": 722,
+    "loss": 2.256587028503418,
+    "diagonal": 2.2379140853881836,
+    "shortcut": 0.018672853708267212
+  },
+  {
+    "step": 723,
+    "loss": 2.3054986000061035,
+    "diagonal": 2.2834205627441406,
+    "shortcut": 0.022078143432736397
+  },
+  {
+    "step": 724,
+    "loss": 2.1641693115234375,
+    "diagonal": 2.1314101219177246,
+    "shortcut": 0.03275921568274498
+  },
+  {
+    "step": 725,
+    "loss": 2.393791675567627,
+    "diagonal": 2.3624870777130127,
+    "shortcut": 0.03130457550287247
+  },
+  {
+    "step": 726,
+    "loss": 2.1271889209747314,
+    "diagonal": 2.10697603225708,
+    "shortcut": 0.020212838426232338
+  },
+  {
+    "step": 727,
+    "loss": 2.098649740219116,
+    "diagonal": 2.0558807849884033,
+    "shortcut": 0.04276898130774498
+  },
+  {
+    "step": 728,
+    "loss": 2.045478582382202,
+    "diagonal": 2.0308361053466797,
+    "shortcut": 0.014642477035522461
+  },
+  {
+    "step": 729,
+    "loss": 1.8575518131256104,
+    "diagonal": 1.8473179340362549,
+    "shortcut": 0.010233891196548939
+  },
+  {
+    "step": 730,
+    "loss": 2.1491403579711914,
+    "diagonal": 2.1223762035369873,
+    "shortcut": 0.026764076203107834
+  },
+  {
+    "step": 731,
+    "loss": 2.0850446224212646,
+    "diagonal": 2.068324089050293,
+    "shortcut": 0.01672053150832653
+  },
+  {
+    "step": 732,
+    "loss": 1.9479937553405762,
+    "diagonal": 1.9386593103408813,
+    "shortcut": 0.009334462694823742
+  },
+  {
+    "step": 733,
+    "loss": 2.0831005573272705,
+    "diagonal": 2.0722603797912598,
+    "shortcut": 0.010840263217687607
+  },
+  {
+    "step": 734,
+    "loss": 2.6084113121032715,
+    "diagonal": 2.5987606048583984,
+    "shortcut": 0.009650693275034428
+  },
+  {
+    "step": 735,
+    "loss": 2.5705976486206055,
+    "diagonal": 2.5578861236572266,
+    "shortcut": 0.01271149143576622
+  },
+  {
+    "step": 736,
+    "loss": 2.0816171169281006,
+    "diagonal": 2.063173532485962,
+    "shortcut": 0.01844368688762188
+  },
+  {
+    "step": 737,
+    "loss": 2.431701183319092,
+    "diagonal": 2.3858022689819336,
+    "shortcut": 0.04589884355664253
+  },
+  {
+    "step": 738,
+    "loss": 2.652386426925659,
+    "diagonal": 2.636176586151123,
+    "shortcut": 0.01620975136756897
+  },
+  {
+    "step": 739,
+    "loss": 2.0169119834899902,
+    "diagonal": 1.9983031749725342,
+    "shortcut": 0.018608711659908295
+  },
+  {
+    "step": 740,
+    "loss": 2.3831989765167236,
+    "diagonal": 2.367509603500366,
+    "shortcut": 0.015689440071582794
+  },
+  {
+    "step": 741,
+    "loss": 2.2603518962860107,
+    "diagonal": 2.2425315380096436,
+    "shortcut": 0.017820246517658234
+  },
+  {
+    "step": 742,
+    "loss": 2.167921304702759,
+    "diagonal": 2.155670404434204,
+    "shortcut": 0.012250883504748344
+  },
+  {
+    "step": 743,
+    "loss": 2.126948595046997,
+    "diagonal": 2.110326051712036,
+    "shortcut": 0.016622547060251236
+  },
+  {
+    "step": 744,
+    "loss": 2.321162223815918,
+    "diagonal": 2.307574987411499,
+    "shortcut": 0.01358724944293499
+  },
+  {
+    "step": 745,
+    "loss": 1.4110746383666992,
+    "diagonal": 1.381164312362671,
+    "shortcut": 0.029910296201705933
+  },
+  {
+    "step": 746,
+    "loss": 2.3324134349823,
+    "diagonal": 2.299138069152832,
+    "shortcut": 0.03327527642250061
+  },
+  {
+    "step": 747,
+    "loss": 2.034966468811035,
+    "diagonal": 2.0220444202423096,
+    "shortcut": 0.012922124937176704
+  },
+  {
+    "step": 748,
+    "loss": 1.9025182723999023,
+    "diagonal": 1.8912453651428223,
+    "shortcut": 0.011272851377725601
+  },
+  {
+    "step": 749,
+    "loss": 2.018361806869507,
+    "diagonal": 2.0013651847839355,
+    "shortcut": 0.016996534541249275
+  },
+  {
+    "step": 750,
+    "loss": 1.7700273990631104,
+    "diagonal": 1.75008225440979,
+    "shortcut": 0.019945111125707626
+  },
+  {
+    "step": 751,
+    "loss": 1.7562144994735718,
+    "diagonal": 1.7347925901412964,
+    "shortcut": 0.021421879529953003
+  },
+  {
+    "step": 752,
+    "loss": 2.526979446411133,
+    "diagonal": 2.5106143951416016,
+    "shortcut": 0.01636507362127304
+  },
+  {
+    "step": 753,
+    "loss": 2.7254204750061035,
+    "diagonal": 2.6982598304748535,
+    "shortcut": 0.027160722762346268
+  },
+  {
+    "step": 754,
+    "loss": 2.5798726081848145,
+    "diagonal": 2.5652167797088623,
+    "shortcut": 0.01465582475066185
+  },
+  {
+    "step": 755,
+    "loss": 2.8483426570892334,
+    "diagonal": 2.83111310005188,
+    "shortcut": 0.01722957007586956
+  },
+  {
+    "step": 756,
+    "loss": 1.937608003616333,
+    "diagonal": 1.9249435663223267,
+    "shortcut": 0.012664452195167542
+  },
+  {
+    "step": 757,
+    "loss": 2.134988784790039,
+    "diagonal": 2.1206345558166504,
+    "shortcut": 0.014354120939970016
+  },
+  {
+    "step": 758,
+    "loss": 1.641727089881897,
+    "diagonal": 1.625101923942566,
+    "shortcut": 0.01662519946694374
+  },
+  {
+    "step": 759,
+    "loss": 2.342397689819336,
+    "diagonal": 2.328777313232422,
+    "shortcut": 0.013620283454656601
+  },
+  {
+    "step": 760,
+    "loss": 1.8858113288879395,
+    "diagonal": 1.8708546161651611,
+    "shortcut": 0.01495667640119791
+  },
+  {
+    "step": 761,
+    "loss": 2.602790117263794,
+    "diagonal": 2.5905771255493164,
+    "shortcut": 0.012213052250444889
+  },
+  {
+    "step": 762,
+    "loss": 1.4384918212890625,
+    "diagonal": 1.420055627822876,
+    "shortcut": 0.018436133861541748
+  },
+  {
+    "step": 763,
+    "loss": 2.161268711090088,
+    "diagonal": 2.1415209770202637,
+    "shortcut": 0.01974763534963131
+  },
+  {
+    "step": 764,
+    "loss": 1.8478447198867798,
+    "diagonal": 1.8284258842468262,
+    "shortcut": 0.01941884681582451
+  },
+  {
+    "step": 765,
+    "loss": 2.4937422275543213,
+    "diagonal": 2.4777445793151855,
+    "shortcut": 0.015997665002942085
+  },
+  {
+    "step": 766,
+    "loss": 2.1311569213867188,
+    "diagonal": 2.084462881088257,
+    "shortcut": 0.046693962067365646
+  },
+  {
+    "step": 767,
+    "loss": 2.782186269760132,
+    "diagonal": 2.7473788261413574,
+    "shortcut": 0.03480735048651695
+  },
+  {
+    "step": 768,
+    "loss": 2.003328561782837,
+    "diagonal": 1.992667555809021,
+    "shortcut": 0.010661023668944836
+  },
+  {
+    "step": 769,
+    "loss": 1.8633898496627808,
+    "diagonal": 1.8406646251678467,
+    "shortcut": 0.02272520586848259
+  },
+  {
+    "step": 770,
+    "loss": 1.5905063152313232,
+    "diagonal": 1.5810552835464478,
+    "shortcut": 0.009450983256101608
+  },
+  {
+    "step": 771,
+    "loss": 2.1173694133758545,
+    "diagonal": 2.1022884845733643,
+    "shortcut": 0.015080896206200123
+  },
+  {
+    "step": 772,
+    "loss": 2.383999824523926,
+    "diagonal": 2.3764729499816895,
+    "shortcut": 0.007526780944317579
+  },
+  {
+    "step": 773,
+    "loss": 2.1289150714874268,
+    "diagonal": 2.1174721717834473,
+    "shortcut": 0.011442907154560089
+  },
+  {
+    "step": 774,
+    "loss": 1.8173186779022217,
+    "diagonal": 1.7992298603057861,
+    "shortcut": 0.01808881387114525
+  },
+  {
+    "step": 775,
+    "loss": 2.316190481185913,
+    "diagonal": 2.297304153442383,
+    "shortcut": 0.01888643205165863
+  },
+  {
+    "step": 776,
+    "loss": 2.2181529998779297,
+    "diagonal": 2.2080018520355225,
+    "shortcut": 0.010151115246117115
+  },
+  {
+    "step": 777,
+    "loss": 2.452065944671631,
+    "diagonal": 2.4361391067504883,
+    "shortcut": 0.015926718711853027
+  },
+  {
+    "step": 778,
+    "loss": 2.1674580574035645,
+    "diagonal": 2.1501429080963135,
+    "shortcut": 0.017315201461315155
+  },
+  {
+    "step": 779,
+    "loss": 2.3046650886535645,
+    "diagonal": 2.2805724143981934,
+    "shortcut": 0.024092791602015495
+  },
+  {
+    "step": 780,
+    "loss": 2.4172916412353516,
+    "diagonal": 2.3945653438568115,
+    "shortcut": 0.022726284340023994
+  },
+  {
+    "step": 781,
+    "loss": 2.210123062133789,
+    "diagonal": 2.1884279251098633,
+    "shortcut": 0.02169509045779705
+  },
+  {
+    "step": 782,
+    "loss": 2.439243793487549,
+    "diagonal": 2.410165309906006,
+    "shortcut": 0.029078597202897072
+  },
+  {
+    "step": 783,
+    "loss": 2.436093807220459,
+    "diagonal": 2.415797710418701,
+    "shortcut": 0.02029605209827423
+  },
+  {
+    "step": 784,
+    "loss": 2.0388474464416504,
+    "diagonal": 2.0235507488250732,
+    "shortcut": 0.015296649187803268
+  },
+  {
+    "step": 785,
+    "loss": 2.05289888381958,
+    "diagonal": 2.033450126647949,
+    "shortcut": 0.019448716193437576
+  },
+  {
+    "step": 786,
+    "loss": 2.3512587547302246,
+    "diagonal": 2.3240232467651367,
+    "shortcut": 0.027235565707087517
+  },
+  {
+    "step": 787,
+    "loss": 2.1433072090148926,
+    "diagonal": 2.1250836849212646,
+    "shortcut": 0.018223464488983154
+  },
+  {
+    "step": 788,
+    "loss": 1.8270466327667236,
+    "diagonal": 1.817275881767273,
+    "shortcut": 0.009770735166966915
+  },
+  {
+    "step": 789,
+    "loss": 1.9886001348495483,
+    "diagonal": 1.9795037508010864,
+    "shortcut": 0.009096353314816952
+  },
+  {
+    "step": 790,
+    "loss": 2.4533498287200928,
+    "diagonal": 2.439518690109253,
+    "shortcut": 0.013831079937517643
+  },
+  {
+    "step": 791,
+    "loss": 2.275099277496338,
+    "diagonal": 2.2613611221313477,
+    "shortcut": 0.013738173060119152
+  },
+  {
+    "step": 792,
+    "loss": 1.8366096019744873,
+    "diagonal": 1.8116860389709473,
+    "shortcut": 0.024923549965023994
+  },
+  {
+    "step": 793,
+    "loss": 2.282665252685547,
+    "diagonal": 2.265371322631836,
+    "shortcut": 0.017293984070420265
+  },
+  {
+    "step": 794,
+    "loss": 1.5965207815170288,
+    "diagonal": 1.5805566310882568,
+    "shortcut": 0.015964137390255928
+  },
+  {
+    "step": 795,
+    "loss": 2.3136813640594482,
+    "diagonal": 2.3036105632781982,
+    "shortcut": 0.010070775635540485
+  },
+  {
+    "step": 796,
+    "loss": 2.2934625148773193,
+    "diagonal": 2.278337001800537,
+    "shortcut": 0.015125554986298084
+  },
+  {
+    "step": 797,
+    "loss": 2.074263095855713,
+    "diagonal": 2.0636308193206787,
+    "shortcut": 0.010632229968905449
+  },
+  {
+    "step": 798,
+    "loss": 2.097703218460083,
+    "diagonal": 2.085548162460327,
+    "shortcut": 0.012155145406723022
+  },
+  {
+    "step": 799,
+    "loss": 2.1674373149871826,
+    "diagonal": 2.158541202545166,
+    "shortcut": 0.008896230719983578
+  },
+  {
+    "step": 800,
+    "loss": 2.6201019287109375,
+    "diagonal": 2.6115262508392334,
+    "shortcut": 0.008575566112995148
+  },
+  {
+    "step": 801,
+    "loss": 2.002514123916626,
+    "diagonal": 1.9863965511322021,
+    "shortcut": 0.016117475926876068
+  },
+  {
+    "step": 802,
+    "loss": 2.0755159854888916,
+    "diagonal": 2.0539605617523193,
+    "shortcut": 0.021555524319410324
+  },
+  {
+    "step": 803,
+    "loss": 2.243853807449341,
+    "diagonal": 2.2271902561187744,
+    "shortcut": 0.016663577407598495
+  },
+  {
+    "step": 804,
+    "loss": 2.3526058197021484,
+    "diagonal": 2.343397378921509,
+    "shortcut": 0.00920854415744543
+  },
+  {
+    "step": 805,
+    "loss": 2.1223418712615967,
+    "diagonal": 2.1020383834838867,
+    "shortcut": 0.020303459838032722
+  },
+  {
+    "step": 806,
+    "loss": 2.370117425918579,
+    "diagonal": 2.3381452560424805,
+    "shortcut": 0.031972192227840424
+  },
+  {
+    "step": 807,
+    "loss": 2.484966516494751,
+    "diagonal": 2.4739110469818115,
+    "shortcut": 0.011055420152842999
+  },
+  {
+    "step": 808,
+    "loss": 2.417536735534668,
+    "diagonal": 2.4075279235839844,
+    "shortcut": 0.010008837096393108
+  },
+  {
+    "step": 809,
+    "loss": 1.922433614730835,
+    "diagonal": 1.9160897731781006,
+    "shortcut": 0.006343860179185867
+  },
+  {
+    "step": 810,
+    "loss": 2.410008668899536,
+    "diagonal": 2.401599884033203,
+    "shortcut": 0.008408761583268642
+  },
+  {
+    "step": 811,
+    "loss": 2.2593655586242676,
+    "diagonal": 2.2397117614746094,
+    "shortcut": 0.019653739407658577
+  },
+  {
+    "step": 812,
+    "loss": 2.0191190242767334,
+    "diagonal": 2.004011392593384,
+    "shortcut": 0.015107526443898678
+  },
+  {
+    "step": 813,
+    "loss": 2.0834414958953857,
+    "diagonal": 2.0568015575408936,
+    "shortcut": 0.0266399122774601
+  },
+  {
+    "step": 814,
+    "loss": 2.1994094848632812,
+    "diagonal": 2.1833889484405518,
+    "shortcut": 0.01602061651647091
+  },
+  {
+    "step": 815,
+    "loss": 2.265894889831543,
+    "diagonal": 2.253420352935791,
+    "shortcut": 0.012474417686462402
+  },
+  {
+    "step": 816,
+    "loss": 1.9269461631774902,
+    "diagonal": 1.9124892950057983,
+    "shortcut": 0.014456868171691895
+  },
+  {
+    "step": 817,
+    "loss": 2.2117698192596436,
+    "diagonal": 2.192737340927124,
+    "shortcut": 0.01903240941464901
+  },
+  {
+    "step": 818,
+    "loss": 2.3312623500823975,
+    "diagonal": 2.310983657836914,
+    "shortcut": 0.020278679206967354
+  },
+  {
+    "step": 819,
+    "loss": 2.509439706802368,
+    "diagonal": 2.4756388664245605,
+    "shortcut": 0.033800821751356125
+  },
+  {
+    "step": 820,
+    "loss": 2.135326385498047,
+    "diagonal": 2.124067544937134,
+    "shortcut": 0.011258743703365326
+  },
+  {
+    "step": 821,
+    "loss": 2.1292450428009033,
+    "diagonal": 2.118007183074951,
+    "shortcut": 0.011237741447985172
+  },
+  {
+    "step": 822,
+    "loss": 2.6190199851989746,
+    "diagonal": 2.6049790382385254,
+    "shortcut": 0.014040982350707054
+  },
+  {
+    "step": 823,
+    "loss": 1.9083428382873535,
+    "diagonal": 1.8962411880493164,
+    "shortcut": 0.012101697735488415
+  },
+  {
+    "step": 824,
+    "loss": 2.2288031578063965,
+    "diagonal": 2.216064929962158,
+    "shortcut": 0.012738206423819065
+  },
+  {
+    "step": 825,
+    "loss": 2.0344767570495605,
+    "diagonal": 2.022672653198242,
+    "shortcut": 0.011804185807704926
+  },
+  {
+    "step": 826,
+    "loss": 2.324537754058838,
+    "diagonal": 2.3131632804870605,
+    "shortcut": 0.011374428868293762
+  },
+  {
+    "step": 827,
+    "loss": 2.03334903717041,
+    "diagonal": 2.0229434967041016,
+    "shortcut": 0.010405478067696095
+  },
+  {
+    "step": 828,
+    "loss": 2.354241132736206,
+    "diagonal": 2.3372676372528076,
+    "shortcut": 0.01697351783514023
+  },
+  {
+    "step": 829,
+    "loss": 2.245626926422119,
+    "diagonal": 2.233769416809082,
+    "shortcut": 0.011857503093779087
+  },
+  {
+    "step": 830,
+    "loss": 2.158799409866333,
+    "diagonal": 2.147817373275757,
+    "shortcut": 0.01098212506622076
+  },
+  {
+    "step": 831,
+    "loss": 1.863264560699463,
+    "diagonal": 1.8536443710327148,
+    "shortcut": 0.009620154276490211
+  },
+  {
+    "step": 832,
+    "loss": 2.3557772636413574,
+    "diagonal": 2.345404863357544,
+    "shortcut": 0.010372471995651722
+  },
+  {
+    "step": 833,
+    "loss": 1.9282318353652954,
+    "diagonal": 1.9195748567581177,
+    "shortcut": 0.00865701399743557
+  },
+  {
+    "step": 834,
+    "loss": 1.7978875637054443,
+    "diagonal": 1.787511944770813,
+    "shortcut": 0.010375563986599445
+  },
+  {
+    "step": 835,
+    "loss": 1.9286975860595703,
+    "diagonal": 1.9215724468231201,
+    "shortcut": 0.007125101052224636
+  },
+  {
+    "step": 836,
+    "loss": 2.039696216583252,
+    "diagonal": 2.0023229122161865,
+    "shortcut": 0.037373244762420654
+  },
+  {
+    "step": 837,
+    "loss": 2.205456256866455,
+    "diagonal": 2.1923303604125977,
+    "shortcut": 0.013125987723469734
+  },
+  {
+    "step": 838,
+    "loss": 2.8928470611572266,
+    "diagonal": 2.8666200637817383,
+    "shortcut": 0.026227012276649475
+  },
+  {
+    "step": 839,
+    "loss": 2.289289712905884,
+    "diagonal": 2.266589641571045,
+    "shortcut": 0.022700035944581032
+  },
+  {
+    "step": 840,
+    "loss": 2.139538049697876,
+    "diagonal": 2.1166775226593018,
+    "shortcut": 0.022860512137413025
+  },
+  {
+    "step": 841,
+    "loss": 2.506507396697998,
+    "diagonal": 2.466494083404541,
+    "shortcut": 0.04001343250274658
+  },
+  {
+    "step": 842,
+    "loss": 2.63036847114563,
+    "diagonal": 2.5846023559570312,
+    "shortcut": 0.04576602950692177
+  },
+  {
+    "step": 843,
+    "loss": 2.5695974826812744,
+    "diagonal": 2.555086135864258,
+    "shortcut": 0.014511361718177795
+  },
+  {
+    "step": 844,
+    "loss": 2.3910715579986572,
+    "diagonal": 2.381030559539795,
+    "shortcut": 0.01004108041524887
+  },
+  {
+    "step": 845,
+    "loss": 1.9158985614776611,
+    "diagonal": 1.902080774307251,
+    "shortcut": 0.013817792758345604
+  },
+  {
+    "step": 846,
+    "loss": 2.2240493297576904,
+    "diagonal": 2.2020769119262695,
+    "shortcut": 0.021972496062517166
+  },
+  {
+    "step": 847,
+    "loss": 3.0855753421783447,
+    "diagonal": 3.0562243461608887,
+    "shortcut": 0.029351098462939262
+  },
+  {
+    "step": 848,
+    "loss": 2.333021879196167,
+    "diagonal": 2.3125486373901367,
+    "shortcut": 0.020473182201385498
+  },
+  {
+    "step": 849,
+    "loss": 2.0337750911712646,
+    "diagonal": 2.0249671936035156,
+    "shortcut": 0.008807974867522717
+  },
+  {
+    "step": 850,
+    "loss": 2.2405731678009033,
+    "diagonal": 2.232262134552002,
+    "shortcut": 0.008310986682772636
+  },
+  {
+    "step": 851,
+    "loss": 1.7722418308258057,
+    "diagonal": 1.7615524530410767,
+    "shortcut": 0.010689427144825459
+  },
+  {
+    "step": 852,
+    "loss": 2.2190847396850586,
+    "diagonal": 2.1753268241882324,
+    "shortcut": 0.04375786706805229
+  },
+  {
+    "step": 853,
+    "loss": 2.1366159915924072,
+    "diagonal": 2.1129047870635986,
+    "shortcut": 0.023711206391453743
+  },
+  {
+    "step": 854,
+    "loss": 2.093477725982666,
+    "diagonal": 2.074190855026245,
+    "shortcut": 0.01928683929145336
+  },
+  {
+    "step": 855,
+    "loss": 2.351078510284424,
+    "diagonal": 2.333784818649292,
+    "shortcut": 0.017293736338615417
+  },
+  {
+    "step": 856,
+    "loss": 2.0679476261138916,
+    "diagonal": 2.0569145679473877,
+    "shortcut": 0.01103303488343954
+  },
+  {
+    "step": 857,
+    "loss": 2.1508545875549316,
+    "diagonal": 2.1343600749969482,
+    "shortcut": 0.016494542360305786
+  },
+  {
+    "step": 858,
+    "loss": 2.1996214389801025,
+    "diagonal": 2.1846773624420166,
+    "shortcut": 0.014944066293537617
+  },
+  {
+    "step": 859,
+    "loss": 2.4767467975616455,
+    "diagonal": 2.462623119354248,
+    "shortcut": 0.014123772270977497
+  },
+  {
+    "step": 860,
+    "loss": 2.232133388519287,
+    "diagonal": 2.2183499336242676,
+    "shortcut": 0.013783552683889866
+  },
+  {
+    "step": 861,
+    "loss": 1.87798273563385,
+    "diagonal": 1.8640106916427612,
+    "shortcut": 0.013972061686217785
+  },
+  {
+    "step": 862,
+    "loss": 2.8605740070343018,
+    "diagonal": 2.8503012657165527,
+    "shortcut": 0.01027275063097477
+  },
+  {
+    "step": 863,
+    "loss": 2.296761989593506,
+    "diagonal": 2.2850489616394043,
+    "shortcut": 0.011713041923940182
+  },
+  {
+    "step": 864,
+    "loss": 1.799146056175232,
+    "diagonal": 1.7884713411331177,
+    "shortcut": 0.010674736462533474
+  },
+  {
+    "step": 865,
+    "loss": 1.9372440576553345,
+    "diagonal": 1.9002108573913574,
+    "shortcut": 0.03703314810991287
+  },
+  {
+    "step": 866,
+    "loss": 1.9542925357818604,
+    "diagonal": 1.9445953369140625,
+    "shortcut": 0.009697185829281807
+  },
+  {
+    "step": 867,
+    "loss": 2.008431911468506,
+    "diagonal": 1.9962116479873657,
+    "shortcut": 0.012220306321978569
+  },
+  {
+    "step": 868,
+    "loss": 2.3371846675872803,
+    "diagonal": 2.3086626529693604,
+    "shortcut": 0.028522059321403503
+  },
+  {
+    "step": 869,
+    "loss": 2.346499443054199,
+    "diagonal": 2.3276281356811523,
+    "shortcut": 0.018871285021305084
+  },
+  {
+    "step": 870,
+    "loss": 1.9022020101547241,
+    "diagonal": 1.8763114213943481,
+    "shortcut": 0.025890622287988663
+  },
+  {
+    "step": 871,
+    "loss": 2.2857859134674072,
+    "diagonal": 2.2622194290161133,
+    "shortcut": 0.023566486313939095
+  },
+  {
+    "step": 872,
+    "loss": 2.1409659385681152,
+    "diagonal": 2.1260275840759277,
+    "shortcut": 0.01493832841515541
+  },
+  {
+    "step": 873,
+    "loss": 2.270764112472534,
+    "diagonal": 2.2580037117004395,
+    "shortcut": 0.01276028249412775
+  },
+  {
+    "step": 874,
+    "loss": 1.9985517263412476,
+    "diagonal": 1.9759548902511597,
+    "shortcut": 0.0225968137383461
+  },
+  {
+    "step": 875,
+    "loss": 1.9173855781555176,
+    "diagonal": 1.9062803983688354,
+    "shortcut": 0.01110512763261795
+  },
+  {
+    "step": 876,
+    "loss": 1.9924691915512085,
+    "diagonal": 1.9828441143035889,
+    "shortcut": 0.009625114500522614
+  },
+  {
+    "step": 877,
+    "loss": 2.5175693035125732,
+    "diagonal": 2.50699520111084,
+    "shortcut": 0.010574094951152802
+  },
+  {
+    "step": 878,
+    "loss": 1.7535187005996704,
+    "diagonal": 1.7342015504837036,
+    "shortcut": 0.01931709237396717
+  },
+  {
+    "step": 879,
+    "loss": 1.7977603673934937,
+    "diagonal": 1.7765426635742188,
+    "shortcut": 0.02121768705546856
+  },
+  {
+    "step": 880,
+    "loss": 2.26640248298645,
+    "diagonal": 2.2486143112182617,
+    "shortcut": 0.017788223922252655
+  },
+  {
+    "step": 881,
+    "loss": 2.4023854732513428,
+    "diagonal": 2.374640703201294,
+    "shortcut": 0.027744879946112633
+  },
+  {
+    "step": 882,
+    "loss": 2.2020463943481445,
+    "diagonal": 2.1651878356933594,
+    "shortcut": 0.03685861825942993
+  },
+  {
+    "step": 883,
+    "loss": 2.40028715133667,
+    "diagonal": 2.379816770553589,
+    "shortcut": 0.020470406860113144
+  },
+  {
+    "step": 884,
+    "loss": 2.362780809402466,
+    "diagonal": 2.344911813735962,
+    "shortcut": 0.017868977040052414
+  },
+  {
+    "step": 885,
+    "loss": 2.1214611530303955,
+    "diagonal": 2.10610032081604,
+    "shortcut": 0.015360875986516476
+  },
+  {
+    "step": 886,
+    "loss": 1.63456392288208,
+    "diagonal": 1.6212201118469238,
+    "shortcut": 0.013343794271349907
+  },
+  {
+    "step": 887,
+    "loss": 1.9931761026382446,
+    "diagonal": 1.985180377960205,
+    "shortcut": 0.007995737716555595
+  },
+  {
+    "step": 888,
+    "loss": 1.7836605310440063,
+    "diagonal": 1.761330485343933,
+    "shortcut": 0.02233002707362175
+  },
+  {
+    "step": 889,
+    "loss": 1.7989988327026367,
+    "diagonal": 1.7814866304397583,
+    "shortcut": 0.017512181773781776
+  },
+  {
+    "step": 890,
+    "loss": 1.8629331588745117,
+    "diagonal": 1.85231351852417,
+    "shortcut": 0.010619642212986946
+  },
+  {
+    "step": 891,
+    "loss": 2.7398929595947266,
+    "diagonal": 2.730027914047241,
+    "shortcut": 0.009865149855613708
+  },
+  {
+    "step": 892,
+    "loss": 2.1751625537872314,
+    "diagonal": 2.1664533615112305,
+    "shortcut": 0.008709246292710304
+  },
+  {
+    "step": 893,
+    "loss": 2.5818965435028076,
+    "diagonal": 2.552114725112915,
+    "shortcut": 0.029781745746731758
+  },
+  {
+    "step": 894,
+    "loss": 2.626244306564331,
+    "diagonal": 2.6064581871032715,
+    "shortcut": 0.019786182790994644
+  },
+  {
+    "step": 895,
+    "loss": 2.6951398849487305,
+    "diagonal": 2.685021162033081,
+    "shortcut": 0.010118809528648853
+  },
+  {
+    "step": 896,
+    "loss": 1.9809379577636719,
+    "diagonal": 1.9693523645401,
+    "shortcut": 0.011585533618927002
+  },
+  {
+    "step": 897,
+    "loss": 2.1894845962524414,
+    "diagonal": 2.177994966506958,
+    "shortcut": 0.011489691212773323
+  },
+  {
+    "step": 898,
+    "loss": 1.9116333723068237,
+    "diagonal": 1.901230812072754,
+    "shortcut": 0.010402542538940907
+  },
+  {
+    "step": 899,
+    "loss": 2.7436671257019043,
+    "diagonal": 2.7209689617156982,
+    "shortcut": 0.02269824780523777
+  },
+  {
+    "step": 900,
+    "loss": 2.323993682861328,
+    "diagonal": 2.313115119934082,
+    "shortcut": 0.010878481902182102
+  },
+  {
+    "step": 901,
+    "loss": 2.473856210708618,
+    "diagonal": 2.4590249061584473,
+    "shortcut": 0.014831227250397205
+  },
+  {
+    "step": 902,
+    "loss": 2.441094160079956,
+    "diagonal": 2.4294650554656982,
+    "shortcut": 0.011628987267613411
+  },
+  {
+    "step": 903,
+    "loss": 2.098768711090088,
+    "diagonal": 2.086174964904785,
+    "shortcut": 0.012593681924045086
+  },
+  {
+    "step": 904,
+    "loss": 2.2952990531921387,
+    "diagonal": 2.2834830284118652,
+    "shortcut": 0.011815921403467655
+  },
+  {
+    "step": 905,
+    "loss": 1.9952585697174072,
+    "diagonal": 1.9889582395553589,
+    "shortcut": 0.006300304085016251
+  },
+  {
+    "step": 906,
+    "loss": 2.297769784927368,
+    "diagonal": 2.2835440635681152,
+    "shortcut": 0.014225629158318043
+  },
+  {
+    "step": 907,
+    "loss": 1.889382243156433,
+    "diagonal": 1.8696820735931396,
+    "shortcut": 0.01970016583800316
+  },
+  {
+    "step": 908,
+    "loss": 2.4967076778411865,
+    "diagonal": 2.4706568717956543,
+    "shortcut": 0.026050737127661705
+  },
+  {
+    "step": 909,
+    "loss": 2.190544605255127,
+    "diagonal": 2.1832385063171387,
+    "shortcut": 0.007306203246116638
+  },
+  {
+    "step": 910,
+    "loss": 2.4451959133148193,
+    "diagonal": 2.428142786026001,
+    "shortcut": 0.017053009942173958
+  },
+  {
+    "step": 911,
+    "loss": 1.7455081939697266,
+    "diagonal": 1.7272552251815796,
+    "shortcut": 0.018252968788146973
+  },
+  {
+    "step": 912,
+    "loss": 2.3462283611297607,
+    "diagonal": 2.3324391841888428,
+    "shortcut": 0.013789075426757336
+  },
+  {
+    "step": 913,
+    "loss": 2.6076509952545166,
+    "diagonal": 2.596447229385376,
+    "shortcut": 0.011203695088624954
+  },
+  {
+    "step": 914,
+    "loss": 2.3666749000549316,
+    "diagonal": 2.3553192615509033,
+    "shortcut": 0.011355573311448097
+  },
+  {
+    "step": 915,
+    "loss": 1.9881269931793213,
+    "diagonal": 1.9750301837921143,
+    "shortcut": 0.013096816837787628
+  },
+  {
+    "step": 916,
+    "loss": 1.9654525518417358,
+    "diagonal": 1.9547531604766846,
+    "shortcut": 0.01069935504347086
+  },
+  {
+    "step": 917,
+    "loss": 2.0218465328216553,
+    "diagonal": 2.011294364929199,
+    "shortcut": 0.010552054271101952
+  },
+  {
+    "step": 918,
+    "loss": 2.1980113983154297,
+    "diagonal": 2.1816749572753906,
+    "shortcut": 0.016336342319846153
+  },
+  {
+    "step": 919,
+    "loss": 2.100736618041992,
+    "diagonal": 2.0888612270355225,
+    "shortcut": 0.011875472962856293
+  },
+  {
+    "step": 920,
+    "loss": 2.1101083755493164,
+    "diagonal": 2.0928728580474854,
+    "shortcut": 0.01723545230925083
+  },
+  {
+    "step": 921,
+    "loss": 2.4410195350646973,
+    "diagonal": 2.4206435680389404,
+    "shortcut": 0.020375849679112434
+  },
+  {
+    "step": 922,
+    "loss": 2.4796206951141357,
+    "diagonal": 2.461939811706543,
+    "shortcut": 0.017680946737527847
+  },
+  {
+    "step": 923,
+    "loss": 2.192338466644287,
+    "diagonal": 2.184187173843384,
+    "shortcut": 0.008151196874678135
+  },
+  {
+    "step": 924,
+    "loss": 2.2362306118011475,
+    "diagonal": 2.227126359939575,
+    "shortcut": 0.009104353375732899
+  },
+  {
+    "step": 925,
+    "loss": 1.647282361984253,
+    "diagonal": 1.608883023262024,
+    "shortcut": 0.03839936479926109
+  },
+  {
+    "step": 926,
+    "loss": 2.5599498748779297,
+    "diagonal": 2.5494961738586426,
+    "shortcut": 0.010453791357576847
+  },
+  {
+    "step": 927,
+    "loss": 2.710207939147949,
+    "diagonal": 2.698575019836426,
+    "shortcut": 0.011632975190877914
+  },
+  {
+    "step": 928,
+    "loss": 2.1814188957214355,
+    "diagonal": 2.1683523654937744,
+    "shortcut": 0.013066531158983707
+  },
+  {
+    "step": 929,
+    "loss": 2.3179190158843994,
+    "diagonal": 2.2999441623687744,
+    "shortcut": 0.01797475852072239
+  },
+  {
+    "step": 930,
+    "loss": 2.2663991451263428,
+    "diagonal": 2.2332770824432373,
+    "shortcut": 0.03312206640839577
+  },
+  {
+    "step": 931,
+    "loss": 2.348121166229248,
+    "diagonal": 2.337876796722412,
+    "shortcut": 0.010244439356029034
+  },
+  {
+    "step": 932,
+    "loss": 2.644357681274414,
+    "diagonal": 2.6342380046844482,
+    "shortcut": 0.010119572281837463
+  },
+  {
+    "step": 933,
+    "loss": 2.002782106399536,
+    "diagonal": 1.9811755418777466,
+    "shortcut": 0.021606512367725372
+  },
+  {
+    "step": 934,
+    "loss": 2.0216169357299805,
+    "diagonal": 2.009690046310425,
+    "shortcut": 0.011927008628845215
+  },
+  {
+    "step": 935,
+    "loss": 2.3666417598724365,
+    "diagonal": 2.341003179550171,
+    "shortcut": 0.025638554245233536
+  },
+  {
+    "step": 936,
+    "loss": 2.465555191040039,
+    "diagonal": 2.4387824535369873,
+    "shortcut": 0.02677283249795437
+  },
+  {
+    "step": 937,
+    "loss": 2.239837646484375,
+    "diagonal": 2.232678174972534,
+    "shortcut": 0.0071595036424696445
+  },
+  {
+    "step": 938,
+    "loss": 2.2181270122528076,
+    "diagonal": 2.20878529548645,
+    "shortcut": 0.009341605938971043
+  },
+  {
+    "step": 939,
+    "loss": 1.894375205039978,
+    "diagonal": 1.874272108078003,
+    "shortcut": 0.02010307088494301
+  },
+  {
+    "step": 940,
+    "loss": 2.1487457752227783,
+    "diagonal": 2.133615493774414,
+    "shortcut": 0.015130206942558289
+  },
+  {
+    "step": 941,
+    "loss": 1.8820557594299316,
+    "diagonal": 1.870519757270813,
+    "shortcut": 0.01153599750250578
+  },
+  {
+    "step": 942,
+    "loss": 2.3985114097595215,
+    "diagonal": 2.3690617084503174,
+    "shortcut": 0.029449719935655594
+  },
+  {
+    "step": 943,
+    "loss": 2.204378128051758,
+    "diagonal": 2.1906819343566895,
+    "shortcut": 0.013696183450520039
+  },
+  {
+    "step": 944,
+    "loss": 2.6164140701293945,
+    "diagonal": 2.599562168121338,
+    "shortcut": 0.01685188151896
+  },
+  {
+    "step": 945,
+    "loss": 2.2805583477020264,
+    "diagonal": 2.2614245414733887,
+    "shortcut": 0.019133910536766052
+  },
+  {
+    "step": 946,
+    "loss": 2.311842203140259,
+    "diagonal": 2.294236898422241,
+    "shortcut": 0.0176053699105978
+  },
+  {
+    "step": 947,
+    "loss": 2.0095021724700928,
+    "diagonal": 1.9965505599975586,
+    "shortcut": 0.012951583601534367
+  },
+  {
+    "step": 948,
+    "loss": 2.4342453479766846,
+    "diagonal": 2.4185190200805664,
+    "shortcut": 0.015726227313280106
+  },
+  {
+    "step": 949,
+    "loss": 1.7289073467254639,
+    "diagonal": 1.7154393196105957,
+    "shortcut": 0.013468082062900066
+  },
+  {
+    "step": 950,
+    "loss": 2.160226821899414,
+    "diagonal": 2.1490819454193115,
+    "shortcut": 0.011144910007715225
+  },
+  {
+    "step": 951,
+    "loss": 1.949874758720398,
+    "diagonal": 1.9255294799804688,
+    "shortcut": 0.02434522658586502
+  },
+  {
+    "step": 952,
+    "loss": 2.437764883041382,
+    "diagonal": 2.4205386638641357,
+    "shortcut": 0.01722630113363266
+  },
+  {
+    "step": 953,
+    "loss": 1.6247022151947021,
+    "diagonal": 1.5762939453125,
+    "shortcut": 0.04840825870633125
+  },
+  {
+    "step": 954,
+    "loss": 1.8814107179641724,
+    "diagonal": 1.853278398513794,
+    "shortcut": 0.028132274746894836
+  },
+  {
+    "step": 955,
+    "loss": 1.9212549924850464,
+    "diagonal": 1.9003932476043701,
+    "shortcut": 0.020861689001321793
+  },
+  {
+    "step": 956,
+    "loss": 2.033761501312256,
+    "diagonal": 2.007812261581421,
+    "shortcut": 0.02594924159348011
+  },
+  {
+    "step": 957,
+    "loss": 2.056678295135498,
+    "diagonal": 2.0427143573760986,
+    "shortcut": 0.013963868841528893
+  },
+  {
+    "step": 958,
+    "loss": 2.459074020385742,
+    "diagonal": 2.444047451019287,
+    "shortcut": 0.015026596374809742
+  },
+  {
+    "step": 959,
+    "loss": 2.247178316116333,
+    "diagonal": 2.2151591777801514,
+    "shortcut": 0.032019175589084625
+  },
+  {
+    "step": 960,
+    "loss": 1.8592504262924194,
+    "diagonal": 1.842259168624878,
+    "shortcut": 0.01699127070605755
+  },
+  {
+    "step": 961,
+    "loss": 2.136570930480957,
+    "diagonal": 2.1266889572143555,
+    "shortcut": 0.00988193228840828
+  },
+  {
+    "step": 962,
+    "loss": 2.4916343688964844,
+    "diagonal": 2.4841508865356445,
+    "shortcut": 0.007483504246920347
+  },
+  {
+    "step": 963,
+    "loss": 2.098687171936035,
+    "diagonal": 2.0854854583740234,
+    "shortcut": 0.013201780617237091
+  },
+  {
+    "step": 964,
+    "loss": 2.04711651802063,
+    "diagonal": 2.021153211593628,
+    "shortcut": 0.025963278487324715
+  },
+  {
+    "step": 965,
+    "loss": 1.8400557041168213,
+    "diagonal": 1.8119850158691406,
+    "shortcut": 0.028070708736777306
+  },
+  {
+    "step": 966,
+    "loss": 2.458181142807007,
+    "diagonal": 2.4357712268829346,
+    "shortcut": 0.02240997925400734
+  },
+  {
+    "step": 967,
+    "loss": 2.066878080368042,
+    "diagonal": 2.0358455181121826,
+    "shortcut": 0.0310325026512146
+  },
+  {
+    "step": 968,
+    "loss": 1.735597014427185,
+    "diagonal": 1.704897165298462,
+    "shortcut": 0.030699843540787697
+  },
+  {
+    "step": 969,
+    "loss": 2.059269428253174,
+    "diagonal": 2.034578800201416,
+    "shortcut": 0.02469068579375744
+  },
+  {
+    "step": 970,
+    "loss": 2.5003058910369873,
+    "diagonal": 2.4738247394561768,
+    "shortcut": 0.026481062173843384
+  },
+  {
+    "step": 971,
+    "loss": 2.187565565109253,
+    "diagonal": 2.162182569503784,
+    "shortcut": 0.025382962077856064
+  },
+  {
+    "step": 972,
+    "loss": 1.999191164970398,
+    "diagonal": 1.9836913347244263,
+    "shortcut": 0.015499847941100597
+  },
+  {
+    "step": 973,
+    "loss": 2.3723437786102295,
+    "diagonal": 2.3637988567352295,
+    "shortcut": 0.008544848300516605
+  },
+  {
+    "step": 974,
+    "loss": 2.5258824825286865,
+    "diagonal": 2.5196945667266846,
+    "shortcut": 0.006188034545630217
+  },
+  {
+    "step": 975,
+    "loss": 2.4780900478363037,
+    "diagonal": 2.4688491821289062,
+    "shortcut": 0.009240953251719475
+  },
+  {
+    "step": 976,
+    "loss": 2.6039490699768066,
+    "diagonal": 2.59472918510437,
+    "shortcut": 0.009219780564308167
+  },
+  {
+    "step": 977,
+    "loss": 1.9290685653686523,
+    "diagonal": 1.9175512790679932,
+    "shortcut": 0.011517299339175224
+  },
+  {
+    "step": 978,
+    "loss": 1.964201807975769,
+    "diagonal": 1.949449062347412,
+    "shortcut": 0.01475280337035656
+  },
+  {
+    "step": 979,
+    "loss": 1.9573171138763428,
+    "diagonal": 1.9357101917266846,
+    "shortcut": 0.021606970578432083
+  },
+  {
+    "step": 980,
+    "loss": 2.2335591316223145,
+    "diagonal": 2.2074239253997803,
+    "shortcut": 0.026135278865695
+  },
+  {
+    "step": 981,
+    "loss": 2.805067539215088,
+    "diagonal": 2.7843151092529297,
+    "shortcut": 0.020752374082803726
+  },
+  {
+    "step": 982,
+    "loss": 2.0518081188201904,
+    "diagonal": 2.0279440879821777,
+    "shortcut": 0.023864004760980606
+  },
+  {
+    "step": 983,
+    "loss": 2.2390613555908203,
+    "diagonal": 2.219902753829956,
+    "shortcut": 0.019158557057380676
+  },
+  {
+    "step": 984,
+    "loss": 1.921650767326355,
+    "diagonal": 1.888311743736267,
+    "shortcut": 0.03333904221653938
+  },
+  {
+    "step": 985,
+    "loss": 2.4633564949035645,
+    "diagonal": 2.438307762145996,
+    "shortcut": 0.025048797950148582
+  },
+  {
+    "step": 986,
+    "loss": 2.010347843170166,
+    "diagonal": 1.9967930316925049,
+    "shortcut": 0.013554709032177925
+  },
+  {
+    "step": 987,
+    "loss": 2.3448190689086914,
+    "diagonal": 2.3348536491394043,
+    "shortcut": 0.009965427219867706
+  },
+  {
+    "step": 988,
+    "loss": 1.7555867433547974,
+    "diagonal": 1.738176941871643,
+    "shortcut": 0.017409801483154297
+  },
+  {
+    "step": 989,
+    "loss": 2.3127667903900146,
+    "diagonal": 2.2942593097686768,
+    "shortcut": 0.01850748062133789
+  },
+  {
+    "step": 990,
+    "loss": 2.625152111053467,
+    "diagonal": 2.616091728210449,
+    "shortcut": 0.009060274809598923
+  },
+  {
+    "step": 991,
+    "loss": 2.28438401222229,
+    "diagonal": 2.2621278762817383,
+    "shortcut": 0.02225608378648758
+  },
+  {
+    "step": 992,
+    "loss": 2.159656524658203,
+    "diagonal": 2.1376423835754395,
+    "shortcut": 0.022014077752828598
+  },
+  {
+    "step": 993,
+    "loss": 1.93095064163208,
+    "diagonal": 1.9142283201217651,
+    "shortcut": 0.016722379252314568
+  },
+  {
+    "step": 994,
+    "loss": 2.0280301570892334,
+    "diagonal": 1.9999648332595825,
+    "shortcut": 0.028065381571650505
+  },
+  {
+    "step": 995,
+    "loss": 2.170438289642334,
+    "diagonal": 2.1567392349243164,
+    "shortcut": 0.01369914785027504
+  },
+  {
+    "step": 996,
+    "loss": 1.9519596099853516,
+    "diagonal": 1.9307475090026855,
+    "shortcut": 0.0212121419608593
+  },
+  {
+    "step": 997,
+    "loss": 2.065429210662842,
+    "diagonal": 2.0479230880737305,
+    "shortcut": 0.017506131902337074
+  },
+  {
+    "step": 998,
+    "loss": 1.99710214138031,
+    "diagonal": 1.973226547241211,
+    "shortcut": 0.023875553160905838
+  },
+  {
+    "step": 999,
+    "loss": 2.3231570720672607,
+    "diagonal": 2.3118033409118652,
+    "shortcut": 0.011353770270943642
+  }
+]
diff --git a/lecture_6/verified_examples/shortcut/report.json b/lecture_6/verified_examples/shortcut/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..1deb1a27eb9cb03a404a2df30c0722c32361a086
--- /dev/null
+++ b/lecture_6/verified_examples/shortcut/report.json
@@ -0,0 +1,24 @@
+{
+  "method": "shortcut",
+  "data_kind": "four-gaussian-mixture",
+  "train_loss_first_20_mean": 3.2219650387763976,
+  "train_loss_last_20_mean": 2.1837141811847687,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "composition_rmse": 0.1742144525051117,
+  "finite_samples": true,
+  "mean_distance_to_center": 0.7382770776748657,
+  "mode_fractions": [
+    0.234375,
+    0.25,
+    0.2734375,
+    0.2421875
+  ],
+  "mode_entropy": 1.3846063613891602,
+  "mean_target_log_density": -7.562736511230469,
+  "elapsed_seconds": 2.735806157004845
+}
diff --git a/lecture_6/verified_examples/shortcut/samples.txt b/lecture_6/verified_examples/shortcut/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..6b53ae67bf55a9972618fdc0f3d0e0baa38a0677
--- /dev/null
+++ b/lecture_6/verified_examples/shortcut/samples.txt
@@ -0,0 +1,128 @@
+-0.9397520 1.8434894
+-1.6457565 1.6795756
+-1.9607430 -1.6405226
+-1.5925705 0.3978128
+0.5785844 -1.3960897
+-1.4285191 1.7329285
+1.7045836 -1.9606987
+-1.5114963 -1.9833593
+-1.6207657 -1.4431806
+0.9903250 1.8832164
+0.3259699 1.3426938
+2.0611534 -0.7152329
+1.8701609 0.8781749
+0.6954005 -0.0300274
+-1.1755028 -1.6521041
+1.9322835 -1.7753531
+1.2060525 1.5936545
+1.3147813 -1.9803380
+0.5438697 0.9122164
+1.5829912 -1.6776056
+-1.7875210 1.7188780
+-1.5969303 -0.7403266
+-1.5399786 -1.8926868
+-1.1580830 -1.9686940
+0.3586769 -1.8242189
+-1.8648679 0.7743056
+1.0229735 0.3584876
+-0.1705401 -1.8857458
+-1.8009557 1.3988619
+-0.1109925 -1.9547659
+-0.9092611 -1.2904648
+-2.1179035 -1.5361464
+0.1535771 -2.1272814
+-1.4937074 -1.6851591
+1.7779032 1.7714536
+0.0692725 -1.6060020
+1.7658112 1.4509912
+-0.0014759 1.8470401
+1.5725094 2.0645940
+1.6138003 -0.2459521
+0.3606985 1.6821531
+-1.8833857 -0.4426081
+-0.0225752 -1.3349426
+2.0632896 1.2356800
+-1.6734959 -1.6000289
+-0.3771827 1.6406658
+-1.2251515 -1.3994015
+1.6505548 -1.8057048
+1.3193121 1.9840059
+-1.7769244 1.2710007
+0.5579147 1.7437346
+0.1617877 -0.3727005
+0.9732565 -1.0657380
+0.8252587 1.6131858
+-0.1788172 1.9059726
+-2.1337981 1.3317709
+1.1508558 -1.1215957
+-0.2208735 1.2237351
+-1.7867719 -1.0990115
+-1.9066385 2.0856879
+-1.7601126 -0.1716439
+1.0799125 1.8122309
+0.4996414 1.6615621
+1.8793857 0.8968195
+2.0588324 -1.8141506
+1.6548517 -2.0603406
+0.1754636 -1.0490789
+1.9431378 -1.6960407
+-1.5002220 -1.5701054
+-1.9150246 -0.6013917
+1.5632041 1.3650939
+1.5093315 0.4972502
+0.1756172 -0.1504856
+-0.3178616 1.3490356
+1.5962007 1.7359232
+0.3296883 -1.9070020
+1.6057329 -1.9278383
+2.0065892 -1.5824132
+1.5613950 1.5967115
+2.1015129 -1.4082234
+-0.7389610 1.8821241
+1.5532260 1.3183134
+1.3015776 1.9670520
+-1.4308503 2.2335355
+-1.0507863 -0.6745248
+-2.0383205 -0.6714498
+2.2917066 1.6607128
+-0.1641527 1.3996718
+-2.0511038 1.6874782
+-0.0065134 -0.1631986
+2.0750678 1.3639090
+-2.1568210 1.5065674
+2.2229674 -1.7705263
+1.2662171 1.6204417
+-1.8641304 0.8236212
+-0.6922424 1.4232305
+-0.2734449 1.2261280
+1.3334463 -1.7394631
+-1.7628984 0.2814613
+1.0911722 -1.7344928
+-1.8574041 -1.4964480
+-1.6267834 1.0086989
+-0.5169057 1.8390795
+-2.0884688 -0.9723973
+-1.5219523 -1.8497277
+-1.8937987 1.6228213
+0.9405403 -1.8775935
+1.2893009 -1.8399060
+-2.0978751 -1.6138878
+-0.8161881 1.4841776
+-0.4116380 -1.7612422
+2.1073205 1.2925478
+0.7462686 1.0213723
+1.2487456 -1.7973634
+1.9670458 -1.5649452
+-1.2823834 -0.9329342
+1.3786342 1.9661475
+1.9822050 1.6186794
+1.0654521 -0.7504648
+-1.9128451 -1.5494390
+2.2390211 -1.7220294
+-2.1025443 0.5130165
+-1.7871177 1.5248345
+1.5262021 1.9169292
+1.3197131 -1.8044215
+-2.2054169 1.6779470
+-1.0297639 1.2294964
+1.9980808 -1.7407784
diff --git a/lecture_6/verified_examples/ssfm-paper/config.json b/lecture_6/verified_examples/ssfm-paper/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..a7f43fa7d35ad59a233dc0fde5d77acbb022145a
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm-paper/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "ssfm",
+  "mode": "train-sample",
+  "train_steps": 2000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "paper",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.0001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/ssfm-paper-stable"
+}
diff --git a/lecture_6/verified_examples/ssfm-paper/losses.json b/lecture_6/verified_examples/ssfm-paper/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..68cd2637ef92b1e8b90048d1cca5b8c583b332a4
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm-paper/losses.json
@@ -0,0 +1,14002 @@
+[
+  {
+    "step": 0,
+    "loss": 0.5536360740661621,
+    "drift": 0.5483575463294983,
+    "small_step": 0.005278528667986393,
+    "strong_consistency": 8.609625183453318e-06
+  },
+  {
+    "step": 1,
+    "loss": 0.7068049311637878,
+    "drift": 0.6975401043891907,
+    "small_step": 0.009264746680855751,
+    "strong_consistency": 1.1530249139468651e-05
+  },
+  {
+    "step": 2,
+    "loss": 0.5164759159088135,
+    "drift": 0.5120258331298828,
+    "small_step": 0.00445000221952796,
+    "strong_consistency": 9.759733075043187e-06
+  },
+  {
+    "step": 3,
+    "loss": 0.47911936044692993,
+    "drift": 0.47368571162223816,
+    "small_step": 0.005433431826531887,
+    "strong_consistency": 2.665663487277925e-05
+  },
+  {
+    "step": 4,
+    "loss": 0.541792094707489,
+    "drift": 0.5348783135414124,
+    "small_step": 0.0069135865196585655,
+    "strong_consistency": 1.8356338841840625e-05
+  },
+  {
+    "step": 5,
+    "loss": 0.6077595353126526,
+    "drift": 0.6014829874038696,
+    "small_step": 0.006276171188801527,
+    "strong_consistency": 2.7895441235159524e-05
+  },
+  {
+    "step": 6,
+    "loss": 0.5463441014289856,
+    "drift": 0.539813220500946,
+    "small_step": 0.006530235055834055,
+    "strong_consistency": 4.622017149813473e-05
+  },
+  {
+    "step": 7,
+    "loss": 0.4680253863334656,
+    "drift": 0.46290433406829834,
+    "small_step": 0.005120058543980122,
+    "strong_consistency": 6.155754817882553e-05
+  },
+  {
+    "step": 8,
+    "loss": 0.41498443484306335,
+    "drift": 0.41047540307044983,
+    "small_step": 0.004508154932409525,
+    "strong_consistency": 4.8722096835263073e-05
+  },
+  {
+    "step": 9,
+    "loss": 0.6611175537109375,
+    "drift": 0.653378427028656,
+    "small_step": 0.007737387903034687,
+    "strong_consistency": 8.648774382891133e-05
+  },
+  {
+    "step": 10,
+    "loss": 0.7423354387283325,
+    "drift": 0.7337977290153503,
+    "small_step": 0.008533339947462082,
+    "strong_consistency": 0.00019791160593740642
+  },
+  {
+    "step": 11,
+    "loss": 0.5848373174667358,
+    "drift": 0.5774042010307312,
+    "small_step": 0.007429921068251133,
+    "strong_consistency": 0.0001341227616649121
+  },
+  {
+    "step": 12,
+    "loss": 0.41862621903419495,
+    "drift": 0.41372179985046387,
+    "small_step": 0.004901577718555927,
+    "strong_consistency": 0.00010933139856206253
+  },
+  {
+    "step": 13,
+    "loss": 0.5780798196792603,
+    "drift": 0.5728272199630737,
+    "small_step": 0.005249283276498318,
+    "strong_consistency": 0.00011897309013875201
+  },
+  {
+    "step": 14,
+    "loss": 0.6886651515960693,
+    "drift": 0.6795684099197388,
+    "small_step": 0.009093079715967178,
+    "strong_consistency": 0.00012045667244819924
+  },
+  {
+    "step": 15,
+    "loss": 0.5867249369621277,
+    "drift": 0.5811349153518677,
+    "small_step": 0.005585208535194397,
+    "strong_consistency": 0.0001506769476691261
+  },
+  {
+    "step": 16,
+    "loss": 0.5159415006637573,
+    "drift": 0.510123610496521,
+    "small_step": 0.005811744835227728,
+    "strong_consistency": 0.00018050931976176798
+  },
+  {
+    "step": 17,
+    "loss": 0.5693457722663879,
+    "drift": 0.564026415348053,
+    "small_step": 0.005311942659318447,
+    "strong_consistency": 0.00020459100778680295
+  },
+  {
+    "step": 18,
+    "loss": 0.5426191091537476,
+    "drift": 0.5366358160972595,
+    "small_step": 0.005972370970994234,
+    "strong_consistency": 0.0002868173469323665
+  },
+  {
+    "step": 19,
+    "loss": 0.33701860904693604,
+    "drift": 0.3334863483905792,
+    "small_step": 0.003526404732838273,
+    "strong_consistency": 0.00014568197366315871
+  },
+  {
+    "step": 20,
+    "loss": 0.5959336161613464,
+    "drift": 0.5893433094024658,
+    "small_step": 0.006579962559044361,
+    "strong_consistency": 0.00024754455080255866
+  },
+  {
+    "step": 21,
+    "loss": 0.5702304840087891,
+    "drift": 0.564483642578125,
+    "small_step": 0.005730672739446163,
+    "strong_consistency": 0.0003666974953375757
+  },
+  {
+    "step": 22,
+    "loss": 0.5682919025421143,
+    "drift": 0.5618904829025269,
+    "small_step": 0.006392274051904678,
+    "strong_consistency": 0.00019820473971776664
+  },
+  {
+    "step": 23,
+    "loss": 0.6967231631278992,
+    "drift": 0.6910216212272644,
+    "small_step": 0.005683724768459797,
+    "strong_consistency": 0.00037109263939782977
+  },
+  {
+    "step": 24,
+    "loss": 0.43550020456314087,
+    "drift": 0.4317318797111511,
+    "small_step": 0.0037529957480728626,
+    "strong_consistency": 0.0003065097553189844
+  },
+  {
+    "step": 25,
+    "loss": 0.7671471238136292,
+    "drift": 0.7585805654525757,
+    "small_step": 0.008541530929505825,
+    "strong_consistency": 0.0004819651658181101
+  },
+  {
+    "step": 26,
+    "loss": 0.6710260510444641,
+    "drift": 0.6638801693916321,
+    "small_step": 0.007127873133867979,
+    "strong_consistency": 0.0003338913375046104
+  },
+  {
+    "step": 27,
+    "loss": 0.5385535955429077,
+    "drift": 0.5340316295623779,
+    "small_step": 0.004504492972046137,
+    "strong_consistency": 0.0003121547633782029
+  },
+  {
+    "step": 28,
+    "loss": 0.6056962609291077,
+    "drift": 0.5993289351463318,
+    "small_step": 0.006346793379634619,
+    "strong_consistency": 0.00035313417902216315
+  },
+  {
+    "step": 29,
+    "loss": 0.47163134813308716,
+    "drift": 0.46637025475502014,
+    "small_step": 0.005231731571257114,
+    "strong_consistency": 0.0004891037242487073
+  },
+  {
+    "step": 30,
+    "loss": 0.561296284198761,
+    "drift": 0.5556613802909851,
+    "small_step": 0.005612285807728767,
+    "strong_consistency": 0.0003648337733466178
+  },
+  {
+    "step": 31,
+    "loss": 0.7312054634094238,
+    "drift": 0.7245271801948547,
+    "small_step": 0.006626450456678867,
+    "strong_consistency": 0.0008098540711216629
+  },
+  {
+    "step": 32,
+    "loss": 0.4169143736362457,
+    "drift": 0.4126865565776825,
+    "small_step": 0.004206533543765545,
+    "strong_consistency": 0.0003223066159989685
+  },
+  {
+    "step": 33,
+    "loss": 0.349479615688324,
+    "drift": 0.34568196535110474,
+    "small_step": 0.0037714228965342045,
+    "strong_consistency": 0.0003855207178276032
+  },
+  {
+    "step": 34,
+    "loss": 0.41218987107276917,
+    "drift": 0.4089307188987732,
+    "small_step": 0.0032261330634355545,
+    "strong_consistency": 0.0004718504205811769
+  },
+  {
+    "step": 35,
+    "loss": 0.45052340626716614,
+    "drift": 0.4459896981716156,
+    "small_step": 0.0044900705106556416,
+    "strong_consistency": 0.0006060583982616663
+  },
+  {
+    "step": 36,
+    "loss": 0.5647702813148499,
+    "drift": 0.5600906610488892,
+    "small_step": 0.004633125849068165,
+    "strong_consistency": 0.0006280051311478019
+  },
+  {
+    "step": 37,
+    "loss": 0.38375598192214966,
+    "drift": 0.37930065393447876,
+    "small_step": 0.004425636027008295,
+    "strong_consistency": 0.00039055218803696334
+  },
+  {
+    "step": 38,
+    "loss": 0.47037070989608765,
+    "drift": 0.46539294719696045,
+    "small_step": 0.004933307413011789,
+    "strong_consistency": 0.0005699362372979522
+  },
+  {
+    "step": 39,
+    "loss": 0.458107590675354,
+    "drift": 0.4529813826084137,
+    "small_step": 0.00507502444088459,
+    "strong_consistency": 0.0006395781529136002
+  },
+  {
+    "step": 40,
+    "loss": 0.4769575297832489,
+    "drift": 0.47218769788742065,
+    "small_step": 0.004685693420469761,
+    "strong_consistency": 0.0010261574061587453
+  },
+  {
+    "step": 41,
+    "loss": 0.4608135223388672,
+    "drift": 0.4552353620529175,
+    "small_step": 0.005517872981727123,
+    "strong_consistency": 0.0007178143714554608
+  },
+  {
+    "step": 42,
+    "loss": 0.5425810217857361,
+    "drift": 0.5375820398330688,
+    "small_step": 0.0049298913218081,
+    "strong_consistency": 0.0008033099002204835
+  },
+  {
+    "step": 43,
+    "loss": 0.8515391945838928,
+    "drift": 0.84416264295578,
+    "small_step": 0.007241866551339626,
+    "strong_consistency": 0.0015305561246350408
+  },
+  {
+    "step": 44,
+    "loss": 0.45550888776779175,
+    "drift": 0.4513079524040222,
+    "small_step": 0.004144602920860052,
+    "strong_consistency": 0.000625781889539212
+  },
+  {
+    "step": 45,
+    "loss": 0.7673793435096741,
+    "drift": 0.7584925889968872,
+    "small_step": 0.008759139105677605,
+    "strong_consistency": 0.001387136522680521
+  },
+  {
+    "step": 46,
+    "loss": 0.7652767300605774,
+    "drift": 0.7575244307518005,
+    "small_step": 0.0076290396973490715,
+    "strong_consistency": 0.0013110404834151268
+  },
+  {
+    "step": 47,
+    "loss": 0.5619804859161377,
+    "drift": 0.5549912452697754,
+    "small_step": 0.006846102420240641,
+    "strong_consistency": 0.001490886090323329
+  },
+  {
+    "step": 48,
+    "loss": 0.6772493124008179,
+    "drift": 0.6708084344863892,
+    "small_step": 0.006340800318866968,
+    "strong_consistency": 0.0010210481705144048
+  },
+  {
+    "step": 49,
+    "loss": 0.7155576348304749,
+    "drift": 0.707793116569519,
+    "small_step": 0.0076348199509084225,
+    "strong_consistency": 0.001296990318223834
+  },
+  {
+    "step": 50,
+    "loss": 0.5761213302612305,
+    "drift": 0.5709618330001831,
+    "small_step": 0.004999077413231134,
+    "strong_consistency": 0.001572323846630752
+  },
+  {
+    "step": 51,
+    "loss": 0.5193505883216858,
+    "drift": 0.5132186412811279,
+    "small_step": 0.00601374264806509,
+    "strong_consistency": 0.0011362479999661446
+  },
+  {
+    "step": 52,
+    "loss": 0.6322450637817383,
+    "drift": 0.6262538433074951,
+    "small_step": 0.005844069179147482,
+    "strong_consistency": 0.001388469128869474
+  },
+  {
+    "step": 53,
+    "loss": 0.4696689248085022,
+    "drift": 0.4648396074771881,
+    "small_step": 0.004735673312097788,
+    "strong_consistency": 0.0008670050883665681
+  },
+  {
+    "step": 54,
+    "loss": 0.5016387104988098,
+    "drift": 0.4957672655582428,
+    "small_step": 0.005694763734936714,
+    "strong_consistency": 0.001606069621630013
+  },
+  {
+    "step": 55,
+    "loss": 0.44672250747680664,
+    "drift": 0.44177669286727905,
+    "small_step": 0.004844251088798046,
+    "strong_consistency": 0.0009067790233530104
+  },
+  {
+    "step": 56,
+    "loss": 0.5657077431678772,
+    "drift": 0.5588715076446533,
+    "small_step": 0.006691841874271631,
+    "strong_consistency": 0.0012667527189478278
+  },
+  {
+    "step": 57,
+    "loss": 0.5757104158401489,
+    "drift": 0.5697143077850342,
+    "small_step": 0.005871731322258711,
+    "strong_consistency": 0.001072194892913103
+  },
+  {
+    "step": 58,
+    "loss": 0.6250011920928955,
+    "drift": 0.6186319589614868,
+    "small_step": 0.00615209573879838,
+    "strong_consistency": 0.001840298413299024
+  },
+  {
+    "step": 59,
+    "loss": 0.5427295565605164,
+    "drift": 0.5377912521362305,
+    "small_step": 0.004797252826392651,
+    "strong_consistency": 0.0011750571429729462
+  },
+  {
+    "step": 60,
+    "loss": 0.5740160942077637,
+    "drift": 0.5680878162384033,
+    "small_step": 0.00569074135273695,
+    "strong_consistency": 0.001946730655618012
+  },
+  {
+    "step": 61,
+    "loss": 0.4927141070365906,
+    "drift": 0.48758333921432495,
+    "small_step": 0.004906907677650452,
+    "strong_consistency": 0.001805423991754651
+  },
+  {
+    "step": 62,
+    "loss": 0.6573272347450256,
+    "drift": 0.6502437591552734,
+    "small_step": 0.006845078431069851,
+    "strong_consistency": 0.0018921407172456384
+  },
+  {
+    "step": 63,
+    "loss": 0.8309145569801331,
+    "drift": 0.8226155638694763,
+    "small_step": 0.007985569536685944,
+    "strong_consistency": 0.002448609098792076
+  },
+  {
+    "step": 64,
+    "loss": 0.4018667936325073,
+    "drift": 0.3977099061012268,
+    "small_step": 0.0039817532524466515,
+    "strong_consistency": 0.0013472249265760183
+  },
+  {
+    "step": 65,
+    "loss": 0.6612595319747925,
+    "drift": 0.6543848514556885,
+    "small_step": 0.00654405914247036,
+    "strong_consistency": 0.0025046777445822954
+  },
+  {
+    "step": 66,
+    "loss": 0.43587589263916016,
+    "drift": 0.4309670627117157,
+    "small_step": 0.004700618330389261,
+    "strong_consistency": 0.0015536308055743575
+  },
+  {
+    "step": 67,
+    "loss": 0.6206396222114563,
+    "drift": 0.6139256358146667,
+    "small_step": 0.006373590789735317,
+    "strong_consistency": 0.0025029252283275127
+  },
+  {
+    "step": 68,
+    "loss": 0.6962381601333618,
+    "drift": 0.6883773803710938,
+    "small_step": 0.00754029443487525,
+    "strong_consistency": 0.0023226067423820496
+  },
+  {
+    "step": 69,
+    "loss": 0.5923368334770203,
+    "drift": 0.5851026177406311,
+    "small_step": 0.007033714558929205,
+    "strong_consistency": 0.0014324154471978545
+  },
+  {
+    "step": 70,
+    "loss": 0.33385133743286133,
+    "drift": 0.3301541805267334,
+    "small_step": 0.0035011721774935722,
+    "strong_consistency": 0.0013800697633996606
+  },
+  {
+    "step": 71,
+    "loss": 0.6694769859313965,
+    "drift": 0.662299394607544,
+    "small_step": 0.00675535760819912,
+    "strong_consistency": 0.0029323084745556116
+  },
+  {
+    "step": 72,
+    "loss": 0.5485737919807434,
+    "drift": 0.5424163937568665,
+    "small_step": 0.0057884566485881805,
+    "strong_consistency": 0.0025269798934459686
+  },
+  {
+    "step": 73,
+    "loss": 0.3817652463912964,
+    "drift": 0.3775249123573303,
+    "small_step": 0.0039757173508405685,
+    "strong_consistency": 0.001787893008440733
+  },
+  {
+    "step": 74,
+    "loss": 0.5698000192642212,
+    "drift": 0.5636751055717468,
+    "small_step": 0.005800272338092327,
+    "strong_consistency": 0.002164460252970457
+  },
+  {
+    "step": 75,
+    "loss": 0.44590651988983154,
+    "drift": 0.4408934712409973,
+    "small_step": 0.004648410715162754,
+    "strong_consistency": 0.002398820361122489
+  },
+  {
+    "step": 76,
+    "loss": 0.4667564332485199,
+    "drift": 0.4621381163597107,
+    "small_step": 0.004416612442582846,
+    "strong_consistency": 0.0013097268529236317
+  },
+  {
+    "step": 77,
+    "loss": 0.48977941274642944,
+    "drift": 0.48423686623573303,
+    "small_step": 0.005208235699683428,
+    "strong_consistency": 0.002143000951036811
+  },
+  {
+    "step": 78,
+    "loss": 0.509657621383667,
+    "drift": 0.5046455264091492,
+    "small_step": 0.004556741565465927,
+    "strong_consistency": 0.002881972584873438
+  },
+  {
+    "step": 79,
+    "loss": 0.35249391198158264,
+    "drift": 0.3482169806957245,
+    "small_step": 0.0039505744352936745,
+    "strong_consistency": 0.002039700746536255
+  },
+  {
+    "step": 80,
+    "loss": 0.38554200530052185,
+    "drift": 0.38145706057548523,
+    "small_step": 0.0038167238235473633,
+    "strong_consistency": 0.0016557251801714301
+  },
+  {
+    "step": 81,
+    "loss": 0.3822769522666931,
+    "drift": 0.3785891830921173,
+    "small_step": 0.0032549346797168255,
+    "strong_consistency": 0.0026392657309770584
+  },
+  {
+    "step": 82,
+    "loss": 0.3465728163719177,
+    "drift": 0.34249547123908997,
+    "small_step": 0.003766103647649288,
+    "strong_consistency": 0.0018751081079244614
+  },
+  {
+    "step": 83,
+    "loss": 0.5077496767044067,
+    "drift": 0.5014317035675049,
+    "small_step": 0.00574463838711381,
+    "strong_consistency": 0.003412846475839615
+  },
+  {
+    "step": 84,
+    "loss": 0.41851499676704407,
+    "drift": 0.4140178859233856,
+    "small_step": 0.004050338175147772,
+    "strong_consistency": 0.002628025831654668
+  },
+  {
+    "step": 85,
+    "loss": 0.3813507854938507,
+    "drift": 0.3763374090194702,
+    "small_step": 0.004538554698228836,
+    "strong_consistency": 0.0027605181094259024
+  },
+  {
+    "step": 86,
+    "loss": 0.5334195494651794,
+    "drift": 0.5263031125068665,
+    "small_step": 0.006703141611069441,
+    "strong_consistency": 0.002375270240008831
+  },
+  {
+    "step": 87,
+    "loss": 0.5232259035110474,
+    "drift": 0.5166988372802734,
+    "small_step": 0.005872664973139763,
+    "strong_consistency": 0.0037180634681135416
+  },
+  {
+    "step": 88,
+    "loss": 0.389692097902298,
+    "drift": 0.38495776057243347,
+    "small_step": 0.004414060153067112,
+    "strong_consistency": 0.0017993104411289096
+  },
+  {
+    "step": 89,
+    "loss": 0.5328529477119446,
+    "drift": 0.5263077616691589,
+    "small_step": 0.005948347970843315,
+    "strong_consistency": 0.0033155980054289103
+  },
+  {
+    "step": 90,
+    "loss": 0.3179909586906433,
+    "drift": 0.31443431973457336,
+    "small_step": 0.0032752726692706347,
+    "strong_consistency": 0.0015459861606359482
+  },
+  {
+    "step": 91,
+    "loss": 0.5411912202835083,
+    "drift": 0.5343242883682251,
+    "small_step": 0.006168815772980452,
+    "strong_consistency": 0.003794020740315318
+  },
+  {
+    "step": 92,
+    "loss": 0.4385019540786743,
+    "drift": 0.43284520506858826,
+    "small_step": 0.005139909218996763,
+    "strong_consistency": 0.0027787089347839355
+  },
+  {
+    "step": 93,
+    "loss": 0.5671675801277161,
+    "drift": 0.5597941875457764,
+    "small_step": 0.006648749113082886,
+    "strong_consistency": 0.0038543064147233963
+  },
+  {
+    "step": 94,
+    "loss": 0.4206026494503021,
+    "drift": 0.41577064990997314,
+    "small_step": 0.004345718305557966,
+    "strong_consistency": 0.0025593263562768698
+  },
+  {
+    "step": 95,
+    "loss": 0.3018491864204407,
+    "drift": 0.2988319993019104,
+    "small_step": 0.0027176104485988617,
+    "strong_consistency": 0.0015602217754349113
+  },
+  {
+    "step": 96,
+    "loss": 0.4287540018558502,
+    "drift": 0.4234044551849365,
+    "small_step": 0.004790148697793484,
+    "strong_consistency": 0.0028834748081862926
+  },
+  {
+    "step": 97,
+    "loss": 0.39508193731307983,
+    "drift": 0.3901330828666687,
+    "small_step": 0.004473578184843063,
+    "strong_consistency": 0.002424953505396843
+  },
+  {
+    "step": 98,
+    "loss": 0.5158254504203796,
+    "drift": 0.5094876289367676,
+    "small_step": 0.00574394129216671,
+    "strong_consistency": 0.0029995297081768513
+  },
+  {
+    "step": 99,
+    "loss": 0.5724641680717468,
+    "drift": 0.5677021741867065,
+    "small_step": 0.003938585519790649,
+    "strong_consistency": 0.004117195960134268
+  },
+  {
+    "step": 100,
+    "loss": 0.5093267560005188,
+    "drift": 0.5033087730407715,
+    "small_step": 0.005283356178551912,
+    "strong_consistency": 0.0036368300206959248
+  },
+  {
+    "step": 101,
+    "loss": 0.35552921891212463,
+    "drift": 0.3507189154624939,
+    "small_step": 0.00429320614784956,
+    "strong_consistency": 0.0025347976479679346
+  },
+  {
+    "step": 102,
+    "loss": 0.4533117413520813,
+    "drift": 0.4485342800617218,
+    "small_step": 0.004234389401972294,
+    "strong_consistency": 0.0026362473145127296
+  },
+  {
+    "step": 103,
+    "loss": 0.51646488904953,
+    "drift": 0.509788990020752,
+    "small_step": 0.005891587119549513,
+    "strong_consistency": 0.003770931623876095
+  },
+  {
+    "step": 104,
+    "loss": 0.5798137187957764,
+    "drift": 0.5721692442893982,
+    "small_step": 0.006826123688369989,
+    "strong_consistency": 0.0038969467859715223
+  },
+  {
+    "step": 105,
+    "loss": 0.39243125915527344,
+    "drift": 0.38788294792175293,
+    "small_step": 0.003860361408442259,
+    "strong_consistency": 0.0032450573053210974
+  },
+  {
+    "step": 106,
+    "loss": 0.5674445033073425,
+    "drift": 0.561262845993042,
+    "small_step": 0.005297224503010511,
+    "strong_consistency": 0.004132886417210102
+  },
+  {
+    "step": 107,
+    "loss": 0.45408323407173157,
+    "drift": 0.44780075550079346,
+    "small_step": 0.005516894161701202,
+    "strong_consistency": 0.0035443506203591824
+  },
+  {
+    "step": 108,
+    "loss": 0.40507856011390686,
+    "drift": 0.399596244096756,
+    "small_step": 0.004859526641666889,
+    "strong_consistency": 0.002856799168512225
+  },
+  {
+    "step": 109,
+    "loss": 0.25764790177345276,
+    "drift": 0.2542504072189331,
+    "small_step": 0.002850387943908572,
+    "strong_consistency": 0.002486825454980135
+  },
+  {
+    "step": 110,
+    "loss": 0.40399375557899475,
+    "drift": 0.39926066994667053,
+    "small_step": 0.003996056504547596,
+    "strong_consistency": 0.0033199996687471867
+  },
+  {
+    "step": 111,
+    "loss": 0.45309334993362427,
+    "drift": 0.4480211138725281,
+    "small_step": 0.0044600763358175755,
+    "strong_consistency": 0.002732908586040139
+  },
+  {
+    "step": 112,
+    "loss": 0.4778502583503723,
+    "drift": 0.4727754592895508,
+    "small_step": 0.004309108946472406,
+    "strong_consistency": 0.0033879156690090895
+  },
+  {
+    "step": 113,
+    "loss": 0.4173680245876312,
+    "drift": 0.41291144490242004,
+    "small_step": 0.003782165702432394,
+    "strong_consistency": 0.0029580341652035713
+  },
+  {
+    "step": 114,
+    "loss": 0.3856908679008484,
+    "drift": 0.3812999427318573,
+    "small_step": 0.003613072680309415,
+    "strong_consistency": 0.0033819181844592094
+  },
+  {
+    "step": 115,
+    "loss": 0.36090078949928284,
+    "drift": 0.3568292558193207,
+    "small_step": 0.0032520147506147623,
+    "strong_consistency": 0.003532341681420803
+  },
+  {
+    "step": 116,
+    "loss": 0.40290844440460205,
+    "drift": 0.39845195412635803,
+    "small_step": 0.0036745104007422924,
+    "strong_consistency": 0.003341837553307414
+  },
+  {
+    "step": 117,
+    "loss": 0.25057482719421387,
+    "drift": 0.246957927942276,
+    "small_step": 0.002872679615393281,
+    "strong_consistency": 0.003153442870825529
+  },
+  {
+    "step": 118,
+    "loss": 0.4187798500061035,
+    "drift": 0.4140356779098511,
+    "small_step": 0.003926948644220829,
+    "strong_consistency": 0.00343366083689034
+  },
+  {
+    "step": 119,
+    "loss": 0.3446667790412903,
+    "drift": 0.3402038812637329,
+    "small_step": 0.003674311563372612,
+    "strong_consistency": 0.00328585272654891
+  },
+  {
+    "step": 120,
+    "loss": 0.5514259338378906,
+    "drift": 0.5450595617294312,
+    "small_step": 0.0051956488750875,
+    "strong_consistency": 0.0048376331105828285
+  },
+  {
+    "step": 121,
+    "loss": 0.3539092242717743,
+    "drift": 0.3484587073326111,
+    "small_step": 0.004273996222764254,
+    "strong_consistency": 0.004821763839572668
+  },
+  {
+    "step": 122,
+    "loss": 0.3579702079296112,
+    "drift": 0.3528328835964203,
+    "small_step": 0.004168225452303886,
+    "strong_consistency": 0.003939504735171795
+  },
+  {
+    "step": 123,
+    "loss": 0.4267062246799469,
+    "drift": 0.42105281352996826,
+    "small_step": 0.00459048617631197,
+    "strong_consistency": 0.004285973962396383
+  },
+  {
+    "step": 124,
+    "loss": 0.4305047392845154,
+    "drift": 0.42453116178512573,
+    "small_step": 0.004729453939944506,
+    "strong_consistency": 0.0049765706062316895
+  },
+  {
+    "step": 125,
+    "loss": 0.3191846013069153,
+    "drift": 0.3147806227207184,
+    "small_step": 0.0036714717280119658,
+    "strong_consistency": 0.0029067315626889467
+  },
+  {
+    "step": 126,
+    "loss": 0.38473227620124817,
+    "drift": 0.37977689504623413,
+    "small_step": 0.003889791900292039,
+    "strong_consistency": 0.004195153247565031
+  },
+  {
+    "step": 127,
+    "loss": 0.40178123116493225,
+    "drift": 0.39716166257858276,
+    "small_step": 0.003669802099466324,
+    "strong_consistency": 0.003710040356963873
+  },
+  {
+    "step": 128,
+    "loss": 0.3655526638031006,
+    "drift": 0.3606443405151367,
+    "small_step": 0.0036640753969550133,
+    "strong_consistency": 0.004822658374905586
+  },
+  {
+    "step": 129,
+    "loss": 0.31359225511550903,
+    "drift": 0.309126615524292,
+    "small_step": 0.003637938527390361,
+    "strong_consistency": 0.00318344309926033
+  },
+  {
+    "step": 130,
+    "loss": 0.27542179822921753,
+    "drift": 0.2714768350124359,
+    "small_step": 0.0029383611399680376,
+    "strong_consistency": 0.003841981291770935
+  },
+  {
+    "step": 131,
+    "loss": 0.38476383686065674,
+    "drift": 0.3791501224040985,
+    "small_step": 0.004376828670501709,
+    "strong_consistency": 0.0046852040104568005
+  },
+  {
+    "step": 132,
+    "loss": 0.3741803765296936,
+    "drift": 0.3705555200576782,
+    "small_step": 0.00261349487118423,
+    "strong_consistency": 0.003802147228270769
+  },
+  {
+    "step": 133,
+    "loss": 0.3075428307056427,
+    "drift": 0.30266931653022766,
+    "small_step": 0.003701341338455677,
+    "strong_consistency": 0.004373834002763033
+  },
+  {
+    "step": 134,
+    "loss": 0.2947508990764618,
+    "drift": 0.29075321555137634,
+    "small_step": 0.0029246702324599028,
+    "strong_consistency": 0.003974124789237976
+  },
+  {
+    "step": 135,
+    "loss": 0.27367016673088074,
+    "drift": 0.26887473464012146,
+    "small_step": 0.003357222769409418,
+    "strong_consistency": 0.005287551321089268
+  },
+  {
+    "step": 136,
+    "loss": 0.3149111866950989,
+    "drift": 0.31094488501548767,
+    "small_step": 0.002855055732652545,
+    "strong_consistency": 0.004055628553032875
+  },
+  {
+    "step": 137,
+    "loss": 0.316592812538147,
+    "drift": 0.31269457936286926,
+    "small_step": 0.0029333780985325575,
+    "strong_consistency": 0.003495819168165326
+  },
+  {
+    "step": 138,
+    "loss": 0.2548867464065552,
+    "drift": 0.2508271634578705,
+    "small_step": 0.0029393211007118225,
+    "strong_consistency": 0.004029774572700262
+  },
+  {
+    "step": 139,
+    "loss": 0.3373710811138153,
+    "drift": 0.3318445682525635,
+    "small_step": 0.004077482968568802,
+    "strong_consistency": 0.005175026599317789
+  },
+  {
+    "step": 140,
+    "loss": 0.4286746084690094,
+    "drift": 0.4217720925807953,
+    "small_step": 0.0052856504917144775,
+    "strong_consistency": 0.00573357567191124
+  },
+  {
+    "step": 141,
+    "loss": 0.2879064977169037,
+    "drift": 0.28381043672561646,
+    "small_step": 0.0030146643985062838,
+    "strong_consistency": 0.003807766828685999
+  },
+  {
+    "step": 142,
+    "loss": 0.427993506193161,
+    "drift": 0.4218655228614807,
+    "small_step": 0.004027251619845629,
+    "strong_consistency": 0.007345240097492933
+  },
+  {
+    "step": 143,
+    "loss": 0.2763687074184418,
+    "drift": 0.27163881063461304,
+    "small_step": 0.003194032935425639,
+    "strong_consistency": 0.005332904402166605
+  },
+  {
+    "step": 144,
+    "loss": 0.3818996548652649,
+    "drift": 0.37602394819259644,
+    "small_step": 0.004083965439349413,
+    "strong_consistency": 0.006178436800837517
+  },
+  {
+    "step": 145,
+    "loss": 0.2780427932739258,
+    "drift": 0.2742249369621277,
+    "small_step": 0.0031245157588273287,
+    "strong_consistency": 0.002374453702941537
+  },
+  {
+    "step": 146,
+    "loss": 0.32187724113464355,
+    "drift": 0.31643471121788025,
+    "small_step": 0.0037837447598576546,
+    "strong_consistency": 0.005642154719680548
+  },
+  {
+    "step": 147,
+    "loss": 0.2605525553226471,
+    "drift": 0.2564292550086975,
+    "small_step": 0.0028906152583658695,
+    "strong_consistency": 0.004164486657828093
+  },
+  {
+    "step": 148,
+    "loss": 0.3782207667827606,
+    "drift": 0.3725432753562927,
+    "small_step": 0.004037993494421244,
+    "strong_consistency": 0.005501594860106707
+  },
+  {
+    "step": 149,
+    "loss": 0.30431509017944336,
+    "drift": 0.3004506528377533,
+    "small_step": 0.0025659375824034214,
+    "strong_consistency": 0.004328287206590176
+  },
+  {
+    "step": 150,
+    "loss": 0.20731881260871887,
+    "drift": 0.20494145154953003,
+    "small_step": 0.001707928255200386,
+    "strong_consistency": 0.002216653199866414
+  },
+  {
+    "step": 151,
+    "loss": 0.3817938268184662,
+    "drift": 0.3762287497520447,
+    "small_step": 0.003980616573244333,
+    "strong_consistency": 0.0052120257169008255
+  },
+  {
+    "step": 152,
+    "loss": 0.29484739899635315,
+    "drift": 0.28964337706565857,
+    "small_step": 0.0029916001949459314,
+    "strong_consistency": 0.0072301654145121574
+  },
+  {
+    "step": 153,
+    "loss": 0.2551864683628082,
+    "drift": 0.2518352270126343,
+    "small_step": 0.0022913049906492233,
+    "strong_consistency": 0.0034413838293403387
+  },
+  {
+    "step": 154,
+    "loss": 0.2983161211013794,
+    "drift": 0.2936507761478424,
+    "small_step": 0.003200083039700985,
+    "strong_consistency": 0.004726661369204521
+  },
+  {
+    "step": 155,
+    "loss": 0.2789795994758606,
+    "drift": 0.2746080458164215,
+    "small_step": 0.0031263865530490875,
+    "strong_consistency": 0.003990890458226204
+  },
+  {
+    "step": 156,
+    "loss": 0.23180395364761353,
+    "drift": 0.22825488448143005,
+    "small_step": 0.002177182352170348,
+    "strong_consistency": 0.004369064699858427
+  },
+  {
+    "step": 157,
+    "loss": 0.3346705436706543,
+    "drift": 0.3294815123081207,
+    "small_step": 0.003568604588508606,
+    "strong_consistency": 0.005127888172864914
+  },
+  {
+    "step": 158,
+    "loss": 0.3381282091140747,
+    "drift": 0.33344560861587524,
+    "small_step": 0.002587085822597146,
+    "strong_consistency": 0.006589679978787899
+  },
+  {
+    "step": 159,
+    "loss": 0.2185402810573578,
+    "drift": 0.21513505280017853,
+    "small_step": 0.0025204948615282774,
+    "strong_consistency": 0.0027647758834064007
+  },
+  {
+    "step": 160,
+    "loss": 0.3059942424297333,
+    "drift": 0.30124402046203613,
+    "small_step": 0.003309934865683317,
+    "strong_consistency": 0.0044729216024279594
+  },
+  {
+    "step": 161,
+    "loss": 0.325926274061203,
+    "drift": 0.3208904266357422,
+    "small_step": 0.003574763424694538,
+    "strong_consistency": 0.004509545397013426
+  },
+  {
+    "step": 162,
+    "loss": 0.27539142966270447,
+    "drift": 0.2701673209667206,
+    "small_step": 0.0030831724870949984,
+    "strong_consistency": 0.006567274685949087
+  },
+  {
+    "step": 163,
+    "loss": 0.3475375175476074,
+    "drift": 0.3413729667663574,
+    "small_step": 0.004125600680708885,
+    "strong_consistency": 0.0062162913382053375
+  },
+  {
+    "step": 164,
+    "loss": 0.22657421231269836,
+    "drift": 0.22212107479572296,
+    "small_step": 0.0025274597574025393,
+    "strong_consistency": 0.0058354041539132595
+  },
+  {
+    "step": 165,
+    "loss": 0.3187911808490753,
+    "drift": 0.3137738108634949,
+    "small_step": 0.003384337527677417,
+    "strong_consistency": 0.004918690305203199
+  },
+  {
+    "step": 166,
+    "loss": 0.29569318890571594,
+    "drift": 0.28996729850769043,
+    "small_step": 0.003711978206411004,
+    "strong_consistency": 0.006029689684510231
+  },
+  {
+    "step": 167,
+    "loss": 0.2377084642648697,
+    "drift": 0.23452487587928772,
+    "small_step": 0.0018782101105898619,
+    "strong_consistency": 0.0038850214332342148
+  },
+  {
+    "step": 168,
+    "loss": 0.23799698054790497,
+    "drift": 0.23433829843997955,
+    "small_step": 0.0022463970817625523,
+    "strong_consistency": 0.0041783773340284824
+  },
+  {
+    "step": 169,
+    "loss": 0.2792894244194031,
+    "drift": 0.2746138274669647,
+    "small_step": 0.002937502460554242,
+    "strong_consistency": 0.005112025886774063
+  },
+  {
+    "step": 170,
+    "loss": 0.311714231967926,
+    "drift": 0.3056934177875519,
+    "small_step": 0.00395001657307148,
+    "strong_consistency": 0.006054962985217571
+  },
+  {
+    "step": 171,
+    "loss": 0.2896782159805298,
+    "drift": 0.28520146012306213,
+    "small_step": 0.0026048580184578896,
+    "strong_consistency": 0.005441503133624792
+  },
+  {
+    "step": 172,
+    "loss": 0.2142803966999054,
+    "drift": 0.2101815938949585,
+    "small_step": 0.002208891324698925,
+    "strong_consistency": 0.005462175235152245
+  },
+  {
+    "step": 173,
+    "loss": 0.20229807496070862,
+    "drift": 0.19858883321285248,
+    "small_step": 0.0019741591531783342,
+    "strong_consistency": 0.004985833540558815
+  },
+  {
+    "step": 174,
+    "loss": 0.2115437388420105,
+    "drift": 0.20762261748313904,
+    "small_step": 0.002209642669185996,
+    "strong_consistency": 0.004889930132776499
+  },
+  {
+    "step": 175,
+    "loss": 0.19657418131828308,
+    "drift": 0.19308145344257355,
+    "small_step": 0.001723055960610509,
+    "strong_consistency": 0.005027489736676216
+  },
+  {
+    "step": 176,
+    "loss": 0.2441897839307785,
+    "drift": 0.24036987125873566,
+    "small_step": 0.002050314098596573,
+    "strong_consistency": 0.004998889286071062
+  },
+  {
+    "step": 177,
+    "loss": 0.3240226209163666,
+    "drift": 0.31837862730026245,
+    "small_step": 0.002856702310964465,
+    "strong_consistency": 0.00782947801053524
+  },
+  {
+    "step": 178,
+    "loss": 0.1974426954984665,
+    "drift": 0.19270740449428558,
+    "small_step": 0.002019049832597375,
+    "strong_consistency": 0.00758728850632906
+  },
+  {
+    "step": 179,
+    "loss": 0.2849767506122589,
+    "drift": 0.2799808979034424,
+    "small_step": 0.002733130007982254,
+    "strong_consistency": 0.006285331677645445
+  },
+  {
+    "step": 180,
+    "loss": 0.27059265971183777,
+    "drift": 0.26547473669052124,
+    "small_step": 0.0022597520146518946,
+    "strong_consistency": 0.00789546500891447
+  },
+  {
+    "step": 181,
+    "loss": 0.2893434166908264,
+    "drift": 0.28435027599334717,
+    "small_step": 0.00248901778832078,
+    "strong_consistency": 0.006879385560750961
+  },
+  {
+    "step": 182,
+    "loss": 0.3289482891559601,
+    "drift": 0.3232654929161072,
+    "small_step": 0.0035114288330078125,
+    "strong_consistency": 0.005932676140218973
+  },
+  {
+    "step": 183,
+    "loss": 0.30689409375190735,
+    "drift": 0.30135107040405273,
+    "small_step": 0.0031481441110372543,
+    "strong_consistency": 0.006507808342576027
+  },
+  {
+    "step": 184,
+    "loss": 0.23306742310523987,
+    "drift": 0.228505939245224,
+    "small_step": 0.002082715043798089,
+    "strong_consistency": 0.0066993809305131435
+  },
+  {
+    "step": 185,
+    "loss": 0.23304349184036255,
+    "drift": 0.22843460738658905,
+    "small_step": 0.0023662173189222813,
+    "strong_consistency": 0.006028680130839348
+  },
+  {
+    "step": 186,
+    "loss": 0.3282916247844696,
+    "drift": 0.3216574490070343,
+    "small_step": 0.0037203324027359486,
+    "strong_consistency": 0.007791019044816494
+  },
+  {
+    "step": 187,
+    "loss": 0.18123966455459595,
+    "drift": 0.17705947160720825,
+    "small_step": 0.0018339179223403335,
+    "strong_consistency": 0.0062400829046964645
+  },
+  {
+    "step": 188,
+    "loss": 0.32678765058517456,
+    "drift": 0.32020825147628784,
+    "small_step": 0.0036257822066545486,
+    "strong_consistency": 0.007813841104507446
+  },
+  {
+    "step": 189,
+    "loss": 0.16354255378246307,
+    "drift": 0.1603190302848816,
+    "small_step": 0.0018369988538324833,
+    "strong_consistency": 0.0036487486213445663
+  },
+  {
+    "step": 190,
+    "loss": 0.19055582582950592,
+    "drift": 0.18674419820308685,
+    "small_step": 0.0017670653760433197,
+    "strong_consistency": 0.005352244712412357
+  },
+  {
+    "step": 191,
+    "loss": 0.3086678385734558,
+    "drift": 0.30214130878448486,
+    "small_step": 0.0035226575564593077,
+    "strong_consistency": 0.007822578772902489
+  },
+  {
+    "step": 192,
+    "loss": 0.22059163451194763,
+    "drift": 0.21578451991081238,
+    "small_step": 0.002253724727779627,
+    "strong_consistency": 0.006615014281123877
+  },
+  {
+    "step": 193,
+    "loss": 0.22032059729099274,
+    "drift": 0.21621224284172058,
+    "small_step": 0.0025957997422665358,
+    "strong_consistency": 0.0038983465638011694
+  },
+  {
+    "step": 194,
+    "loss": 0.21096357703208923,
+    "drift": 0.2063622772693634,
+    "small_step": 0.002427594270557165,
+    "strong_consistency": 0.005573596805334091
+  },
+  {
+    "step": 195,
+    "loss": 0.1944134384393692,
+    "drift": 0.19106554985046387,
+    "small_step": 0.0015635006129741669,
+    "strong_consistency": 0.004551994614303112
+  },
+  {
+    "step": 196,
+    "loss": 0.23570753633975983,
+    "drift": 0.23065587878227234,
+    "small_step": 0.0024242966901510954,
+    "strong_consistency": 0.006668436340987682
+  },
+  {
+    "step": 197,
+    "loss": 0.2523888349533081,
+    "drift": 0.24659214913845062,
+    "small_step": 0.0028390842489898205,
+    "strong_consistency": 0.007468658033758402
+  },
+  {
+    "step": 198,
+    "loss": 0.1980184018611908,
+    "drift": 0.19295066595077515,
+    "small_step": 0.002441478194668889,
+    "strong_consistency": 0.006598624400794506
+  },
+  {
+    "step": 199,
+    "loss": 0.24099791049957275,
+    "drift": 0.23624031245708466,
+    "small_step": 0.0023536072112619877,
+    "strong_consistency": 0.00600998243317008
+  },
+  {
+    "step": 200,
+    "loss": 0.29836568236351013,
+    "drift": 0.29260504245758057,
+    "small_step": 0.002990573877468705,
+    "strong_consistency": 0.0068907286040484905
+  },
+  {
+    "step": 201,
+    "loss": 0.20169146358966827,
+    "drift": 0.19669774174690247,
+    "small_step": 0.0018755958881229162,
+    "strong_consistency": 0.007718139328062534
+  },
+  {
+    "step": 202,
+    "loss": 0.19582690298557281,
+    "drift": 0.19092850387096405,
+    "small_step": 0.0017920241225510836,
+    "strong_consistency": 0.007651162799447775
+  },
+  {
+    "step": 203,
+    "loss": 0.18722359836101532,
+    "drift": 0.18260282278060913,
+    "small_step": 0.001837960327975452,
+    "strong_consistency": 0.006820631679147482
+  },
+  {
+    "step": 204,
+    "loss": 0.22291021049022675,
+    "drift": 0.2172331064939499,
+    "small_step": 0.002266152761876583,
+    "strong_consistency": 0.008319397456943989
+  },
+  {
+    "step": 205,
+    "loss": 0.18655067682266235,
+    "drift": 0.18171629309654236,
+    "small_step": 0.0020289705134928226,
+    "strong_consistency": 0.006809269543737173
+  },
+  {
+    "step": 206,
+    "loss": 0.23724696040153503,
+    "drift": 0.2292952835559845,
+    "small_step": 0.0028212780598551035,
+    "strong_consistency": 0.012392272241413593
+  },
+  {
+    "step": 207,
+    "loss": 0.2014339566230774,
+    "drift": 0.19582873582839966,
+    "small_step": 0.0021048891358077526,
+    "strong_consistency": 0.008414260111749172
+  },
+  {
+    "step": 208,
+    "loss": 0.18875016272068024,
+    "drift": 0.18464435636997223,
+    "small_step": 0.0020805904641747475,
+    "strong_consistency": 0.004845018964260817
+  },
+  {
+    "step": 209,
+    "loss": 0.17609713971614838,
+    "drift": 0.1706465780735016,
+    "small_step": 0.0016691071214154363,
+    "strong_consistency": 0.00900346040725708
+  },
+  {
+    "step": 210,
+    "loss": 0.14427819848060608,
+    "drift": 0.14106714725494385,
+    "small_step": 0.0012563137570396066,
+    "strong_consistency": 0.004632072057574987
+  },
+  {
+    "step": 211,
+    "loss": 0.18153028190135956,
+    "drift": 0.17565566301345825,
+    "small_step": 0.0021033594384789467,
+    "strong_consistency": 0.008894478902220726
+  },
+  {
+    "step": 212,
+    "loss": 0.3064463436603546,
+    "drift": 0.2995642423629761,
+    "small_step": 0.00284015666693449,
+    "strong_consistency": 0.009488122537732124
+  },
+  {
+    "step": 213,
+    "loss": 0.1440448760986328,
+    "drift": 0.14015328884124756,
+    "small_step": 0.001562893739901483,
+    "strong_consistency": 0.005440863780677319
+  },
+  {
+    "step": 214,
+    "loss": 0.19079245626926422,
+    "drift": 0.1851358413696289,
+    "small_step": 0.0017475761706009507,
+    "strong_consistency": 0.009090782143175602
+  },
+  {
+    "step": 215,
+    "loss": 0.18951793015003204,
+    "drift": 0.18360275030136108,
+    "small_step": 0.0021038539707660675,
+    "strong_consistency": 0.008822538889944553
+  },
+  {
+    "step": 216,
+    "loss": 0.16154031455516815,
+    "drift": 0.15706229209899902,
+    "small_step": 0.0015049948124215007,
+    "strong_consistency": 0.006850306410342455
+  },
+  {
+    "step": 217,
+    "loss": 0.27152636647224426,
+    "drift": 0.264032781124115,
+    "small_step": 0.00294864852912724,
+    "strong_consistency": 0.010424181818962097
+  },
+  {
+    "step": 218,
+    "loss": 0.18928979337215424,
+    "drift": 0.18414048850536346,
+    "small_step": 0.0018592976266518235,
+    "strong_consistency": 0.007511459290981293
+  },
+  {
+    "step": 219,
+    "loss": 0.258726567029953,
+    "drift": 0.2520948648452759,
+    "small_step": 0.002843350637704134,
+    "strong_consistency": 0.008609903044998646
+  },
+  {
+    "step": 220,
+    "loss": 0.1446753740310669,
+    "drift": 0.14022883772850037,
+    "small_step": 0.0015873771626502275,
+    "strong_consistency": 0.006468689534813166
+  },
+  {
+    "step": 221,
+    "loss": 0.21694393455982208,
+    "drift": 0.2112634927034378,
+    "small_step": 0.002198160160332918,
+    "strong_consistency": 0.007842962630093098
+  },
+  {
+    "step": 222,
+    "loss": 0.20583869516849518,
+    "drift": 0.1990012675523758,
+    "small_step": 0.0019432813860476017,
+    "strong_consistency": 0.010973424650728703
+  },
+  {
+    "step": 223,
+    "loss": 0.16998043656349182,
+    "drift": 0.16521716117858887,
+    "small_step": 0.001399783417582512,
+    "strong_consistency": 0.007507781498134136
+  },
+  {
+    "step": 224,
+    "loss": 0.14334383606910706,
+    "drift": 0.13890203833580017,
+    "small_step": 0.0014186912449076772,
+    "strong_consistency": 0.006718015298247337
+  },
+  {
+    "step": 225,
+    "loss": 0.16851806640625,
+    "drift": 0.16308186948299408,
+    "small_step": 0.0015744260745123029,
+    "strong_consistency": 0.008543726056814194
+  },
+  {
+    "step": 226,
+    "loss": 0.1802053600549698,
+    "drift": 0.17450176179409027,
+    "small_step": 0.0019120449433103204,
+    "strong_consistency": 0.008351434022188187
+  },
+  {
+    "step": 227,
+    "loss": 0.15460383892059326,
+    "drift": 0.1495227813720703,
+    "small_step": 0.0013459308538585901,
+    "strong_consistency": 0.008191054686903954
+  },
+  {
+    "step": 228,
+    "loss": 0.16394738852977753,
+    "drift": 0.1589869111776352,
+    "small_step": 0.001578102819621563,
+    "strong_consistency": 0.007385074160993099
+  },
+  {
+    "step": 229,
+    "loss": 0.12169700860977173,
+    "drift": 0.11838486790657043,
+    "small_step": 0.0010161505779251456,
+    "strong_consistency": 0.00499129481613636
+  },
+  {
+    "step": 230,
+    "loss": 0.13916751742362976,
+    "drift": 0.13393323123455048,
+    "small_step": 0.0014638847205787897,
+    "strong_consistency": 0.008161044679582119
+  },
+  {
+    "step": 231,
+    "loss": 0.16828981041908264,
+    "drift": 0.16303536295890808,
+    "small_step": 0.0015426420141011477,
+    "strong_consistency": 0.007999569177627563
+  },
+  {
+    "step": 232,
+    "loss": 0.16536590456962585,
+    "drift": 0.1585283726453781,
+    "small_step": 0.0015985029749572277,
+    "strong_consistency": 0.01124254148453474
+  },
+  {
+    "step": 233,
+    "loss": 0.1706175059080124,
+    "drift": 0.16585563123226166,
+    "small_step": 0.0012476086849346757,
+    "strong_consistency": 0.0075091044418513775
+  },
+  {
+    "step": 234,
+    "loss": 0.1584887057542801,
+    "drift": 0.15284796059131622,
+    "small_step": 0.0017017112113535404,
+    "strong_consistency": 0.008380931802093983
+  },
+  {
+    "step": 235,
+    "loss": 0.13264834880828857,
+    "drift": 0.1276097595691681,
+    "small_step": 0.0011485401773825288,
+    "strong_consistency": 0.008241649717092514
+  },
+  {
+    "step": 236,
+    "loss": 0.13907402753829956,
+    "drift": 0.13423316180706024,
+    "small_step": 0.0012799350079149008,
+    "strong_consistency": 0.0075125135481357574
+  },
+  {
+    "step": 237,
+    "loss": 0.17056183516979218,
+    "drift": 0.16461607813835144,
+    "small_step": 0.0018284341786056757,
+    "strong_consistency": 0.00864985678344965
+  },
+  {
+    "step": 238,
+    "loss": 0.168558269739151,
+    "drift": 0.16126899421215057,
+    "small_step": 0.001974532613530755,
+    "strong_consistency": 0.011118695139884949
+  },
+  {
+    "step": 239,
+    "loss": 0.14567698538303375,
+    "drift": 0.140279620885849,
+    "small_step": 0.0013836337020620704,
+    "strong_consistency": 0.00836193561553955
+  },
+  {
+    "step": 240,
+    "loss": 0.16477079689502716,
+    "drift": 0.15995746850967407,
+    "small_step": 0.0013406953075900674,
+    "strong_consistency": 0.007204628083854914
+  },
+  {
+    "step": 241,
+    "loss": 0.1429092437028885,
+    "drift": 0.1375398486852646,
+    "small_step": 0.0009198092157021165,
+    "strong_consistency": 0.009193362668156624
+  },
+  {
+    "step": 242,
+    "loss": 0.16755114495754242,
+    "drift": 0.159384086728096,
+    "small_step": 0.0014950421173125505,
+    "strong_consistency": 0.013728413730859756
+  },
+  {
+    "step": 243,
+    "loss": 0.09348683059215546,
+    "drift": 0.08963992446660995,
+    "small_step": 0.0008484693244099617,
+    "strong_consistency": 0.006144328508526087
+  },
+  {
+    "step": 244,
+    "loss": 0.15100575983524323,
+    "drift": 0.14480090141296387,
+    "small_step": 0.0015544950729236007,
+    "strong_consistency": 0.009490558877587318
+  },
+  {
+    "step": 245,
+    "loss": 0.13871003687381744,
+    "drift": 0.13347800076007843,
+    "small_step": 0.0015007966430857778,
+    "strong_consistency": 0.00758382398635149
+  },
+  {
+    "step": 246,
+    "loss": 0.14691880345344543,
+    "drift": 0.14187663793563843,
+    "small_step": 0.001341726048849523,
+    "strong_consistency": 0.007490753661841154
+  },
+  {
+    "step": 247,
+    "loss": 0.16413567960262299,
+    "drift": 0.15900735557079315,
+    "small_step": 0.001636051107198,
+    "strong_consistency": 0.007040845230221748
+  },
+  {
+    "step": 248,
+    "loss": 0.1465373933315277,
+    "drift": 0.14072613418102264,
+    "small_step": 0.0015125469071790576,
+    "strong_consistency": 0.008631973527371883
+  },
+  {
+    "step": 249,
+    "loss": 0.15427188575267792,
+    "drift": 0.1471461057662964,
+    "small_step": 0.0014414871111512184,
+    "strong_consistency": 0.01136857271194458
+  },
+  {
+    "step": 250,
+    "loss": 0.14605894684791565,
+    "drift": 0.14058449864387512,
+    "small_step": 0.0014064728748053312,
+    "strong_consistency": 0.008103516884148121
+  },
+  {
+    "step": 251,
+    "loss": 0.16724127531051636,
+    "drift": 0.1585499346256256,
+    "small_step": 0.0015955088892951608,
+    "strong_consistency": 0.014079028740525246
+  },
+  {
+    "step": 252,
+    "loss": 0.13523581624031067,
+    "drift": 0.12918251752853394,
+    "small_step": 0.0012393610086292028,
+    "strong_consistency": 0.00951369944959879
+  },
+  {
+    "step": 253,
+    "loss": 0.12909528613090515,
+    "drift": 0.12373609840869904,
+    "small_step": 0.0011851578019559383,
+    "strong_consistency": 0.008216586895287037
+  },
+  {
+    "step": 254,
+    "loss": 0.131868377327919,
+    "drift": 0.12587305903434753,
+    "small_step": 0.0013885960215702653,
+    "strong_consistency": 0.009032804518938065
+  },
+  {
+    "step": 255,
+    "loss": 0.12891097366809845,
+    "drift": 0.12409693747758865,
+    "small_step": 0.0008218953153118491,
+    "strong_consistency": 0.007797136437147856
+  },
+  {
+    "step": 256,
+    "loss": 0.13067227602005005,
+    "drift": 0.12506259977817535,
+    "small_step": 0.0012540591415017843,
+    "strong_consistency": 0.008473982103168964
+  },
+  {
+    "step": 257,
+    "loss": 0.11611484736204147,
+    "drift": 0.10999822616577148,
+    "small_step": 0.0014173501404002309,
+    "strong_consistency": 0.009107111021876335
+  },
+  {
+    "step": 258,
+    "loss": 0.10584726184606552,
+    "drift": 0.10056114196777344,
+    "small_step": 0.0008819928043521941,
+    "strong_consistency": 0.008502170443534851
+  },
+  {
+    "step": 259,
+    "loss": 0.147541806101799,
+    "drift": 0.13962528109550476,
+    "small_step": 0.001158777391538024,
+    "strong_consistency": 0.012995666824281216
+  },
+  {
+    "step": 260,
+    "loss": 0.08810228854417801,
+    "drift": 0.08182252198457718,
+    "small_step": 0.0008100526756606996,
+    "strong_consistency": 0.010478389449417591
+  },
+  {
+    "step": 261,
+    "loss": 0.12655885517597198,
+    "drift": 0.12172863632440567,
+    "small_step": 0.0012173352297395468,
+    "strong_consistency": 0.0068948231637477875
+  },
+  {
+    "step": 262,
+    "loss": 0.0906553864479065,
+    "drift": 0.08608992397785187,
+    "small_step": 0.0009374317014589906,
+    "strong_consistency": 0.006897399667650461
+  },
+  {
+    "step": 263,
+    "loss": 0.13548648357391357,
+    "drift": 0.12760688364505768,
+    "small_step": 0.0014383373782038689,
+    "strong_consistency": 0.01219935528934002
+  },
+  {
+    "step": 264,
+    "loss": 0.1532769799232483,
+    "drift": 0.14503274857997894,
+    "small_step": 0.001688194228336215,
+    "strong_consistency": 0.012369873933494091
+  },
+  {
+    "step": 265,
+    "loss": 0.10880988836288452,
+    "drift": 0.10277830064296722,
+    "small_step": 0.0014204408507794142,
+    "strong_consistency": 0.008667569607496262
+  },
+  {
+    "step": 266,
+    "loss": 0.09902331233024597,
+    "drift": 0.0913032740354538,
+    "small_step": 0.000988790299743414,
+    "strong_consistency": 0.01260533556342125
+  },
+  {
+    "step": 267,
+    "loss": 0.12461791932582855,
+    "drift": 0.11768923699855804,
+    "small_step": 0.0009616109309718013,
+    "strong_consistency": 0.011132592335343361
+  },
+  {
+    "step": 268,
+    "loss": 0.1487836390733719,
+    "drift": 0.13942952454090118,
+    "small_step": 0.0014749834081158042,
+    "strong_consistency": 0.014645238406956196
+  },
+  {
+    "step": 269,
+    "loss": 0.15697190165519714,
+    "drift": 0.14909487962722778,
+    "small_step": 0.001720144529826939,
+    "strong_consistency": 0.011401617899537086
+  },
+  {
+    "step": 270,
+    "loss": 0.11753078550100327,
+    "drift": 0.1108165979385376,
+    "small_step": 0.0010079829953610897,
+    "strong_consistency": 0.010528059676289558
+  },
+  {
+    "step": 271,
+    "loss": 0.13412635028362274,
+    "drift": 0.12420547008514404,
+    "small_step": 0.0011997164692729712,
+    "strong_consistency": 0.01603154093027115
+  },
+  {
+    "step": 272,
+    "loss": 0.10839472711086273,
+    "drift": 0.10190865397453308,
+    "small_step": 0.0010317135602235794,
+    "strong_consistency": 0.009989676997065544
+  },
+  {
+    "step": 273,
+    "loss": 0.13776130974292755,
+    "drift": 0.12956801056861877,
+    "small_step": 0.001437826780602336,
+    "strong_consistency": 0.012327492237091064
+  },
+  {
+    "step": 274,
+    "loss": 0.13168984651565552,
+    "drift": 0.12459143251180649,
+    "small_step": 0.0013620902318507433,
+    "strong_consistency": 0.010429661720991135
+  },
+  {
+    "step": 275,
+    "loss": 0.1387908011674881,
+    "drift": 0.12961030006408691,
+    "small_step": 0.001338136731646955,
+    "strong_consistency": 0.014207187108695507
+  },
+  {
+    "step": 276,
+    "loss": 0.1304720640182495,
+    "drift": 0.12143437564373016,
+    "small_step": 0.0012069582007825375,
+    "strong_consistency": 0.01413489505648613
+  },
+  {
+    "step": 277,
+    "loss": 0.09953604638576508,
+    "drift": 0.09302621334791183,
+    "small_step": 0.0009531216928735375,
+    "strong_consistency": 0.009994076564908028
+  },
+  {
+    "step": 278,
+    "loss": 0.09506377577781677,
+    "drift": 0.08675243705511093,
+    "small_step": 0.0008431979804299772,
+    "strong_consistency": 0.013383772224187851
+  },
+  {
+    "step": 279,
+    "loss": 0.10530196875333786,
+    "drift": 0.09546035528182983,
+    "small_step": 0.0010884582297876477,
+    "strong_consistency": 0.01563064008951187
+  },
+  {
+    "step": 280,
+    "loss": 0.10412275791168213,
+    "drift": 0.09693294763565063,
+    "small_step": 0.0008745361119508743,
+    "strong_consistency": 0.01123714353889227
+  },
+  {
+    "step": 281,
+    "loss": 0.07550304383039474,
+    "drift": 0.07073255628347397,
+    "small_step": 0.0006941808387637138,
+    "strong_consistency": 0.0072274962440133095
+  },
+  {
+    "step": 282,
+    "loss": 0.13575279712677002,
+    "drift": 0.12805262207984924,
+    "small_step": 0.0013192874612286687,
+    "strong_consistency": 0.011273646727204323
+  },
+  {
+    "step": 283,
+    "loss": 0.17095087468624115,
+    "drift": 0.16263164579868317,
+    "small_step": 0.0016110134311020374,
+    "strong_consistency": 0.01181025244295597
+  },
+  {
+    "step": 284,
+    "loss": 0.0841718316078186,
+    "drift": 0.07818691432476044,
+    "small_step": 0.0008171705412678421,
+    "strong_consistency": 0.00906621478497982
+  },
+  {
+    "step": 285,
+    "loss": 0.07691752165555954,
+    "drift": 0.07204827666282654,
+    "small_step": 0.0007292664377018809,
+    "strong_consistency": 0.007237727753818035
+  },
+  {
+    "step": 286,
+    "loss": 0.13776074349880219,
+    "drift": 0.1277502477169037,
+    "small_step": 0.001253111520782113,
+    "strong_consistency": 0.015256768092513084
+  },
+  {
+    "step": 287,
+    "loss": 0.06498068571090698,
+    "drift": 0.06145896017551422,
+    "small_step": 0.0005948530742898583,
+    "strong_consistency": 0.00508137745782733
+  },
+  {
+    "step": 288,
+    "loss": 0.12283168733119965,
+    "drift": 0.11371690034866333,
+    "small_step": 0.0010718938428908587,
+    "strong_consistency": 0.013915039598941803
+  },
+  {
+    "step": 289,
+    "loss": 0.09046061336994171,
+    "drift": 0.0836305096745491,
+    "small_step": 0.000830037344712764,
+    "strong_consistency": 0.010344935581088066
+  },
+  {
+    "step": 290,
+    "loss": 0.06090615689754486,
+    "drift": 0.05688434839248657,
+    "small_step": 0.0005714201251976192,
+    "strong_consistency": 0.0059285033494234085
+  },
+  {
+    "step": 291,
+    "loss": 0.06524605304002762,
+    "drift": 0.06060538813471794,
+    "small_step": 0.0005412581376731396,
+    "strong_consistency": 0.007019526790827513
+  },
+  {
+    "step": 292,
+    "loss": 0.06493473798036575,
+    "drift": 0.05952799320220947,
+    "small_step": 0.0006110009271651506,
+    "strong_consistency": 0.00818387046456337
+  },
+  {
+    "step": 293,
+    "loss": 0.0969451367855072,
+    "drift": 0.08975190669298172,
+    "small_step": 0.0008827335550449789,
+    "strong_consistency": 0.01073213666677475
+  },
+  {
+    "step": 294,
+    "loss": 0.06509426981210709,
+    "drift": 0.05852077156305313,
+    "small_step": 0.0006301137036643922,
+    "strong_consistency": 0.010073534213006496
+  },
+  {
+    "step": 295,
+    "loss": 0.09167155623435974,
+    "drift": 0.08494461327791214,
+    "small_step": 0.0008832726161926985,
+    "strong_consistency": 0.009871061891317368
+  },
+  {
+    "step": 296,
+    "loss": 0.08285171538591385,
+    "drift": 0.07525534927845001,
+    "small_step": 0.0007303782622329891,
+    "strong_consistency": 0.01155889593064785
+  },
+  {
+    "step": 297,
+    "loss": 0.08350910246372223,
+    "drift": 0.07669240236282349,
+    "small_step": 0.0008150379289872944,
+    "strong_consistency": 0.010069901123642921
+  },
+  {
+    "step": 298,
+    "loss": 0.09735140204429626,
+    "drift": 0.08844295144081116,
+    "small_step": 0.0009120075847022235,
+    "strong_consistency": 0.013371973298490047
+  },
+  {
+    "step": 299,
+    "loss": 0.06303734332323074,
+    "drift": 0.05726505070924759,
+    "small_step": 0.0004217438690830022,
+    "strong_consistency": 0.008917577564716339
+  },
+  {
+    "step": 300,
+    "loss": 0.09734517335891724,
+    "drift": 0.08750268816947937,
+    "small_step": 0.0008783877710811794,
+    "strong_consistency": 0.014890527352690697
+  },
+  {
+    "step": 301,
+    "loss": 0.06457947194576263,
+    "drift": 0.05904810503125191,
+    "small_step": 0.000409159081755206,
+    "strong_consistency": 0.008480479940772057
+  },
+  {
+    "step": 302,
+    "loss": 0.08411628007888794,
+    "drift": 0.07703353464603424,
+    "small_step": 0.0007357888971455395,
+    "strong_consistency": 0.010473519563674927
+  },
+  {
+    "step": 303,
+    "loss": 0.08732233941555023,
+    "drift": 0.07930910587310791,
+    "small_step": 0.0010058495681732893,
+    "strong_consistency": 0.011525304988026619
+  },
+  {
+    "step": 304,
+    "loss": 0.07002456486225128,
+    "drift": 0.06286081671714783,
+    "small_step": 0.0006136199808679521,
+    "strong_consistency": 0.01073791179805994
+  },
+  {
+    "step": 305,
+    "loss": 0.0645698755979538,
+    "drift": 0.05797553062438965,
+    "small_step": 0.0005617591086775064,
+    "strong_consistency": 0.009857170283794403
+  },
+  {
+    "step": 306,
+    "loss": 0.0666045993566513,
+    "drift": 0.05863438919186592,
+    "small_step": 0.0006715065101161599,
+    "strong_consistency": 0.011887138709425926
+  },
+  {
+    "step": 307,
+    "loss": 0.05378730222582817,
+    "drift": 0.04753149673342705,
+    "small_step": 0.0005076148663647473,
+    "strong_consistency": 0.009331478737294674
+  },
+  {
+    "step": 308,
+    "loss": 0.06382019072771072,
+    "drift": 0.05683819577097893,
+    "small_step": 0.000597802281845361,
+    "strong_consistency": 0.010330413468182087
+  },
+  {
+    "step": 309,
+    "loss": 0.04469703882932663,
+    "drift": 0.03938307985663414,
+    "small_step": 0.0004733849491458386,
+    "strong_consistency": 0.0078073786571621895
+  },
+  {
+    "step": 310,
+    "loss": 0.10681549459695816,
+    "drift": 0.09360694140195847,
+    "small_step": 0.0010702095460146666,
+    "strong_consistency": 0.0195150263607502
+  },
+  {
+    "step": 311,
+    "loss": 0.049291372299194336,
+    "drift": 0.04447053745388985,
+    "small_step": 0.00040593737503513694,
+    "strong_consistency": 0.007075157947838306
+  },
+  {
+    "step": 312,
+    "loss": 0.06211620941758156,
+    "drift": 0.05382336303591728,
+    "small_step": 0.0005903952405788004,
+    "strong_consistency": 0.012304236181080341
+  },
+  {
+    "step": 313,
+    "loss": 0.07445128262042999,
+    "drift": 0.06438188254833221,
+    "small_step": 0.0006367635214701295,
+    "strong_consistency": 0.015020119026303291
+  },
+  {
+    "step": 314,
+    "loss": 0.06565568596124649,
+    "drift": 0.05706767737865448,
+    "small_step": 0.0006647344562225044,
+    "strong_consistency": 0.0125766322016716
+  },
+  {
+    "step": 315,
+    "loss": 0.06137651577591896,
+    "drift": 0.052619222551584244,
+    "small_step": 0.0006729775341227651,
+    "strong_consistency": 0.012791636399924755
+  },
+  {
+    "step": 316,
+    "loss": 0.06918078660964966,
+    "drift": 0.06051421910524368,
+    "small_step": 0.0005464628338813782,
+    "strong_consistency": 0.012807736173272133
+  },
+  {
+    "step": 317,
+    "loss": 0.07686079293489456,
+    "drift": 0.06691747158765793,
+    "small_step": 0.000759700546041131,
+    "strong_consistency": 0.014439662918448448
+  },
+  {
+    "step": 318,
+    "loss": 0.09372152388095856,
+    "drift": 0.08289845287799835,
+    "small_step": 0.0007211648626253009,
+    "strong_consistency": 0.01583370938897133
+  },
+  {
+    "step": 319,
+    "loss": 0.04810246825218201,
+    "drift": 0.04140844568610191,
+    "small_step": 0.00041320649324916303,
+    "strong_consistency": 0.00981377623975277
+  },
+  {
+    "step": 320,
+    "loss": 0.0891687273979187,
+    "drift": 0.07816527783870697,
+    "small_step": 0.0006612313445657492,
+    "strong_consistency": 0.016109377145767212
+  },
+  {
+    "step": 321,
+    "loss": 0.07988496124744415,
+    "drift": 0.07035878300666809,
+    "small_step": 0.0007943346863612533,
+    "strong_consistency": 0.013558764010667801
+  },
+  {
+    "step": 322,
+    "loss": 0.062420692294836044,
+    "drift": 0.05440489947795868,
+    "small_step": 0.0005536898970603943,
+    "strong_consistency": 0.011551241390407085
+  },
+  {
+    "step": 323,
+    "loss": 0.07961288094520569,
+    "drift": 0.06642921268939972,
+    "small_step": 0.0007743153837509453,
+    "strong_consistency": 0.019150234758853912
+  },
+  {
+    "step": 324,
+    "loss": 0.09787158668041229,
+    "drift": 0.08803320676088333,
+    "small_step": 0.000960857723839581,
+    "strong_consistency": 0.013657725416123867
+  },
+  {
+    "step": 325,
+    "loss": 0.04321867972612381,
+    "drift": 0.03620341792702675,
+    "small_step": 0.00042075946112163365,
+    "strong_consistency": 0.01011426281183958
+  },
+  {
+    "step": 326,
+    "loss": 0.031938113272190094,
+    "drift": 0.02682821825146675,
+    "small_step": 0.00026783751673065126,
+    "strong_consistency": 0.0074037592858076096
+  },
+  {
+    "step": 327,
+    "loss": 0.04260648414492607,
+    "drift": 0.036042965948581696,
+    "small_step": 0.00041327509097754955,
+    "strong_consistency": 0.009375370107591152
+  },
+  {
+    "step": 328,
+    "loss": 0.06176498532295227,
+    "drift": 0.05294002220034599,
+    "small_step": 0.000595340970903635,
+    "strong_consistency": 0.012507026083767414
+  },
+  {
+    "step": 329,
+    "loss": 0.05823564529418945,
+    "drift": 0.0474369153380394,
+    "small_step": 0.0004571710014715791,
+    "strong_consistency": 0.015669027343392372
+  },
+  {
+    "step": 330,
+    "loss": 0.07428483664989471,
+    "drift": 0.05842912942171097,
+    "small_step": 0.0004684674786403775,
+    "strong_consistency": 0.02324356511235237
+  },
+  {
+    "step": 331,
+    "loss": 0.06670019775629044,
+    "drift": 0.055315952748060226,
+    "small_step": 0.00043741147965192795,
+    "strong_consistency": 0.016486195847392082
+  },
+  {
+    "step": 332,
+    "loss": 0.052142295986413956,
+    "drift": 0.04484826326370239,
+    "small_step": 0.0005218408768996596,
+    "strong_consistency": 0.01016845554113388
+  },
+  {
+    "step": 333,
+    "loss": 0.03191119059920311,
+    "drift": 0.026656588539481163,
+    "small_step": 0.0002481912961229682,
+    "strong_consistency": 0.007494624238461256
+  },
+  {
+    "step": 334,
+    "loss": 0.05497073009610176,
+    "drift": 0.04614127799868584,
+    "small_step": 0.00044197903480380774,
+    "strong_consistency": 0.012518616393208504
+  },
+  {
+    "step": 335,
+    "loss": 0.0476536899805069,
+    "drift": 0.03987336903810501,
+    "small_step": 0.0004290926153771579,
+    "strong_consistency": 0.010939324274659157
+  },
+  {
+    "step": 336,
+    "loss": 0.0572076290845871,
+    "drift": 0.04721218720078468,
+    "small_step": 0.0005612623644992709,
+    "strong_consistency": 0.013997298665344715
+  },
+  {
+    "step": 337,
+    "loss": 0.03953678533434868,
+    "drift": 0.03327728807926178,
+    "small_step": 0.0003575101727619767,
+    "strong_consistency": 0.008730750530958176
+  },
+  {
+    "step": 338,
+    "loss": 0.05265317112207413,
+    "drift": 0.04424253851175308,
+    "small_step": 0.00046582985669374466,
+    "strong_consistency": 0.01171799749135971
+  },
+  {
+    "step": 339,
+    "loss": 0.04666602611541748,
+    "drift": 0.035866208374500275,
+    "small_step": 0.00044928770512342453,
+    "strong_consistency": 0.015221369452774525
+  },
+  {
+    "step": 340,
+    "loss": 0.03799354285001755,
+    "drift": 0.029423067346215248,
+    "small_step": 0.000322383304592222,
+    "strong_consistency": 0.012093977071344852
+  },
+  {
+    "step": 341,
+    "loss": 0.051008738577365875,
+    "drift": 0.041699446737766266,
+    "small_step": 0.00036656600423157215,
+    "strong_consistency": 0.013074164278805256
+  },
+  {
+    "step": 342,
+    "loss": 0.05242744833230972,
+    "drift": 0.04321438819169998,
+    "small_step": 0.0005072848871350288,
+    "strong_consistency": 0.012690635398030281
+  },
+  {
+    "step": 343,
+    "loss": 0.03077458217740059,
+    "drift": 0.02465951442718506,
+    "small_step": 0.0002815680345520377,
+    "strong_consistency": 0.0084789227694273
+  },
+  {
+    "step": 344,
+    "loss": 0.03361104801297188,
+    "drift": 0.025482511147856712,
+    "small_step": 0.0002826155978254974,
+    "strong_consistency": 0.01137089915573597
+  },
+  {
+    "step": 345,
+    "loss": 0.05140497907996178,
+    "drift": 0.04149312153458595,
+    "small_step": 0.0004208702885080129,
+    "strong_consistency": 0.013715296052396297
+  },
+  {
+    "step": 346,
+    "loss": 0.034627705812454224,
+    "drift": 0.028214450925588608,
+    "small_step": 0.00031796516850590706,
+    "strong_consistency": 0.00878283940255642
+  },
+  {
+    "step": 347,
+    "loss": 0.04478016495704651,
+    "drift": 0.03565012663602829,
+    "small_step": 0.0005210356903262436,
+    "strong_consistency": 0.012369257397949696
+  },
+  {
+    "step": 348,
+    "loss": 0.03891046717762947,
+    "drift": 0.03085324726998806,
+    "small_step": 0.00031389837386086583,
+    "strong_consistency": 0.011093582957983017
+  },
+  {
+    "step": 349,
+    "loss": 0.04155780375003815,
+    "drift": 0.033555712550878525,
+    "small_step": 0.00042475693044252694,
+    "strong_consistency": 0.010824761353433132
+  },
+  {
+    "step": 350,
+    "loss": 0.045178379863500595,
+    "drift": 0.03573029115796089,
+    "small_step": 0.0003770573530346155,
+    "strong_consistency": 0.012921692803502083
+  },
+  {
+    "step": 351,
+    "loss": 0.042735472321510315,
+    "drift": 0.031044280156493187,
+    "small_step": 0.0004587915609590709,
+    "strong_consistency": 0.015955116599798203
+  },
+  {
+    "step": 352,
+    "loss": 0.03525439649820328,
+    "drift": 0.025234555825591087,
+    "small_step": 0.00025048619136214256,
+    "strong_consistency": 0.01383761316537857
+  },
+  {
+    "step": 353,
+    "loss": 0.03728622943162918,
+    "drift": 0.027584688737988472,
+    "small_step": 0.0003034107794519514,
+    "strong_consistency": 0.013274194672703743
+  },
+  {
+    "step": 354,
+    "loss": 0.03461046889424324,
+    "drift": 0.02651153691112995,
+    "small_step": 0.00031257723458111286,
+    "strong_consistency": 0.010966694913804531
+  },
+  {
+    "step": 355,
+    "loss": 0.03427163511514664,
+    "drift": 0.026937421411275864,
+    "small_step": 0.00030443916330114007,
+    "strong_consistency": 0.009873275645077229
+  },
+  {
+    "step": 356,
+    "loss": 0.045939747244119644,
+    "drift": 0.03338108956813812,
+    "small_step": 0.0003226047847419977,
+    "strong_consistency": 0.017137328162789345
+  },
+  {
+    "step": 357,
+    "loss": 0.0312802717089653,
+    "drift": 0.024076789617538452,
+    "small_step": 0.0002758496266324073,
+    "strong_consistency": 0.009675463661551476
+  },
+  {
+    "step": 358,
+    "loss": 0.04915599524974823,
+    "drift": 0.0380299836397171,
+    "small_step": 0.0004172028275206685,
+    "strong_consistency": 0.014914775267243385
+  },
+  {
+    "step": 359,
+    "loss": 0.03336373716592789,
+    "drift": 0.026258837431669235,
+    "small_step": 0.00022234139032661915,
+    "strong_consistency": 0.009559105150401592
+  },
+  {
+    "step": 360,
+    "loss": 0.04015409201383591,
+    "drift": 0.027014724910259247,
+    "small_step": 0.00024024109006859362,
+    "strong_consistency": 0.017865827307105064
+  },
+  {
+    "step": 361,
+    "loss": 0.030449528247117996,
+    "drift": 0.021442251279950142,
+    "small_step": 0.00025489385006949306,
+    "strong_consistency": 0.012088929302990437
+  },
+  {
+    "step": 362,
+    "loss": 0.025672998279333115,
+    "drift": 0.017505958676338196,
+    "small_step": 0.00019665947183966637,
+    "strong_consistency": 0.010978484526276588
+  },
+  {
+    "step": 363,
+    "loss": 0.04209024831652641,
+    "drift": 0.03177816793322563,
+    "small_step": 0.00033408665331080556,
+    "strong_consistency": 0.013706032186746597
+  },
+  {
+    "step": 364,
+    "loss": 0.019962243735790253,
+    "drift": 0.015066312626004219,
+    "small_step": 0.00016208147280849516,
+    "strong_consistency": 0.00648472411558032
+  },
+  {
+    "step": 365,
+    "loss": 0.02573905698955059,
+    "drift": 0.019580088555812836,
+    "small_step": 0.0002013389894273132,
+    "strong_consistency": 0.008138838224112988
+  },
+  {
+    "step": 366,
+    "loss": 0.030865075066685677,
+    "drift": 0.022566568106412888,
+    "small_step": 0.0003133141726721078,
+    "strong_consistency": 0.010879009030759335
+  },
+  {
+    "step": 367,
+    "loss": 0.03374484181404114,
+    "drift": 0.02486240863800049,
+    "small_step": 0.00025624161935411394,
+    "strong_consistency": 0.011720366775989532
+  },
+  {
+    "step": 368,
+    "loss": 0.029201064258813858,
+    "drift": 0.019361553713679314,
+    "small_step": 0.00017694853886496276,
+    "strong_consistency": 0.01309290062636137
+  },
+  {
+    "step": 369,
+    "loss": 0.0311435554176569,
+    "drift": 0.02060273103415966,
+    "small_step": 0.00019898355822078884,
+    "strong_consistency": 0.013975461944937706
+  },
+  {
+    "step": 370,
+    "loss": 0.043132178485393524,
+    "drift": 0.03144543990492821,
+    "small_step": 0.00031299059628508985,
+    "strong_consistency": 0.015328503213822842
+  },
+  {
+    "step": 371,
+    "loss": 0.027227455750107765,
+    "drift": 0.01798553578555584,
+    "small_step": 0.00020368921104818583,
+    "strong_consistency": 0.012148158624768257
+  },
+  {
+    "step": 372,
+    "loss": 0.031222879886627197,
+    "drift": 0.021961629390716553,
+    "small_step": 0.00022440442990045995,
+    "strong_consistency": 0.012113736011087894
+  },
+  {
+    "step": 373,
+    "loss": 0.02982410602271557,
+    "drift": 0.021704673767089844,
+    "small_step": 0.0002310398849658668,
+    "strong_consistency": 0.01054597832262516
+  },
+  {
+    "step": 374,
+    "loss": 0.02120397984981537,
+    "drift": 0.011468598619103432,
+    "small_step": 9.81480916379951e-05,
+    "strong_consistency": 0.012849642895162106
+  },
+  {
+    "step": 375,
+    "loss": 0.026801109313964844,
+    "drift": 0.020345425233244896,
+    "small_step": 0.00018773354531731457,
+    "strong_consistency": 0.008335040882229805
+  },
+  {
+    "step": 376,
+    "loss": 0.032900769263505936,
+    "drift": 0.02478213794529438,
+    "small_step": 0.0002903746208176017,
+    "strong_consistency": 0.010382302105426788
+  },
+  {
+    "step": 377,
+    "loss": 0.03330104425549507,
+    "drift": 0.02175666019320488,
+    "small_step": 0.00020899534865748137,
+    "strong_consistency": 0.014993900433182716
+  },
+  {
+    "step": 378,
+    "loss": 0.02499382570385933,
+    "drift": 0.015489667654037476,
+    "small_step": 0.0001628085010452196,
+    "strong_consistency": 0.012323681265115738
+  },
+  {
+    "step": 379,
+    "loss": 0.023915275931358337,
+    "drift": 0.013369183987379074,
+    "small_step": 0.00015921682643238455,
+    "strong_consistency": 0.013666941784322262
+  },
+  {
+    "step": 380,
+    "loss": 0.02551015093922615,
+    "drift": 0.018257007002830505,
+    "small_step": 0.00019458899623714387,
+    "strong_consistency": 0.009263196960091591
+  },
+  {
+    "step": 381,
+    "loss": 0.022262033075094223,
+    "drift": 0.015393056906759739,
+    "small_step": 0.00018738521612249315,
+    "strong_consistency": 0.008745537139475346
+  },
+  {
+    "step": 382,
+    "loss": 0.019761178642511368,
+    "drift": 0.011580943129956722,
+    "small_step": 0.00012752162001561373,
+    "strong_consistency": 0.010512683540582657
+  },
+  {
+    "step": 383,
+    "loss": 0.03928666561841965,
+    "drift": 0.027670376002788544,
+    "small_step": 0.00031410984229296446,
+    "strong_consistency": 0.014716382138431072
+  },
+  {
+    "step": 384,
+    "loss": 0.03996320068836212,
+    "drift": 0.030545316636562347,
+    "small_step": 0.0003468159993644804,
+    "strong_consistency": 0.011780611239373684
+  },
+  {
+    "step": 385,
+    "loss": 0.021216873079538345,
+    "drift": 0.011867851950228214,
+    "small_step": 0.00013855281576979905,
+    "strong_consistency": 0.011930659413337708
+  },
+  {
+    "step": 386,
+    "loss": 0.04433291032910347,
+    "drift": 0.0269533209502697,
+    "small_step": 0.00023049712763167918,
+    "strong_consistency": 0.022156450897455215
+  },
+  {
+    "step": 387,
+    "loss": 0.028588570654392242,
+    "drift": 0.01914491131901741,
+    "small_step": 0.0002606942434795201,
+    "strong_consistency": 0.011833718977868557
+  },
+  {
+    "step": 388,
+    "loss": 0.027537859976291656,
+    "drift": 0.01933770626783371,
+    "small_step": 0.0001510395377408713,
+    "strong_consistency": 0.010345904156565666
+  },
+  {
+    "step": 389,
+    "loss": 0.027789980173110962,
+    "drift": 0.019391097128391266,
+    "small_step": 0.0001982797693926841,
+    "strong_consistency": 0.01051359437406063
+  },
+  {
+    "step": 390,
+    "loss": 0.014757324010133743,
+    "drift": 0.008688981644809246,
+    "small_step": 0.0001070627331500873,
+    "strong_consistency": 0.007623118814080954
+  },
+  {
+    "step": 391,
+    "loss": 0.023765839636325836,
+    "drift": 0.016079731285572052,
+    "small_step": 0.00014903146075084805,
+    "strong_consistency": 0.009613619185984135
+  },
+  {
+    "step": 392,
+    "loss": 0.015320036560297012,
+    "drift": 0.010103212669491768,
+    "small_step": 8.32049481687136e-05,
+    "strong_consistency": 0.006531321909278631
+  },
+  {
+    "step": 393,
+    "loss": 0.024895720183849335,
+    "drift": 0.018053758889436722,
+    "small_step": 0.00011282574996585026,
+    "strong_consistency": 0.008539511822164059
+  },
+  {
+    "step": 394,
+    "loss": 0.027589207515120506,
+    "drift": 0.01808682270348072,
+    "small_step": 0.00021531576931010932,
+    "strong_consistency": 0.01175578311085701
+  },
+  {
+    "step": 395,
+    "loss": 0.02434898540377617,
+    "drift": 0.01831611432135105,
+    "small_step": 0.00017409902648068964,
+    "strong_consistency": 0.007397437933832407
+  },
+  {
+    "step": 396,
+    "loss": 0.03220575302839279,
+    "drift": 0.02231188490986824,
+    "small_step": 0.00024650487466715276,
+    "strong_consistency": 0.012150331400334835
+  },
+  {
+    "step": 397,
+    "loss": 0.025622092187404633,
+    "drift": 0.01790129952132702,
+    "small_step": 0.00022184019326232374,
+    "strong_consistency": 0.009420793503522873
+  },
+  {
+    "step": 398,
+    "loss": 0.020110201090574265,
+    "drift": 0.011297871358692646,
+    "small_step": 0.00013040535850450397,
+    "strong_consistency": 0.010879604145884514
+  },
+  {
+    "step": 399,
+    "loss": 0.027755778282880783,
+    "drift": 0.016858164221048355,
+    "small_step": 9.263072570320219e-05,
+    "strong_consistency": 0.013506228104233742
+  },
+  {
+    "step": 400,
+    "loss": 0.01919947937130928,
+    "drift": 0.009759793989360332,
+    "small_step": 0.00010194944479735568,
+    "strong_consistency": 0.01164306327700615
+  },
+  {
+    "step": 401,
+    "loss": 0.017226502299308777,
+    "drift": 0.009765975177288055,
+    "small_step": 0.0001230870111612603,
+    "strong_consistency": 0.009126169607043266
+  },
+  {
+    "step": 402,
+    "loss": 0.035895224660634995,
+    "drift": 0.02092045173048973,
+    "small_step": 0.00022260825789999217,
+    "strong_consistency": 0.018302934244275093
+  },
+  {
+    "step": 403,
+    "loss": 0.022638121619820595,
+    "drift": 0.010591121390461922,
+    "small_step": 0.00013734339154325426,
+    "strong_consistency": 0.014739674516022205
+  },
+  {
+    "step": 404,
+    "loss": 0.01695152372121811,
+    "drift": 0.01017725095152855,
+    "small_step": 9.924689220497385e-05,
+    "strong_consistency": 0.008240772411227226
+  },
+  {
+    "step": 405,
+    "loss": 0.024085871875286102,
+    "drift": 0.008577327243983746,
+    "small_step": 7.620122050866485e-05,
+    "strong_consistency": 0.019005348905920982
+  },
+  {
+    "step": 406,
+    "loss": 0.011243568733334541,
+    "drift": 0.005879431031644344,
+    "small_step": 6.194742309162393e-05,
+    "strong_consistency": 0.006513746455311775
+  },
+  {
+    "step": 407,
+    "loss": 0.01884220913052559,
+    "drift": 0.007590719033032656,
+    "small_step": 8.301460184156895e-05,
+    "strong_consistency": 0.013686856254935265
+  },
+  {
+    "step": 408,
+    "loss": 0.017517156898975372,
+    "drift": 0.008435623720288277,
+    "small_step": 7.437152089551091e-05,
+    "strong_consistency": 0.011011198163032532
+  },
+  {
+    "step": 409,
+    "loss": 0.01756587252020836,
+    "drift": 0.00761293014511466,
+    "small_step": 0.00010092082084156573,
+    "strong_consistency": 0.01201466005295515
+  },
+  {
+    "step": 410,
+    "loss": 0.018672030419111252,
+    "drift": 0.010284858755767345,
+    "small_step": 8.394649194087833e-05,
+    "strong_consistency": 0.010101246647536755
+  },
+  {
+    "step": 411,
+    "loss": 0.02227325737476349,
+    "drift": 0.010835537686944008,
+    "small_step": 0.00014108832692727447,
+    "strong_consistency": 0.013709505088627338
+  },
+  {
+    "step": 412,
+    "loss": 0.019158001989126205,
+    "drift": 0.00846482440829277,
+    "small_step": 8.571221405873075e-05,
+    "strong_consistency": 0.0128419678658247
+  },
+  {
+    "step": 413,
+    "loss": 0.014617742970585823,
+    "drift": 0.006603083107620478,
+    "small_step": 6.341539847198874e-05,
+    "strong_consistency": 0.009602950885891914
+  },
+  {
+    "step": 414,
+    "loss": 0.02318515069782734,
+    "drift": 0.01262274757027626,
+    "small_step": 0.00015900094876997173,
+    "strong_consistency": 0.012534219771623611
+  },
+  {
+    "step": 415,
+    "loss": 0.016401218250393867,
+    "drift": 0.005797539837658405,
+    "small_step": 5.3437677706824616e-05,
+    "strong_consistency": 0.012680577114224434
+  },
+  {
+    "step": 416,
+    "loss": 0.014840188436210155,
+    "drift": 0.00832937378436327,
+    "small_step": 0.00010403877240605652,
+    "strong_consistency": 0.0076819853857159615
+  },
+  {
+    "step": 417,
+    "loss": 0.0184645876288414,
+    "drift": 0.007813198491930962,
+    "small_step": 8.069133036769927e-05,
+    "strong_consistency": 0.012644375674426556
+  },
+  {
+    "step": 418,
+    "loss": 0.03517141193151474,
+    "drift": 0.014745689928531647,
+    "small_step": 0.0001929730933625251,
+    "strong_consistency": 0.024144092574715614
+  },
+  {
+    "step": 419,
+    "loss": 0.011932224035263062,
+    "drift": 0.005285135004669428,
+    "small_step": 5.7982964790426195e-05,
+    "strong_consistency": 0.007844174280762672
+  },
+  {
+    "step": 420,
+    "loss": 0.018823329359292984,
+    "drift": 0.006627557799220085,
+    "small_step": 6.0461825341917574e-05,
+    "strong_consistency": 0.01441248133778572
+  },
+  {
+    "step": 421,
+    "loss": 0.017453990876674652,
+    "drift": 0.00885485764592886,
+    "small_step": 0.0001123890615417622,
+    "strong_consistency": 0.01005538459867239
+  },
+  {
+    "step": 422,
+    "loss": 0.021389003843069077,
+    "drift": 0.008206824772059917,
+    "small_step": 9.0807254309766e-05,
+    "strong_consistency": 0.015474433079361916
+  },
+  {
+    "step": 423,
+    "loss": 0.021018067374825478,
+    "drift": 0.006062859669327736,
+    "small_step": 5.7107597967842594e-05,
+    "strong_consistency": 0.017568513751029968
+  },
+  {
+    "step": 424,
+    "loss": 0.011159119196236134,
+    "drift": 0.006107907276600599,
+    "small_step": 6.35278265690431e-05,
+    "strong_consistency": 0.005867863539606333
+  },
+  {
+    "step": 425,
+    "loss": 0.01423550397157669,
+    "drift": 0.006326637696474791,
+    "small_step": 5.4209485824685544e-05,
+    "strong_consistency": 0.009219080209732056
+  },
+  {
+    "step": 426,
+    "loss": 0.021257825195789337,
+    "drift": 0.011881728656589985,
+    "small_step": 0.00010884464427363127,
+    "strong_consistency": 0.010851584374904633
+  },
+  {
+    "step": 427,
+    "loss": 0.018360011279582977,
+    "drift": 0.008295535109937191,
+    "small_step": 7.885727245593444e-05,
+    "strong_consistency": 0.011665442027151585
+  },
+  {
+    "step": 428,
+    "loss": 0.02362615242600441,
+    "drift": 0.01591024361550808,
+    "small_step": 0.00016905771917663515,
+    "strong_consistency": 0.008795863017439842
+  },
+  {
+    "step": 429,
+    "loss": 0.016210705041885376,
+    "drift": 0.004157796502113342,
+    "small_step": 3.515319258440286e-05,
+    "strong_consistency": 0.013974133878946304
+  },
+  {
+    "step": 430,
+    "loss": 0.0075633227825164795,
+    "drift": 0.0032695475965738297,
+    "small_step": 3.605462916311808e-05,
+    "strong_consistency": 0.004939351696521044
+  },
+  {
+    "step": 431,
+    "loss": 0.021184006705880165,
+    "drift": 0.010735208168625832,
+    "small_step": 0.00014106252638157457,
+    "strong_consistency": 0.011930249631404877
+  },
+  {
+    "step": 432,
+    "loss": 0.018520206212997437,
+    "drift": 0.00814439170062542,
+    "small_step": 9.931738895829767e-05,
+    "strong_consistency": 0.011866624467074871
+  },
+  {
+    "step": 433,
+    "loss": 0.01944231428205967,
+    "drift": 0.008990512229502201,
+    "small_step": 0.00010013053542934358,
+    "strong_consistency": 0.011925889179110527
+  },
+  {
+    "step": 434,
+    "loss": 0.019432809203863144,
+    "drift": 0.0072329663671553135,
+    "small_step": 7.924134843051434e-05,
+    "strong_consistency": 0.013931725174188614
+  },
+  {
+    "step": 435,
+    "loss": 0.016399461776018143,
+    "drift": 0.007148805074393749,
+    "small_step": 7.705458119744435e-05,
+    "strong_consistency": 0.01052018627524376
+  },
+  {
+    "step": 436,
+    "loss": 0.0285057220607996,
+    "drift": 0.016539881005883217,
+    "small_step": 0.00011382932279957458,
+    "strong_consistency": 0.013560652732849121
+  },
+  {
+    "step": 437,
+    "loss": 0.015599596314132214,
+    "drift": 0.004154946189373732,
+    "small_step": 3.9006197766866535e-05,
+    "strong_consistency": 0.01302014198154211
+  },
+  {
+    "step": 438,
+    "loss": 0.014513050206005573,
+    "drift": 0.006147288251668215,
+    "small_step": 6.767385639250278e-05,
+    "strong_consistency": 0.00945112481713295
+  },
+  {
+    "step": 439,
+    "loss": 0.01585024781525135,
+    "drift": 0.006981849670410156,
+    "small_step": 5.288884131005034e-05,
+    "strong_consistency": 0.010017624124884605
+  },
+  {
+    "step": 440,
+    "loss": 0.01654341071844101,
+    "drift": 0.0089571513235569,
+    "small_step": 9.790598414838314e-05,
+    "strong_consistency": 0.008490197360515594
+  },
+  {
+    "step": 441,
+    "loss": 0.014661572873592377,
+    "drift": 0.0038634357042610645,
+    "small_step": 5.536183016374707e-05,
+    "strong_consistency": 0.012152460403740406
+  },
+  {
+    "step": 442,
+    "loss": 0.017218900844454765,
+    "drift": 0.009447043761610985,
+    "small_step": 9.638018673285842e-05,
+    "strong_consistency": 0.008663066662847996
+  },
+  {
+    "step": 443,
+    "loss": 0.013072538189589977,
+    "drift": 0.00509266834706068,
+    "small_step": 7.445816299878061e-05,
+    "strong_consistency": 0.008902490139007568
+  },
+  {
+    "step": 444,
+    "loss": 0.014714517630636692,
+    "drift": 0.003971503581851721,
+    "small_step": 4.827355587622151e-05,
+    "strong_consistency": 0.01201656274497509
+  },
+  {
+    "step": 445,
+    "loss": 0.015906311571598053,
+    "drift": 0.00590595044195652,
+    "small_step": 5.571512883761898e-05,
+    "strong_consistency": 0.011148706078529358
+  },
+  {
+    "step": 446,
+    "loss": 0.012971186079084873,
+    "drift": 0.004834397230297327,
+    "small_step": 4.311230077291839e-05,
+    "strong_consistency": 0.00905332900583744
+  },
+  {
+    "step": 447,
+    "loss": 0.014368345029652119,
+    "drift": 0.007088718004524708,
+    "small_step": 6.941332685528323e-05,
+    "strong_consistency": 0.008047113195061684
+  },
+  {
+    "step": 448,
+    "loss": 0.017724089324474335,
+    "drift": 0.0067934514954686165,
+    "small_step": 0.00010076997568830848,
+    "strong_consistency": 0.012059986591339111
+  },
+  {
+    "step": 449,
+    "loss": 0.015233132988214493,
+    "drift": 0.006718656048178673,
+    "small_step": 5.217319630901329e-05,
+    "strong_consistency": 0.009402561001479626
+  },
+  {
+    "step": 450,
+    "loss": 0.01901043951511383,
+    "drift": 0.0061922697350382805,
+    "small_step": 5.965116361039691e-05,
+    "strong_consistency": 0.014144700020551682
+  },
+  {
+    "step": 451,
+    "loss": 0.012503457255661488,
+    "drift": 0.0070266625843942165,
+    "small_step": 7.940872455947101e-05,
+    "strong_consistency": 0.005970559548586607
+  },
+  {
+    "step": 452,
+    "loss": 0.02164623700082302,
+    "drift": 0.012737415730953217,
+    "small_step": 0.0001676426618359983,
+    "strong_consistency": 0.009648099541664124
+  },
+  {
+    "step": 453,
+    "loss": 0.01588493213057518,
+    "drift": 0.01026997622102499,
+    "small_step": 0.00010045149247162044,
+    "strong_consistency": 0.0060732439160346985
+  },
+  {
+    "step": 454,
+    "loss": 0.02367212437093258,
+    "drift": 0.00949060171842575,
+    "small_step": 6.605626549571753e-05,
+    "strong_consistency": 0.01551150158047676
+  },
+  {
+    "step": 455,
+    "loss": 0.012938165105879307,
+    "drift": 0.0031451056711375713,
+    "small_step": 2.5884000933729112e-05,
+    "strong_consistency": 0.010709622874855995
+  },
+  {
+    "step": 456,
+    "loss": 0.009922033175826073,
+    "drift": 0.003992403857409954,
+    "small_step": 4.880326014244929e-05,
+    "strong_consistency": 0.006434164009988308
+  },
+  {
+    "step": 457,
+    "loss": 0.01579926908016205,
+    "drift": 0.003976854961365461,
+    "small_step": 4.44861470896285e-05,
+    "strong_consistency": 0.01285799965262413
+  },
+  {
+    "step": 458,
+    "loss": 0.014933718368411064,
+    "drift": 0.008667197078466415,
+    "small_step": 0.00010007555829361081,
+    "strong_consistency": 0.006717261858284473
+  },
+  {
+    "step": 459,
+    "loss": 0.016492478549480438,
+    "drift": 0.004185113590210676,
+    "small_step": 5.5294291087193415e-05,
+    "strong_consistency": 0.013317468576133251
+  },
+  {
+    "step": 460,
+    "loss": 0.0066633387468755245,
+    "drift": 0.0019405760103836656,
+    "small_step": 2.393344220763538e-05,
+    "strong_consistency": 0.005096344277262688
+  },
+  {
+    "step": 461,
+    "loss": 0.016387401148676872,
+    "drift": 0.0038126586005091667,
+    "small_step": 4.7982324758777395e-05,
+    "strong_consistency": 0.013557099737226963
+  },
+  {
+    "step": 462,
+    "loss": 0.014519356191158295,
+    "drift": 0.0043205032125115395,
+    "small_step": 5.7792727602645755e-05,
+    "strong_consistency": 0.010951468721032143
+  },
+  {
+    "step": 463,
+    "loss": 0.014085069298744202,
+    "drift": 0.004632019437849522,
+    "small_step": 5.026835060562007e-05,
+    "strong_consistency": 0.01013230811804533
+  },
+  {
+    "step": 464,
+    "loss": 0.012928641401231289,
+    "drift": 0.0036933047231286764,
+    "small_step": 3.906616984750144e-05,
+    "strong_consistency": 0.009888462722301483
+  },
+  {
+    "step": 465,
+    "loss": 0.017443303018808365,
+    "drift": 0.008527560159564018,
+    "small_step": 0.00010520410432945937,
+    "strong_consistency": 0.00945336651057005
+  },
+  {
+    "step": 466,
+    "loss": 0.01564115472137928,
+    "drift": 0.008145964704453945,
+    "small_step": 9.032402886077762e-05,
+    "strong_consistency": 0.007928121834993362
+  },
+  {
+    "step": 467,
+    "loss": 0.01433836854994297,
+    "drift": 0.005621651187539101,
+    "small_step": 5.854625123902224e-05,
+    "strong_consistency": 0.009250182658433914
+  },
+  {
+    "step": 468,
+    "loss": 0.0168440043926239,
+    "drift": 0.005732262507081032,
+    "small_step": 5.813712778035551e-05,
+    "strong_consistency": 0.011784225702285767
+  },
+  {
+    "step": 469,
+    "loss": 0.01925595849752426,
+    "drift": 0.0043528713285923,
+    "small_step": 6.261504313442856e-05,
+    "strong_consistency": 0.01578773558139801
+  },
+  {
+    "step": 470,
+    "loss": 0.013801655732095242,
+    "drift": 0.00335293123498559,
+    "small_step": 5.021447213948704e-05,
+    "strong_consistency": 0.011038757860660553
+  },
+  {
+    "step": 471,
+    "loss": 0.01138152927160263,
+    "drift": 0.003527186345309019,
+    "small_step": 5.32450940227136e-05,
+    "strong_consistency": 0.008263874799013138
+  },
+  {
+    "step": 472,
+    "loss": 0.007586635649204254,
+    "drift": 0.0027466705068945885,
+    "small_step": 2.280049739056267e-05,
+    "strong_consistency": 0.005092140287160873
+  },
+  {
+    "step": 473,
+    "loss": 0.011412076652050018,
+    "drift": 0.0031643493566662073,
+    "small_step": 3.88044718420133e-05,
+    "strong_consistency": 0.008659201674163342
+  },
+  {
+    "step": 474,
+    "loss": 0.015218100510537624,
+    "drift": 0.005802102852612734,
+    "small_step": 6.319897511275485e-05,
+    "strong_consistency": 0.009845050983130932
+  },
+  {
+    "step": 475,
+    "loss": 0.013858672231435776,
+    "drift": 0.0037111553829163313,
+    "small_step": 2.9590792109956965e-05,
+    "strong_consistency": 0.010628074407577515
+  },
+  {
+    "step": 476,
+    "loss": 0.015725338831543922,
+    "drift": 0.003442093264311552,
+    "small_step": 3.519314850564115e-05,
+    "strong_consistency": 0.012838630005717278
+  },
+  {
+    "step": 477,
+    "loss": 0.023412615060806274,
+    "drift": 0.0037802313454449177,
+    "small_step": 4.325621193856932e-05,
+    "strong_consistency": 0.020490720868110657
+  },
+  {
+    "step": 478,
+    "loss": 0.022015219554305077,
+    "drift": 0.008794457651674747,
+    "small_step": 6.854878301965073e-05,
+    "strong_consistency": 0.013728823512792587
+  },
+  {
+    "step": 479,
+    "loss": 0.011617351323366165,
+    "drift": 0.004055721685290337,
+    "small_step": 3.743302295333706e-05,
+    "strong_consistency": 0.007837704382836819
+  },
+  {
+    "step": 480,
+    "loss": 0.023510178551077843,
+    "drift": 0.0028522571083158255,
+    "small_step": 3.923478288925253e-05,
+    "strong_consistency": 0.021433144807815552
+  },
+  {
+    "step": 481,
+    "loss": 0.014633690938353539,
+    "drift": 0.0031644769478589296,
+    "small_step": 3.930342063540593e-05,
+    "strong_consistency": 0.011856753379106522
+  },
+  {
+    "step": 482,
+    "loss": 0.011175972409546375,
+    "drift": 0.002527194330468774,
+    "small_step": 4.445983358891681e-05,
+    "strong_consistency": 0.00890716165304184
+  },
+  {
+    "step": 483,
+    "loss": 0.013029368594288826,
+    "drift": 0.002934287069365382,
+    "small_step": 5.3750402003061026e-05,
+    "strong_consistency": 0.010373275727033615
+  },
+  {
+    "step": 484,
+    "loss": 0.018827585503458977,
+    "drift": 0.002377852099016309,
+    "small_step": 3.321592157590203e-05,
+    "strong_consistency": 0.016924245283007622
+  },
+  {
+    "step": 485,
+    "loss": 0.011910298839211464,
+    "drift": 0.004331649746745825,
+    "small_step": 5.176471677259542e-05,
+    "strong_consistency": 0.007743707858026028
+  },
+  {
+    "step": 486,
+    "loss": 0.00961883645504713,
+    "drift": 0.002478555543348193,
+    "small_step": 3.550154360709712e-05,
+    "strong_consistency": 0.007294435054063797
+  },
+  {
+    "step": 487,
+    "loss": 0.016295434907078743,
+    "drift": 0.0021150412503629923,
+    "small_step": 3.167535032844171e-05,
+    "strong_consistency": 0.014496637508273125
+  },
+  {
+    "step": 488,
+    "loss": 0.01724189519882202,
+    "drift": 0.0026132124476134777,
+    "small_step": 3.176012614858337e-05,
+    "strong_consistency": 0.014925278723239899
+  },
+  {
+    "step": 489,
+    "loss": 0.009605415165424347,
+    "drift": 0.002091572852805257,
+    "small_step": 1.8808723325491883e-05,
+    "strong_consistency": 0.007647993974387646
+  },
+  {
+    "step": 490,
+    "loss": 0.009275789372622967,
+    "drift": 0.0023812802974134684,
+    "small_step": 2.5398450816283002e-05,
+    "strong_consistency": 0.006995021365582943
+  },
+  {
+    "step": 491,
+    "loss": 0.015923256054520607,
+    "drift": 0.003193939570337534,
+    "small_step": 3.66365238733124e-05,
+    "strong_consistency": 0.01289906445890665
+  },
+  {
+    "step": 492,
+    "loss": 0.018173495307564735,
+    "drift": 0.0013067988911643624,
+    "small_step": 2.8583337552845478e-05,
+    "strong_consistency": 0.017077192664146423
+  },
+  {
+    "step": 493,
+    "loss": 0.013862984254956245,
+    "drift": 0.002490209648385644,
+    "small_step": 2.5589259166736156e-05,
+    "strong_consistency": 0.011485004797577858
+  },
+  {
+    "step": 494,
+    "loss": 0.012403336353600025,
+    "drift": 0.0008812503656372428,
+    "small_step": 2.091708120133262e-05,
+    "strong_consistency": 0.011617342010140419
+  },
+  {
+    "step": 495,
+    "loss": 0.015154499560594559,
+    "drift": 0.002836434170603752,
+    "small_step": 4.0632930904394016e-05,
+    "strong_consistency": 0.012376444414258003
+  },
+  {
+    "step": 496,
+    "loss": 0.018415840342640877,
+    "drift": 0.00761601235717535,
+    "small_step": 5.667208824888803e-05,
+    "strong_consistency": 0.010808004066348076
+  },
+  {
+    "step": 497,
+    "loss": 0.01777244545519352,
+    "drift": 0.004079279489815235,
+    "small_step": 4.880658525507897e-05,
+    "strong_consistency": 0.013699156232178211
+  },
+  {
+    "step": 498,
+    "loss": 0.013288989663124084,
+    "drift": 0.002902100794017315,
+    "small_step": 3.103566268691793e-05,
+    "strong_consistency": 0.01037660613656044
+  },
+  {
+    "step": 499,
+    "loss": 0.010922592133283615,
+    "drift": 0.0014792406000196934,
+    "small_step": 2.2789678041590378e-05,
+    "strong_consistency": 0.009420561604201794
+  },
+  {
+    "step": 500,
+    "loss": 0.01222749799489975,
+    "drift": 0.0028975289314985275,
+    "small_step": 3.144105357932858e-05,
+    "strong_consistency": 0.009298528544604778
+  },
+  {
+    "step": 501,
+    "loss": 0.015388666652143002,
+    "drift": 0.001563913538120687,
+    "small_step": 2.097343167406507e-05,
+    "strong_consistency": 0.01380378007888794
+  },
+  {
+    "step": 502,
+    "loss": 0.011413229629397392,
+    "drift": 0.002163008786737919,
+    "small_step": 4.013999568996951e-05,
+    "strong_consistency": 0.009210080839693546
+  },
+  {
+    "step": 503,
+    "loss": 0.0111202672123909,
+    "drift": 0.0024802961852401495,
+    "small_step": 4.504633761825971e-05,
+    "strong_consistency": 0.008594924584031105
+  },
+  {
+    "step": 504,
+    "loss": 0.012764852494001389,
+    "drift": 0.0028230343014001846,
+    "small_step": 2.9824217563145794e-05,
+    "strong_consistency": 0.009911993518471718
+  },
+  {
+    "step": 505,
+    "loss": 0.013118812814354897,
+    "drift": 0.0024564601480960846,
+    "small_step": 3.0151541068335064e-05,
+    "strong_consistency": 0.010632201097905636
+  },
+  {
+    "step": 506,
+    "loss": 0.008917220868170261,
+    "drift": 0.0025567554403096437,
+    "small_step": 3.1645296985516325e-05,
+    "strong_consistency": 0.006328819785267115
+  },
+  {
+    "step": 507,
+    "loss": 0.022866005077958107,
+    "drift": 0.008492049761116505,
+    "small_step": 0.00012828130275011063,
+    "strong_consistency": 0.014245674014091492
+  },
+  {
+    "step": 508,
+    "loss": 0.011762076057493687,
+    "drift": 0.000684625469148159,
+    "small_step": 1.7378701159032062e-05,
+    "strong_consistency": 0.011060072109103203
+  },
+  {
+    "step": 509,
+    "loss": 0.02169473096728325,
+    "drift": 0.003183715743944049,
+    "small_step": 3.764796565519646e-05,
+    "strong_consistency": 0.018473368138074875
+  },
+  {
+    "step": 510,
+    "loss": 0.010556265711784363,
+    "drift": 0.0022570444270968437,
+    "small_step": 2.6891244488069788e-05,
+    "strong_consistency": 0.008272330276668072
+  },
+  {
+    "step": 511,
+    "loss": 0.007761113811284304,
+    "drift": 0.0012709442526102066,
+    "small_step": 2.433581175864674e-05,
+    "strong_consistency": 0.006465833634138107
+  },
+  {
+    "step": 512,
+    "loss": 0.01704130508005619,
+    "drift": 0.0008027104777283967,
+    "small_step": 1.797539516701363e-05,
+    "strong_consistency": 0.016220619902014732
+  },
+  {
+    "step": 513,
+    "loss": 0.009008756838738918,
+    "drift": 0.001847833045758307,
+    "small_step": 2.6374164008302614e-05,
+    "strong_consistency": 0.007134549785405397
+  },
+  {
+    "step": 514,
+    "loss": 0.016764730215072632,
+    "drift": 0.00420128321275115,
+    "small_step": 4.326316047809087e-05,
+    "strong_consistency": 0.012520184740424156
+  },
+  {
+    "step": 515,
+    "loss": 0.013050012290477753,
+    "drift": 0.0010193816851824522,
+    "small_step": 2.1758269213023596e-05,
+    "strong_consistency": 0.01200887281447649
+  },
+  {
+    "step": 516,
+    "loss": 0.013433452695608139,
+    "drift": 0.0009766430594027042,
+    "small_step": 1.7245962226297706e-05,
+    "strong_consistency": 0.012439563870429993
+  },
+  {
+    "step": 517,
+    "loss": 0.016242321580648422,
+    "drift": 0.003725736401975155,
+    "small_step": 7.471902790712193e-05,
+    "strong_consistency": 0.012441866099834442
+  },
+  {
+    "step": 518,
+    "loss": 0.032851409167051315,
+    "drift": 0.0034043332561850548,
+    "small_step": 2.710735861910507e-05,
+    "strong_consistency": 0.029419967904686928
+  },
+  {
+    "step": 519,
+    "loss": 0.011942267417907715,
+    "drift": 0.002719317562878132,
+    "small_step": 3.945225398638286e-05,
+    "strong_consistency": 0.009183498099446297
+  },
+  {
+    "step": 520,
+    "loss": 0.019829852506518364,
+    "drift": 0.0026039606891572475,
+    "small_step": 2.853757905540988e-05,
+    "strong_consistency": 0.01719735376536846
+  },
+  {
+    "step": 521,
+    "loss": 0.009278982877731323,
+    "drift": 0.0007250766502693295,
+    "small_step": 2.1756759451818652e-05,
+    "strong_consistency": 0.008532149717211723
+  },
+  {
+    "step": 522,
+    "loss": 0.012561016716063023,
+    "drift": 0.0020096043590456247,
+    "small_step": 2.4635441150167026e-05,
+    "strong_consistency": 0.010526777245104313
+  },
+  {
+    "step": 523,
+    "loss": 0.014580153860151768,
+    "drift": 0.004504861775785685,
+    "small_step": 4.7885165258776397e-05,
+    "strong_consistency": 0.010027406737208366
+  },
+  {
+    "step": 524,
+    "loss": 0.005239173769950867,
+    "drift": 0.0012762335827574134,
+    "small_step": 1.8371543774264865e-05,
+    "strong_consistency": 0.0039445688016712666
+  },
+  {
+    "step": 525,
+    "loss": 0.01686934009194374,
+    "drift": 0.001985786249861121,
+    "small_step": 3.061163442907855e-05,
+    "strong_consistency": 0.01485294196754694
+  },
+  {
+    "step": 526,
+    "loss": 0.012150841765105724,
+    "drift": 0.0010569066507741809,
+    "small_step": 1.9705112208612263e-05,
+    "strong_consistency": 0.011074230074882507
+  },
+  {
+    "step": 527,
+    "loss": 0.014748141169548035,
+    "drift": 0.0050826952792704105,
+    "small_step": 5.703514034394175e-05,
+    "strong_consistency": 0.00960841029882431
+  },
+  {
+    "step": 528,
+    "loss": 0.0073301964439451694,
+    "drift": 0.0018377380911260843,
+    "small_step": 2.45651990553597e-05,
+    "strong_consistency": 0.005467893090099096
+  },
+  {
+    "step": 529,
+    "loss": 0.02153143845498562,
+    "drift": 0.0022417798172682524,
+    "small_step": 2.9405486202449538e-05,
+    "strong_consistency": 0.019260253757238388
+  },
+  {
+    "step": 530,
+    "loss": 0.01697763428092003,
+    "drift": 0.003223257139325142,
+    "small_step": 5.215394776314497e-05,
+    "strong_consistency": 0.01370222307741642
+  },
+  {
+    "step": 531,
+    "loss": 0.009018125012516975,
+    "drift": 0.0009113007108680904,
+    "small_step": 1.2297892681090161e-05,
+    "strong_consistency": 0.008094526827335358
+  },
+  {
+    "step": 532,
+    "loss": 0.015209268778562546,
+    "drift": 0.004155269358307123,
+    "small_step": 4.985939449397847e-05,
+    "strong_consistency": 0.011004139669239521
+  },
+  {
+    "step": 533,
+    "loss": 0.014480089768767357,
+    "drift": 0.001449216972105205,
+    "small_step": 1.9501123460941017e-05,
+    "strong_consistency": 0.013011371716856956
+  },
+  {
+    "step": 534,
+    "loss": 0.016181254759430885,
+    "drift": 0.002581797307357192,
+    "small_step": 3.229554204153828e-05,
+    "strong_consistency": 0.013567162677645683
+  },
+  {
+    "step": 535,
+    "loss": 0.012475010007619858,
+    "drift": 0.002372377086430788,
+    "small_step": 2.5144121536868624e-05,
+    "strong_consistency": 0.010077488608658314
+  },
+  {
+    "step": 536,
+    "loss": 0.014498010277748108,
+    "drift": 0.0011385763064026833,
+    "small_step": 2.173551547457464e-05,
+    "strong_consistency": 0.013337698765099049
+  },
+  {
+    "step": 537,
+    "loss": 0.01924007385969162,
+    "drift": 0.001139391795732081,
+    "small_step": 2.4063188902800903e-05,
+    "strong_consistency": 0.018076619133353233
+  },
+  {
+    "step": 538,
+    "loss": 0.011932460591197014,
+    "drift": 0.0011810073629021645,
+    "small_step": 1.5528574294876307e-05,
+    "strong_consistency": 0.010735924355685711
+  },
+  {
+    "step": 539,
+    "loss": 0.03845680505037308,
+    "drift": 0.002522661816328764,
+    "small_step": 2.82725795841543e-05,
+    "strong_consistency": 0.035905871540308
+  },
+  {
+    "step": 540,
+    "loss": 0.010945018380880356,
+    "drift": 0.0010688526090234518,
+    "small_step": 2.4375687644351274e-05,
+    "strong_consistency": 0.00985179003328085
+  },
+  {
+    "step": 541,
+    "loss": 0.01847217231988907,
+    "drift": 0.0013257649261504412,
+    "small_step": 1.9003198758582585e-05,
+    "strong_consistency": 0.017127403989434242
+  },
+  {
+    "step": 542,
+    "loss": 0.0066171493381261826,
+    "drift": 0.0016221910482272506,
+    "small_step": 2.6768480893224478e-05,
+    "strong_consistency": 0.004968189634382725
+  },
+  {
+    "step": 543,
+    "loss": 0.014291726984083652,
+    "drift": 0.0034130243584513664,
+    "small_step": 3.335642031743191e-05,
+    "strong_consistency": 0.010845346376299858
+  },
+  {
+    "step": 544,
+    "loss": 0.021241914480924606,
+    "drift": 0.0011557177640497684,
+    "small_step": 1.2442956176528241e-05,
+    "strong_consistency": 0.020073752850294113
+  },
+  {
+    "step": 545,
+    "loss": 0.006657828111201525,
+    "drift": 0.0005965012824162841,
+    "small_step": 1.8481114238966256e-05,
+    "strong_consistency": 0.006042845547199249
+  },
+  {
+    "step": 546,
+    "loss": 0.010801742784678936,
+    "drift": 0.0016186205903068185,
+    "small_step": 2.213906918768771e-05,
+    "strong_consistency": 0.009160983376204967
+  },
+  {
+    "step": 547,
+    "loss": 0.013452515937387943,
+    "drift": 0.0018890475621446967,
+    "small_step": 3.619634662754834e-05,
+    "strong_consistency": 0.011527271941304207
+  },
+  {
+    "step": 548,
+    "loss": 0.011671699583530426,
+    "drift": 0.0031930385157465935,
+    "small_step": 4.160450407653116e-05,
+    "strong_consistency": 0.008437056094408035
+  },
+  {
+    "step": 549,
+    "loss": 0.011707408353686333,
+    "drift": 0.0029599240515381098,
+    "small_step": 4.316673948778771e-05,
+    "strong_consistency": 0.00870431773364544
+  },
+  {
+    "step": 550,
+    "loss": 0.014422653242945671,
+    "drift": 0.0019426499493420124,
+    "small_step": 3.559146716725081e-05,
+    "strong_consistency": 0.01244441233575344
+  },
+  {
+    "step": 551,
+    "loss": 0.018490061163902283,
+    "drift": 0.001013507484458387,
+    "small_step": 2.5015027858898975e-05,
+    "strong_consistency": 0.017451537773013115
+  },
+  {
+    "step": 552,
+    "loss": 0.0044858274050056934,
+    "drift": 0.0009366554440930486,
+    "small_step": 1.98641064343974e-05,
+    "strong_consistency": 0.0035293076653033495
+  },
+  {
+    "step": 553,
+    "loss": 0.014297232031822205,
+    "drift": 0.0016563499812036753,
+    "small_step": 3.962611663155258e-05,
+    "strong_consistency": 0.012601255439221859
+  },
+  {
+    "step": 554,
+    "loss": 0.020481986925005913,
+    "drift": 0.003368677105754614,
+    "small_step": 4.706424078904092e-05,
+    "strong_consistency": 0.017066245898604393
+  },
+  {
+    "step": 555,
+    "loss": 0.009998885914683342,
+    "drift": 0.0017340084305033088,
+    "small_step": 2.8011138056172058e-05,
+    "strong_consistency": 0.008236866444349289
+  },
+  {
+    "step": 556,
+    "loss": 0.009821179322898388,
+    "drift": 0.0020657717250287533,
+    "small_step": 3.725832357304171e-05,
+    "strong_consistency": 0.007718149106949568
+  },
+  {
+    "step": 557,
+    "loss": 0.023358190432190895,
+    "drift": 0.0016510692657902837,
+    "small_step": 2.9605318559333682e-05,
+    "strong_consistency": 0.021677516400814056
+  },
+  {
+    "step": 558,
+    "loss": 0.0117653151974082,
+    "drift": 0.000989861087873578,
+    "small_step": 2.5034838472492993e-05,
+    "strong_consistency": 0.010750419460237026
+  },
+  {
+    "step": 559,
+    "loss": 0.01796909049153328,
+    "drift": 0.001677344087511301,
+    "small_step": 3.6878991522826254e-05,
+    "strong_consistency": 0.016254868358373642
+  },
+  {
+    "step": 560,
+    "loss": 0.02446357160806656,
+    "drift": 0.0008310067350976169,
+    "small_step": 2.1761356038041413e-05,
+    "strong_consistency": 0.023610804229974747
+  },
+  {
+    "step": 561,
+    "loss": 0.017735838890075684,
+    "drift": 0.0016522299265488982,
+    "small_step": 4.4933742174180225e-05,
+    "strong_consistency": 0.016038674861192703
+  },
+  {
+    "step": 562,
+    "loss": 0.017081551253795624,
+    "drift": 0.0013399871531873941,
+    "small_step": 2.7986383429379202e-05,
+    "strong_consistency": 0.015713578090071678
+  },
+  {
+    "step": 563,
+    "loss": 0.013445600867271423,
+    "drift": 0.0012994733406230807,
+    "small_step": 3.391734935576096e-05,
+    "strong_consistency": 0.012112210504710674
+  },
+  {
+    "step": 564,
+    "loss": 0.007333415560424328,
+    "drift": 0.0013333254028111696,
+    "small_step": 2.532747203076724e-05,
+    "strong_consistency": 0.005974762607365847
+  },
+  {
+    "step": 565,
+    "loss": 0.008988114073872566,
+    "drift": 0.001827889122068882,
+    "small_step": 2.531449354137294e-05,
+    "strong_consistency": 0.007134910207241774
+  },
+  {
+    "step": 566,
+    "loss": 0.02144373394548893,
+    "drift": 0.0012779138050973415,
+    "small_step": 2.2800762963015586e-05,
+    "strong_consistency": 0.020143019035458565
+  },
+  {
+    "step": 567,
+    "loss": 0.007723149843513966,
+    "drift": 0.0013116099871695042,
+    "small_step": 2.2044527213438414e-05,
+    "strong_consistency": 0.006389495451003313
+  },
+  {
+    "step": 568,
+    "loss": 0.008928243070840836,
+    "drift": 0.0013890645932406187,
+    "small_step": 2.335988392587751e-05,
+    "strong_consistency": 0.007515818811953068
+  },
+  {
+    "step": 569,
+    "loss": 0.009224804118275642,
+    "drift": 0.0004810923128388822,
+    "small_step": 1.6827900253701955e-05,
+    "strong_consistency": 0.008726883679628372
+  },
+  {
+    "step": 570,
+    "loss": 0.01702205464243889,
+    "drift": 0.0011192476376891136,
+    "small_step": 2.652439070516266e-05,
+    "strong_consistency": 0.01587628200650215
+  },
+  {
+    "step": 571,
+    "loss": 0.020095501095056534,
+    "drift": 0.0007167476578615606,
+    "small_step": 2.134053283953108e-05,
+    "strong_consistency": 0.019357413053512573
+  },
+  {
+    "step": 572,
+    "loss": 0.019417325034737587,
+    "drift": 0.0018171498086303473,
+    "small_step": 3.1599174690200016e-05,
+    "strong_consistency": 0.017568575218319893
+  },
+  {
+    "step": 573,
+    "loss": 0.01315495278686285,
+    "drift": 0.0005882288096472621,
+    "small_step": 1.6929150660871528e-05,
+    "strong_consistency": 0.01254979521036148
+  },
+  {
+    "step": 574,
+    "loss": 0.01921975612640381,
+    "drift": 0.0019481510389596224,
+    "small_step": 2.5131379516096786e-05,
+    "strong_consistency": 0.01724647358059883
+  },
+  {
+    "step": 575,
+    "loss": 0.010637027211487293,
+    "drift": 0.001788521301932633,
+    "small_step": 3.477091377135366e-05,
+    "strong_consistency": 0.008813735097646713
+  },
+  {
+    "step": 576,
+    "loss": 0.013621361926198006,
+    "drift": 0.000885327230207622,
+    "small_step": 1.8346483557252213e-05,
+    "strong_consistency": 0.012717688456177711
+  },
+  {
+    "step": 577,
+    "loss": 0.013570107519626617,
+    "drift": 0.0017371359281241894,
+    "small_step": 4.173924753558822e-05,
+    "strong_consistency": 0.011791232042014599
+  },
+  {
+    "step": 578,
+    "loss": 0.014276253059506416,
+    "drift": 0.0019894095603376627,
+    "small_step": 3.942200419260189e-05,
+    "strong_consistency": 0.012247421778738499
+  },
+  {
+    "step": 579,
+    "loss": 0.04552201181650162,
+    "drift": 0.0041363779455423355,
+    "small_step": 7.693120278418064e-05,
+    "strong_consistency": 0.041308701038360596
+  },
+  {
+    "step": 580,
+    "loss": 0.026590872555971146,
+    "drift": 0.0008527898462489247,
+    "small_step": 2.024690547841601e-05,
+    "strong_consistency": 0.025717835873365402
+  },
+  {
+    "step": 581,
+    "loss": 0.009735406376421452,
+    "drift": 0.001164937042631209,
+    "small_step": 2.3420232537318952e-05,
+    "strong_consistency": 0.008547049015760422
+  },
+  {
+    "step": 582,
+    "loss": 0.009347573854029179,
+    "drift": 0.001127630821429193,
+    "small_step": 2.1310863303369842e-05,
+    "strong_consistency": 0.008198631927371025
+  },
+  {
+    "step": 583,
+    "loss": 0.013900290243327618,
+    "drift": 0.0023349360562860966,
+    "small_step": 4.0353028452955186e-05,
+    "strong_consistency": 0.011525001376867294
+  },
+  {
+    "step": 584,
+    "loss": 0.019740574061870575,
+    "drift": 0.0011149424826726317,
+    "small_step": 2.287807183165569e-05,
+    "strong_consistency": 0.018602753058075905
+  },
+  {
+    "step": 585,
+    "loss": 0.017098519951105118,
+    "drift": 0.0007715211831964552,
+    "small_step": 1.2619719200301915e-05,
+    "strong_consistency": 0.01631437987089157
+  },
+  {
+    "step": 586,
+    "loss": 0.013106063939630985,
+    "drift": 0.001701858127489686,
+    "small_step": 3.752612610696815e-05,
+    "strong_consistency": 0.011366679333150387
+  },
+  {
+    "step": 587,
+    "loss": 0.014170662499964237,
+    "drift": 0.0015763011761009693,
+    "small_step": 4.53364773420617e-05,
+    "strong_consistency": 0.012549025006592274
+  },
+  {
+    "step": 588,
+    "loss": 0.011581115424633026,
+    "drift": 0.0022813885007053614,
+    "small_step": 4.236691529513337e-05,
+    "strong_consistency": 0.009257360361516476
+  },
+  {
+    "step": 589,
+    "loss": 0.014164605177938938,
+    "drift": 0.0008454978233203292,
+    "small_step": 2.4191329430323094e-05,
+    "strong_consistency": 0.013294915668666363
+  },
+  {
+    "step": 590,
+    "loss": 0.013825669884681702,
+    "drift": 0.0015494134277105331,
+    "small_step": 2.0035608031321317e-05,
+    "strong_consistency": 0.012256220914423466
+  },
+  {
+    "step": 591,
+    "loss": 0.013499709777534008,
+    "drift": 0.001577043323777616,
+    "small_step": 2.2900989279150963e-05,
+    "strong_consistency": 0.011899765580892563
+  },
+  {
+    "step": 592,
+    "loss": 0.02278253063559532,
+    "drift": 0.000873829354532063,
+    "small_step": 1.8600441762828268e-05,
+    "strong_consistency": 0.021890100091695786
+  },
+  {
+    "step": 593,
+    "loss": 0.010164657607674599,
+    "drift": 0.003026396967470646,
+    "small_step": 4.719163916888647e-05,
+    "strong_consistency": 0.007091068662703037
+  },
+  {
+    "step": 594,
+    "loss": 0.012930835597217083,
+    "drift": 0.0011009707814082503,
+    "small_step": 2.4972126993816346e-05,
+    "strong_consistency": 0.011804892681539059
+  },
+  {
+    "step": 595,
+    "loss": 0.01849663257598877,
+    "drift": 0.0036752286832779646,
+    "small_step": 4.7609682951588184e-05,
+    "strong_consistency": 0.014773793518543243
+  },
+  {
+    "step": 596,
+    "loss": 0.008057674393057823,
+    "drift": 0.0005354873719625175,
+    "small_step": 2.3529340978711843e-05,
+    "strong_consistency": 0.007498657330870628
+  },
+  {
+    "step": 597,
+    "loss": 0.01540551707148552,
+    "drift": 0.0013818928273394704,
+    "small_step": 2.6549872927716933e-05,
+    "strong_consistency": 0.013997074216604233
+  },
+  {
+    "step": 598,
+    "loss": 0.014533168636262417,
+    "drift": 0.0008046558359637856,
+    "small_step": 2.578710700618103e-05,
+    "strong_consistency": 0.013702725991606712
+  },
+  {
+    "step": 599,
+    "loss": 0.023209096863865852,
+    "drift": 0.0015941740712150931,
+    "small_step": 3.0459788831649348e-05,
+    "strong_consistency": 0.021584462374448776
+  },
+  {
+    "step": 600,
+    "loss": 0.021629933267831802,
+    "drift": 0.001384982606396079,
+    "small_step": 2.9733018891420215e-05,
+    "strong_consistency": 0.020215217024087906
+  },
+  {
+    "step": 601,
+    "loss": 0.022567974403500557,
+    "drift": 0.0013736034743487835,
+    "small_step": 3.6306140827946365e-05,
+    "strong_consistency": 0.021158065646886826
+  },
+  {
+    "step": 602,
+    "loss": 0.01775219663977623,
+    "drift": 0.0011382171651348472,
+    "small_step": 1.653125582379289e-05,
+    "strong_consistency": 0.01659744791686535
+  },
+  {
+    "step": 603,
+    "loss": 0.01783081889152527,
+    "drift": 0.0005414531915448606,
+    "small_step": 1.5615562006132677e-05,
+    "strong_consistency": 0.01727375015616417
+  },
+  {
+    "step": 604,
+    "loss": 0.014303985983133316,
+    "drift": 0.0011948361061513424,
+    "small_step": 2.0501442122622393e-05,
+    "strong_consistency": 0.013088648207485676
+  },
+  {
+    "step": 605,
+    "loss": 0.01706758141517639,
+    "drift": 0.0023479170631617308,
+    "small_step": 3.2532534532947466e-05,
+    "strong_consistency": 0.014687132090330124
+  },
+  {
+    "step": 606,
+    "loss": 0.007832079194486141,
+    "drift": 0.0014981564600020647,
+    "small_step": 3.30630864482373e-05,
+    "strong_consistency": 0.006300859618932009
+  },
+  {
+    "step": 607,
+    "loss": 0.012488966807723045,
+    "drift": 0.0004959943471476436,
+    "small_step": 2.480118018866051e-05,
+    "strong_consistency": 0.01196817122399807
+  },
+  {
+    "step": 608,
+    "loss": 0.011526955291628838,
+    "drift": 0.002335046185180545,
+    "small_step": 4.2260617192368954e-05,
+    "strong_consistency": 0.009149648249149323
+  },
+  {
+    "step": 609,
+    "loss": 0.014425136148929596,
+    "drift": 0.000974826340097934,
+    "small_step": 1.6629128367640078e-05,
+    "strong_consistency": 0.01343368086963892
+  },
+  {
+    "step": 610,
+    "loss": 0.04000232368707657,
+    "drift": 0.0019123335368931293,
+    "small_step": 2.3949412934598513e-05,
+    "strong_consistency": 0.038066040724515915
+  },
+  {
+    "step": 611,
+    "loss": 0.00781526230275631,
+    "drift": 0.0006079755257815123,
+    "small_step": 1.958478787855711e-05,
+    "strong_consistency": 0.007187701761722565
+  },
+  {
+    "step": 612,
+    "loss": 0.011451750993728638,
+    "drift": 0.0021515213884413242,
+    "small_step": 2.91818032565061e-05,
+    "strong_consistency": 0.0092710480093956
+  },
+  {
+    "step": 613,
+    "loss": 0.010672364383935928,
+    "drift": 0.0005500719998963177,
+    "small_step": 1.8245384126203135e-05,
+    "strong_consistency": 0.010104047134518623
+  },
+  {
+    "step": 614,
+    "loss": 0.013780140317976475,
+    "drift": 0.0006967626977711916,
+    "small_step": 2.7200387194170617e-05,
+    "strong_consistency": 0.013056177645921707
+  },
+  {
+    "step": 615,
+    "loss": 0.01912306249141693,
+    "drift": 0.0006852851365692914,
+    "small_step": 2.078724719467573e-05,
+    "strong_consistency": 0.018416989594697952
+  },
+  {
+    "step": 616,
+    "loss": 0.013945688493549824,
+    "drift": 0.0008585709147155285,
+    "small_step": 2.4896889954106882e-05,
+    "strong_consistency": 0.013062220998108387
+  },
+  {
+    "step": 617,
+    "loss": 0.010449227876961231,
+    "drift": 0.0007400423637591302,
+    "small_step": 3.3465657907072455e-05,
+    "strong_consistency": 0.009675719775259495
+  },
+  {
+    "step": 618,
+    "loss": 0.01567094773054123,
+    "drift": 0.0005934844375588,
+    "small_step": 1.834954491641838e-05,
+    "strong_consistency": 0.015059114433825016
+  },
+  {
+    "step": 619,
+    "loss": 0.026731746271252632,
+    "drift": 0.0007709097699262202,
+    "small_step": 2.9778468160657212e-05,
+    "strong_consistency": 0.025931058451533318
+  },
+  {
+    "step": 620,
+    "loss": 0.009410571306943893,
+    "drift": 0.0008718422031961381,
+    "small_step": 3.0139512091409415e-05,
+    "strong_consistency": 0.008508590050041676
+  },
+  {
+    "step": 621,
+    "loss": 0.008657571859657764,
+    "drift": 0.0007771987584419549,
+    "small_step": 2.9452658054651693e-05,
+    "strong_consistency": 0.007850920781493187
+  },
+  {
+    "step": 622,
+    "loss": 0.016800783574581146,
+    "drift": 0.0012043158058077097,
+    "small_step": 2.190234044974204e-05,
+    "strong_consistency": 0.015574566088616848
+  },
+  {
+    "step": 623,
+    "loss": 0.01115453615784645,
+    "drift": 0.0006154995644465089,
+    "small_step": 1.94713611563202e-05,
+    "strong_consistency": 0.01051956508308649
+  },
+  {
+    "step": 624,
+    "loss": 0.013380376622080803,
+    "drift": 0.0016873781569302082,
+    "small_step": 3.8945752748986706e-05,
+    "strong_consistency": 0.011654052883386612
+  },
+  {
+    "step": 625,
+    "loss": 0.017969656735658646,
+    "drift": 0.0005439689848572016,
+    "small_step": 2.711481647565961e-05,
+    "strong_consistency": 0.017398573458194733
+  },
+  {
+    "step": 626,
+    "loss": 0.013952534645795822,
+    "drift": 0.00022815237753093243,
+    "small_step": 1.840761979110539e-05,
+    "strong_consistency": 0.013705974444746971
+  },
+  {
+    "step": 627,
+    "loss": 0.018290147185325623,
+    "drift": 0.0008294633589684963,
+    "small_step": 1.794138916011434e-05,
+    "strong_consistency": 0.017442742362618446
+  },
+  {
+    "step": 628,
+    "loss": 0.012109963223338127,
+    "drift": 0.0006975036230869591,
+    "small_step": 3.283096521045081e-05,
+    "strong_consistency": 0.01137962844222784
+  },
+  {
+    "step": 629,
+    "loss": 0.01898733340203762,
+    "drift": 0.0010699197882786393,
+    "small_step": 1.3566786947194487e-05,
+    "strong_consistency": 0.017903847619891167
+  },
+  {
+    "step": 630,
+    "loss": 0.015035595744848251,
+    "drift": 0.0005957836401648819,
+    "small_step": 3.238071076339111e-05,
+    "strong_consistency": 0.014407431706786156
+  },
+  {
+    "step": 631,
+    "loss": 0.012857832945883274,
+    "drift": 0.001400171546265483,
+    "small_step": 2.4821523766149767e-05,
+    "strong_consistency": 0.011432839557528496
+  },
+  {
+    "step": 632,
+    "loss": 0.01636882871389389,
+    "drift": 0.0013548387214541435,
+    "small_step": 2.8114925953559577e-05,
+    "strong_consistency": 0.01498587429523468
+  },
+  {
+    "step": 633,
+    "loss": 0.013821274042129517,
+    "drift": 0.00037664498086087406,
+    "small_step": 1.751353011059109e-05,
+    "strong_consistency": 0.013427115976810455
+  },
+  {
+    "step": 634,
+    "loss": 0.021018117666244507,
+    "drift": 0.00045605580089613795,
+    "small_step": 1.8776980141410604e-05,
+    "strong_consistency": 0.020543284714221954
+  },
+  {
+    "step": 635,
+    "loss": 0.010132282972335815,
+    "drift": 0.0006512896507047117,
+    "small_step": 2.449407838867046e-05,
+    "strong_consistency": 0.009456499479711056
+  },
+  {
+    "step": 636,
+    "loss": 0.01896289549767971,
+    "drift": 0.001549242646433413,
+    "small_step": 3.7923091440461576e-05,
+    "strong_consistency": 0.017375729978084564
+  },
+  {
+    "step": 637,
+    "loss": 0.012130307033658028,
+    "drift": 0.0009968442609533668,
+    "small_step": 2.8483840651460923e-05,
+    "strong_consistency": 0.011104978621006012
+  },
+  {
+    "step": 638,
+    "loss": 0.014391381293535233,
+    "drift": 0.0004815146094188094,
+    "small_step": 2.4451970602967776e-05,
+    "strong_consistency": 0.013885414227843285
+  },
+  {
+    "step": 639,
+    "loss": 0.010524658486247063,
+    "drift": 0.000470499275252223,
+    "small_step": 2.4998706066980958e-05,
+    "strong_consistency": 0.010029160417616367
+  },
+  {
+    "step": 640,
+    "loss": 0.013844908215105534,
+    "drift": 0.0010116577614098787,
+    "small_step": 2.7990103262709454e-05,
+    "strong_consistency": 0.012805260717868805
+  },
+  {
+    "step": 641,
+    "loss": 0.021047299727797508,
+    "drift": 0.0007278943667188287,
+    "small_step": 3.9490470953751355e-05,
+    "strong_consistency": 0.020279914140701294
+  },
+  {
+    "step": 642,
+    "loss": 0.02882636897265911,
+    "drift": 0.004043979104608297,
+    "small_step": 9.738713561091572e-05,
+    "strong_consistency": 0.024685002863407135
+  },
+  {
+    "step": 643,
+    "loss": 0.024799223989248276,
+    "drift": 0.0005072102067060769,
+    "small_step": 1.4884662050462794e-05,
+    "strong_consistency": 0.024277128279209137
+  },
+  {
+    "step": 644,
+    "loss": 0.014138460159301758,
+    "drift": 0.0006370138144120574,
+    "small_step": 2.963192673632875e-05,
+    "strong_consistency": 0.013471814803779125
+  },
+  {
+    "step": 645,
+    "loss": 0.038334235548973083,
+    "drift": 0.0026358431205153465,
+    "small_step": 4.916165562462993e-05,
+    "strong_consistency": 0.03564922884106636
+  },
+  {
+    "step": 646,
+    "loss": 0.016172396019101143,
+    "drift": 0.0006930330418981612,
+    "small_step": 2.5256553271901794e-05,
+    "strong_consistency": 0.015454106032848358
+  },
+  {
+    "step": 647,
+    "loss": 0.018257025629281998,
+    "drift": 0.0009526537614874542,
+    "small_step": 2.724021214817185e-05,
+    "strong_consistency": 0.017277130857110023
+  },
+  {
+    "step": 648,
+    "loss": 0.0104975625872612,
+    "drift": 0.0016075191088020802,
+    "small_step": 4.585922579281032e-05,
+    "strong_consistency": 0.008844183757901192
+  },
+  {
+    "step": 649,
+    "loss": 0.027390865609049797,
+    "drift": 0.00027986973873339593,
+    "small_step": 2.3340904590440914e-05,
+    "strong_consistency": 0.027087654918432236
+  },
+  {
+    "step": 650,
+    "loss": 0.01624157465994358,
+    "drift": 0.0009784819558262825,
+    "small_step": 4.4182488636579365e-05,
+    "strong_consistency": 0.01521891076117754
+  },
+  {
+    "step": 651,
+    "loss": 0.020925864577293396,
+    "drift": 0.00037521286867558956,
+    "small_step": 9.011973816086538e-06,
+    "strong_consistency": 0.020541639998555183
+  },
+  {
+    "step": 652,
+    "loss": 0.04221720993518829,
+    "drift": 0.0010582590475678444,
+    "small_step": 1.5594621800119057e-05,
+    "strong_consistency": 0.04114335775375366
+  },
+  {
+    "step": 653,
+    "loss": 0.01291417796164751,
+    "drift": 0.0007924840901978314,
+    "small_step": 2.8938182367710397e-05,
+    "strong_consistency": 0.012092756107449532
+  },
+  {
+    "step": 654,
+    "loss": 0.026377933099865913,
+    "drift": 0.0005388821591623127,
+    "small_step": 2.1258380002109334e-05,
+    "strong_consistency": 0.025817792862653732
+  },
+  {
+    "step": 655,
+    "loss": 0.01989908143877983,
+    "drift": 0.0009037331328727305,
+    "small_step": 2.9521610485971905e-05,
+    "strong_consistency": 0.0189658273011446
+  },
+  {
+    "step": 656,
+    "loss": 0.01658940315246582,
+    "drift": 0.0012975833378732204,
+    "small_step": 3.656053013401106e-05,
+    "strong_consistency": 0.015255259349942207
+  },
+  {
+    "step": 657,
+    "loss": 0.01859080232679844,
+    "drift": 0.00086337944958359,
+    "small_step": 4.159551463089883e-05,
+    "strong_consistency": 0.017685826867818832
+  },
+  {
+    "step": 658,
+    "loss": 0.03525426238775253,
+    "drift": 0.0008866612915880978,
+    "small_step": 2.5382596504641697e-05,
+    "strong_consistency": 0.034342218190431595
+  },
+  {
+    "step": 659,
+    "loss": 0.015796195715665817,
+    "drift": 0.0007837431621737778,
+    "small_step": 2.474309440003708e-05,
+    "strong_consistency": 0.014987709932029247
+  },
+  {
+    "step": 660,
+    "loss": 0.01695978455245495,
+    "drift": 0.0015712311724200845,
+    "small_step": 5.162804154679179e-05,
+    "strong_consistency": 0.015336926095187664
+  },
+  {
+    "step": 661,
+    "loss": 0.017932604998350143,
+    "drift": 0.0005253713461570442,
+    "small_step": 2.6267884095432237e-05,
+    "strong_consistency": 0.017380965873599052
+  },
+  {
+    "step": 662,
+    "loss": 0.019626453518867493,
+    "drift": 0.0005897992523387074,
+    "small_step": 2.9671235097339377e-05,
+    "strong_consistency": 0.019006982445716858
+  },
+  {
+    "step": 663,
+    "loss": 0.013311546295881271,
+    "drift": 0.0008393035386689007,
+    "small_step": 3.1412178941536695e-05,
+    "strong_consistency": 0.01244083046913147
+  },
+  {
+    "step": 664,
+    "loss": 0.026844479143619537,
+    "drift": 0.0003455010009929538,
+    "small_step": 2.7099707949673757e-05,
+    "strong_consistency": 0.026471879333257675
+  },
+  {
+    "step": 665,
+    "loss": 0.012610561214387417,
+    "drift": 0.0006082950858399272,
+    "small_step": 2.0712413970613852e-05,
+    "strong_consistency": 0.01198155339807272
+  },
+  {
+    "step": 666,
+    "loss": 0.012867213226854801,
+    "drift": 0.0006983057828620076,
+    "small_step": 3.877195194945671e-05,
+    "strong_consistency": 0.012130135670304298
+  },
+  {
+    "step": 667,
+    "loss": 0.043639179319143295,
+    "drift": 0.00033238783362321556,
+    "small_step": 3.777066376642324e-05,
+    "strong_consistency": 0.043269019573926926
+  },
+  {
+    "step": 668,
+    "loss": 0.021026281639933586,
+    "drift": 0.00043203620589338243,
+    "small_step": 2.5240800823667087e-05,
+    "strong_consistency": 0.020569004118442535
+  },
+  {
+    "step": 669,
+    "loss": 0.03284527361392975,
+    "drift": 0.001907395082525909,
+    "small_step": 6.027254858054221e-05,
+    "strong_consistency": 0.030877606943249702
+  },
+  {
+    "step": 670,
+    "loss": 0.01683991029858589,
+    "drift": 0.0009548522066324949,
+    "small_step": 4.35687143180985e-05,
+    "strong_consistency": 0.015841489657759666
+  },
+  {
+    "step": 671,
+    "loss": 0.0177915096282959,
+    "drift": 0.0005040559335611761,
+    "small_step": 3.447177732596174e-05,
+    "strong_consistency": 0.017252981662750244
+  },
+  {
+    "step": 672,
+    "loss": 0.016402065753936768,
+    "drift": 0.0005417882930487394,
+    "small_step": 2.646085704327561e-05,
+    "strong_consistency": 0.015833817422389984
+  },
+  {
+    "step": 673,
+    "loss": 0.014639873057603836,
+    "drift": 0.0008254582644440234,
+    "small_step": 3.027108141395729e-05,
+    "strong_consistency": 0.013784144073724747
+  },
+  {
+    "step": 674,
+    "loss": 0.009293155744671822,
+    "drift": 0.0007451174315065145,
+    "small_step": 3.749523966689594e-05,
+    "strong_consistency": 0.008510543033480644
+  },
+  {
+    "step": 675,
+    "loss": 0.020790332928299904,
+    "drift": 0.0015291160671040416,
+    "small_step": 2.365556065342389e-05,
+    "strong_consistency": 0.019237561151385307
+  },
+  {
+    "step": 676,
+    "loss": 0.028421644121408463,
+    "drift": 0.0007297618431039155,
+    "small_step": 2.2168944269651547e-05,
+    "strong_consistency": 0.027669712901115417
+  },
+  {
+    "step": 677,
+    "loss": 0.012514044530689716,
+    "drift": 0.0006924348999746144,
+    "small_step": 3.8821854104753584e-05,
+    "strong_consistency": 0.01178278774023056
+  },
+  {
+    "step": 678,
+    "loss": 0.024963874369859695,
+    "drift": 0.000599833088926971,
+    "small_step": 3.363944051670842e-05,
+    "strong_consistency": 0.02433040179312229
+  },
+  {
+    "step": 679,
+    "loss": 0.020048290491104126,
+    "drift": 0.0010546052362769842,
+    "small_step": 3.8177076930878684e-05,
+    "strong_consistency": 0.01895550824701786
+  },
+  {
+    "step": 680,
+    "loss": 0.02896970510482788,
+    "drift": 0.0005427920259535313,
+    "small_step": 3.531448237481527e-05,
+    "strong_consistency": 0.028391597792506218
+  },
+  {
+    "step": 681,
+    "loss": 0.0226423479616642,
+    "drift": 0.0006956345168873668,
+    "small_step": 4.471011197892949e-05,
+    "strong_consistency": 0.02190200239419937
+  },
+  {
+    "step": 682,
+    "loss": 0.025610584765672684,
+    "drift": 0.0006983035709708929,
+    "small_step": 2.712733839871362e-05,
+    "strong_consistency": 0.024885153397917747
+  },
+  {
+    "step": 683,
+    "loss": 0.03401873633265495,
+    "drift": 0.00040242786053568125,
+    "small_step": 3.450395161053166e-05,
+    "strong_consistency": 0.03358180448412895
+  },
+  {
+    "step": 684,
+    "loss": 0.02677866443991661,
+    "drift": 0.000518142303917557,
+    "small_step": 2.587000017229002e-05,
+    "strong_consistency": 0.02623465284705162
+  },
+  {
+    "step": 685,
+    "loss": 0.031973786652088165,
+    "drift": 0.0010471927234902978,
+    "small_step": 4.4580589019460604e-05,
+    "strong_consistency": 0.030882013961672783
+  },
+  {
+    "step": 686,
+    "loss": 0.026127949357032776,
+    "drift": 0.00033625538344495,
+    "small_step": 2.5542001822032034e-05,
+    "strong_consistency": 0.025766151025891304
+  },
+  {
+    "step": 687,
+    "loss": 0.013473964296281338,
+    "drift": 0.0004398535820655525,
+    "small_step": 2.4977352950372733e-05,
+    "strong_consistency": 0.013009133748710155
+  },
+  {
+    "step": 688,
+    "loss": 0.012871028855443,
+    "drift": 0.0013400373281911016,
+    "small_step": 2.394456896581687e-05,
+    "strong_consistency": 0.011507047340273857
+  },
+  {
+    "step": 689,
+    "loss": 0.017419198527932167,
+    "drift": 0.0010365403722971678,
+    "small_step": 2.059651342278812e-05,
+    "strong_consistency": 0.016362061724066734
+  },
+  {
+    "step": 690,
+    "loss": 0.014409814029932022,
+    "drift": 0.0007893795846030116,
+    "small_step": 2.863910049200058e-05,
+    "strong_consistency": 0.013591795228421688
+  },
+  {
+    "step": 691,
+    "loss": 0.02128221094608307,
+    "drift": 0.0004321209853515029,
+    "small_step": 1.9400988094275817e-05,
+    "strong_consistency": 0.020830688998103142
+  },
+  {
+    "step": 692,
+    "loss": 0.028557520359754562,
+    "drift": 0.0003817151882685721,
+    "small_step": 2.2924665245227516e-05,
+    "strong_consistency": 0.02815288119018078
+  },
+  {
+    "step": 693,
+    "loss": 0.026183001697063446,
+    "drift": 0.0006255159387364984,
+    "small_step": 4.256704414729029e-05,
+    "strong_consistency": 0.025514919310808182
+  },
+  {
+    "step": 694,
+    "loss": 0.02548067830502987,
+    "drift": 0.0012825399171561003,
+    "small_step": 4.2819057853193954e-05,
+    "strong_consistency": 0.02415531873703003
+  },
+  {
+    "step": 695,
+    "loss": 0.017081283032894135,
+    "drift": 0.0005249675596132874,
+    "small_step": 2.2461081243818626e-05,
+    "strong_consistency": 0.016533855348825455
+  },
+  {
+    "step": 696,
+    "loss": 0.018923984840512276,
+    "drift": 0.0006040621665306389,
+    "small_step": 4.147141953581013e-05,
+    "strong_consistency": 0.0182784516364336
+  },
+  {
+    "step": 697,
+    "loss": 0.02036922797560692,
+    "drift": 0.0008038061787374318,
+    "small_step": 3.5260374716017395e-05,
+    "strong_consistency": 0.01953016221523285
+  },
+  {
+    "step": 698,
+    "loss": 0.019018061459064484,
+    "drift": 0.0005574245005846024,
+    "small_step": 2.2148886273498647e-05,
+    "strong_consistency": 0.018438488245010376
+  },
+  {
+    "step": 699,
+    "loss": 0.023703739047050476,
+    "drift": 0.0006002478185109794,
+    "small_step": 3.1598563509760424e-05,
+    "strong_consistency": 0.02307189255952835
+  },
+  {
+    "step": 700,
+    "loss": 0.019605455920100212,
+    "drift": 0.0005774994497187436,
+    "small_step": 3.4463864722056314e-05,
+    "strong_consistency": 0.018993493169546127
+  },
+  {
+    "step": 701,
+    "loss": 0.031678736209869385,
+    "drift": 0.0009081161115318537,
+    "small_step": 3.113885031780228e-05,
+    "strong_consistency": 0.03073948062956333
+  },
+  {
+    "step": 702,
+    "loss": 0.02046262100338936,
+    "drift": 0.000703730620443821,
+    "small_step": 3.502540130284615e-05,
+    "strong_consistency": 0.019723864272236824
+  },
+  {
+    "step": 703,
+    "loss": 0.017148414626717567,
+    "drift": 0.0005390758742578328,
+    "small_step": 2.6570711270323955e-05,
+    "strong_consistency": 0.01658276841044426
+  },
+  {
+    "step": 704,
+    "loss": 0.009519176557660103,
+    "drift": 0.0004787870275322348,
+    "small_step": 3.7119963963050395e-05,
+    "strong_consistency": 0.009003269486129284
+  },
+  {
+    "step": 705,
+    "loss": 0.020111896097660065,
+    "drift": 0.0006341615226119757,
+    "small_step": 2.7887792384717613e-05,
+    "strong_consistency": 0.01944984681904316
+  },
+  {
+    "step": 706,
+    "loss": 0.02267085760831833,
+    "drift": 0.001490466995164752,
+    "small_step": 2.296908678545151e-05,
+    "strong_consistency": 0.02115742117166519
+  },
+  {
+    "step": 707,
+    "loss": 0.021414143964648247,
+    "drift": 0.001085486263036728,
+    "small_step": 3.712849866133183e-05,
+    "strong_consistency": 0.020291529595851898
+  },
+  {
+    "step": 708,
+    "loss": 0.012914562597870827,
+    "drift": 0.00035686109913513064,
+    "small_step": 1.9944298401242122e-05,
+    "strong_consistency": 0.012537756934762001
+  },
+  {
+    "step": 709,
+    "loss": 0.02695252001285553,
+    "drift": 0.001561253797262907,
+    "small_step": 5.5756387155270204e-05,
+    "strong_consistency": 0.025335509330034256
+  },
+  {
+    "step": 710,
+    "loss": 0.02703767642378807,
+    "drift": 0.0005490147741511464,
+    "small_step": 2.3278509615920484e-05,
+    "strong_consistency": 0.026465382426977158
+  },
+  {
+    "step": 711,
+    "loss": 0.0242186076939106,
+    "drift": 0.000443017779616639,
+    "small_step": 2.8456719519454055e-05,
+    "strong_consistency": 0.02374713309109211
+  },
+  {
+    "step": 712,
+    "loss": 0.013259791769087315,
+    "drift": 0.0010334663093090057,
+    "small_step": 4.008314135717228e-05,
+    "strong_consistency": 0.012186242267489433
+  },
+  {
+    "step": 713,
+    "loss": 0.02071203477680683,
+    "drift": 0.0007484544184990227,
+    "small_step": 2.764509554253891e-05,
+    "strong_consistency": 0.019935935735702515
+  },
+  {
+    "step": 714,
+    "loss": 0.03762554004788399,
+    "drift": 0.0009794285288080573,
+    "small_step": 4.192390770185739e-05,
+    "strong_consistency": 0.03660418838262558
+  },
+  {
+    "step": 715,
+    "loss": 0.05121247470378876,
+    "drift": 0.0005825245752930641,
+    "small_step": 2.4988197765196674e-05,
+    "strong_consistency": 0.050604961812496185
+  },
+  {
+    "step": 716,
+    "loss": 0.03842851519584656,
+    "drift": 0.0006969435489736497,
+    "small_step": 2.972668153233826e-05,
+    "strong_consistency": 0.03770184516906738
+  },
+  {
+    "step": 717,
+    "loss": 0.010877090506255627,
+    "drift": 0.0009340199758298695,
+    "small_step": 3.6439974792301655e-05,
+    "strong_consistency": 0.009906630963087082
+  },
+  {
+    "step": 718,
+    "loss": 0.016652559861540794,
+    "drift": 0.0005617093411274254,
+    "small_step": 3.216174081899226e-05,
+    "strong_consistency": 0.01605868898332119
+  },
+  {
+    "step": 719,
+    "loss": 0.012186874635517597,
+    "drift": 0.0009059828007593751,
+    "small_step": 3.046635538339615e-05,
+    "strong_consistency": 0.01125042513012886
+  },
+  {
+    "step": 720,
+    "loss": 0.012805942445993423,
+    "drift": 0.00035395807935856283,
+    "small_step": 2.952148497570306e-05,
+    "strong_consistency": 0.012422462925314903
+  },
+  {
+    "step": 721,
+    "loss": 0.02061343751847744,
+    "drift": 0.0008464830461889505,
+    "small_step": 3.874861795338802e-05,
+    "strong_consistency": 0.01972820609807968
+  },
+  {
+    "step": 722,
+    "loss": 0.013042493723332882,
+    "drift": 0.0014224349288269877,
+    "small_step": 3.2709423976484686e-05,
+    "strong_consistency": 0.011587349697947502
+  },
+  {
+    "step": 723,
+    "loss": 0.02410736493766308,
+    "drift": 0.0017273182747885585,
+    "small_step": 4.585732676787302e-05,
+    "strong_consistency": 0.02233419008553028
+  },
+  {
+    "step": 724,
+    "loss": 0.02344592474400997,
+    "drift": 0.0008205518242903054,
+    "small_step": 4.8434711061418056e-05,
+    "strong_consistency": 0.022576937451958656
+  },
+  {
+    "step": 725,
+    "loss": 0.015005113556981087,
+    "drift": 0.0007322534802369773,
+    "small_step": 3.790518530877307e-05,
+    "strong_consistency": 0.014234954491257668
+  },
+  {
+    "step": 726,
+    "loss": 0.011762253008782864,
+    "drift": 0.00030501847504638135,
+    "small_step": 3.283396290498786e-05,
+    "strong_consistency": 0.011424400843679905
+  },
+  {
+    "step": 727,
+    "loss": 0.03349393606185913,
+    "drift": 0.001119732391089201,
+    "small_step": 3.536114309099503e-05,
+    "strong_consistency": 0.03233884274959564
+  },
+  {
+    "step": 728,
+    "loss": 0.01228026021271944,
+    "drift": 0.0009985448559746146,
+    "small_step": 3.8656220567645505e-05,
+    "strong_consistency": 0.011243059299886227
+  },
+  {
+    "step": 729,
+    "loss": 0.03582943230867386,
+    "drift": 0.0005066777230240405,
+    "small_step": 2.606670568638947e-05,
+    "strong_consistency": 0.03529668599367142
+  },
+  {
+    "step": 730,
+    "loss": 0.02390434592962265,
+    "drift": 0.0004911310388706625,
+    "small_step": 4.164908386883326e-05,
+    "strong_consistency": 0.023371566087007523
+  },
+  {
+    "step": 731,
+    "loss": 0.02259439043700695,
+    "drift": 0.0013106206897646189,
+    "small_step": 3.782417843467556e-05,
+    "strong_consistency": 0.021245945245027542
+  },
+  {
+    "step": 732,
+    "loss": 0.04113105684518814,
+    "drift": 0.0007059217314235866,
+    "small_step": 3.965190262533724e-05,
+    "strong_consistency": 0.04038548469543457
+  },
+  {
+    "step": 733,
+    "loss": 0.02988945133984089,
+    "drift": 0.00039788734284229577,
+    "small_step": 3.140922126476653e-05,
+    "strong_consistency": 0.029460154473781586
+  },
+  {
+    "step": 734,
+    "loss": 0.021314337849617004,
+    "drift": 0.0006758262752555311,
+    "small_step": 4.587557486956939e-05,
+    "strong_consistency": 0.02059263549745083
+  },
+  {
+    "step": 735,
+    "loss": 0.012220625765621662,
+    "drift": 0.0015048411441966891,
+    "small_step": 5.017552030039951e-05,
+    "strong_consistency": 0.010665609501302242
+  },
+  {
+    "step": 736,
+    "loss": 0.018884819000959396,
+    "drift": 0.0007423083297908306,
+    "small_step": 3.914283661288209e-05,
+    "strong_consistency": 0.01810336858034134
+  },
+  {
+    "step": 737,
+    "loss": 0.035871826112270355,
+    "drift": 0.0007072162115946412,
+    "small_step": 3.6894438380841166e-05,
+    "strong_consistency": 0.03512771427631378
+  },
+  {
+    "step": 738,
+    "loss": 0.02311057411134243,
+    "drift": 0.0010266482131555676,
+    "small_step": 5.372713349061087e-05,
+    "strong_consistency": 0.022030198946595192
+  },
+  {
+    "step": 739,
+    "loss": 0.01430505607277155,
+    "drift": 0.0009444555034860969,
+    "small_step": 2.8655442292802036e-05,
+    "strong_consistency": 0.013331945054233074
+  },
+  {
+    "step": 740,
+    "loss": 0.0335250161588192,
+    "drift": 0.0005411086603999138,
+    "small_step": 2.750122257566545e-05,
+    "strong_consistency": 0.032956406474113464
+  },
+  {
+    "step": 741,
+    "loss": 0.014114541001617908,
+    "drift": 0.0008089548791758716,
+    "small_step": 2.7674563170876354e-05,
+    "strong_consistency": 0.013277911581099033
+  },
+  {
+    "step": 742,
+    "loss": 0.012577543035149574,
+    "drift": 0.0006392623181454837,
+    "small_step": 3.303156336187385e-05,
+    "strong_consistency": 0.011905249208211899
+  },
+  {
+    "step": 743,
+    "loss": 0.03251710534095764,
+    "drift": 0.0008174500544555485,
+    "small_step": 2.6776673621498048e-05,
+    "strong_consistency": 0.0316728800535202
+  },
+  {
+    "step": 744,
+    "loss": 0.010685618035495281,
+    "drift": 0.0006326657603494823,
+    "small_step": 4.05363280151505e-05,
+    "strong_consistency": 0.010012416169047356
+  },
+  {
+    "step": 745,
+    "loss": 0.03010917454957962,
+    "drift": 0.0007326513295993209,
+    "small_step": 2.8019301680615172e-05,
+    "strong_consistency": 0.029348503798246384
+  },
+  {
+    "step": 746,
+    "loss": 0.028787212446331978,
+    "drift": 0.00044345881906338036,
+    "small_step": 3.45742519129999e-05,
+    "strong_consistency": 0.028309179469943047
+  },
+  {
+    "step": 747,
+    "loss": 0.016241753473877907,
+    "drift": 0.0004196534282527864,
+    "small_step": 2.6865116524277255e-05,
+    "strong_consistency": 0.015795234590768814
+  },
+  {
+    "step": 748,
+    "loss": 0.01675504446029663,
+    "drift": 0.0005822476232424378,
+    "small_step": 5.697985761798918e-05,
+    "strong_consistency": 0.016115816310048103
+  },
+  {
+    "step": 749,
+    "loss": 0.018141627311706543,
+    "drift": 0.0004938118509016931,
+    "small_step": 5.3157200454734266e-05,
+    "strong_consistency": 0.017594657838344574
+  },
+  {
+    "step": 750,
+    "loss": 0.02944808639585972,
+    "drift": 0.0008367716218344867,
+    "small_step": 3.327411104692146e-05,
+    "strong_consistency": 0.02857804112136364
+  },
+  {
+    "step": 751,
+    "loss": 0.03148677572607994,
+    "drift": 0.00047919663484208286,
+    "small_step": 5.03226401633583e-05,
+    "strong_consistency": 0.030957257375121117
+  },
+  {
+    "step": 752,
+    "loss": 0.012921326793730259,
+    "drift": 0.0002698434400372207,
+    "small_step": 4.24061763624195e-05,
+    "strong_consistency": 0.012609077617526054
+  },
+  {
+    "step": 753,
+    "loss": 0.022737354040145874,
+    "drift": 0.0007340742740780115,
+    "small_step": 4.27746563218534e-05,
+    "strong_consistency": 0.021960504353046417
+  },
+  {
+    "step": 754,
+    "loss": 0.02283339574933052,
+    "drift": 0.00059329072246328,
+    "small_step": 3.617032416514121e-05,
+    "strong_consistency": 0.02220393531024456
+  },
+  {
+    "step": 755,
+    "loss": 0.02798953279852867,
+    "drift": 0.0005378329660743475,
+    "small_step": 4.528380304691382e-05,
+    "strong_consistency": 0.027406416833400726
+  },
+  {
+    "step": 756,
+    "loss": 0.02344639226794243,
+    "drift": 0.00042271189158782363,
+    "small_step": 3.053441469091922e-05,
+    "strong_consistency": 0.022993145510554314
+  },
+  {
+    "step": 757,
+    "loss": 0.035067953169345856,
+    "drift": 0.0011505578877404332,
+    "small_step": 3.0034409064683132e-05,
+    "strong_consistency": 0.033887360244989395
+  },
+  {
+    "step": 758,
+    "loss": 0.03263131529092789,
+    "drift": 0.0009402992436662316,
+    "small_step": 4.539247674983926e-05,
+    "strong_consistency": 0.03164562210440636
+  },
+  {
+    "step": 759,
+    "loss": 0.016331974416971207,
+    "drift": 0.000787996337749064,
+    "small_step": 4.129335138713941e-05,
+    "strong_consistency": 0.015502684749662876
+  },
+  {
+    "step": 760,
+    "loss": 0.015148560516536236,
+    "drift": 0.00046918244333937764,
+    "small_step": 3.633272717706859e-05,
+    "strong_consistency": 0.014643045142292976
+  },
+  {
+    "step": 761,
+    "loss": 0.013564630411565304,
+    "drift": 0.0003764024586416781,
+    "small_step": 2.778982525342144e-05,
+    "strong_consistency": 0.013160438276827335
+  },
+  {
+    "step": 762,
+    "loss": 0.011785627342760563,
+    "drift": 0.00033546227496117353,
+    "small_step": 3.852067675325088e-05,
+    "strong_consistency": 0.011411644518375397
+  },
+  {
+    "step": 763,
+    "loss": 0.023819394409656525,
+    "drift": 0.00048226938815787435,
+    "small_step": 4.282682129996829e-05,
+    "strong_consistency": 0.023294297978281975
+  },
+  {
+    "step": 764,
+    "loss": 0.013805852271616459,
+    "drift": 0.000635678181424737,
+    "small_step": 4.7198649554047734e-05,
+    "strong_consistency": 0.013122975826263428
+  },
+  {
+    "step": 765,
+    "loss": 0.016357064247131348,
+    "drift": 0.00026327650994062424,
+    "small_step": 6.186276732478291e-05,
+    "strong_consistency": 0.01603192463517189
+  },
+  {
+    "step": 766,
+    "loss": 0.02282276190817356,
+    "drift": 0.0008539780974388123,
+    "small_step": 4.26295300712809e-05,
+    "strong_consistency": 0.0219261534512043
+  },
+  {
+    "step": 767,
+    "loss": 0.025121621787548065,
+    "drift": 0.0004076798795722425,
+    "small_step": 3.314149580546655e-05,
+    "strong_consistency": 0.02468080073595047
+  },
+  {
+    "step": 768,
+    "loss": 0.022180691361427307,
+    "drift": 0.0008460297831334174,
+    "small_step": 5.006220453651622e-05,
+    "strong_consistency": 0.021284598857164383
+  },
+  {
+    "step": 769,
+    "loss": 0.04747878760099411,
+    "drift": 0.0016921606147661805,
+    "small_step": 5.8475558034842834e-05,
+    "strong_consistency": 0.04572815075516701
+  },
+  {
+    "step": 770,
+    "loss": 0.0169227197766304,
+    "drift": 0.0006163581856526434,
+    "small_step": 4.825531141250394e-05,
+    "strong_consistency": 0.016258105635643005
+  },
+  {
+    "step": 771,
+    "loss": 0.02269815281033516,
+    "drift": 0.000503287126775831,
+    "small_step": 2.5401541279279627e-05,
+    "strong_consistency": 0.022169463336467743
+  },
+  {
+    "step": 772,
+    "loss": 0.03574205935001373,
+    "drift": 0.0003492964315228164,
+    "small_step": 4.999486918677576e-05,
+    "strong_consistency": 0.03534276783466339
+  },
+  {
+    "step": 773,
+    "loss": 0.03082752227783203,
+    "drift": 0.00031706318259239197,
+    "small_step": 2.855110142263584e-05,
+    "strong_consistency": 0.030481908470392227
+  },
+  {
+    "step": 774,
+    "loss": 0.030016645789146423,
+    "drift": 0.0004110947484150529,
+    "small_step": 3.057775757042691e-05,
+    "strong_consistency": 0.02957497350871563
+  },
+  {
+    "step": 775,
+    "loss": 0.01586896926164627,
+    "drift": 0.0002451763139106333,
+    "small_step": 3.5050637961830944e-05,
+    "strong_consistency": 0.01558874174952507
+  },
+  {
+    "step": 776,
+    "loss": 0.028247524052858353,
+    "drift": 0.0008141199359670281,
+    "small_step": 3.884538455167785e-05,
+    "strong_consistency": 0.027394559234380722
+  },
+  {
+    "step": 777,
+    "loss": 0.019429214298725128,
+    "drift": 0.0004402200283948332,
+    "small_step": 3.624304008553736e-05,
+    "strong_consistency": 0.018952751532197
+  },
+  {
+    "step": 778,
+    "loss": 0.02348654344677925,
+    "drift": 0.000415005546528846,
+    "small_step": 3.957488661399111e-05,
+    "strong_consistency": 0.023031963035464287
+  },
+  {
+    "step": 779,
+    "loss": 0.020413760095834732,
+    "drift": 0.0004205247387290001,
+    "small_step": 3.928014848497696e-05,
+    "strong_consistency": 0.019953954964876175
+  },
+  {
+    "step": 780,
+    "loss": 0.017490463331341743,
+    "drift": 0.0004519168578553945,
+    "small_step": 2.216013854194898e-05,
+    "strong_consistency": 0.01701638661324978
+  },
+  {
+    "step": 781,
+    "loss": 0.026562374085187912,
+    "drift": 0.00032221630681306124,
+    "small_step": 4.3740255932789296e-05,
+    "strong_consistency": 0.026196418330073357
+  },
+  {
+    "step": 782,
+    "loss": 0.02162221446633339,
+    "drift": 0.0007056289468891919,
+    "small_step": 4.209208054817282e-05,
+    "strong_consistency": 0.020874492824077606
+  },
+  {
+    "step": 783,
+    "loss": 0.014860488474369049,
+    "drift": 0.0006037457496859133,
+    "small_step": 2.9752762202406302e-05,
+    "strong_consistency": 0.014226989820599556
+  },
+  {
+    "step": 784,
+    "loss": 0.018053285777568817,
+    "drift": 0.0006068982183933258,
+    "small_step": 3.784873479162343e-05,
+    "strong_consistency": 0.01740853860974312
+  },
+  {
+    "step": 785,
+    "loss": 0.044210270047187805,
+    "drift": 0.0005613055545836687,
+    "small_step": 2.9777129384456202e-05,
+    "strong_consistency": 0.04361918568611145
+  },
+  {
+    "step": 786,
+    "loss": 0.05416205897927284,
+    "drift": 0.0005659774760715663,
+    "small_step": 3.740148531505838e-05,
+    "strong_consistency": 0.05355868116021156
+  },
+  {
+    "step": 787,
+    "loss": 0.04933345317840576,
+    "drift": 0.001146930968388915,
+    "small_step": 3.0095045076450333e-05,
+    "strong_consistency": 0.04815642535686493
+  },
+  {
+    "step": 788,
+    "loss": 0.018275970593094826,
+    "drift": 0.00022252272174227983,
+    "small_step": 3.422375084483065e-05,
+    "strong_consistency": 0.01801922358572483
+  },
+  {
+    "step": 789,
+    "loss": 0.030025729909539223,
+    "drift": 0.0005935612134635448,
+    "small_step": 4.8402263928437606e-05,
+    "strong_consistency": 0.029383765533566475
+  },
+  {
+    "step": 790,
+    "loss": 0.05555547773838043,
+    "drift": 0.0005949957994744182,
+    "small_step": 3.591589484130964e-05,
+    "strong_consistency": 0.05492456629872322
+  },
+  {
+    "step": 791,
+    "loss": 0.014953691512346268,
+    "drift": 0.0007116632186807692,
+    "small_step": 8.536777750123292e-05,
+    "strong_consistency": 0.014156660996377468
+  },
+  {
+    "step": 792,
+    "loss": 0.03473815694451332,
+    "drift": 0.0006693073664791882,
+    "small_step": 5.061950287199579e-05,
+    "strong_consistency": 0.03401822969317436
+  },
+  {
+    "step": 793,
+    "loss": 0.039389852434396744,
+    "drift": 0.0006097782170400023,
+    "small_step": 4.053534576087259e-05,
+    "strong_consistency": 0.03873953968286514
+  },
+  {
+    "step": 794,
+    "loss": 0.029913365840911865,
+    "drift": 0.00027999962912872434,
+    "small_step": 3.526733780745417e-05,
+    "strong_consistency": 0.029598098248243332
+  },
+  {
+    "step": 795,
+    "loss": 0.024612590670585632,
+    "drift": 0.0005350614665076137,
+    "small_step": 3.636306428234093e-05,
+    "strong_consistency": 0.02404116652905941
+  },
+  {
+    "step": 796,
+    "loss": 0.01761719398200512,
+    "drift": 0.00031610773294232786,
+    "small_step": 2.6859477657126263e-05,
+    "strong_consistency": 0.017274226993322372
+  },
+  {
+    "step": 797,
+    "loss": 0.022215623408555984,
+    "drift": 0.00025642014225013554,
+    "small_step": 4.002279820269905e-05,
+    "strong_consistency": 0.02191917970776558
+  },
+  {
+    "step": 798,
+    "loss": 0.024976639077067375,
+    "drift": 0.0004773632390424609,
+    "small_step": 6.213928281795233e-05,
+    "strong_consistency": 0.024437136948108673
+  },
+  {
+    "step": 799,
+    "loss": 0.0636434480547905,
+    "drift": 0.00030206807423383,
+    "small_step": 3.3029016776708886e-05,
+    "strong_consistency": 0.06330835074186325
+  },
+  {
+    "step": 800,
+    "loss": 0.02377837523818016,
+    "drift": 0.00021947133063804358,
+    "small_step": 4.239654299453832e-05,
+    "strong_consistency": 0.02351650781929493
+  },
+  {
+    "step": 801,
+    "loss": 0.05305882915854454,
+    "drift": 0.0004071440198458731,
+    "small_step": 3.044643744942732e-05,
+    "strong_consistency": 0.05262123793363571
+  },
+  {
+    "step": 802,
+    "loss": 0.028046149760484695,
+    "drift": 0.000368816836271435,
+    "small_step": 5.486707595991902e-05,
+    "strong_consistency": 0.027622465044260025
+  },
+  {
+    "step": 803,
+    "loss": 0.039365872740745544,
+    "drift": 0.00043511652620509267,
+    "small_step": 6.392002978827804e-05,
+    "strong_consistency": 0.038866836577653885
+  },
+  {
+    "step": 804,
+    "loss": 0.025037679821252823,
+    "drift": 0.0010148014407604933,
+    "small_step": 3.377599568921141e-05,
+    "strong_consistency": 0.023989101871848106
+  },
+  {
+    "step": 805,
+    "loss": 0.03890720009803772,
+    "drift": 0.0012261996744200587,
+    "small_step": 7.95060332166031e-05,
+    "strong_consistency": 0.037601493299007416
+  },
+  {
+    "step": 806,
+    "loss": 0.05155472084879875,
+    "drift": 0.0004930106806568801,
+    "small_step": 3.321715121273883e-05,
+    "strong_consistency": 0.05102849379181862
+  },
+  {
+    "step": 807,
+    "loss": 0.04377176985144615,
+    "drift": 0.000464407610706985,
+    "small_step": 3.9730417483951896e-05,
+    "strong_consistency": 0.0432676300406456
+  },
+  {
+    "step": 808,
+    "loss": 0.051422830671072006,
+    "drift": 0.0005412441678345203,
+    "small_step": 4.825247742701322e-05,
+    "strong_consistency": 0.050833333283662796
+  },
+  {
+    "step": 809,
+    "loss": 0.026999734342098236,
+    "drift": 0.00037024973426014185,
+    "small_step": 4.1548577428329736e-05,
+    "strong_consistency": 0.02658793516457081
+  },
+  {
+    "step": 810,
+    "loss": 0.025188736617565155,
+    "drift": 0.0003483522159513086,
+    "small_step": 3.112179911113344e-05,
+    "strong_consistency": 0.02480926178395748
+  },
+  {
+    "step": 811,
+    "loss": 0.03075714223086834,
+    "drift": 0.00038420691271312535,
+    "small_step": 3.439104693825357e-05,
+    "strong_consistency": 0.03033854439854622
+  },
+  {
+    "step": 812,
+    "loss": 0.03398098424077034,
+    "drift": 0.00042709545232355595,
+    "small_step": 3.5862594813806936e-05,
+    "strong_consistency": 0.033518027514219284
+  },
+  {
+    "step": 813,
+    "loss": 0.031130990013480186,
+    "drift": 0.0006787538295611739,
+    "small_step": 4.688936678576283e-05,
+    "strong_consistency": 0.030405346304178238
+  },
+  {
+    "step": 814,
+    "loss": 0.02187059074640274,
+    "drift": 0.0011210492812097073,
+    "small_step": 6.0004607803421095e-05,
+    "strong_consistency": 0.02068953774869442
+  },
+  {
+    "step": 815,
+    "loss": 0.023150954395532608,
+    "drift": 0.0019480874761939049,
+    "small_step": 7.662937423447147e-05,
+    "strong_consistency": 0.021126236766576767
+  },
+  {
+    "step": 816,
+    "loss": 0.01956719160079956,
+    "drift": 0.00016535680333618075,
+    "small_step": 5.295863593346439e-05,
+    "strong_consistency": 0.019348876550793648
+  },
+  {
+    "step": 817,
+    "loss": 0.030323345214128494,
+    "drift": 0.0009248483111150563,
+    "small_step": 4.488524791668169e-05,
+    "strong_consistency": 0.029353611171245575
+  },
+  {
+    "step": 818,
+    "loss": 0.03267768397927284,
+    "drift": 0.0002908297465182841,
+    "small_step": 4.9210095312446356e-05,
+    "strong_consistency": 0.03233764320611954
+  },
+  {
+    "step": 819,
+    "loss": 0.01389542780816555,
+    "drift": 0.00027442252030596137,
+    "small_step": 3.4061034966725856e-05,
+    "strong_consistency": 0.013586943969130516
+  },
+  {
+    "step": 820,
+    "loss": 0.027450477704405785,
+    "drift": 0.0003589848056435585,
+    "small_step": 4.699703276855871e-05,
+    "strong_consistency": 0.027044495567679405
+  },
+  {
+    "step": 821,
+    "loss": 0.01488327607512474,
+    "drift": 0.0004794205306097865,
+    "small_step": 6.118568126112223e-05,
+    "strong_consistency": 0.01434267032891512
+  },
+  {
+    "step": 822,
+    "loss": 0.03447013348340988,
+    "drift": 0.0004725825856439769,
+    "small_step": 4.275317405699752e-05,
+    "strong_consistency": 0.03395479917526245
+  },
+  {
+    "step": 823,
+    "loss": 0.03897867351770401,
+    "drift": 0.0005999950808472931,
+    "small_step": 4.327318674768321e-05,
+    "strong_consistency": 0.0383354052901268
+  },
+  {
+    "step": 824,
+    "loss": 0.029197225347161293,
+    "drift": 0.0010997750796377659,
+    "small_step": 6.425323226721957e-05,
+    "strong_consistency": 0.028033196926116943
+  },
+  {
+    "step": 825,
+    "loss": 0.02441101334989071,
+    "drift": 0.0002482506388332695,
+    "small_step": 6.846804171800613e-05,
+    "strong_consistency": 0.024094294756650925
+  },
+  {
+    "step": 826,
+    "loss": 0.03423282504081726,
+    "drift": 0.0002901231637224555,
+    "small_step": 4.9719048547558486e-05,
+    "strong_consistency": 0.033892981708049774
+  },
+  {
+    "step": 827,
+    "loss": 0.024598727002739906,
+    "drift": 0.0008002197137102485,
+    "small_step": 3.8758968003094196e-05,
+    "strong_consistency": 0.02375974878668785
+  },
+  {
+    "step": 828,
+    "loss": 0.033011674880981445,
+    "drift": 0.0003676675842143595,
+    "small_step": 4.798433292307891e-05,
+    "strong_consistency": 0.03259602189064026
+  },
+  {
+    "step": 829,
+    "loss": 0.037945907562971115,
+    "drift": 0.0006867863703519106,
+    "small_step": 4.296418046578765e-05,
+    "strong_consistency": 0.03721615672111511
+  },
+  {
+    "step": 830,
+    "loss": 0.06968820840120316,
+    "drift": 0.0005381808150559664,
+    "small_step": 3.999196633230895e-05,
+    "strong_consistency": 0.06911003589630127
+  },
+  {
+    "step": 831,
+    "loss": 0.043956100940704346,
+    "drift": 0.0003959807800129056,
+    "small_step": 4.080515282112174e-05,
+    "strong_consistency": 0.043519314378499985
+  },
+  {
+    "step": 832,
+    "loss": 0.03407977893948555,
+    "drift": 0.0003719996311701834,
+    "small_step": 6.430526991607621e-05,
+    "strong_consistency": 0.03364347293972969
+  },
+  {
+    "step": 833,
+    "loss": 0.03876832500100136,
+    "drift": 0.0002621468447614461,
+    "small_step": 5.856645657331683e-05,
+    "strong_consistency": 0.03844761103391647
+  },
+  {
+    "step": 834,
+    "loss": 0.04081632196903229,
+    "drift": 0.001562456600368023,
+    "small_step": 5.210152448853478e-05,
+    "strong_consistency": 0.0392017625272274
+  },
+  {
+    "step": 835,
+    "loss": 0.012616747990250587,
+    "drift": 0.0005671724211424589,
+    "small_step": 4.5444783609127626e-05,
+    "strong_consistency": 0.012004130519926548
+  },
+  {
+    "step": 836,
+    "loss": 0.033383194357156754,
+    "drift": 0.00045778299681842327,
+    "small_step": 8.165153121808544e-05,
+    "strong_consistency": 0.03284376114606857
+  },
+  {
+    "step": 837,
+    "loss": 0.047159843146800995,
+    "drift": 0.0004724196041934192,
+    "small_step": 6.948745431145653e-05,
+    "strong_consistency": 0.046617936342954636
+  },
+  {
+    "step": 838,
+    "loss": 0.027471676468849182,
+    "drift": 0.0005627669743262231,
+    "small_step": 3.509067391860299e-05,
+    "strong_consistency": 0.026873819530010223
+  },
+  {
+    "step": 839,
+    "loss": 0.023271571844816208,
+    "drift": 0.000390824192436412,
+    "small_step": 6.122086779214442e-05,
+    "strong_consistency": 0.022819526493549347
+  },
+  {
+    "step": 840,
+    "loss": 0.048183079808950424,
+    "drift": 0.00030921446159482,
+    "small_step": 3.8513881008839235e-05,
+    "strong_consistency": 0.047835350036621094
+  },
+  {
+    "step": 841,
+    "loss": 0.019933504983782768,
+    "drift": 0.0004493595624808222,
+    "small_step": 6.279914668994024e-05,
+    "strong_consistency": 0.019421346485614777
+  },
+  {
+    "step": 842,
+    "loss": 0.04385293647646904,
+    "drift": 0.0006222240044735372,
+    "small_step": 9.282152313971892e-05,
+    "strong_consistency": 0.043137889355421066
+  },
+  {
+    "step": 843,
+    "loss": 0.04913386330008507,
+    "drift": 0.0006716023199260235,
+    "small_step": 6.0719561588484794e-05,
+    "strong_consistency": 0.048401542007923126
+  },
+  {
+    "step": 844,
+    "loss": 0.030524149537086487,
+    "drift": 0.0008194607216864824,
+    "small_step": 5.8402452850714326e-05,
+    "strong_consistency": 0.029646286740899086
+  },
+  {
+    "step": 845,
+    "loss": 0.022473083809018135,
+    "drift": 0.0004805354692507535,
+    "small_step": 7.473193545592949e-05,
+    "strong_consistency": 0.021917816251516342
+  },
+  {
+    "step": 846,
+    "loss": 0.029851043596863747,
+    "drift": 0.00030996979330666363,
+    "small_step": 7.302618905669078e-05,
+    "strong_consistency": 0.029468048363924026
+  },
+  {
+    "step": 847,
+    "loss": 0.02765868417918682,
+    "drift": 0.0007265887106768787,
+    "small_step": 5.435594357550144e-05,
+    "strong_consistency": 0.026877740398049355
+  },
+  {
+    "step": 848,
+    "loss": 0.0393986739218235,
+    "drift": 0.0004981799283996224,
+    "small_step": 6.056426718714647e-05,
+    "strong_consistency": 0.038839928805828094
+  },
+  {
+    "step": 849,
+    "loss": 0.021079223603010178,
+    "drift": 0.0007009118562564254,
+    "small_step": 3.610236672102474e-05,
+    "strong_consistency": 0.020342210307717323
+  },
+  {
+    "step": 850,
+    "loss": 0.032916758209466934,
+    "drift": 0.0002880443353205919,
+    "small_step": 4.720978904515505e-05,
+    "strong_consistency": 0.03258150443434715
+  },
+  {
+    "step": 851,
+    "loss": 0.04316955432295799,
+    "drift": 0.00047362837358377874,
+    "small_step": 4.125267514609732e-05,
+    "strong_consistency": 0.042654674500226974
+  },
+  {
+    "step": 852,
+    "loss": 0.029652638360857964,
+    "drift": 0.00029438373167067766,
+    "small_step": 5.940442133578472e-05,
+    "strong_consistency": 0.029298849403858185
+  },
+  {
+    "step": 853,
+    "loss": 0.020472390577197075,
+    "drift": 0.00043464821646921337,
+    "small_step": 2.2219530364964157e-05,
+    "strong_consistency": 0.020015522837638855
+  },
+  {
+    "step": 854,
+    "loss": 0.04336560145020485,
+    "drift": 0.0004829003883060068,
+    "small_step": 5.4958825785433874e-05,
+    "strong_consistency": 0.04282774403691292
+  },
+  {
+    "step": 855,
+    "loss": 0.03276226297020912,
+    "drift": 0.0004457204486243427,
+    "small_step": 5.712928395951167e-05,
+    "strong_consistency": 0.03225941210985184
+  },
+  {
+    "step": 856,
+    "loss": 0.02861730568110943,
+    "drift": 0.00044145918218418956,
+    "small_step": 4.637166057364084e-05,
+    "strong_consistency": 0.028129475191235542
+  },
+  {
+    "step": 857,
+    "loss": 0.02546275034546852,
+    "drift": 0.0005019887466914952,
+    "small_step": 4.288363561499864e-05,
+    "strong_consistency": 0.024917878210544586
+  },
+  {
+    "step": 858,
+    "loss": 0.038282833993434906,
+    "drift": 0.0004378044977784157,
+    "small_step": 7.303136953851208e-05,
+    "strong_consistency": 0.03777199983596802
+  },
+  {
+    "step": 859,
+    "loss": 0.02669370174407959,
+    "drift": 0.00041468386189080775,
+    "small_step": 5.113412771606818e-05,
+    "strong_consistency": 0.026227883994579315
+  },
+  {
+    "step": 860,
+    "loss": 0.037051450461149216,
+    "drift": 0.0003487942449282855,
+    "small_step": 4.519461435847916e-05,
+    "strong_consistency": 0.036657460033893585
+  },
+  {
+    "step": 861,
+    "loss": 0.03884687274694443,
+    "drift": 0.00041560549288988113,
+    "small_step": 4.691207141149789e-05,
+    "strong_consistency": 0.03838435560464859
+  },
+  {
+    "step": 862,
+    "loss": 0.037059485912323,
+    "drift": 0.000358621240593493,
+    "small_step": 6.488621875178069e-05,
+    "strong_consistency": 0.036635980010032654
+  },
+  {
+    "step": 863,
+    "loss": 0.029140040278434753,
+    "drift": 0.0002990927314385772,
+    "small_step": 6.04201341047883e-05,
+    "strong_consistency": 0.028780527412891388
+  },
+  {
+    "step": 864,
+    "loss": 0.03236787021160126,
+    "drift": 0.0009513949044048786,
+    "small_step": 8.752814756007865e-05,
+    "strong_consistency": 0.031328946352005005
+  },
+  {
+    "step": 865,
+    "loss": 0.03365852311253548,
+    "drift": 0.0004698853299487382,
+    "small_step": 5.353643064154312e-05,
+    "strong_consistency": 0.033135101199150085
+  },
+  {
+    "step": 866,
+    "loss": 0.047802332788705826,
+    "drift": 0.00034870198578573763,
+    "small_step": 5.498044993146323e-05,
+    "strong_consistency": 0.0473986491560936
+  },
+  {
+    "step": 867,
+    "loss": 0.025578374043107033,
+    "drift": 0.00047388277016580105,
+    "small_step": 4.997914584237151e-05,
+    "strong_consistency": 0.025054512545466423
+  },
+  {
+    "step": 868,
+    "loss": 0.04706275463104248,
+    "drift": 0.0005120021523907781,
+    "small_step": 4.471810461836867e-05,
+    "strong_consistency": 0.04650603607296944
+  },
+  {
+    "step": 869,
+    "loss": 0.056784968823194504,
+    "drift": 0.0009048007195815444,
+    "small_step": 8.751480345381424e-05,
+    "strong_consistency": 0.05579265207052231
+  },
+  {
+    "step": 870,
+    "loss": 0.06128601357340813,
+    "drift": 0.000563453184440732,
+    "small_step": 4.8346511903218925e-05,
+    "strong_consistency": 0.060674212872982025
+  },
+  {
+    "step": 871,
+    "loss": 0.027414897456765175,
+    "drift": 0.00031436904100701213,
+    "small_step": 6.667796697001904e-05,
+    "strong_consistency": 0.02703385055065155
+  },
+  {
+    "step": 872,
+    "loss": 0.021833769977092743,
+    "drift": 0.0005393792525865138,
+    "small_step": 4.353261465439573e-05,
+    "strong_consistency": 0.021250858902931213
+  },
+  {
+    "step": 873,
+    "loss": 0.05275596305727959,
+    "drift": 0.0006872629746794701,
+    "small_step": 8.812468149699271e-05,
+    "strong_consistency": 0.05198057368397713
+  },
+  {
+    "step": 874,
+    "loss": 0.035173363983631134,
+    "drift": 0.0004959177458658814,
+    "small_step": 4.219730180921033e-05,
+    "strong_consistency": 0.03463524952530861
+  },
+  {
+    "step": 875,
+    "loss": 0.028030026704072952,
+    "drift": 0.0002624334883876145,
+    "small_step": 7.695391832385212e-05,
+    "strong_consistency": 0.027690639719367027
+  },
+  {
+    "step": 876,
+    "loss": 0.03512192144989967,
+    "drift": 0.0004521132505033165,
+    "small_step": 3.272182948421687e-05,
+    "strong_consistency": 0.03463708609342575
+  },
+  {
+    "step": 877,
+    "loss": 0.04914107546210289,
+    "drift": 0.00034087736275978386,
+    "small_step": 7.28678351151757e-05,
+    "strong_consistency": 0.048727329820394516
+  },
+  {
+    "step": 878,
+    "loss": 0.04482617974281311,
+    "drift": 0.00041262683225795627,
+    "small_step": 5.4472136980621144e-05,
+    "strong_consistency": 0.044359080493450165
+  },
+  {
+    "step": 879,
+    "loss": 0.045500461012125015,
+    "drift": 0.0005084308213554323,
+    "small_step": 4.702085061580874e-05,
+    "strong_consistency": 0.04494500905275345
+  },
+  {
+    "step": 880,
+    "loss": 0.022735487669706345,
+    "drift": 0.0005859398515895009,
+    "small_step": 7.220812403829768e-05,
+    "strong_consistency": 0.022077340632677078
+  },
+  {
+    "step": 881,
+    "loss": 0.01767546311020851,
+    "drift": 0.0009713451145216823,
+    "small_step": 4.684442683355883e-05,
+    "strong_consistency": 0.016657274216413498
+  },
+  {
+    "step": 882,
+    "loss": 0.017772885039448738,
+    "drift": 0.0004516144981607795,
+    "small_step": 4.961315789842047e-05,
+    "strong_consistency": 0.017271656543016434
+  },
+  {
+    "step": 883,
+    "loss": 0.02454705908894539,
+    "drift": 0.00039331038715317845,
+    "small_step": 3.319991083117202e-05,
+    "strong_consistency": 0.024120548740029335
+  },
+  {
+    "step": 884,
+    "loss": 0.026807285845279694,
+    "drift": 0.0006484771729446948,
+    "small_step": 8.775389869697392e-05,
+    "strong_consistency": 0.026071054860949516
+  },
+  {
+    "step": 885,
+    "loss": 0.035188596695661545,
+    "drift": 0.000526426883880049,
+    "small_step": 6.890628719702363e-05,
+    "strong_consistency": 0.034593261778354645
+  },
+  {
+    "step": 886,
+    "loss": 0.03078269213438034,
+    "drift": 0.0007695016101934016,
+    "small_step": 9.16256831260398e-05,
+    "strong_consistency": 0.02992156520485878
+  },
+  {
+    "step": 887,
+    "loss": 0.0359131395816803,
+    "drift": 0.0003909093211404979,
+    "small_step": 6.892546662129462e-05,
+    "strong_consistency": 0.03545330464839935
+  },
+  {
+    "step": 888,
+    "loss": 0.022086571902036667,
+    "drift": 0.0005787277477793396,
+    "small_step": 2.6432055165059865e-05,
+    "strong_consistency": 0.021481411531567574
+  },
+  {
+    "step": 889,
+    "loss": 0.04862792044878006,
+    "drift": 0.0005488536553457379,
+    "small_step": 7.524234388256446e-05,
+    "strong_consistency": 0.048003826290369034
+  },
+  {
+    "step": 890,
+    "loss": 0.03532126918435097,
+    "drift": 0.00045077194226905704,
+    "small_step": 0.00010115513578057289,
+    "strong_consistency": 0.034769341349601746
+  },
+  {
+    "step": 891,
+    "loss": 0.01969892717897892,
+    "drift": 0.00024317475617863238,
+    "small_step": 5.873561531188898e-05,
+    "strong_consistency": 0.019397016614675522
+  },
+  {
+    "step": 892,
+    "loss": 0.0375710055232048,
+    "drift": 0.0001924503594636917,
+    "small_step": 3.939352245652117e-05,
+    "strong_consistency": 0.037339162081480026
+  },
+  {
+    "step": 893,
+    "loss": 0.04316345602273941,
+    "drift": 0.000367158732842654,
+    "small_step": 6.489006045740098e-05,
+    "strong_consistency": 0.04273140802979469
+  },
+  {
+    "step": 894,
+    "loss": 0.031971048563718796,
+    "drift": 0.0006561395712196827,
+    "small_step": 7.20643438398838e-05,
+    "strong_consistency": 0.031242843717336655
+  },
+  {
+    "step": 895,
+    "loss": 0.02583472616970539,
+    "drift": 0.0004417115414980799,
+    "small_step": 6.425069295801222e-05,
+    "strong_consistency": 0.02532876469194889
+  },
+  {
+    "step": 896,
+    "loss": 0.029034195467829704,
+    "drift": 0.00041196419624611735,
+    "small_step": 9.936868445947766e-05,
+    "strong_consistency": 0.028522862121462822
+  },
+  {
+    "step": 897,
+    "loss": 0.025418924167752266,
+    "drift": 0.0007155759376473725,
+    "small_step": 6.893790123285726e-05,
+    "strong_consistency": 0.024634409695863724
+  },
+  {
+    "step": 898,
+    "loss": 0.048534952104091644,
+    "drift": 0.0005026441067457199,
+    "small_step": 4.648456888389774e-05,
+    "strong_consistency": 0.04798582196235657
+  },
+  {
+    "step": 899,
+    "loss": 0.02930190972983837,
+    "drift": 0.0005404154653660953,
+    "small_step": 5.239559686742723e-05,
+    "strong_consistency": 0.02870909869670868
+  },
+  {
+    "step": 900,
+    "loss": 0.0462908111512661,
+    "drift": 0.00027758622309193015,
+    "small_step": 8.124662417685613e-05,
+    "strong_consistency": 0.04593198001384735
+  },
+  {
+    "step": 901,
+    "loss": 0.02056080847978592,
+    "drift": 0.00037925364449620247,
+    "small_step": 8.074093057075515e-05,
+    "strong_consistency": 0.02010081335902214
+  },
+  {
+    "step": 902,
+    "loss": 0.06578665226697922,
+    "drift": 0.0004186661390122026,
+    "small_step": 7.32807966414839e-05,
+    "strong_consistency": 0.06529470533132553
+  },
+  {
+    "step": 903,
+    "loss": 0.05872874706983566,
+    "drift": 0.0001920612994581461,
+    "small_step": 9.190208947984502e-05,
+    "strong_consistency": 0.058444783091545105
+  },
+  {
+    "step": 904,
+    "loss": 0.028081174939870834,
+    "drift": 0.00027874758234247565,
+    "small_step": 7.56110530346632e-05,
+    "strong_consistency": 0.02772681601345539
+  },
+  {
+    "step": 905,
+    "loss": 0.029532290995121002,
+    "drift": 0.00034850244992412627,
+    "small_step": 6.178601324791089e-05,
+    "strong_consistency": 0.0291220024228096
+  },
+  {
+    "step": 906,
+    "loss": 0.05755029246211052,
+    "drift": 0.0005110232159495354,
+    "small_step": 5.8294463087804615e-05,
+    "strong_consistency": 0.05698097497224808
+  },
+  {
+    "step": 907,
+    "loss": 0.07269041985273361,
+    "drift": 0.0002978971169795841,
+    "small_step": 5.2780222176807e-05,
+    "strong_consistency": 0.0723397433757782
+  },
+  {
+    "step": 908,
+    "loss": 0.035418618470430374,
+    "drift": 0.000532523961737752,
+    "small_step": 7.653218926861882e-05,
+    "strong_consistency": 0.03480956330895424
+  },
+  {
+    "step": 909,
+    "loss": 0.03371521830558777,
+    "drift": 0.00026487806462682784,
+    "small_step": 6.450395449064672e-05,
+    "strong_consistency": 0.03338583558797836
+  },
+  {
+    "step": 910,
+    "loss": 0.05536956340074539,
+    "drift": 0.000285838934360072,
+    "small_step": 5.453977428260259e-05,
+    "strong_consistency": 0.05502918362617493
+  },
+  {
+    "step": 911,
+    "loss": 0.027657339349389076,
+    "drift": 0.0003808760375250131,
+    "small_step": 5.164309186511673e-05,
+    "strong_consistency": 0.027224820107221603
+  },
+  {
+    "step": 912,
+    "loss": 0.026331666857004166,
+    "drift": 0.00045051079359836876,
+    "small_step": 5.9956611949019134e-05,
+    "strong_consistency": 0.025821199640631676
+  },
+  {
+    "step": 913,
+    "loss": 0.02293286845088005,
+    "drift": 0.00039047742029652,
+    "small_step": 8.86156121850945e-05,
+    "strong_consistency": 0.022453775629401207
+  },
+  {
+    "step": 914,
+    "loss": 0.04272419586777687,
+    "drift": 0.00036499137058854103,
+    "small_step": 7.771869422867894e-05,
+    "strong_consistency": 0.042281486093997955
+  },
+  {
+    "step": 915,
+    "loss": 0.021899022161960602,
+    "drift": 0.0003486641217023134,
+    "small_step": 5.760944986832328e-05,
+    "strong_consistency": 0.021492749452590942
+  },
+  {
+    "step": 916,
+    "loss": 0.04230319708585739,
+    "drift": 0.0004911553696729243,
+    "small_step": 6.404668238246813e-05,
+    "strong_consistency": 0.04174799472093582
+  },
+  {
+    "step": 917,
+    "loss": 0.05680975690484047,
+    "drift": 0.0002644381020218134,
+    "small_step": 5.259879617369734e-05,
+    "strong_consistency": 0.05649271979928017
+  },
+  {
+    "step": 918,
+    "loss": 0.05507363751530647,
+    "drift": 0.00026054258341901004,
+    "small_step": 6.698934885207564e-05,
+    "strong_consistency": 0.0547461062669754
+  },
+  {
+    "step": 919,
+    "loss": 0.02984864078462124,
+    "drift": 0.0003398485714569688,
+    "small_step": 6.645175744779408e-05,
+    "strong_consistency": 0.02944234013557434
+  },
+  {
+    "step": 920,
+    "loss": 0.026423975825309753,
+    "drift": 0.00030797807266935706,
+    "small_step": 8.073283970588818e-05,
+    "strong_consistency": 0.026035264134407043
+  },
+  {
+    "step": 921,
+    "loss": 0.03462390601634979,
+    "drift": 0.00043191813165321946,
+    "small_step": 5.852897811564617e-05,
+    "strong_consistency": 0.034133460372686386
+  },
+  {
+    "step": 922,
+    "loss": 0.03332462161779404,
+    "drift": 0.0005575940012931824,
+    "small_step": 3.107618977082893e-05,
+    "strong_consistency": 0.032735951244831085
+  },
+  {
+    "step": 923,
+    "loss": 0.03833654522895813,
+    "drift": 0.0002904619905166328,
+    "small_step": 6.584964285138994e-05,
+    "strong_consistency": 0.03798023238778114
+  },
+  {
+    "step": 924,
+    "loss": 0.038760706782341,
+    "drift": 0.00042046947055496275,
+    "small_step": 9.87653766060248e-05,
+    "strong_consistency": 0.03824147209525108
+  },
+  {
+    "step": 925,
+    "loss": 0.05921442061662674,
+    "drift": 0.00021137643489055336,
+    "small_step": 7.211296178866178e-05,
+    "strong_consistency": 0.058930929750204086
+  },
+  {
+    "step": 926,
+    "loss": 0.029051734134554863,
+    "drift": 0.00048756704200059175,
+    "small_step": 0.00012394937220960855,
+    "strong_consistency": 0.028440218418836594
+  },
+  {
+    "step": 927,
+    "loss": 0.039856668561697006,
+    "drift": 0.00016251811757683754,
+    "small_step": 9.009191126096994e-05,
+    "strong_consistency": 0.0396040603518486
+  },
+  {
+    "step": 928,
+    "loss": 0.03273295238614082,
+    "drift": 0.0001698970445431769,
+    "small_step": 6.459573341999203e-05,
+    "strong_consistency": 0.03249846026301384
+  },
+  {
+    "step": 929,
+    "loss": 0.052284762263298035,
+    "drift": 0.00019147212151437998,
+    "small_step": 6.523927004309371e-05,
+    "strong_consistency": 0.052028052508831024
+  },
+  {
+    "step": 930,
+    "loss": 0.036741193383932114,
+    "drift": 0.0002933732175733894,
+    "small_step": 7.882346108090132e-05,
+    "strong_consistency": 0.036368995904922485
+  },
+  {
+    "step": 931,
+    "loss": 0.03544106334447861,
+    "drift": 0.00029981325496919453,
+    "small_step": 6.646180554525927e-05,
+    "strong_consistency": 0.03507478907704353
+  },
+  {
+    "step": 932,
+    "loss": 0.061862822622060776,
+    "drift": 0.000769052654504776,
+    "small_step": 9.111193503485993e-05,
+    "strong_consistency": 0.06100265681743622
+  },
+  {
+    "step": 933,
+    "loss": 0.036409907042980194,
+    "drift": 0.00024279803619720042,
+    "small_step": 5.448971933219582e-05,
+    "strong_consistency": 0.03611261770129204
+  },
+  {
+    "step": 934,
+    "loss": 0.04130407050251961,
+    "drift": 0.00030613908893428743,
+    "small_step": 0.0001022571450448595,
+    "strong_consistency": 0.040895674377679825
+  },
+  {
+    "step": 935,
+    "loss": 0.02967810444533825,
+    "drift": 0.0003340773982927203,
+    "small_step": 6.080453749746084e-05,
+    "strong_consistency": 0.029283221811056137
+  },
+  {
+    "step": 936,
+    "loss": 0.04650575667619705,
+    "drift": 0.001509380992501974,
+    "small_step": 0.00010406541696283966,
+    "strong_consistency": 0.044892311096191406
+  },
+  {
+    "step": 937,
+    "loss": 0.04425095394253731,
+    "drift": 0.0002306145615875721,
+    "small_step": 4.4015454477630556e-05,
+    "strong_consistency": 0.043976325541734695
+  },
+  {
+    "step": 938,
+    "loss": 0.030086888000369072,
+    "drift": 0.00013630643661599606,
+    "small_step": 4.355674536782317e-05,
+    "strong_consistency": 0.029907025396823883
+  },
+  {
+    "step": 939,
+    "loss": 0.04343997687101364,
+    "drift": 0.0002779910573735833,
+    "small_step": 7.54446373321116e-05,
+    "strong_consistency": 0.04308653995394707
+  },
+  {
+    "step": 940,
+    "loss": 0.028385870158672333,
+    "drift": 0.0004833645944017917,
+    "small_step": 9.768875315785408e-05,
+    "strong_consistency": 0.027804816141724586
+  },
+  {
+    "step": 941,
+    "loss": 0.04625575244426727,
+    "drift": 0.0008395945187658072,
+    "small_step": 0.00014146746252663434,
+    "strong_consistency": 0.04527468979358673
+  },
+  {
+    "step": 942,
+    "loss": 0.01573232002556324,
+    "drift": 0.00040923766209743917,
+    "small_step": 8.39377025840804e-05,
+    "strong_consistency": 0.015239144675433636
+  },
+  {
+    "step": 943,
+    "loss": 0.040444739162921906,
+    "drift": 0.00040806419565342367,
+    "small_step": 5.5410939239664e-05,
+    "strong_consistency": 0.03998126462101936
+  },
+  {
+    "step": 944,
+    "loss": 0.054651837795972824,
+    "drift": 0.00037620466900989413,
+    "small_step": 7.826898945495486e-05,
+    "strong_consistency": 0.054197363555431366
+  },
+  {
+    "step": 945,
+    "loss": 0.04025029018521309,
+    "drift": 0.0003515411517582834,
+    "small_step": 6.424500315915793e-05,
+    "strong_consistency": 0.03983450308442116
+  },
+  {
+    "step": 946,
+    "loss": 0.05486224591732025,
+    "drift": 0.0003074206761084497,
+    "small_step": 5.147787669557147e-05,
+    "strong_consistency": 0.05450334772467613
+  },
+  {
+    "step": 947,
+    "loss": 0.023711958900094032,
+    "drift": 0.00041747355135157704,
+    "small_step": 6.843404844403267e-05,
+    "strong_consistency": 0.023226050660014153
+  },
+  {
+    "step": 948,
+    "loss": 0.04847332462668419,
+    "drift": 0.0002598521823529154,
+    "small_step": 8.008005534065887e-05,
+    "strong_consistency": 0.04813339188694954
+  },
+  {
+    "step": 949,
+    "loss": 0.01946417987346649,
+    "drift": 0.0001837030577007681,
+    "small_step": 0.00010292929073330015,
+    "strong_consistency": 0.019177546724677086
+  },
+  {
+    "step": 950,
+    "loss": 0.04499921202659607,
+    "drift": 0.00028115062741562724,
+    "small_step": 7.856723823351786e-05,
+    "strong_consistency": 0.04463949427008629
+  },
+  {
+    "step": 951,
+    "loss": 0.03378079831600189,
+    "drift": 0.00028532734722830355,
+    "small_step": 5.6301854783669114e-05,
+    "strong_consistency": 0.03343917056918144
+  },
+  {
+    "step": 952,
+    "loss": 0.04166249558329582,
+    "drift": 0.00032626662869006395,
+    "small_step": 6.883497553644702e-05,
+    "strong_consistency": 0.04126739501953125
+  },
+  {
+    "step": 953,
+    "loss": 0.018443090841174126,
+    "drift": 0.00020115103689022362,
+    "small_step": 9.6018316980917e-05,
+    "strong_consistency": 0.01814592070877552
+  },
+  {
+    "step": 954,
+    "loss": 0.05532550439238548,
+    "drift": 0.00036677366006188095,
+    "small_step": 0.00011999908747384325,
+    "strong_consistency": 0.05483873188495636
+  },
+  {
+    "step": 955,
+    "loss": 0.08971825242042542,
+    "drift": 0.0004151627654209733,
+    "small_step": 9.968611993826926e-05,
+    "strong_consistency": 0.08920340240001678
+  },
+  {
+    "step": 956,
+    "loss": 0.05615988373756409,
+    "drift": 0.0001888195110950619,
+    "small_step": 8.222668111557141e-05,
+    "strong_consistency": 0.055888839066028595
+  },
+  {
+    "step": 957,
+    "loss": 0.03101612813770771,
+    "drift": 0.0004906848189420998,
+    "small_step": 7.626354636158794e-05,
+    "strong_consistency": 0.03044917993247509
+  },
+  {
+    "step": 958,
+    "loss": 0.08011472225189209,
+    "drift": 0.0005275523290038109,
+    "small_step": 8.192668610718101e-05,
+    "strong_consistency": 0.07950524240732193
+  },
+  {
+    "step": 959,
+    "loss": 0.01985483057796955,
+    "drift": 0.00022363381867762655,
+    "small_step": 7.977517816470936e-05,
+    "strong_consistency": 0.01955142244696617
+  },
+  {
+    "step": 960,
+    "loss": 0.10495822131633759,
+    "drift": 0.0005074400687590241,
+    "small_step": 7.131094753276557e-05,
+    "strong_consistency": 0.10437946766614914
+  },
+  {
+    "step": 961,
+    "loss": 0.03865783289074898,
+    "drift": 0.00042186075006611645,
+    "small_step": 0.0001042365183820948,
+    "strong_consistency": 0.03813173621892929
+  },
+  {
+    "step": 962,
+    "loss": 0.04623349383473396,
+    "drift": 0.00022821794846095145,
+    "small_step": 7.875243318267167e-05,
+    "strong_consistency": 0.045926522463560104
+  },
+  {
+    "step": 963,
+    "loss": 0.025835849344730377,
+    "drift": 0.0003818177501671016,
+    "small_step": 8.608232019469142e-05,
+    "strong_consistency": 0.025367949157953262
+  },
+  {
+    "step": 964,
+    "loss": 0.02832701802253723,
+    "drift": 0.00018774908676277846,
+    "small_step": 8.511483611073345e-05,
+    "strong_consistency": 0.02805415354669094
+  },
+  {
+    "step": 965,
+    "loss": 0.023206980898976326,
+    "drift": 0.0003279986558482051,
+    "small_step": 0.00010075766476802528,
+    "strong_consistency": 0.0227782242000103
+  },
+  {
+    "step": 966,
+    "loss": 0.03233909606933594,
+    "drift": 0.00036065024323761463,
+    "small_step": 7.608629675814882e-05,
+    "strong_consistency": 0.03190235793590546
+  },
+  {
+    "step": 967,
+    "loss": 0.07238661497831345,
+    "drift": 0.00030590855749323964,
+    "small_step": 8.791793516138569e-05,
+    "strong_consistency": 0.07199279218912125
+  },
+  {
+    "step": 968,
+    "loss": 0.04324997961521149,
+    "drift": 0.0003629655693657696,
+    "small_step": 0.00010324977483833209,
+    "strong_consistency": 0.04278376325964928
+  },
+  {
+    "step": 969,
+    "loss": 0.04001171886920929,
+    "drift": 0.0003237184137105942,
+    "small_step": 8.792713197181001e-05,
+    "strong_consistency": 0.03960007429122925
+  },
+  {
+    "step": 970,
+    "loss": 0.04125293716788292,
+    "drift": 0.0005970614729449153,
+    "small_step": 0.00011194075341336429,
+    "strong_consistency": 0.04054393619298935
+  },
+  {
+    "step": 971,
+    "loss": 0.03708667308092117,
+    "drift": 0.0004495338653214276,
+    "small_step": 0.00010388194641564041,
+    "strong_consistency": 0.036533258855342865
+  },
+  {
+    "step": 972,
+    "loss": 0.06309456378221512,
+    "drift": 0.0007300526485778391,
+    "small_step": 0.00012293012696318328,
+    "strong_consistency": 0.062241584062576294
+  },
+  {
+    "step": 973,
+    "loss": 0.04782221466302872,
+    "drift": 0.00030492007499560714,
+    "small_step": 0.00011707478552125394,
+    "strong_consistency": 0.04740022122859955
+  },
+  {
+    "step": 974,
+    "loss": 0.05528412386775017,
+    "drift": 0.0003743005217984319,
+    "small_step": 0.00015184858057182282,
+    "strong_consistency": 0.0547579750418663
+  },
+  {
+    "step": 975,
+    "loss": 0.04959826543927193,
+    "drift": 0.0007377404836006463,
+    "small_step": 8.292413258459419e-05,
+    "strong_consistency": 0.04877760261297226
+  },
+  {
+    "step": 976,
+    "loss": 0.026892883703112602,
+    "drift": 0.0004197624512016773,
+    "small_step": 9.7177158750128e-05,
+    "strong_consistency": 0.026375943794846535
+  },
+  {
+    "step": 977,
+    "loss": 0.05670156329870224,
+    "drift": 0.0006443750462494791,
+    "small_step": 0.00010105931869475171,
+    "strong_consistency": 0.05595612898468971
+  },
+  {
+    "step": 978,
+    "loss": 0.05145059525966644,
+    "drift": 0.0002492419152986258,
+    "small_step": 7.741722220089287e-05,
+    "strong_consistency": 0.05112393572926521
+  },
+  {
+    "step": 979,
+    "loss": 0.048722509294748306,
+    "drift": 0.0006668597343377769,
+    "small_step": 0.00014372137957252562,
+    "strong_consistency": 0.04791192710399628
+  },
+  {
+    "step": 980,
+    "loss": 0.03487856313586235,
+    "drift": 0.0003275076160207391,
+    "small_step": 0.00011089797772001475,
+    "strong_consistency": 0.03444015607237816
+  },
+  {
+    "step": 981,
+    "loss": 0.03313823416829109,
+    "drift": 0.000329600676195696,
+    "small_step": 8.507772872690111e-05,
+    "strong_consistency": 0.0327235572040081
+  },
+  {
+    "step": 982,
+    "loss": 0.04769952967762947,
+    "drift": 0.00034805951872840524,
+    "small_step": 7.459787593688816e-05,
+    "strong_consistency": 0.047276873141527176
+  },
+  {
+    "step": 983,
+    "loss": 0.055423300713300705,
+    "drift": 0.0003957131411880255,
+    "small_step": 0.0001648823672439903,
+    "strong_consistency": 0.05486270412802696
+  },
+  {
+    "step": 984,
+    "loss": 0.03030763380229473,
+    "drift": 0.000283916451735422,
+    "small_step": 0.00013395857240539044,
+    "strong_consistency": 0.029889758676290512
+  },
+  {
+    "step": 985,
+    "loss": 0.036447323858737946,
+    "drift": 0.00018862757133319974,
+    "small_step": 0.0001084326722775586,
+    "strong_consistency": 0.036150261759757996
+  },
+  {
+    "step": 986,
+    "loss": 0.03509240597486496,
+    "drift": 0.0004857166495639831,
+    "small_step": 0.0001315048721153289,
+    "strong_consistency": 0.034475184977054596
+  },
+  {
+    "step": 987,
+    "loss": 0.038152795284986496,
+    "drift": 0.0002786035183817148,
+    "small_step": 8.575182437198237e-05,
+    "strong_consistency": 0.03778843954205513
+  },
+  {
+    "step": 988,
+    "loss": 0.02306532673537731,
+    "drift": 0.0002854288322851062,
+    "small_step": 9.325645805802196e-05,
+    "strong_consistency": 0.022686641663312912
+  },
+  {
+    "step": 989,
+    "loss": 0.04670252650976181,
+    "drift": 0.0002446075086481869,
+    "small_step": 0.00011898210505023599,
+    "strong_consistency": 0.04633893817663193
+  },
+  {
+    "step": 990,
+    "loss": 0.040085501968860626,
+    "drift": 0.00023145991144701838,
+    "small_step": 6.075607961975038e-05,
+    "strong_consistency": 0.039793286472558975
+  },
+  {
+    "step": 991,
+    "loss": 0.05490042269229889,
+    "drift": 0.0006644579698331654,
+    "small_step": 8.706098742550239e-05,
+    "strong_consistency": 0.05414890497922897
+  },
+  {
+    "step": 992,
+    "loss": 0.037809476256370544,
+    "drift": 0.00036245520459488034,
+    "small_step": 6.513499829452485e-05,
+    "strong_consistency": 0.037381887435913086
+  },
+  {
+    "step": 993,
+    "loss": 0.03190553933382034,
+    "drift": 0.00033851771149784327,
+    "small_step": 0.00010101464431500062,
+    "strong_consistency": 0.031466007232666016
+  },
+  {
+    "step": 994,
+    "loss": 0.04970170557498932,
+    "drift": 0.0004303929745219648,
+    "small_step": 0.00010382187610957772,
+    "strong_consistency": 0.04916749149560928
+  },
+  {
+    "step": 995,
+    "loss": 0.037332724779844284,
+    "drift": 0.0002772830193862319,
+    "small_step": 9.82888086582534e-05,
+    "strong_consistency": 0.03695715218782425
+  },
+  {
+    "step": 996,
+    "loss": 0.024110844358801842,
+    "drift": 0.0004313501704018563,
+    "small_step": 0.00010868924437090755,
+    "strong_consistency": 0.02357080578804016
+  },
+  {
+    "step": 997,
+    "loss": 0.059676866978406906,
+    "drift": 0.00021870362979825586,
+    "small_step": 0.00012725604756269604,
+    "strong_consistency": 0.059330906718969345
+  },
+  {
+    "step": 998,
+    "loss": 0.03024873696267605,
+    "drift": 0.0006982788327150047,
+    "small_step": 0.00013371107343118638,
+    "strong_consistency": 0.029416747391223907
+  },
+  {
+    "step": 999,
+    "loss": 0.0339537039399147,
+    "drift": 0.0003811555216088891,
+    "small_step": 0.00011233892291784286,
+    "strong_consistency": 0.033460211008787155
+  },
+  {
+    "step": 1000,
+    "loss": 0.034526195377111435,
+    "drift": 0.000469778518890962,
+    "small_step": 0.0001174572971649468,
+    "strong_consistency": 0.03393895924091339
+  },
+  {
+    "step": 1001,
+    "loss": 0.051525384187698364,
+    "drift": 0.00040887758950702846,
+    "small_step": 9.16187564143911e-05,
+    "strong_consistency": 0.05102488771080971
+  },
+  {
+    "step": 1002,
+    "loss": 0.028486909344792366,
+    "drift": 0.0006330339820124209,
+    "small_step": 0.0001376512082060799,
+    "strong_consistency": 0.027716225013136864
+  },
+  {
+    "step": 1003,
+    "loss": 0.03759586438536644,
+    "drift": 0.00014658403233624995,
+    "small_step": 6.150569970486686e-05,
+    "strong_consistency": 0.037387773394584656
+  },
+  {
+    "step": 1004,
+    "loss": 0.056267160922288895,
+    "drift": 0.0005617500864900649,
+    "small_step": 8.723675273358822e-05,
+    "strong_consistency": 0.055618174374103546
+  },
+  {
+    "step": 1005,
+    "loss": 0.057393379509449005,
+    "drift": 0.0003071429382544011,
+    "small_step": 8.001468086149544e-05,
+    "strong_consistency": 0.057006221264600754
+  },
+  {
+    "step": 1006,
+    "loss": 0.04170207679271698,
+    "drift": 0.0004846445517614484,
+    "small_step": 0.00015802626148797572,
+    "strong_consistency": 0.041059404611587524
+  },
+  {
+    "step": 1007,
+    "loss": 0.04955153912305832,
+    "drift": 0.00032803695648908615,
+    "small_step": 0.00011191686644451693,
+    "strong_consistency": 0.049111586064100266
+  },
+  {
+    "step": 1008,
+    "loss": 0.040671709924936295,
+    "drift": 0.00031018018489703536,
+    "small_step": 8.459656237391755e-05,
+    "strong_consistency": 0.04027693346142769
+  },
+  {
+    "step": 1009,
+    "loss": 0.03571571409702301,
+    "drift": 0.00035758601734414697,
+    "small_step": 0.0001172319971374236,
+    "strong_consistency": 0.03524089604616165
+  },
+  {
+    "step": 1010,
+    "loss": 0.02425353042781353,
+    "drift": 0.0006976727163419127,
+    "small_step": 9.156690794043243e-05,
+    "strong_consistency": 0.02346429042518139
+  },
+  {
+    "step": 1011,
+    "loss": 0.042106129229068756,
+    "drift": 0.0003137413295917213,
+    "small_step": 0.00012096698628738523,
+    "strong_consistency": 0.04167142137885094
+  },
+  {
+    "step": 1012,
+    "loss": 0.0446181483566761,
+    "drift": 0.0003114942228421569,
+    "small_step": 0.00012331096513662487,
+    "strong_consistency": 0.04418334364891052
+  },
+  {
+    "step": 1013,
+    "loss": 0.04217002913355827,
+    "drift": 0.0003346606972627342,
+    "small_step": 5.258783858153038e-05,
+    "strong_consistency": 0.04178278148174286
+  },
+  {
+    "step": 1014,
+    "loss": 0.050501443445682526,
+    "drift": 0.00017771145212464035,
+    "small_step": 8.879477536538616e-05,
+    "strong_consistency": 0.05023493617773056
+  },
+  {
+    "step": 1015,
+    "loss": 0.034991733729839325,
+    "drift": 0.0002571231161709875,
+    "small_step": 0.0001280851720366627,
+    "strong_consistency": 0.03460652381181717
+  },
+  {
+    "step": 1016,
+    "loss": 0.024328723549842834,
+    "drift": 0.0002848324947990477,
+    "small_step": 8.194397378247231e-05,
+    "strong_consistency": 0.023961946368217468
+  },
+  {
+    "step": 1017,
+    "loss": 0.06822311133146286,
+    "drift": 0.00035293723340146244,
+    "small_step": 8.037182851694524e-05,
+    "strong_consistency": 0.06778980046510696
+  },
+  {
+    "step": 1018,
+    "loss": 0.09676991403102875,
+    "drift": 0.0002974467643070966,
+    "small_step": 5.0145994464401156e-05,
+    "strong_consistency": 0.09642232209444046
+  },
+  {
+    "step": 1019,
+    "loss": 0.03794705867767334,
+    "drift": 0.0003220266953576356,
+    "small_step": 8.158560376614332e-05,
+    "strong_consistency": 0.03754344582557678
+  },
+  {
+    "step": 1020,
+    "loss": 0.04812883958220482,
+    "drift": 0.00032231712248176336,
+    "small_step": 8.799874922260642e-05,
+    "strong_consistency": 0.04771852493286133
+  },
+  {
+    "step": 1021,
+    "loss": 0.048088692128658295,
+    "drift": 0.0005072369240224361,
+    "small_step": 7.603458652738482e-05,
+    "strong_consistency": 0.047505419701337814
+  },
+  {
+    "step": 1022,
+    "loss": 0.06443274766206741,
+    "drift": 0.00014925158757250756,
+    "small_step": 8.847685239743441e-05,
+    "strong_consistency": 0.06419502198696136
+  },
+  {
+    "step": 1023,
+    "loss": 0.028845811262726784,
+    "drift": 0.00041729261283762753,
+    "small_step": 0.00010924649541266263,
+    "strong_consistency": 0.02831927128136158
+  },
+  {
+    "step": 1024,
+    "loss": 0.05689777061343193,
+    "drift": 0.00031242211116477847,
+    "small_step": 0.000112318062747363,
+    "strong_consistency": 0.056473031640052795
+  },
+  {
+    "step": 1025,
+    "loss": 0.032062213867902756,
+    "drift": 0.00026532402262091637,
+    "small_step": 0.00014069656026549637,
+    "strong_consistency": 0.03165619447827339
+  },
+  {
+    "step": 1026,
+    "loss": 0.026109520345926285,
+    "drift": 0.00027931033400818706,
+    "small_step": 0.00011841896775877103,
+    "strong_consistency": 0.025711791589856148
+  },
+  {
+    "step": 1027,
+    "loss": 0.04616588354110718,
+    "drift": 0.00017117758397944272,
+    "small_step": 9.422636503586546e-05,
+    "strong_consistency": 0.04590047895908356
+  },
+  {
+    "step": 1028,
+    "loss": 0.03689378499984741,
+    "drift": 0.000241614761762321,
+    "small_step": 8.438586519332603e-05,
+    "strong_consistency": 0.03656778484582901
+  },
+  {
+    "step": 1029,
+    "loss": 0.05240868031978607,
+    "drift": 0.0001268192718271166,
+    "small_step": 0.00011203360190847889,
+    "strong_consistency": 0.05216982588171959
+  },
+  {
+    "step": 1030,
+    "loss": 0.03461756557226181,
+    "drift": 0.00022391026141121984,
+    "small_step": 0.00010141013626707718,
+    "strong_consistency": 0.03429224342107773
+  },
+  {
+    "step": 1031,
+    "loss": 0.05295658856630325,
+    "drift": 0.0004590766620822251,
+    "small_step": 0.00013680182746611536,
+    "strong_consistency": 0.05236070975661278
+  },
+  {
+    "step": 1032,
+    "loss": 0.05850417539477348,
+    "drift": 0.0003183797816745937,
+    "small_step": 0.00011994277156190947,
+    "strong_consistency": 0.058065854012966156
+  },
+  {
+    "step": 1033,
+    "loss": 0.04882168024778366,
+    "drift": 0.00040967625682242215,
+    "small_step": 9.050659718923271e-05,
+    "strong_consistency": 0.048321496695280075
+  },
+  {
+    "step": 1034,
+    "loss": 0.03995726630091667,
+    "drift": 0.00032299727899953723,
+    "small_step": 8.862814866006374e-05,
+    "strong_consistency": 0.03954564034938812
+  },
+  {
+    "step": 1035,
+    "loss": 0.04208558797836304,
+    "drift": 0.0002857406507246196,
+    "small_step": 0.0001198428581119515,
+    "strong_consistency": 0.04168000444769859
+  },
+  {
+    "step": 1036,
+    "loss": 0.02810731530189514,
+    "drift": 0.00018047730554826558,
+    "small_step": 8.624712791061029e-05,
+    "strong_consistency": 0.027840590104460716
+  },
+  {
+    "step": 1037,
+    "loss": 0.07035579532384872,
+    "drift": 0.00015286638517864048,
+    "small_step": 0.00010736755939433351,
+    "strong_consistency": 0.07009556144475937
+  },
+  {
+    "step": 1038,
+    "loss": 0.047345828264951706,
+    "drift": 0.00038089079316705465,
+    "small_step": 8.872240869095549e-05,
+    "strong_consistency": 0.0468762144446373
+  },
+  {
+    "step": 1039,
+    "loss": 0.058321718126535416,
+    "drift": 0.0001870840205810964,
+    "small_step": 0.00010593766637612134,
+    "strong_consistency": 0.0580286979675293
+  },
+  {
+    "step": 1040,
+    "loss": 0.04472619667649269,
+    "drift": 0.00023250238155014813,
+    "small_step": 0.000111524568637833,
+    "strong_consistency": 0.04438216984272003
+  },
+  {
+    "step": 1041,
+    "loss": 0.028437908738851547,
+    "drift": 0.0002900191175285727,
+    "small_step": 9.10077360458672e-05,
+    "strong_consistency": 0.028056882321834564
+  },
+  {
+    "step": 1042,
+    "loss": 0.07254554331302643,
+    "drift": 0.00032885646214708686,
+    "small_step": 9.931970271281898e-05,
+    "strong_consistency": 0.07211736589670181
+  },
+  {
+    "step": 1043,
+    "loss": 0.025170516222715378,
+    "drift": 0.0003317187656648457,
+    "small_step": 9.836988465394825e-05,
+    "strong_consistency": 0.02474042773246765
+  },
+  {
+    "step": 1044,
+    "loss": 0.031078089028596878,
+    "drift": 0.00020632176892831922,
+    "small_step": 0.00014545379963237792,
+    "strong_consistency": 0.030726313591003418
+  },
+  {
+    "step": 1045,
+    "loss": 0.0429450087249279,
+    "drift": 0.0003046913770958781,
+    "small_step": 0.00017642026068642735,
+    "strong_consistency": 0.04246389865875244
+  },
+  {
+    "step": 1046,
+    "loss": 0.03706137835979462,
+    "drift": 0.00017674130504019558,
+    "small_step": 0.00011690143583109602,
+    "strong_consistency": 0.036767736077308655
+  },
+  {
+    "step": 1047,
+    "loss": 0.06032272055745125,
+    "drift": 0.0001424959918949753,
+    "small_step": 0.0001313551765633747,
+    "strong_consistency": 0.060048870742321014
+  },
+  {
+    "step": 1048,
+    "loss": 0.042069386690855026,
+    "drift": 0.0002495880180504173,
+    "small_step": 0.00017248776566702873,
+    "strong_consistency": 0.04164731130003929
+  },
+  {
+    "step": 1049,
+    "loss": 0.057868216186761856,
+    "drift": 0.0001657796819927171,
+    "small_step": 9.86369195743464e-05,
+    "strong_consistency": 0.05760379880666733
+  },
+  {
+    "step": 1050,
+    "loss": 0.05396515876054764,
+    "drift": 0.00015873883967287838,
+    "small_step": 7.851398549973965e-05,
+    "strong_consistency": 0.053727906197309494
+  },
+  {
+    "step": 1051,
+    "loss": 0.01984979584813118,
+    "drift": 0.00019322443404234946,
+    "small_step": 0.00015367820742540061,
+    "strong_consistency": 0.019502893090248108
+  },
+  {
+    "step": 1052,
+    "loss": 0.044090088456869125,
+    "drift": 0.0001834058784879744,
+    "small_step": 0.00015862502914387733,
+    "strong_consistency": 0.04374805837869644
+  },
+  {
+    "step": 1053,
+    "loss": 0.059750188142061234,
+    "drift": 0.00020840406068600714,
+    "small_step": 0.000126183163956739,
+    "strong_consistency": 0.05941560119390488
+  },
+  {
+    "step": 1054,
+    "loss": 0.055750906467437744,
+    "drift": 0.0003406920877750963,
+    "small_step": 0.00013767350174020976,
+    "strong_consistency": 0.05527254194021225
+  },
+  {
+    "step": 1055,
+    "loss": 0.05012843757867813,
+    "drift": 0.0002427588915452361,
+    "small_step": 0.00010736512922449037,
+    "strong_consistency": 0.04977831244468689
+  },
+  {
+    "step": 1056,
+    "loss": 0.0871688649058342,
+    "drift": 0.00020572266657836735,
+    "small_step": 0.00011130846542073414,
+    "strong_consistency": 0.08685183525085449
+  },
+  {
+    "step": 1057,
+    "loss": 0.03855274245142937,
+    "drift": 0.0002813704777508974,
+    "small_step": 7.00821983627975e-05,
+    "strong_consistency": 0.03820129111409187
+  },
+  {
+    "step": 1058,
+    "loss": 0.07026468962430954,
+    "drift": 0.0004074181488249451,
+    "small_step": 0.00011472368350951001,
+    "strong_consistency": 0.06974254548549652
+  },
+  {
+    "step": 1059,
+    "loss": 0.04934883490204811,
+    "drift": 0.0002864546549972147,
+    "small_step": 0.00014348494005389512,
+    "strong_consistency": 0.04891889542341232
+  },
+  {
+    "step": 1060,
+    "loss": 0.03898165374994278,
+    "drift": 0.0004945031832903624,
+    "small_step": 0.00011323206854285672,
+    "strong_consistency": 0.0383739173412323
+  },
+  {
+    "step": 1061,
+    "loss": 0.07116743922233582,
+    "drift": 0.00045160166337154806,
+    "small_step": 0.00011526849993970245,
+    "strong_consistency": 0.07060056924819946
+  },
+  {
+    "step": 1062,
+    "loss": 0.03697672858834267,
+    "drift": 0.00037737746606580913,
+    "small_step": 0.00012429733760654926,
+    "strong_consistency": 0.036475054919719696
+  },
+  {
+    "step": 1063,
+    "loss": 0.035734061151742935,
+    "drift": 0.0003977972373832017,
+    "small_step": 0.00015923625323921442,
+    "strong_consistency": 0.03517702594399452
+  },
+  {
+    "step": 1064,
+    "loss": 0.028314944356679916,
+    "drift": 0.0001753965625539422,
+    "small_step": 0.00012786805746145546,
+    "strong_consistency": 0.028011679649353027
+  },
+  {
+    "step": 1065,
+    "loss": 0.04914604872465134,
+    "drift": 0.0003236178308725357,
+    "small_step": 0.0002195310516981408,
+    "strong_consistency": 0.04860290139913559
+  },
+  {
+    "step": 1066,
+    "loss": 0.03198712691664696,
+    "drift": 0.00032491085585206747,
+    "small_step": 0.0001592125918250531,
+    "strong_consistency": 0.03150300309062004
+  },
+  {
+    "step": 1067,
+    "loss": 0.08789696544408798,
+    "drift": 0.00019099091878160834,
+    "small_step": 0.00014581161667592824,
+    "strong_consistency": 0.08756016194820404
+  },
+  {
+    "step": 1068,
+    "loss": 0.040521953254938126,
+    "drift": 0.0003939770394936204,
+    "small_step": 0.00013386212231125683,
+    "strong_consistency": 0.03999411314725876
+  },
+  {
+    "step": 1069,
+    "loss": 0.03894843906164169,
+    "drift": 0.00020101731934119016,
+    "small_step": 0.00013336073607206345,
+    "strong_consistency": 0.03861406072974205
+  },
+  {
+    "step": 1070,
+    "loss": 0.053072571754455566,
+    "drift": 0.0004501674266066402,
+    "small_step": 0.00010481796925887465,
+    "strong_consistency": 0.05251758545637131
+  },
+  {
+    "step": 1071,
+    "loss": 0.0907074362039566,
+    "drift": 0.0002617444552015513,
+    "small_step": 0.0002053996577160433,
+    "strong_consistency": 0.09024029225111008
+  },
+  {
+    "step": 1072,
+    "loss": 0.04163569211959839,
+    "drift": 0.00031072142883203924,
+    "small_step": 0.00012265736586414278,
+    "strong_consistency": 0.04120231419801712
+  },
+  {
+    "step": 1073,
+    "loss": 0.04595489799976349,
+    "drift": 0.00027587340446189046,
+    "small_step": 9.774410136742517e-05,
+    "strong_consistency": 0.045581281185150146
+  },
+  {
+    "step": 1074,
+    "loss": 0.020495925098657608,
+    "drift": 0.000303202512441203,
+    "small_step": 0.00012089138181181625,
+    "strong_consistency": 0.020071830600500107
+  },
+  {
+    "step": 1075,
+    "loss": 0.021172989159822464,
+    "drift": 0.00035784184001386166,
+    "small_step": 0.00010644417488947511,
+    "strong_consistency": 0.020708702504634857
+  },
+  {
+    "step": 1076,
+    "loss": 0.04476745426654816,
+    "drift": 0.00033977223210968077,
+    "small_step": 0.00011165267642354593,
+    "strong_consistency": 0.04431603103876114
+  },
+  {
+    "step": 1077,
+    "loss": 0.054684121161699295,
+    "drift": 0.0003534446004778147,
+    "small_step": 0.00014968150935601443,
+    "strong_consistency": 0.054180994629859924
+  },
+  {
+    "step": 1078,
+    "loss": 0.022413507103919983,
+    "drift": 0.00044465914834290743,
+    "small_step": 0.0002656674478203058,
+    "strong_consistency": 0.02170317992568016
+  },
+  {
+    "step": 1079,
+    "loss": 0.040054190903902054,
+    "drift": 0.00035284162731841207,
+    "small_step": 0.0001509246794739738,
+    "strong_consistency": 0.03955042362213135
+  },
+  {
+    "step": 1080,
+    "loss": 0.11645743995904922,
+    "drift": 0.00027382723055779934,
+    "small_step": 0.00011810729483840987,
+    "strong_consistency": 0.11606550216674805
+  },
+  {
+    "step": 1081,
+    "loss": 0.03631795197725296,
+    "drift": 0.00019758238340727985,
+    "small_step": 9.760302782524377e-05,
+    "strong_consistency": 0.036022767424583435
+  },
+  {
+    "step": 1082,
+    "loss": 0.03675189986824989,
+    "drift": 0.0002566305047366768,
+    "small_step": 0.00020581393619067967,
+    "strong_consistency": 0.036289457231760025
+  },
+  {
+    "step": 1083,
+    "loss": 0.04730129987001419,
+    "drift": 0.0002861698449123651,
+    "small_step": 0.0001309570943703875,
+    "strong_consistency": 0.04688417166471481
+  },
+  {
+    "step": 1084,
+    "loss": 0.04684321582317352,
+    "drift": 0.0004943167441524565,
+    "small_step": 0.00012088994117220864,
+    "strong_consistency": 0.04622801020741463
+  },
+  {
+    "step": 1085,
+    "loss": 0.07353190332651138,
+    "drift": 0.00022633805929217488,
+    "small_step": 0.00015312136383727193,
+    "strong_consistency": 0.07315244525671005
+  },
+  {
+    "step": 1086,
+    "loss": 0.04134397208690643,
+    "drift": 0.00025292893406003714,
+    "small_step": 0.0001380358444293961,
+    "strong_consistency": 0.040953006595373154
+  },
+  {
+    "step": 1087,
+    "loss": 0.07032885402441025,
+    "drift": 0.0002713098074309528,
+    "small_step": 0.0001761887688189745,
+    "strong_consistency": 0.06988135725259781
+  },
+  {
+    "step": 1088,
+    "loss": 0.08976650983095169,
+    "drift": 0.000122328448924236,
+    "small_step": 0.00012592796701937914,
+    "strong_consistency": 0.08951825648546219
+  },
+  {
+    "step": 1089,
+    "loss": 0.04678164795041084,
+    "drift": 0.0003577308380044997,
+    "small_step": 0.00013842352200299501,
+    "strong_consistency": 0.04628549516201019
+  },
+  {
+    "step": 1090,
+    "loss": 0.09220776706933975,
+    "drift": 0.0002864068665076047,
+    "small_step": 0.0001643495779717341,
+    "strong_consistency": 0.09175700694322586
+  },
+  {
+    "step": 1091,
+    "loss": 0.05568933114409447,
+    "drift": 0.00029139957041479647,
+    "small_step": 0.00014755591109860688,
+    "strong_consistency": 0.0552503764629364
+  },
+  {
+    "step": 1092,
+    "loss": 0.033562518656253815,
+    "drift": 0.00023237685672938824,
+    "small_step": 0.00014032202307134867,
+    "strong_consistency": 0.033189818263053894
+  },
+  {
+    "step": 1093,
+    "loss": 0.05718144401907921,
+    "drift": 0.00024111548555083573,
+    "small_step": 0.00014970233314670622,
+    "strong_consistency": 0.05679062753915787
+  },
+  {
+    "step": 1094,
+    "loss": 0.04292398318648338,
+    "drift": 0.00026969792088493705,
+    "small_step": 0.00015151241677813232,
+    "strong_consistency": 0.04250277206301689
+  },
+  {
+    "step": 1095,
+    "loss": 0.10978330671787262,
+    "drift": 0.00035190850030630827,
+    "small_step": 0.00011752248974516988,
+    "strong_consistency": 0.10931387543678284
+  },
+  {
+    "step": 1096,
+    "loss": 0.06618891656398773,
+    "drift": 0.00019536913896445185,
+    "small_step": 0.0001239139528479427,
+    "strong_consistency": 0.06586963683366776
+  },
+  {
+    "step": 1097,
+    "loss": 0.056833066046237946,
+    "drift": 0.0002748168190009892,
+    "small_step": 0.00013753071834798902,
+    "strong_consistency": 0.056420717388391495
+  },
+  {
+    "step": 1098,
+    "loss": 0.05780839920043945,
+    "drift": 0.00022902005002833903,
+    "small_step": 0.0001729358482407406,
+    "strong_consistency": 0.05740644410252571
+  },
+  {
+    "step": 1099,
+    "loss": 0.032534174621105194,
+    "drift": 0.00027628563111647964,
+    "small_step": 9.114464046433568e-05,
+    "strong_consistency": 0.0321667455136776
+  },
+  {
+    "step": 1100,
+    "loss": 0.05328262597322464,
+    "drift": 0.0002404914703220129,
+    "small_step": 0.0001261159632122144,
+    "strong_consistency": 0.052916020154953
+  },
+  {
+    "step": 1101,
+    "loss": 0.04774005338549614,
+    "drift": 0.00026447881828062236,
+    "small_step": 0.0001366872020298615,
+    "strong_consistency": 0.04733888804912567
+  },
+  {
+    "step": 1102,
+    "loss": 0.10371658951044083,
+    "drift": 0.00021509677753783762,
+    "small_step": 9.984375355998054e-05,
+    "strong_consistency": 0.10340164601802826
+  },
+  {
+    "step": 1103,
+    "loss": 0.052222833037376404,
+    "drift": 0.00018058464047499,
+    "small_step": 0.00011966402234975249,
+    "strong_consistency": 0.05192258581519127
+  },
+  {
+    "step": 1104,
+    "loss": 0.0660167708992958,
+    "drift": 0.00023957915254868567,
+    "small_step": 0.00015653071750421077,
+    "strong_consistency": 0.06562066078186035
+  },
+  {
+    "step": 1105,
+    "loss": 0.06780165433883667,
+    "drift": 0.00019113736925646663,
+    "small_step": 0.00012243050150573254,
+    "strong_consistency": 0.06748808920383453
+  },
+  {
+    "step": 1106,
+    "loss": 0.04990210011601448,
+    "drift": 0.00020035954366903752,
+    "small_step": 0.00012919775326736271,
+    "strong_consistency": 0.04957254230976105
+  },
+  {
+    "step": 1107,
+    "loss": 0.05526738986372948,
+    "drift": 0.00016121650696732104,
+    "small_step": 0.00013366607890930027,
+    "strong_consistency": 0.05497250705957413
+  },
+  {
+    "step": 1108,
+    "loss": 0.03815332427620888,
+    "drift": 0.00022280204575508833,
+    "small_step": 0.00026480041560716927,
+    "strong_consistency": 0.0376657210290432
+  },
+  {
+    "step": 1109,
+    "loss": 0.035662949085235596,
+    "drift": 0.0001972031022887677,
+    "small_step": 0.00019139560754410923,
+    "strong_consistency": 0.03527434915304184
+  },
+  {
+    "step": 1110,
+    "loss": 0.04312024265527725,
+    "drift": 0.00010323467722628266,
+    "small_step": 9.858667181106284e-05,
+    "strong_consistency": 0.04291842132806778
+  },
+  {
+    "step": 1111,
+    "loss": 0.04036971181631088,
+    "drift": 0.00017778974142856896,
+    "small_step": 0.00012121725740144029,
+    "strong_consistency": 0.040070705115795135
+  },
+  {
+    "step": 1112,
+    "loss": 0.040544699877500534,
+    "drift": 0.00021854264196008444,
+    "small_step": 0.00011820794316008687,
+    "strong_consistency": 0.04020794853568077
+  },
+  {
+    "step": 1113,
+    "loss": 0.05325862020254135,
+    "drift": 0.00017745733202900738,
+    "small_step": 0.00018019622075371444,
+    "strong_consistency": 0.05290096625685692
+  },
+  {
+    "step": 1114,
+    "loss": 0.15039433538913727,
+    "drift": 0.00011087718303315341,
+    "small_step": 0.0001763676555128768,
+    "strong_consistency": 0.15010708570480347
+  },
+  {
+    "step": 1115,
+    "loss": 0.038118742406368256,
+    "drift": 0.00018509603978600353,
+    "small_step": 0.00015211796562653035,
+    "strong_consistency": 0.03778152912855148
+  },
+  {
+    "step": 1116,
+    "loss": 0.065106600522995,
+    "drift": 0.0001862694334704429,
+    "small_step": 0.0001316435809712857,
+    "strong_consistency": 0.06478868424892426
+  },
+  {
+    "step": 1117,
+    "loss": 0.05687104910612106,
+    "drift": 0.0001667731412453577,
+    "small_step": 0.00013634773495141417,
+    "strong_consistency": 0.056567929685115814
+  },
+  {
+    "step": 1118,
+    "loss": 0.03748356178402901,
+    "drift": 0.00014703348278999329,
+    "small_step": 0.0001316658454015851,
+    "strong_consistency": 0.037204861640930176
+  },
+  {
+    "step": 1119,
+    "loss": 0.06043609604239464,
+    "drift": 0.0002508175384718925,
+    "small_step": 0.0002211096725659445,
+    "strong_consistency": 0.059964168816804886
+  },
+  {
+    "step": 1120,
+    "loss": 0.0659106969833374,
+    "drift": 0.00018114055274054408,
+    "small_step": 0.0001598245435161516,
+    "strong_consistency": 0.06556972861289978
+  },
+  {
+    "step": 1121,
+    "loss": 0.038479190319776535,
+    "drift": 9.9749187938869e-05,
+    "small_step": 0.0001434941659681499,
+    "strong_consistency": 0.038235947489738464
+  },
+  {
+    "step": 1122,
+    "loss": 0.09819579124450684,
+    "drift": 0.00022637686925008893,
+    "small_step": 0.0001004255173029378,
+    "strong_consistency": 0.09786898642778397
+  },
+  {
+    "step": 1123,
+    "loss": 0.03779866173863411,
+    "drift": 0.00021528813522309065,
+    "small_step": 0.00013561926607508212,
+    "strong_consistency": 0.03744775429368019
+  },
+  {
+    "step": 1124,
+    "loss": 0.06160854548215866,
+    "drift": 0.00030316784977912903,
+    "small_step": 0.0001080353104043752,
+    "strong_consistency": 0.06119734048843384
+  },
+  {
+    "step": 1125,
+    "loss": 0.09793101996183395,
+    "drift": 0.0002745573001448065,
+    "small_step": 0.00014094615471549332,
+    "strong_consistency": 0.0975155159831047
+  },
+  {
+    "step": 1126,
+    "loss": 0.08527848869562149,
+    "drift": 0.0006247791461646557,
+    "small_step": 0.000152843160321936,
+    "strong_consistency": 0.08450086414813995
+  },
+  {
+    "step": 1127,
+    "loss": 0.06188100948929787,
+    "drift": 0.000350520305801183,
+    "small_step": 0.00020811831927858293,
+    "strong_consistency": 0.061322372406721115
+  },
+  {
+    "step": 1128,
+    "loss": 0.032096389681100845,
+    "drift": 0.0004694041854236275,
+    "small_step": 0.0001761172024998814,
+    "strong_consistency": 0.031450867652893066
+  },
+  {
+    "step": 1129,
+    "loss": 0.027683505788445473,
+    "drift": 0.00047997396904975176,
+    "small_step": 0.00017486882279627025,
+    "strong_consistency": 0.027028663083910942
+  },
+  {
+    "step": 1130,
+    "loss": 0.06617524474859238,
+    "drift": 0.0004373248666524887,
+    "small_step": 0.0001857533206930384,
+    "strong_consistency": 0.06555216759443283
+  },
+  {
+    "step": 1131,
+    "loss": 0.14178135991096497,
+    "drift": 0.00038843968650326133,
+    "small_step": 0.00010535479668760672,
+    "strong_consistency": 0.14128756523132324
+  },
+  {
+    "step": 1132,
+    "loss": 0.05913520231842995,
+    "drift": 0.0003792190400417894,
+    "small_step": 0.00015650705609004945,
+    "strong_consistency": 0.058599475771188736
+  },
+  {
+    "step": 1133,
+    "loss": 0.042828064411878586,
+    "drift": 0.0004613132041413337,
+    "small_step": 0.00011608789645833895,
+    "strong_consistency": 0.04225066304206848
+  },
+  {
+    "step": 1134,
+    "loss": 0.050328582525253296,
+    "drift": 0.0006368427420966327,
+    "small_step": 0.00018733138858806342,
+    "strong_consistency": 0.04950440675020218
+  },
+  {
+    "step": 1135,
+    "loss": 0.05109643563628197,
+    "drift": 0.00029936563805676997,
+    "small_step": 0.0001303749595535919,
+    "strong_consistency": 0.050666693598032
+  },
+  {
+    "step": 1136,
+    "loss": 0.025703001767396927,
+    "drift": 0.0002599205472506583,
+    "small_step": 0.0001449038099963218,
+    "strong_consistency": 0.02529817819595337
+  },
+  {
+    "step": 1137,
+    "loss": 0.06506229937076569,
+    "drift": 0.00034776260145008564,
+    "small_step": 0.00017154758097603917,
+    "strong_consistency": 0.0645429864525795
+  },
+  {
+    "step": 1138,
+    "loss": 0.09499649703502655,
+    "drift": 0.00019812415121123195,
+    "small_step": 8.662696200190112e-05,
+    "strong_consistency": 0.09471174329519272
+  },
+  {
+    "step": 1139,
+    "loss": 0.08826397359371185,
+    "drift": 0.0002584323228802532,
+    "small_step": 0.00017722467600833625,
+    "strong_consistency": 0.08782831579446793
+  },
+  {
+    "step": 1140,
+    "loss": 0.04235900565981865,
+    "drift": 0.00031545289675705135,
+    "small_step": 0.00023261064779944718,
+    "strong_consistency": 0.04181094095110893
+  },
+  {
+    "step": 1141,
+    "loss": 0.046392425894737244,
+    "drift": 0.0004435090522747487,
+    "small_step": 0.0001774428237695247,
+    "strong_consistency": 0.04577147588133812
+  },
+  {
+    "step": 1142,
+    "loss": 0.031052684411406517,
+    "drift": 0.0002631812822073698,
+    "small_step": 0.00012801692355424166,
+    "strong_consistency": 0.030661486089229584
+  },
+  {
+    "step": 1143,
+    "loss": 0.07913457602262497,
+    "drift": 0.00038310885429382324,
+    "small_step": 0.00014513616042677313,
+    "strong_consistency": 0.07860632985830307
+  },
+  {
+    "step": 1144,
+    "loss": 0.09946516156196594,
+    "drift": 0.0002974546514451504,
+    "small_step": 0.000224056449951604,
+    "strong_consistency": 0.09894365072250366
+  },
+  {
+    "step": 1145,
+    "loss": 0.05282485857605934,
+    "drift": 0.0002984931052196771,
+    "small_step": 0.00015600521874148399,
+    "strong_consistency": 0.05237036198377609
+  },
+  {
+    "step": 1146,
+    "loss": 0.08288903534412384,
+    "drift": 0.0002460671530570835,
+    "small_step": 0.00016602064715698361,
+    "strong_consistency": 0.08247695118188858
+  },
+  {
+    "step": 1147,
+    "loss": 0.0767701119184494,
+    "drift": 0.0004034278099425137,
+    "small_step": 0.000157994290930219,
+    "strong_consistency": 0.0762086883187294
+  },
+  {
+    "step": 1148,
+    "loss": 0.05133439600467682,
+    "drift": 0.0003157922183163464,
+    "small_step": 0.0001391569385305047,
+    "strong_consistency": 0.050879448652267456
+  },
+  {
+    "step": 1149,
+    "loss": 0.09907471388578415,
+    "drift": 0.00034126098034903407,
+    "small_step": 0.0001767971843946725,
+    "strong_consistency": 0.09855665266513824
+  },
+  {
+    "step": 1150,
+    "loss": 0.040037453174591064,
+    "drift": 0.00017467229918111116,
+    "small_step": 0.00012480233272071928,
+    "strong_consistency": 0.03973797708749771
+  },
+  {
+    "step": 1151,
+    "loss": 0.0443434901535511,
+    "drift": 0.00020086558652110398,
+    "small_step": 0.00014253593690227717,
+    "strong_consistency": 0.044000089168548584
+  },
+  {
+    "step": 1152,
+    "loss": 0.06073084473609924,
+    "drift": 0.00019096676260232925,
+    "small_step": 0.00015935336705297232,
+    "strong_consistency": 0.06038052588701248
+  },
+  {
+    "step": 1153,
+    "loss": 0.03426845371723175,
+    "drift": 0.00028691551415249705,
+    "small_step": 0.00020129131735302508,
+    "strong_consistency": 0.03378024697303772
+  },
+  {
+    "step": 1154,
+    "loss": 0.039844486862421036,
+    "drift": 0.00021748848666902632,
+    "small_step": 0.00018922881281469017,
+    "strong_consistency": 0.03943777084350586
+  },
+  {
+    "step": 1155,
+    "loss": 0.08775793761014938,
+    "drift": 0.00019809008517768234,
+    "small_step": 0.00023500352108385414,
+    "strong_consistency": 0.0873248428106308
+  },
+  {
+    "step": 1156,
+    "loss": 0.1162782683968544,
+    "drift": 0.00015359604731202126,
+    "small_step": 0.0003216954064555466,
+    "strong_consistency": 0.11580297350883484
+  },
+  {
+    "step": 1157,
+    "loss": 0.057962216436862946,
+    "drift": 0.0002414317277725786,
+    "small_step": 0.00016915227752178907,
+    "strong_consistency": 0.057551633566617966
+  },
+  {
+    "step": 1158,
+    "loss": 0.1015404760837555,
+    "drift": 0.00019783123570960015,
+    "small_step": 0.00015743069525342435,
+    "strong_consistency": 0.10118521749973297
+  },
+  {
+    "step": 1159,
+    "loss": 0.03077593818306923,
+    "drift": 0.00017431736341677606,
+    "small_step": 0.00016694943769834936,
+    "strong_consistency": 0.03043467178940773
+  },
+  {
+    "step": 1160,
+    "loss": 0.08216753602027893,
+    "drift": 0.00019989807333331555,
+    "small_step": 0.0002945649903267622,
+    "strong_consistency": 0.08167307078838348
+  },
+  {
+    "step": 1161,
+    "loss": 0.0664307102560997,
+    "drift": 0.0002019597013713792,
+    "small_step": 0.00015795728540979326,
+    "strong_consistency": 0.0660707950592041
+  },
+  {
+    "step": 1162,
+    "loss": 0.04886975139379501,
+    "drift": 0.0001858623290900141,
+    "small_step": 0.00019694525690283626,
+    "strong_consistency": 0.048486944288015366
+  },
+  {
+    "step": 1163,
+    "loss": 0.06279784440994263,
+    "drift": 0.00027554621919989586,
+    "small_step": 0.00015211928985081613,
+    "strong_consistency": 0.0623701810836792
+  },
+  {
+    "step": 1164,
+    "loss": 0.04491891339421272,
+    "drift": 0.0002301376371178776,
+    "small_step": 0.00021454747184179723,
+    "strong_consistency": 0.04447422921657562
+  },
+  {
+    "step": 1165,
+    "loss": 0.08942149579524994,
+    "drift": 0.0001767781504895538,
+    "small_step": 0.00016300403513014317,
+    "strong_consistency": 0.08908171206712723
+  },
+  {
+    "step": 1166,
+    "loss": 0.04563683643937111,
+    "drift": 0.0002660925383679569,
+    "small_step": 0.00028966902755200863,
+    "strong_consistency": 0.04508107528090477
+  },
+  {
+    "step": 1167,
+    "loss": 0.10938055068254471,
+    "drift": 0.0002850357268471271,
+    "small_step": 0.00024353474145755172,
+    "strong_consistency": 0.10885197669267654
+  },
+  {
+    "step": 1168,
+    "loss": 0.09139011800289154,
+    "drift": 0.00022552855079993606,
+    "small_step": 0.00013730081263929605,
+    "strong_consistency": 0.09102728962898254
+  },
+  {
+    "step": 1169,
+    "loss": 0.07888045161962509,
+    "drift": 0.00022495849407278,
+    "small_step": 0.0001679609267739579,
+    "strong_consistency": 0.07848753035068512
+  },
+  {
+    "step": 1170,
+    "loss": 0.048498593270778656,
+    "drift": 0.000216857239138335,
+    "small_step": 0.00016803687321953475,
+    "strong_consistency": 0.04811370000243187
+  },
+  {
+    "step": 1171,
+    "loss": 0.04393384978175163,
+    "drift": 0.00021150390966795385,
+    "small_step": 0.00023879154468886554,
+    "strong_consistency": 0.04348355531692505
+  },
+  {
+    "step": 1172,
+    "loss": 0.06623291224241257,
+    "drift": 0.00031366082839667797,
+    "small_step": 0.0002502233546692878,
+    "strong_consistency": 0.06566902995109558
+  },
+  {
+    "step": 1173,
+    "loss": 0.05719440057873726,
+    "drift": 0.0002064795116893947,
+    "small_step": 0.00010228255996480584,
+    "strong_consistency": 0.05688563734292984
+  },
+  {
+    "step": 1174,
+    "loss": 0.06907683610916138,
+    "drift": 0.0002813154424075037,
+    "small_step": 0.00022791282390244305,
+    "strong_consistency": 0.06856761127710342
+  },
+  {
+    "step": 1175,
+    "loss": 0.07046782970428467,
+    "drift": 0.00020578833937179297,
+    "small_step": 0.000209889403777197,
+    "strong_consistency": 0.07005215436220169
+  },
+  {
+    "step": 1176,
+    "loss": 0.07350198924541473,
+    "drift": 0.00029122288106009364,
+    "small_step": 0.00029458609060384333,
+    "strong_consistency": 0.072916179895401
+  },
+  {
+    "step": 1177,
+    "loss": 0.05019579082727432,
+    "drift": 0.0002094793744618073,
+    "small_step": 0.00020384276285767555,
+    "strong_consistency": 0.04978246986865997
+  },
+  {
+    "step": 1178,
+    "loss": 0.03252016380429268,
+    "drift": 0.0001594198402017355,
+    "small_step": 9.75440998445265e-05,
+    "strong_consistency": 0.03226320073008537
+  },
+  {
+    "step": 1179,
+    "loss": 0.08278711140155792,
+    "drift": 0.00012714919284917414,
+    "small_step": 0.00014034354535397142,
+    "strong_consistency": 0.08251962065696716
+  },
+  {
+    "step": 1180,
+    "loss": 0.05255940929055214,
+    "drift": 0.000109559201519005,
+    "small_step": 0.0001775217242538929,
+    "strong_consistency": 0.05227232724428177
+  },
+  {
+    "step": 1181,
+    "loss": 0.05254314839839935,
+    "drift": 0.00017366220708936453,
+    "small_step": 0.00012945584603585303,
+    "strong_consistency": 0.052240028977394104
+  },
+  {
+    "step": 1182,
+    "loss": 0.07235828042030334,
+    "drift": 0.00015152098785620183,
+    "small_step": 0.00018750719027593732,
+    "strong_consistency": 0.07201924920082092
+  },
+  {
+    "step": 1183,
+    "loss": 0.09005507081747055,
+    "drift": 0.00017710946849547327,
+    "small_step": 0.00025779654970392585,
+    "strong_consistency": 0.08962016552686691
+  },
+  {
+    "step": 1184,
+    "loss": 0.05461716651916504,
+    "drift": 0.00016877238522283733,
+    "small_step": 0.00014477301738224924,
+    "strong_consistency": 0.054303620010614395
+  },
+  {
+    "step": 1185,
+    "loss": 0.038792673498392105,
+    "drift": 0.00012898231216240674,
+    "small_step": 0.00015251978766173124,
+    "strong_consistency": 0.03851117193698883
+  },
+  {
+    "step": 1186,
+    "loss": 0.1326407492160797,
+    "drift": 0.00011753164289984852,
+    "small_step": 0.00017117272363975644,
+    "strong_consistency": 0.1323520392179489
+  },
+  {
+    "step": 1187,
+    "loss": 0.03943784534931183,
+    "drift": 0.00018047010235022753,
+    "small_step": 0.00018609684775583446,
+    "strong_consistency": 0.039071276783943176
+  },
+  {
+    "step": 1188,
+    "loss": 0.0801348015666008,
+    "drift": 0.00012300186790525913,
+    "small_step": 0.00013941858196631074,
+    "strong_consistency": 0.07987238466739655
+  },
+  {
+    "step": 1189,
+    "loss": 0.07057758420705795,
+    "drift": 0.00011004066618625075,
+    "small_step": 0.00018889365310315043,
+    "strong_consistency": 0.07027865201234818
+  },
+  {
+    "step": 1190,
+    "loss": 0.08434700965881348,
+    "drift": 0.0001276201946893707,
+    "small_step": 0.0002489955222699791,
+    "strong_consistency": 0.08397039026021957
+  },
+  {
+    "step": 1191,
+    "loss": 0.09440096467733383,
+    "drift": 0.00022970762802287936,
+    "small_step": 0.00023419182980433106,
+    "strong_consistency": 0.09393706172704697
+  },
+  {
+    "step": 1192,
+    "loss": 0.06390812993049622,
+    "drift": 0.0001553923502797261,
+    "small_step": 0.0001974915066966787,
+    "strong_consistency": 0.06355524808168411
+  },
+  {
+    "step": 1193,
+    "loss": 0.045641541481018066,
+    "drift": 0.00019904074724763632,
+    "small_step": 0.00034354650415480137,
+    "strong_consistency": 0.04509895294904709
+  },
+  {
+    "step": 1194,
+    "loss": 0.09724482148885727,
+    "drift": 0.0001999697124119848,
+    "small_step": 0.0002406181301921606,
+    "strong_consistency": 0.09680423140525818
+  },
+  {
+    "step": 1195,
+    "loss": 0.03765050321817398,
+    "drift": 0.000231710058869794,
+    "small_step": 0.00021559529704973102,
+    "strong_consistency": 0.03720319643616676
+  },
+  {
+    "step": 1196,
+    "loss": 0.08646105229854584,
+    "drift": 0.0002553118101786822,
+    "small_step": 0.00020147947361692786,
+    "strong_consistency": 0.08600426465272903
+  },
+  {
+    "step": 1197,
+    "loss": 0.07046934962272644,
+    "drift": 0.00016605856944806874,
+    "small_step": 0.00025310961063951254,
+    "strong_consistency": 0.0700501799583435
+  },
+  {
+    "step": 1198,
+    "loss": 0.09801817685365677,
+    "drift": 0.0003033552202396095,
+    "small_step": 0.00025456235744059086,
+    "strong_consistency": 0.09746026247739792
+  },
+  {
+    "step": 1199,
+    "loss": 0.07894352823495865,
+    "drift": 0.0001858524337876588,
+    "small_step": 0.0003192498115822673,
+    "strong_consistency": 0.0784384235739708
+  },
+  {
+    "step": 1200,
+    "loss": 0.08334724605083466,
+    "drift": 0.00021650121198035777,
+    "small_step": 0.0002081198908854276,
+    "strong_consistency": 0.08292262256145477
+  },
+  {
+    "step": 1201,
+    "loss": 0.05989815667271614,
+    "drift": 0.0002704889921005815,
+    "small_step": 0.00023538981622550637,
+    "strong_consistency": 0.05939227715134621
+  },
+  {
+    "step": 1202,
+    "loss": 0.04225285351276398,
+    "drift": 0.0003104465431533754,
+    "small_step": 0.0001914088352350518,
+    "strong_consistency": 0.04175099730491638
+  },
+  {
+    "step": 1203,
+    "loss": 0.04457753151655197,
+    "drift": 0.00036128616193309426,
+    "small_step": 0.00039631896652281284,
+    "strong_consistency": 0.04381992667913437
+  },
+  {
+    "step": 1204,
+    "loss": 0.0404057614505291,
+    "drift": 0.0003460345615167171,
+    "small_step": 0.0001567864092066884,
+    "strong_consistency": 0.0399029403924942
+  },
+  {
+    "step": 1205,
+    "loss": 0.08731615543365479,
+    "drift": 0.0003367601311765611,
+    "small_step": 0.0002722218632698059,
+    "strong_consistency": 0.08670717477798462
+  },
+  {
+    "step": 1206,
+    "loss": 0.050449490547180176,
+    "drift": 0.00032299867598339915,
+    "small_step": 0.00019608184811659157,
+    "strong_consistency": 0.04993040859699249
+  },
+  {
+    "step": 1207,
+    "loss": 0.06647484749555588,
+    "drift": 0.0002860421664081514,
+    "small_step": 0.0002481793344486505,
+    "strong_consistency": 0.06594062596559525
+  },
+  {
+    "step": 1208,
+    "loss": 0.029066482558846474,
+    "drift": 0.00025597482454031706,
+    "small_step": 0.0003557619347702712,
+    "strong_consistency": 0.028454745188355446
+  },
+  {
+    "step": 1209,
+    "loss": 0.09723184257745743,
+    "drift": 0.00024848798057064414,
+    "small_step": 0.0002304013178218156,
+    "strong_consistency": 0.09675295650959015
+  },
+  {
+    "step": 1210,
+    "loss": 0.05025371164083481,
+    "drift": 0.0002556710096541792,
+    "small_step": 0.000246050680289045,
+    "strong_consistency": 0.04975198954343796
+  },
+  {
+    "step": 1211,
+    "loss": 0.09564491361379623,
+    "drift": 0.0003824126033578068,
+    "small_step": 0.0002902169362641871,
+    "strong_consistency": 0.09497228264808655
+  },
+  {
+    "step": 1212,
+    "loss": 0.12201827019453049,
+    "drift": 0.0007445844239555299,
+    "small_step": 0.00026111872284673154,
+    "strong_consistency": 0.12101256847381592
+  },
+  {
+    "step": 1213,
+    "loss": 0.027386289089918137,
+    "drift": 0.00035432918230071664,
+    "small_step": 0.0002855685306712985,
+    "strong_consistency": 0.026746392250061035
+  },
+  {
+    "step": 1214,
+    "loss": 0.06163175404071808,
+    "drift": 0.0004354940901976079,
+    "small_step": 0.00023530234466306865,
+    "strong_consistency": 0.060960955917835236
+  },
+  {
+    "step": 1215,
+    "loss": 0.08103089779615402,
+    "drift": 0.00016292919463012367,
+    "small_step": 0.0002782071242108941,
+    "strong_consistency": 0.08058976382017136
+  },
+  {
+    "step": 1216,
+    "loss": 0.039849068969488144,
+    "drift": 0.0003173711011186242,
+    "small_step": 0.00021568191004917026,
+    "strong_consistency": 0.03931601718068123
+  },
+  {
+    "step": 1217,
+    "loss": 0.08178739994764328,
+    "drift": 0.00022072787396609783,
+    "small_step": 0.000237659813137725,
+    "strong_consistency": 0.08132901042699814
+  },
+  {
+    "step": 1218,
+    "loss": 0.0550910085439682,
+    "drift": 0.00023145471641328186,
+    "small_step": 0.0002782415540423244,
+    "strong_consistency": 0.05458131060004234
+  },
+  {
+    "step": 1219,
+    "loss": 0.04892030358314514,
+    "drift": 0.0002512384671717882,
+    "small_step": 0.0002264235372422263,
+    "strong_consistency": 0.048442643135786057
+  },
+  {
+    "step": 1220,
+    "loss": 0.05797777324914932,
+    "drift": 0.0002334962337044999,
+    "small_step": 0.000113467984192539,
+    "strong_consistency": 0.05763080716133118
+  },
+  {
+    "step": 1221,
+    "loss": 0.0706174373626709,
+    "drift": 0.00019385894120205194,
+    "small_step": 0.00022398492728825659,
+    "strong_consistency": 0.07019959390163422
+  },
+  {
+    "step": 1222,
+    "loss": 0.05363161489367485,
+    "drift": 0.00023026810958981514,
+    "small_step": 0.00016460259212180972,
+    "strong_consistency": 0.05323674529790878
+  },
+  {
+    "step": 1223,
+    "loss": 0.11679021269083023,
+    "drift": 0.0002706939703784883,
+    "small_step": 0.0002069431502604857,
+    "strong_consistency": 0.11631257832050323
+  },
+  {
+    "step": 1224,
+    "loss": 0.09412632137537003,
+    "drift": 0.00022264911967795342,
+    "small_step": 0.0003870422369800508,
+    "strong_consistency": 0.09351663291454315
+  },
+  {
+    "step": 1225,
+    "loss": 0.056359440088272095,
+    "drift": 0.00035944621777161956,
+    "small_step": 0.00018014010856859386,
+    "strong_consistency": 0.05581985414028168
+  },
+  {
+    "step": 1226,
+    "loss": 0.07043790817260742,
+    "drift": 0.00021311402088031173,
+    "small_step": 0.00029952736804261804,
+    "strong_consistency": 0.06992526352405548
+  },
+  {
+    "step": 1227,
+    "loss": 0.04770375043153763,
+    "drift": 0.0003287301224190742,
+    "small_step": 0.00035531408502720296,
+    "strong_consistency": 0.047019705176353455
+  },
+  {
+    "step": 1228,
+    "loss": 0.05025886744260788,
+    "drift": 0.0002226820361102,
+    "small_step": 0.00018936992273665965,
+    "strong_consistency": 0.049846816807985306
+  },
+  {
+    "step": 1229,
+    "loss": 0.09320760518312454,
+    "drift": 0.00021592045959550887,
+    "small_step": 0.0002837442443706095,
+    "strong_consistency": 0.09270793944597244
+  },
+  {
+    "step": 1230,
+    "loss": 0.08924895524978638,
+    "drift": 0.0002473226049914956,
+    "small_step": 0.00019002947374247015,
+    "strong_consistency": 0.08881160616874695
+  },
+  {
+    "step": 1231,
+    "loss": 0.08792272955179214,
+    "drift": 0.00021161632321309298,
+    "small_step": 0.00030328374123200774,
+    "strong_consistency": 0.08740782737731934
+  },
+  {
+    "step": 1232,
+    "loss": 0.05446793511509895,
+    "drift": 0.000318860518746078,
+    "small_step": 0.00021703157108277082,
+    "strong_consistency": 0.05393204465508461
+  },
+  {
+    "step": 1233,
+    "loss": 0.12029244750738144,
+    "drift": 0.00024069183564279228,
+    "small_step": 0.00022025480575393885,
+    "strong_consistency": 0.11983150243759155
+  },
+  {
+    "step": 1234,
+    "loss": 0.08213822543621063,
+    "drift": 0.00028560907230712473,
+    "small_step": 0.00015671926666982472,
+    "strong_consistency": 0.08169589936733246
+  },
+  {
+    "step": 1235,
+    "loss": 0.0764593631029129,
+    "drift": 0.0002009037707466632,
+    "small_step": 0.0003733237972483039,
+    "strong_consistency": 0.07588513195514679
+  },
+  {
+    "step": 1236,
+    "loss": 0.05211436003446579,
+    "drift": 0.00019294681260362267,
+    "small_step": 0.0002182650496251881,
+    "strong_consistency": 0.05170314759016037
+  },
+  {
+    "step": 1237,
+    "loss": 0.07696337252855301,
+    "drift": 0.0003473563410807401,
+    "small_step": 0.0002626395726110786,
+    "strong_consistency": 0.07635337859392166
+  },
+  {
+    "step": 1238,
+    "loss": 0.06748178601264954,
+    "drift": 0.00032094502239488065,
+    "small_step": 0.00028189877048134804,
+    "strong_consistency": 0.06687894463539124
+  },
+  {
+    "step": 1239,
+    "loss": 0.08251708000898361,
+    "drift": 0.00018197941244579852,
+    "small_step": 0.0002184664481319487,
+    "strong_consistency": 0.08211663365364075
+  },
+  {
+    "step": 1240,
+    "loss": 0.07871386408805847,
+    "drift": 0.00021259006462059915,
+    "small_step": 0.0002977756957989186,
+    "strong_consistency": 0.07820349931716919
+  },
+  {
+    "step": 1241,
+    "loss": 0.0672125443816185,
+    "drift": 0.00032868864946067333,
+    "small_step": 0.00021664226369466633,
+    "strong_consistency": 0.06666721403598785
+  },
+  {
+    "step": 1242,
+    "loss": 0.06593043357133865,
+    "drift": 0.0003974717983510345,
+    "small_step": 0.0002916104858741164,
+    "strong_consistency": 0.06524135172367096
+  },
+  {
+    "step": 1243,
+    "loss": 0.06338313966989517,
+    "drift": 0.00035396803286857903,
+    "small_step": 0.0003067604557145387,
+    "strong_consistency": 0.06272241473197937
+  },
+  {
+    "step": 1244,
+    "loss": 0.11297837644815445,
+    "drift": 0.00028147303964942694,
+    "small_step": 0.00022532648290507495,
+    "strong_consistency": 0.1124715805053711
+  },
+  {
+    "step": 1245,
+    "loss": 0.07106400281190872,
+    "drift": 0.0002515194355510175,
+    "small_step": 0.0003565635997802019,
+    "strong_consistency": 0.07045591622591019
+  },
+  {
+    "step": 1246,
+    "loss": 0.08480724692344666,
+    "drift": 0.0003691204183269292,
+    "small_step": 0.0002503202122170478,
+    "strong_consistency": 0.08418780565261841
+  },
+  {
+    "step": 1247,
+    "loss": 0.07324757426977158,
+    "drift": 0.0002201348397647962,
+    "small_step": 0.0002629706868901849,
+    "strong_consistency": 0.07276447117328644
+  },
+  {
+    "step": 1248,
+    "loss": 0.06961310654878616,
+    "drift": 0.00035081084934063256,
+    "small_step": 0.0002489377511665225,
+    "strong_consistency": 0.06901335716247559
+  },
+  {
+    "step": 1249,
+    "loss": 0.03494590148329735,
+    "drift": 0.00037013000110164285,
+    "small_step": 0.00028630372253246605,
+    "strong_consistency": 0.034289468079805374
+  },
+  {
+    "step": 1250,
+    "loss": 0.07206721603870392,
+    "drift": 0.00033109731157310307,
+    "small_step": 0.00021594813733827323,
+    "strong_consistency": 0.07152017205953598
+  },
+  {
+    "step": 1251,
+    "loss": 0.15113498270511627,
+    "drift": 0.00021809742611367255,
+    "small_step": 0.0003184444212820381,
+    "strong_consistency": 0.1505984365940094
+  },
+  {
+    "step": 1252,
+    "loss": 0.13158108294010162,
+    "drift": 0.0001406743103871122,
+    "small_step": 0.00028594688046723604,
+    "strong_consistency": 0.13115446269512177
+  },
+  {
+    "step": 1253,
+    "loss": 0.04878455400466919,
+    "drift": 0.0002258594031445682,
+    "small_step": 0.0001481876097386703,
+    "strong_consistency": 0.048410508781671524
+  },
+  {
+    "step": 1254,
+    "loss": 0.06048060581088066,
+    "drift": 0.0002761405485216528,
+    "small_step": 0.00039552428643219173,
+    "strong_consistency": 0.059808939695358276
+  },
+  {
+    "step": 1255,
+    "loss": 0.10237456858158112,
+    "drift": 0.0001450498530175537,
+    "small_step": 0.0003251236630603671,
+    "strong_consistency": 0.10190439224243164
+  },
+  {
+    "step": 1256,
+    "loss": 0.11973205208778381,
+    "drift": 0.0001551592577015981,
+    "small_step": 0.0003790821065194905,
+    "strong_consistency": 0.11919780820608139
+  },
+  {
+    "step": 1257,
+    "loss": 0.05220599099993706,
+    "drift": 0.00017892857431434095,
+    "small_step": 0.00018390314653515816,
+    "strong_consistency": 0.05184315890073776
+  },
+  {
+    "step": 1258,
+    "loss": 0.05642189458012581,
+    "drift": 0.00022466713562607765,
+    "small_step": 0.00042550190119072795,
+    "strong_consistency": 0.05577172711491585
+  },
+  {
+    "step": 1259,
+    "loss": 0.09564926475286484,
+    "drift": 0.00023528473684564233,
+    "small_step": 0.0002462058619130403,
+    "strong_consistency": 0.09516777098178864
+  },
+  {
+    "step": 1260,
+    "loss": 0.04160769656300545,
+    "drift": 0.00019475289445836097,
+    "small_step": 0.0003149955300614238,
+    "strong_consistency": 0.04109794646501541
+  },
+  {
+    "step": 1261,
+    "loss": 0.07350552827119827,
+    "drift": 0.00019983747915830463,
+    "small_step": 0.00023355578014161438,
+    "strong_consistency": 0.07307213544845581
+  },
+  {
+    "step": 1262,
+    "loss": 0.04616481438279152,
+    "drift": 0.0001553635229356587,
+    "small_step": 0.000291895295958966,
+    "strong_consistency": 0.04571755602955818
+  },
+  {
+    "step": 1263,
+    "loss": 0.04591069743037224,
+    "drift": 0.00022335309768095613,
+    "small_step": 0.0002464618009980768,
+    "strong_consistency": 0.045440882444381714
+  },
+  {
+    "step": 1264,
+    "loss": 0.060116928070783615,
+    "drift": 0.00016300576680805534,
+    "small_step": 0.000341418432071805,
+    "strong_consistency": 0.05961250513792038
+  },
+  {
+    "step": 1265,
+    "loss": 0.10729839652776718,
+    "drift": 0.00018201461352873594,
+    "small_step": 0.0004021998611278832,
+    "strong_consistency": 0.10671418160200119
+  },
+  {
+    "step": 1266,
+    "loss": 0.1522723287343979,
+    "drift": 0.00017195555847138166,
+    "small_step": 0.000362195773050189,
+    "strong_consistency": 0.15173818171024323
+  },
+  {
+    "step": 1267,
+    "loss": 0.09457094967365265,
+    "drift": 0.00015361722034867853,
+    "small_step": 0.00032513527548871934,
+    "strong_consistency": 0.09409219771623611
+  },
+  {
+    "step": 1268,
+    "loss": 0.04319944605231285,
+    "drift": 0.00012168280954938382,
+    "small_step": 0.00039594536065123975,
+    "strong_consistency": 0.04268181696534157
+  },
+  {
+    "step": 1269,
+    "loss": 0.08126286417245865,
+    "drift": 0.0002078177931252867,
+    "small_step": 0.00024077855050563812,
+    "strong_consistency": 0.08081426471471786
+  },
+  {
+    "step": 1270,
+    "loss": 0.17070116102695465,
+    "drift": 0.00022213920601643622,
+    "small_step": 0.0002814578474499285,
+    "strong_consistency": 0.17019756138324738
+  },
+  {
+    "step": 1271,
+    "loss": 0.11382564902305603,
+    "drift": 0.00019919448823202401,
+    "small_step": 0.0003390108176972717,
+    "strong_consistency": 0.11328744143247604
+  },
+  {
+    "step": 1272,
+    "loss": 0.07360812276601791,
+    "drift": 0.0001884132798295468,
+    "small_step": 0.00031359284184873104,
+    "strong_consistency": 0.07310611754655838
+  },
+  {
+    "step": 1273,
+    "loss": 0.09657607227563858,
+    "drift": 0.00016018519818317145,
+    "small_step": 0.0005995107931084931,
+    "strong_consistency": 0.09581637382507324
+  },
+  {
+    "step": 1274,
+    "loss": 0.1256980448961258,
+    "drift": 0.00023465552658308297,
+    "small_step": 0.0004742972378153354,
+    "strong_consistency": 0.1249890923500061
+  },
+  {
+    "step": 1275,
+    "loss": 0.07548388838768005,
+    "drift": 0.0002706969389691949,
+    "small_step": 0.0004314187099225819,
+    "strong_consistency": 0.07478177547454834
+  },
+  {
+    "step": 1276,
+    "loss": 0.11845375597476959,
+    "drift": 0.00019062157662119716,
+    "small_step": 0.0003053094260394573,
+    "strong_consistency": 0.11795782297849655
+  },
+  {
+    "step": 1277,
+    "loss": 0.09496680647134781,
+    "drift": 0.00030155881540849805,
+    "small_step": 0.0002863176923710853,
+    "strong_consistency": 0.09437893331050873
+  },
+  {
+    "step": 1278,
+    "loss": 0.0725860521197319,
+    "drift": 0.00024324303376488388,
+    "small_step": 0.0002833648177329451,
+    "strong_consistency": 0.07205944508314133
+  },
+  {
+    "step": 1279,
+    "loss": 0.055718597024679184,
+    "drift": 0.0001881670905277133,
+    "small_step": 0.0004511427250690758,
+    "strong_consistency": 0.05507928878068924
+  },
+  {
+    "step": 1280,
+    "loss": 0.11383597552776337,
+    "drift": 0.0002727802493609488,
+    "small_step": 0.0003263237013015896,
+    "strong_consistency": 0.11323687434196472
+  },
+  {
+    "step": 1281,
+    "loss": 0.12313827872276306,
+    "drift": 0.00035608833422884345,
+    "small_step": 0.0003116620355285704,
+    "strong_consistency": 0.12247052788734436
+  },
+  {
+    "step": 1282,
+    "loss": 0.07937169075012207,
+    "drift": 0.00023126989253796637,
+    "small_step": 0.00024063506862148643,
+    "strong_consistency": 0.07889978587627411
+  },
+  {
+    "step": 1283,
+    "loss": 0.08916948735713959,
+    "drift": 0.00022707758762408048,
+    "small_step": 0.0002912414202000946,
+    "strong_consistency": 0.08865116536617279
+  },
+  {
+    "step": 1284,
+    "loss": 0.07892207056283951,
+    "drift": 0.0001791071699699387,
+    "small_step": 0.00040033177356235683,
+    "strong_consistency": 0.07834263145923615
+  },
+  {
+    "step": 1285,
+    "loss": 0.0797593966126442,
+    "drift": 0.00041013219743035734,
+    "small_step": 0.0005300185875967145,
+    "strong_consistency": 0.07881924510002136
+  },
+  {
+    "step": 1286,
+    "loss": 0.14687690138816833,
+    "drift": 0.00032067246502265334,
+    "small_step": 0.00027655510348267853,
+    "strong_consistency": 0.14627967774868011
+  },
+  {
+    "step": 1287,
+    "loss": 0.08773817121982574,
+    "drift": 0.00025208800798282027,
+    "small_step": 0.0002728370891418308,
+    "strong_consistency": 0.08721324801445007
+  },
+  {
+    "step": 1288,
+    "loss": 0.061673711985349655,
+    "drift": 0.00011527854803716764,
+    "small_step": 0.00033935150713659823,
+    "strong_consistency": 0.06121908128261566
+  },
+  {
+    "step": 1289,
+    "loss": 0.06234927847981453,
+    "drift": 0.00021584737987723202,
+    "small_step": 0.0003222392115276307,
+    "strong_consistency": 0.061811190098524094
+  },
+  {
+    "step": 1290,
+    "loss": 0.09235397726297379,
+    "drift": 0.00024531770031899214,
+    "small_step": 0.00028950098203495145,
+    "strong_consistency": 0.0918191596865654
+  },
+  {
+    "step": 1291,
+    "loss": 0.06923514604568481,
+    "drift": 0.00026630988577380776,
+    "small_step": 0.0004256273969076574,
+    "strong_consistency": 0.0685432106256485
+  },
+  {
+    "step": 1292,
+    "loss": 0.10767962783575058,
+    "drift": 0.00023726499057374895,
+    "small_step": 0.00038791235419921577,
+    "strong_consistency": 0.1070544496178627
+  },
+  {
+    "step": 1293,
+    "loss": 0.08271551132202148,
+    "drift": 0.0001981556270038709,
+    "small_step": 0.00026963333948515356,
+    "strong_consistency": 0.08224771916866302
+  },
+  {
+    "step": 1294,
+    "loss": 0.06992662698030472,
+    "drift": 0.00021401795675046742,
+    "small_step": 0.0003704162663780153,
+    "strong_consistency": 0.06934219598770142
+  },
+  {
+    "step": 1295,
+    "loss": 0.07668437063694,
+    "drift": 0.00029302542679943144,
+    "small_step": 0.000265262060565874,
+    "strong_consistency": 0.0761260837316513
+  },
+  {
+    "step": 1296,
+    "loss": 0.11221776157617569,
+    "drift": 0.00040870695374906063,
+    "small_step": 0.0003932483377866447,
+    "strong_consistency": 0.1114158034324646
+  },
+  {
+    "step": 1297,
+    "loss": 0.09618784487247467,
+    "drift": 0.00039605225902050734,
+    "small_step": 0.00032886030385270715,
+    "strong_consistency": 0.09546293318271637
+  },
+  {
+    "step": 1298,
+    "loss": 0.16002219915390015,
+    "drift": 0.0006202944787219167,
+    "small_step": 0.00034116164897568524,
+    "strong_consistency": 0.1590607464313507
+  },
+  {
+    "step": 1299,
+    "loss": 0.07432194799184799,
+    "drift": 0.0005936784436926246,
+    "small_step": 0.0003159233892802149,
+    "strong_consistency": 0.07341234385967255
+  },
+  {
+    "step": 1300,
+    "loss": 0.0839466005563736,
+    "drift": 0.0005549914203584194,
+    "small_step": 0.0004167594888713211,
+    "strong_consistency": 0.08297485113143921
+  },
+  {
+    "step": 1301,
+    "loss": 0.10293949395418167,
+    "drift": 0.00067154411226511,
+    "small_step": 0.0003084827330894768,
+    "strong_consistency": 0.1019594669342041
+  },
+  {
+    "step": 1302,
+    "loss": 0.0890846773982048,
+    "drift": 0.0005300240591168404,
+    "small_step": 0.00030383988632820547,
+    "strong_consistency": 0.08825081586837769
+  },
+  {
+    "step": 1303,
+    "loss": 0.07686932384967804,
+    "drift": 0.0004912263248115778,
+    "small_step": 0.0004469066334422678,
+    "strong_consistency": 0.07593119144439697
+  },
+  {
+    "step": 1304,
+    "loss": 0.1129356324672699,
+    "drift": 0.0004971529706381261,
+    "small_step": 0.0006294922786764801,
+    "strong_consistency": 0.11180898547172546
+  },
+  {
+    "step": 1305,
+    "loss": 0.08593752235174179,
+    "drift": 0.0004011335549876094,
+    "small_step": 0.0002983814338222146,
+    "strong_consistency": 0.0852380096912384
+  },
+  {
+    "step": 1306,
+    "loss": 0.10429994761943817,
+    "drift": 0.00048716197488829494,
+    "small_step": 0.00040290699689649045,
+    "strong_consistency": 0.10340987890958786
+  },
+  {
+    "step": 1307,
+    "loss": 0.15921232104301453,
+    "drift": 0.0005025526625104249,
+    "small_step": 0.00030751616577617824,
+    "strong_consistency": 0.1584022492170334
+  },
+  {
+    "step": 1308,
+    "loss": 0.09692955762147903,
+    "drift": 0.0004233364888932556,
+    "small_step": 0.0004908220726065338,
+    "strong_consistency": 0.09601540118455887
+  },
+  {
+    "step": 1309,
+    "loss": 0.14014932513237,
+    "drift": 0.0002951559145003557,
+    "small_step": 0.0003723971894942224,
+    "strong_consistency": 0.13948176801204681
+  },
+  {
+    "step": 1310,
+    "loss": 0.12282612174749374,
+    "drift": 0.00039927687612362206,
+    "small_step": 0.0005920376861467957,
+    "strong_consistency": 0.12183480709791183
+  },
+  {
+    "step": 1311,
+    "loss": 0.06438998878002167,
+    "drift": 0.0003102158661931753,
+    "small_step": 0.00033654674189165235,
+    "strong_consistency": 0.0637432262301445
+  },
+  {
+    "step": 1312,
+    "loss": 0.05616383999586105,
+    "drift": 0.0003230114234611392,
+    "small_step": 0.0003076779830735177,
+    "strong_consistency": 0.05553315207362175
+  },
+  {
+    "step": 1313,
+    "loss": 0.09751918911933899,
+    "drift": 0.0004394031420815736,
+    "small_step": 0.0003165886737406254,
+    "strong_consistency": 0.09676319360733032
+  },
+  {
+    "step": 1314,
+    "loss": 0.155678853392601,
+    "drift": 0.00027907645562663674,
+    "small_step": 0.00033759800135158,
+    "strong_consistency": 0.15506218373775482
+  },
+  {
+    "step": 1315,
+    "loss": 0.14038996398448944,
+    "drift": 0.0002517916727811098,
+    "small_step": 0.0004529918369371444,
+    "strong_consistency": 0.13968518376350403
+  },
+  {
+    "step": 1316,
+    "loss": 0.13676051795482635,
+    "drift": 0.00020702165784314275,
+    "small_step": 0.00038557895459234715,
+    "strong_consistency": 0.13616791367530823
+  },
+  {
+    "step": 1317,
+    "loss": 0.13656245172023773,
+    "drift": 0.0002710967673920095,
+    "small_step": 0.0003371244529262185,
+    "strong_consistency": 0.13595423102378845
+  },
+  {
+    "step": 1318,
+    "loss": 0.0884658694267273,
+    "drift": 0.00033445845474489033,
+    "small_step": 0.0006443040911108255,
+    "strong_consistency": 0.0874871090054512
+  },
+  {
+    "step": 1319,
+    "loss": 0.06516749411821365,
+    "drift": 0.0005264770006760955,
+    "small_step": 0.0006712523754686117,
+    "strong_consistency": 0.06396976113319397
+  },
+  {
+    "step": 1320,
+    "loss": 0.17591287195682526,
+    "drift": 0.0003157625033054501,
+    "small_step": 0.00028912813286297023,
+    "strong_consistency": 0.1753079742193222
+  },
+  {
+    "step": 1321,
+    "loss": 0.1452466994524002,
+    "drift": 0.0005090185441076756,
+    "small_step": 0.0005249500391073525,
+    "strong_consistency": 0.1442127376794815
+  },
+  {
+    "step": 1322,
+    "loss": 0.05372585356235504,
+    "drift": 0.0005471024196594954,
+    "small_step": 0.000493588566314429,
+    "strong_consistency": 0.05268516391515732
+  },
+  {
+    "step": 1323,
+    "loss": 0.11858319491147995,
+    "drift": 0.0005687634693458676,
+    "small_step": 0.0002846203278750181,
+    "strong_consistency": 0.11772981286048889
+  },
+  {
+    "step": 1324,
+    "loss": 0.13984368741512299,
+    "drift": 0.0007331200176849961,
+    "small_step": 0.0005444348207674921,
+    "strong_consistency": 0.13856613636016846
+  },
+  {
+    "step": 1325,
+    "loss": 0.079642154276371,
+    "drift": 0.0006870910874567926,
+    "small_step": 0.0005187199567444623,
+    "strong_consistency": 0.07843634486198425
+  },
+  {
+    "step": 1326,
+    "loss": 0.09147419035434723,
+    "drift": 0.0005621819291263819,
+    "small_step": 0.0003113410493824631,
+    "strong_consistency": 0.09060066938400269
+  },
+  {
+    "step": 1327,
+    "loss": 0.0708264634013176,
+    "drift": 0.0007539528305642307,
+    "small_step": 0.0005114820087328553,
+    "strong_consistency": 0.06956102699041367
+  },
+  {
+    "step": 1328,
+    "loss": 0.08691927790641785,
+    "drift": 0.0008010077872313559,
+    "small_step": 0.00044783600606024265,
+    "strong_consistency": 0.08567043393850327
+  },
+  {
+    "step": 1329,
+    "loss": 0.054456114768981934,
+    "drift": 0.0009278199868276715,
+    "small_step": 0.0005258772289380431,
+    "strong_consistency": 0.05300241708755493
+  },
+  {
+    "step": 1330,
+    "loss": 0.0923522487282753,
+    "drift": 0.000755983404815197,
+    "small_step": 0.0003236933844164014,
+    "strong_consistency": 0.09127257019281387
+  },
+  {
+    "step": 1331,
+    "loss": 0.07315593212842941,
+    "drift": 0.00082900479901582,
+    "small_step": 0.00036118237767368555,
+    "strong_consistency": 0.07196574658155441
+  },
+  {
+    "step": 1332,
+    "loss": 0.13575853407382965,
+    "drift": 0.0006992564303800464,
+    "small_step": 0.00031600784859620035,
+    "strong_consistency": 0.13474327325820923
+  },
+  {
+    "step": 1333,
+    "loss": 0.07722098380327225,
+    "drift": 0.0006085040513426065,
+    "small_step": 0.00040001660818234086,
+    "strong_consistency": 0.07621246576309204
+  },
+  {
+    "step": 1334,
+    "loss": 0.1096402108669281,
+    "drift": 0.000500600493978709,
+    "small_step": 0.0003737469669431448,
+    "strong_consistency": 0.1087658628821373
+  },
+  {
+    "step": 1335,
+    "loss": 0.12441090494394302,
+    "drift": 0.00039988680509850383,
+    "small_step": 0.0005286026280373335,
+    "strong_consistency": 0.12348241358995438
+  },
+  {
+    "step": 1336,
+    "loss": 0.07308074086904526,
+    "drift": 0.0005405994597822428,
+    "small_step": 0.0004674700030591339,
+    "strong_consistency": 0.07207266986370087
+  },
+  {
+    "step": 1337,
+    "loss": 0.055388111621141434,
+    "drift": 0.0004254558589309454,
+    "small_step": 0.0004492209991440177,
+    "strong_consistency": 0.05451343581080437
+  },
+  {
+    "step": 1338,
+    "loss": 0.12726540863513947,
+    "drift": 0.00046848945203237236,
+    "small_step": 0.000445493555162102,
+    "strong_consistency": 0.12635143101215363
+  },
+  {
+    "step": 1339,
+    "loss": 0.05525076389312744,
+    "drift": 0.0005136977997608483,
+    "small_step": 0.000503838004078716,
+    "strong_consistency": 0.05423322692513466
+  },
+  {
+    "step": 1340,
+    "loss": 0.10282081365585327,
+    "drift": 0.0003448141214903444,
+    "small_step": 0.0005382243543863297,
+    "strong_consistency": 0.10193777829408646
+  },
+  {
+    "step": 1341,
+    "loss": 0.0622427761554718,
+    "drift": 0.00041067408164963126,
+    "small_step": 0.0003427717019803822,
+    "strong_consistency": 0.06148932874202728
+  },
+  {
+    "step": 1342,
+    "loss": 0.12037061899900436,
+    "drift": 0.00041910947766155005,
+    "small_step": 0.00047371775144711137,
+    "strong_consistency": 0.11947779357433319
+  },
+  {
+    "step": 1343,
+    "loss": 0.0998954027891159,
+    "drift": 0.0004095635667908937,
+    "small_step": 0.0004346297646407038,
+    "strong_consistency": 0.09905120730400085
+  },
+  {
+    "step": 1344,
+    "loss": 0.09938250482082367,
+    "drift": 0.000540402194019407,
+    "small_step": 0.0005728347459807992,
+    "strong_consistency": 0.0982692688703537
+  },
+  {
+    "step": 1345,
+    "loss": 0.07210537046194077,
+    "drift": 0.0003545914078131318,
+    "small_step": 0.0004969790461473167,
+    "strong_consistency": 0.07125379890203476
+  },
+  {
+    "step": 1346,
+    "loss": 0.18514569103717804,
+    "drift": 0.00044362698099575937,
+    "small_step": 0.0006823744624853134,
+    "strong_consistency": 0.18401968479156494
+  },
+  {
+    "step": 1347,
+    "loss": 0.07774380594491959,
+    "drift": 0.0004605111025739461,
+    "small_step": 0.00025925293448381126,
+    "strong_consistency": 0.07702404260635376
+  },
+  {
+    "step": 1348,
+    "loss": 0.15968747437000275,
+    "drift": 0.0005126305622979999,
+    "small_step": 0.0004685729800257832,
+    "strong_consistency": 0.15870627760887146
+  },
+  {
+    "step": 1349,
+    "loss": 0.11618215590715408,
+    "drift": 0.0005102046998217702,
+    "small_step": 0.000581417407374829,
+    "strong_consistency": 0.11509053409099579
+  },
+  {
+    "step": 1350,
+    "loss": 0.09789445996284485,
+    "drift": 0.0004701796860899776,
+    "small_step": 0.0004115659394301474,
+    "strong_consistency": 0.0970127135515213
+  },
+  {
+    "step": 1351,
+    "loss": 0.11433415859937668,
+    "drift": 0.0003865768085233867,
+    "small_step": 0.0002646978246048093,
+    "strong_consistency": 0.11368288099765778
+  },
+  {
+    "step": 1352,
+    "loss": 0.1727266162633896,
+    "drift": 0.00030812580371275544,
+    "small_step": 0.0005368240526877344,
+    "strong_consistency": 0.17188166081905365
+  },
+  {
+    "step": 1353,
+    "loss": 0.12925173342227936,
+    "drift": 0.0004072771407663822,
+    "small_step": 0.0004155140195507556,
+    "strong_consistency": 0.12842893600463867
+  },
+  {
+    "step": 1354,
+    "loss": 0.08194053918123245,
+    "drift": 0.0005442161345854402,
+    "small_step": 0.0005199864390306175,
+    "strong_consistency": 0.08087633550167084
+  },
+  {
+    "step": 1355,
+    "loss": 0.06623315811157227,
+    "drift": 0.0004732091911137104,
+    "small_step": 0.0005061373813077807,
+    "strong_consistency": 0.06525380909442902
+  },
+  {
+    "step": 1356,
+    "loss": 0.1005498394370079,
+    "drift": 0.0002904065477196127,
+    "small_step": 0.0004765582852996886,
+    "strong_consistency": 0.09978287667036057
+  },
+  {
+    "step": 1357,
+    "loss": 0.059462595731019974,
+    "drift": 0.000405715691158548,
+    "small_step": 0.0004845170769840479,
+    "strong_consistency": 0.05857236310839653
+  },
+  {
+    "step": 1358,
+    "loss": 0.14184920489788055,
+    "drift": 0.00027092895470559597,
+    "small_step": 0.0005286813830025494,
+    "strong_consistency": 0.1410495936870575
+  },
+  {
+    "step": 1359,
+    "loss": 0.09446461498737335,
+    "drift": 0.00042808003490790725,
+    "small_step": 0.0004522025992628187,
+    "strong_consistency": 0.0935843288898468
+  },
+  {
+    "step": 1360,
+    "loss": 0.09500361979007721,
+    "drift": 0.00041781776235438883,
+    "small_step": 0.0005770809948444366,
+    "strong_consistency": 0.09400872141122818
+  },
+  {
+    "step": 1361,
+    "loss": 0.08915822207927704,
+    "drift": 0.0005005369894206524,
+    "small_step": 0.0007862866623327136,
+    "strong_consistency": 0.08787139505147934
+  },
+  {
+    "step": 1362,
+    "loss": 0.16100163757801056,
+    "drift": 0.0003462457680143416,
+    "small_step": 0.0007195245125330985,
+    "strong_consistency": 0.159935861825943
+  },
+  {
+    "step": 1363,
+    "loss": 0.1880360096693039,
+    "drift": 0.000502738868817687,
+    "small_step": 0.000523049442563206,
+    "strong_consistency": 0.18701022863388062
+  },
+  {
+    "step": 1364,
+    "loss": 0.12342165410518646,
+    "drift": 0.00048052697093226016,
+    "small_step": 0.0002647948858793825,
+    "strong_consistency": 0.12267633527517319
+  },
+  {
+    "step": 1365,
+    "loss": 0.12728455662727356,
+    "drift": 0.00038439020863734186,
+    "small_step": 0.0007811860414221883,
+    "strong_consistency": 0.1261189877986908
+  },
+  {
+    "step": 1366,
+    "loss": 0.13496088981628418,
+    "drift": 0.0003286467690486461,
+    "small_step": 0.0005348192644305527,
+    "strong_consistency": 0.13409742712974548
+  },
+  {
+    "step": 1367,
+    "loss": 0.12338748574256897,
+    "drift": 0.00031424674671143293,
+    "small_step": 0.0007171467295847833,
+    "strong_consistency": 0.12235609441995621
+  },
+  {
+    "step": 1368,
+    "loss": 0.15208324790000916,
+    "drift": 0.00044582487316802144,
+    "small_step": 0.0006651653675362468,
+    "strong_consistency": 0.15097226202487946
+  },
+  {
+    "step": 1369,
+    "loss": 0.14828357100486755,
+    "drift": 0.0002756830945145339,
+    "small_step": 0.00041545185376890004,
+    "strong_consistency": 0.1475924402475357
+  },
+  {
+    "step": 1370,
+    "loss": 0.0826549381017685,
+    "drift": 0.00040878079016692936,
+    "small_step": 0.0004934666212648153,
+    "strong_consistency": 0.08175268769264221
+  },
+  {
+    "step": 1371,
+    "loss": 0.1397506445646286,
+    "drift": 0.0004053052107337862,
+    "small_step": 0.0003729343297891319,
+    "strong_consistency": 0.13897240161895752
+  },
+  {
+    "step": 1372,
+    "loss": 0.08200600743293762,
+    "drift": 0.0003615998139139265,
+    "small_step": 0.00041415414307266474,
+    "strong_consistency": 0.08123025298118591
+  },
+  {
+    "step": 1373,
+    "loss": 0.06522990763187408,
+    "drift": 0.00048360790242441,
+    "small_step": 0.0006618475308641791,
+    "strong_consistency": 0.06408445537090302
+  },
+  {
+    "step": 1374,
+    "loss": 0.07996463030576706,
+    "drift": 0.00027285743271932006,
+    "small_step": 0.0005673367413692176,
+    "strong_consistency": 0.07912443578243256
+  },
+  {
+    "step": 1375,
+    "loss": 0.0627501904964447,
+    "drift": 0.00023894602782092988,
+    "small_step": 0.0003721954708453268,
+    "strong_consistency": 0.06213904917240143
+  },
+  {
+    "step": 1376,
+    "loss": 0.1166267916560173,
+    "drift": 0.0003739707753993571,
+    "small_step": 0.00041763827903196216,
+    "strong_consistency": 0.11583518236875534
+  },
+  {
+    "step": 1377,
+    "loss": 0.15462610125541687,
+    "drift": 0.00035783546627499163,
+    "small_step": 0.0007725902833044529,
+    "strong_consistency": 0.1534956693649292
+  },
+  {
+    "step": 1378,
+    "loss": 0.08394964039325714,
+    "drift": 0.0002321753418073058,
+    "small_step": 0.0004186760343145579,
+    "strong_consistency": 0.08329878747463226
+  },
+  {
+    "step": 1379,
+    "loss": 0.14509280025959015,
+    "drift": 0.00037992832949385047,
+    "small_step": 0.0004881680943071842,
+    "strong_consistency": 0.14422470331192017
+  },
+  {
+    "step": 1380,
+    "loss": 0.17650175094604492,
+    "drift": 0.00023424049140885472,
+    "small_step": 0.0005142379668541253,
+    "strong_consistency": 0.17575326561927795
+  },
+  {
+    "step": 1381,
+    "loss": 0.08233319967985153,
+    "drift": 0.000225595009396784,
+    "small_step": 0.0005917068338021636,
+    "strong_consistency": 0.08151590079069138
+  },
+  {
+    "step": 1382,
+    "loss": 0.18824313580989838,
+    "drift": 0.00017115181253757328,
+    "small_step": 0.0005146873299963772,
+    "strong_consistency": 0.18755729496479034
+  },
+  {
+    "step": 1383,
+    "loss": 0.13864752650260925,
+    "drift": 0.0001805304054869339,
+    "small_step": 0.0005794086027890444,
+    "strong_consistency": 0.13788758218288422
+  },
+  {
+    "step": 1384,
+    "loss": 0.14985062181949615,
+    "drift": 0.0002764830132946372,
+    "small_step": 0.00065592274768278,
+    "strong_consistency": 0.14891821146011353
+  },
+  {
+    "step": 1385,
+    "loss": 0.15283218026161194,
+    "drift": 0.00039320968789979815,
+    "small_step": 0.0007092306623235345,
+    "strong_consistency": 0.1517297327518463
+  },
+  {
+    "step": 1386,
+    "loss": 0.1202486976981163,
+    "drift": 0.00030225992668420076,
+    "small_step": 0.0004183229757472873,
+    "strong_consistency": 0.11952811479568481
+  },
+  {
+    "step": 1387,
+    "loss": 0.23076212406158447,
+    "drift": 0.00034672277979552746,
+    "small_step": 0.000716298702172935,
+    "strong_consistency": 0.22969910502433777
+  },
+  {
+    "step": 1388,
+    "loss": 0.12207159399986267,
+    "drift": 0.00021092013048473746,
+    "small_step": 0.0006210563005879521,
+    "strong_consistency": 0.12123961746692657
+  },
+  {
+    "step": 1389,
+    "loss": 0.1131155714392662,
+    "drift": 0.0003980774199590087,
+    "small_step": 0.0005800033686682582,
+    "strong_consistency": 0.11213748902082443
+  },
+  {
+    "step": 1390,
+    "loss": 0.07448602467775345,
+    "drift": 0.0004932759911753237,
+    "small_step": 0.0003231909067835659,
+    "strong_consistency": 0.07366956025362015
+  },
+  {
+    "step": 1391,
+    "loss": 0.11430370062589645,
+    "drift": 0.0004318470018915832,
+    "small_step": 0.0004367990477476269,
+    "strong_consistency": 0.1134350523352623
+  },
+  {
+    "step": 1392,
+    "loss": 0.10609936714172363,
+    "drift": 0.00038951970054768026,
+    "small_step": 0.0002880695683415979,
+    "strong_consistency": 0.10542178153991699
+  },
+  {
+    "step": 1393,
+    "loss": 0.15478284657001495,
+    "drift": 0.0002316519821761176,
+    "small_step": 0.00046813482185825706,
+    "strong_consistency": 0.15408305823802948
+  },
+  {
+    "step": 1394,
+    "loss": 0.1363043338060379,
+    "drift": 0.0003138090542051941,
+    "small_step": 0.0005237897858023643,
+    "strong_consistency": 0.13546673953533173
+  },
+  {
+    "step": 1395,
+    "loss": 0.058426495641469955,
+    "drift": 0.0002613553369883448,
+    "small_step": 0.000590153387747705,
+    "strong_consistency": 0.05757498741149902
+  },
+  {
+    "step": 1396,
+    "loss": 0.0982123389840126,
+    "drift": 0.0002692128764465451,
+    "small_step": 0.0006234484608285129,
+    "strong_consistency": 0.09731967747211456
+  },
+  {
+    "step": 1397,
+    "loss": 0.2070481926202774,
+    "drift": 0.00047432121937163174,
+    "small_step": 0.0007971164304763079,
+    "strong_consistency": 0.20577675104141235
+  },
+  {
+    "step": 1398,
+    "loss": 0.09441476315259933,
+    "drift": 0.0003465263871476054,
+    "small_step": 0.0007615204667672515,
+    "strong_consistency": 0.09330671280622482
+  },
+  {
+    "step": 1399,
+    "loss": 0.1172381192445755,
+    "drift": 0.00040722437552176416,
+    "small_step": 0.0006340838735923171,
+    "strong_consistency": 0.11619681119918823
+  },
+  {
+    "step": 1400,
+    "loss": 0.09612873941659927,
+    "drift": 0.00034570819116197526,
+    "small_step": 0.0006593433208763599,
+    "strong_consistency": 0.09512368589639664
+  },
+  {
+    "step": 1401,
+    "loss": 0.1093759760260582,
+    "drift": 0.0004188214079476893,
+    "small_step": 0.0004958593635819852,
+    "strong_consistency": 0.10846129804849625
+  },
+  {
+    "step": 1402,
+    "loss": 0.08629829436540604,
+    "drift": 0.0003619230992626399,
+    "small_step": 0.0006827177130617201,
+    "strong_consistency": 0.08525365591049194
+  },
+  {
+    "step": 1403,
+    "loss": 0.12390364706516266,
+    "drift": 0.00029848283156752586,
+    "small_step": 0.0006126003572717309,
+    "strong_consistency": 0.12299256026744843
+  },
+  {
+    "step": 1404,
+    "loss": 0.1016458049416542,
+    "drift": 0.0002026042784564197,
+    "small_step": 0.0005516288219951093,
+    "strong_consistency": 0.10089157521724701
+  },
+  {
+    "step": 1405,
+    "loss": 0.11811325699090958,
+    "drift": 0.0005892504705116153,
+    "small_step": 0.0004061831859871745,
+    "strong_consistency": 0.11711782217025757
+  },
+  {
+    "step": 1406,
+    "loss": 0.07299130409955978,
+    "drift": 0.00022615260968450457,
+    "small_step": 0.0011423820396885276,
+    "strong_consistency": 0.07162276655435562
+  },
+  {
+    "step": 1407,
+    "loss": 0.09828705340623856,
+    "drift": 0.0002486476441845298,
+    "small_step": 0.0006688929861411452,
+    "strong_consistency": 0.09736951440572739
+  },
+  {
+    "step": 1408,
+    "loss": 0.1119358167052269,
+    "drift": 0.00023665725893806666,
+    "small_step": 0.0006681459490209818,
+    "strong_consistency": 0.11103101074695587
+  },
+  {
+    "step": 1409,
+    "loss": 0.14440321922302246,
+    "drift": 0.000503296498209238,
+    "small_step": 0.0007118835346773267,
+    "strong_consistency": 0.14318804442882538
+  },
+  {
+    "step": 1410,
+    "loss": 0.10359597206115723,
+    "drift": 0.00022092220024205744,
+    "small_step": 0.0006558654713444412,
+    "strong_consistency": 0.10271918773651123
+  },
+  {
+    "step": 1411,
+    "loss": 0.08053784817457199,
+    "drift": 0.00010300142457708716,
+    "small_step": 0.0007524190004914999,
+    "strong_consistency": 0.07968242466449738
+  },
+  {
+    "step": 1412,
+    "loss": 0.12507031857967377,
+    "drift": 0.0002271536213811487,
+    "small_step": 0.0008853255421854556,
+    "strong_consistency": 0.12395784258842468
+  },
+  {
+    "step": 1413,
+    "loss": 0.10149339586496353,
+    "drift": 0.00032065383857116103,
+    "small_step": 0.000584329420235008,
+    "strong_consistency": 0.10058841109275818
+  },
+  {
+    "step": 1414,
+    "loss": 0.08243478089570999,
+    "drift": 0.00029678066493943334,
+    "small_step": 0.0005489085451699793,
+    "strong_consistency": 0.08158909529447556
+  },
+  {
+    "step": 1415,
+    "loss": 0.18943190574645996,
+    "drift": 0.0004322043969295919,
+    "small_step": 0.0004189576720818877,
+    "strong_consistency": 0.1885807365179062
+  },
+  {
+    "step": 1416,
+    "loss": 0.08217068016529083,
+    "drift": 0.00014782902144361287,
+    "small_step": 0.0006155535811558366,
+    "strong_consistency": 0.08140730112791061
+  },
+  {
+    "step": 1417,
+    "loss": 0.1363695114850998,
+    "drift": 0.00015246652765199542,
+    "small_step": 0.0007258193218149245,
+    "strong_consistency": 0.13549122214317322
+  },
+  {
+    "step": 1418,
+    "loss": 0.16530029475688934,
+    "drift": 0.00017503841081634164,
+    "small_step": 0.0009429131750948727,
+    "strong_consistency": 0.16418235003948212
+  },
+  {
+    "step": 1419,
+    "loss": 0.17901529371738434,
+    "drift": 0.00019308191258460283,
+    "small_step": 0.0008204433834180236,
+    "strong_consistency": 0.1780017614364624
+  },
+  {
+    "step": 1420,
+    "loss": 0.11945730447769165,
+    "drift": 0.00020306157239247113,
+    "small_step": 0.00046941888285800815,
+    "strong_consistency": 0.1187848225235939
+  },
+  {
+    "step": 1421,
+    "loss": 0.16367143392562866,
+    "drift": 0.00022316747345030308,
+    "small_step": 0.0008514735382050276,
+    "strong_consistency": 0.16259679198265076
+  },
+  {
+    "step": 1422,
+    "loss": 0.13763809204101562,
+    "drift": 0.0001740878651617095,
+    "small_step": 0.0006728250300511718,
+    "strong_consistency": 0.1367911845445633
+  },
+  {
+    "step": 1423,
+    "loss": 0.09702505171298981,
+    "drift": 0.0002615201228763908,
+    "small_step": 0.0006626908434554935,
+    "strong_consistency": 0.0961008369922638
+  },
+  {
+    "step": 1424,
+    "loss": 0.17364859580993652,
+    "drift": 0.00020547150052152574,
+    "small_step": 0.0006180728669278324,
+    "strong_consistency": 0.17282505333423615
+  },
+  {
+    "step": 1425,
+    "loss": 0.20885223150253296,
+    "drift": 0.0002625199849717319,
+    "small_step": 0.0006770897889509797,
+    "strong_consistency": 0.2079126238822937
+  },
+  {
+    "step": 1426,
+    "loss": 0.16787676513195038,
+    "drift": 0.00025338600971736014,
+    "small_step": 0.0007366965874098241,
+    "strong_consistency": 0.16688668727874756
+  },
+  {
+    "step": 1427,
+    "loss": 0.07460067421197891,
+    "drift": 0.0002278216852573678,
+    "small_step": 0.0008438096847385168,
+    "strong_consistency": 0.07352904230356216
+  },
+  {
+    "step": 1428,
+    "loss": 0.1760789453983307,
+    "drift": 0.0001774872071109712,
+    "small_step": 0.0008090792107395828,
+    "strong_consistency": 0.17509238421916962
+  },
+  {
+    "step": 1429,
+    "loss": 0.11102466285228729,
+    "drift": 0.00032779050525277853,
+    "small_step": 0.000720038078725338,
+    "strong_consistency": 0.10997683554887772
+  },
+  {
+    "step": 1430,
+    "loss": 0.1099504679441452,
+    "drift": 0.0003694719634950161,
+    "small_step": 0.0008676204015500844,
+    "strong_consistency": 0.10871337354183197
+  },
+  {
+    "step": 1431,
+    "loss": 0.17789700627326965,
+    "drift": 0.00020802115614060313,
+    "small_step": 0.0008207252831198275,
+    "strong_consistency": 0.1768682599067688
+  },
+  {
+    "step": 1432,
+    "loss": 0.11139973253011703,
+    "drift": 0.00029919648659415543,
+    "small_step": 0.0007390363607555628,
+    "strong_consistency": 0.1103615015745163
+  },
+  {
+    "step": 1433,
+    "loss": 0.089738629758358,
+    "drift": 0.00022544586681760848,
+    "small_step": 0.0007784620393067598,
+    "strong_consistency": 0.08873472362756729
+  },
+  {
+    "step": 1434,
+    "loss": 0.13245302438735962,
+    "drift": 0.0002983065787702799,
+    "small_step": 0.0006084289052523673,
+    "strong_consistency": 0.131546288728714
+  },
+  {
+    "step": 1435,
+    "loss": 0.09370733797550201,
+    "drift": 0.00012570610851980746,
+    "small_step": 0.0009911464294418693,
+    "strong_consistency": 0.09259048849344254
+  },
+  {
+    "step": 1436,
+    "loss": 0.12085754424333572,
+    "drift": 0.0005840245867148042,
+    "small_step": 0.0008011474274098873,
+    "strong_consistency": 0.11947236955165863
+  },
+  {
+    "step": 1437,
+    "loss": 0.15155042707920074,
+    "drift": 0.00028046793886460364,
+    "small_step": 0.0007602834957651794,
+    "strong_consistency": 0.15050967037677765
+  },
+  {
+    "step": 1438,
+    "loss": 0.10654643177986145,
+    "drift": 0.00022289178741630167,
+    "small_step": 0.0008661918109282851,
+    "strong_consistency": 0.1054573506116867
+  },
+  {
+    "step": 1439,
+    "loss": 0.18063761293888092,
+    "drift": 0.0004947721026837826,
+    "small_step": 0.0007675440283492208,
+    "strong_consistency": 0.1793752908706665
+  },
+  {
+    "step": 1440,
+    "loss": 0.07683615386486053,
+    "drift": 0.00027156941359862685,
+    "small_step": 0.0010343280155211687,
+    "strong_consistency": 0.07553025335073471
+  },
+  {
+    "step": 1441,
+    "loss": 0.06444815546274185,
+    "drift": 0.00036755291512236,
+    "small_step": 0.0006192700820975006,
+    "strong_consistency": 0.06346133351325989
+  },
+  {
+    "step": 1442,
+    "loss": 0.07688554376363754,
+    "drift": 0.00022556600742973387,
+    "small_step": 0.0004612465272657573,
+    "strong_consistency": 0.07619873434305191
+  },
+  {
+    "step": 1443,
+    "loss": 0.22223861515522003,
+    "drift": 0.0003837394469883293,
+    "small_step": 0.0008701430633664131,
+    "strong_consistency": 0.22098472714424133
+  },
+  {
+    "step": 1444,
+    "loss": 0.06929418444633484,
+    "drift": 0.0006785125005990267,
+    "small_step": 0.0005001751706004143,
+    "strong_consistency": 0.06811549514532089
+  },
+  {
+    "step": 1445,
+    "loss": 0.2150893211364746,
+    "drift": 0.0001640450645936653,
+    "small_step": 0.0004975954070687294,
+    "strong_consistency": 0.21442767977714539
+  },
+  {
+    "step": 1446,
+    "loss": 0.2562151253223419,
+    "drift": 0.000527485623024404,
+    "small_step": 0.0008493649074807763,
+    "strong_consistency": 0.2548382878303528
+  },
+  {
+    "step": 1447,
+    "loss": 0.13122373819351196,
+    "drift": 0.00015755939239170402,
+    "small_step": 0.001325378194451332,
+    "strong_consistency": 0.12974080443382263
+  },
+  {
+    "step": 1448,
+    "loss": 0.06782635301351547,
+    "drift": 0.00016784587933216244,
+    "small_step": 0.0006009866483509541,
+    "strong_consistency": 0.0670575201511383
+  },
+  {
+    "step": 1449,
+    "loss": 0.2685267925262451,
+    "drift": 0.00023858356871642172,
+    "small_step": 0.0006187823018990457,
+    "strong_consistency": 0.2676694393157959
+  },
+  {
+    "step": 1450,
+    "loss": 0.18092939257621765,
+    "drift": 0.0005234925774857402,
+    "small_step": 0.0006298355874605477,
+    "strong_consistency": 0.17977605760097504
+  },
+  {
+    "step": 1451,
+    "loss": 0.14494004845619202,
+    "drift": 0.00011226711649214849,
+    "small_step": 0.0010789379011839628,
+    "strong_consistency": 0.14374884963035583
+  },
+  {
+    "step": 1452,
+    "loss": 0.10812938958406448,
+    "drift": 0.00029427334084175527,
+    "small_step": 0.0007119360379874706,
+    "strong_consistency": 0.10712318122386932
+  },
+  {
+    "step": 1453,
+    "loss": 0.05972880870103836,
+    "drift": 0.00025370725779794157,
+    "small_step": 0.0006467477069236338,
+    "strong_consistency": 0.05882835388183594
+  },
+  {
+    "step": 1454,
+    "loss": 0.22131411731243134,
+    "drift": 0.00035614665830507874,
+    "small_step": 0.0007066871621645987,
+    "strong_consistency": 0.22025127708911896
+  },
+  {
+    "step": 1455,
+    "loss": 0.172928586602211,
+    "drift": 0.00021250023564789444,
+    "small_step": 0.0008879188681021333,
+    "strong_consistency": 0.17182816565036774
+  },
+  {
+    "step": 1456,
+    "loss": 0.15685735642910004,
+    "drift": 0.00160887255333364,
+    "small_step": 0.0006504040793515742,
+    "strong_consistency": 0.15459808707237244
+  },
+  {
+    "step": 1457,
+    "loss": 0.12278292328119278,
+    "drift": 0.000240802182815969,
+    "small_step": 0.0014693322591483593,
+    "strong_consistency": 0.12107279151678085
+  },
+  {
+    "step": 1458,
+    "loss": 0.17744340002536774,
+    "drift": 0.00028079625917598605,
+    "small_step": 0.0006724437116645277,
+    "strong_consistency": 0.1764901578426361
+  },
+  {
+    "step": 1459,
+    "loss": 0.10550064593553543,
+    "drift": 0.00012002070434391499,
+    "small_step": 0.0012327854055911303,
+    "strong_consistency": 0.10414783656597137
+  },
+  {
+    "step": 1460,
+    "loss": 0.09689869731664658,
+    "drift": 0.00032178411493077874,
+    "small_step": 0.0007605542195960879,
+    "strong_consistency": 0.09581635892391205
+  },
+  {
+    "step": 1461,
+    "loss": 0.2089187651872635,
+    "drift": 0.00017977249808609486,
+    "small_step": 0.0006509788800030947,
+    "strong_consistency": 0.2080880105495453
+  },
+  {
+    "step": 1462,
+    "loss": 0.19593119621276855,
+    "drift": 0.0004759627627208829,
+    "small_step": 0.00044728541979566216,
+    "strong_consistency": 0.19500795006752014
+  },
+  {
+    "step": 1463,
+    "loss": 0.13656754791736603,
+    "drift": 0.0008827326819300652,
+    "small_step": 0.0014925803989171982,
+    "strong_consistency": 0.13419222831726074
+  },
+  {
+    "step": 1464,
+    "loss": 0.2974928617477417,
+    "drift": 0.00020332462736405432,
+    "small_step": 0.0013251525815576315,
+    "strong_consistency": 0.29596439003944397
+  },
+  {
+    "step": 1465,
+    "loss": 0.08952929079532623,
+    "drift": 0.00030468570184893906,
+    "small_step": 0.0008356313337571919,
+    "strong_consistency": 0.08838897198438644
+  },
+  {
+    "step": 1466,
+    "loss": 0.16005228459835052,
+    "drift": 0.0003012384695466608,
+    "small_step": 0.0006912379758432508,
+    "strong_consistency": 0.1590598076581955
+  },
+  {
+    "step": 1467,
+    "loss": 0.1657765805721283,
+    "drift": 0.0007024992955848575,
+    "small_step": 0.0012716599740087986,
+    "strong_consistency": 0.16380241513252258
+  },
+  {
+    "step": 1468,
+    "loss": 0.10921929776668549,
+    "drift": 0.0005395166808739305,
+    "small_step": 0.0009513419936411083,
+    "strong_consistency": 0.10772843658924103
+  },
+  {
+    "step": 1469,
+    "loss": 0.14333832263946533,
+    "drift": 0.0008082271669991314,
+    "small_step": 0.0006315823993645608,
+    "strong_consistency": 0.141898512840271
+  },
+  {
+    "step": 1470,
+    "loss": 0.119759701192379,
+    "drift": 0.0004739707219414413,
+    "small_step": 0.0008183051249943674,
+    "strong_consistency": 0.11846742779016495
+  },
+  {
+    "step": 1471,
+    "loss": 0.14516957104206085,
+    "drift": 0.00030201984918676317,
+    "small_step": 0.0007901372155174613,
+    "strong_consistency": 0.14407742023468018
+  },
+  {
+    "step": 1472,
+    "loss": 0.1606580764055252,
+    "drift": 0.0005473729106597602,
+    "small_step": 0.0009722079848870635,
+    "strong_consistency": 0.1591385006904602
+  },
+  {
+    "step": 1473,
+    "loss": 0.18808281421661377,
+    "drift": 0.00041590037290006876,
+    "small_step": 0.001178874634206295,
+    "strong_consistency": 0.18648803234100342
+  },
+  {
+    "step": 1474,
+    "loss": 0.1700155884027481,
+    "drift": 0.0003921215538866818,
+    "small_step": 0.0006816514651291072,
+    "strong_consistency": 0.16894181072711945
+  },
+  {
+    "step": 1475,
+    "loss": 0.08993399143218994,
+    "drift": 0.00026684097247198224,
+    "small_step": 0.0007585071143694222,
+    "strong_consistency": 0.08890864253044128
+  },
+  {
+    "step": 1476,
+    "loss": 0.20590685307979584,
+    "drift": 0.0003973266575485468,
+    "small_step": 0.0010713887168094516,
+    "strong_consistency": 0.20443813502788544
+  },
+  {
+    "step": 1477,
+    "loss": 0.16670867800712585,
+    "drift": 0.0003405263414606452,
+    "small_step": 0.000975104863755405,
+    "strong_consistency": 0.16539303958415985
+  },
+  {
+    "step": 1478,
+    "loss": 0.08344904333353043,
+    "drift": 0.0004247920005582273,
+    "small_step": 0.0012149026151746511,
+    "strong_consistency": 0.08180934935808182
+  },
+  {
+    "step": 1479,
+    "loss": 0.11114992946386337,
+    "drift": 0.0007151990430429578,
+    "small_step": 0.001036603469401598,
+    "strong_consistency": 0.10939812660217285
+  },
+  {
+    "step": 1480,
+    "loss": 0.17146380245685577,
+    "drift": 0.00031013222178444266,
+    "small_step": 0.000987896346487105,
+    "strong_consistency": 0.1701657772064209
+  },
+  {
+    "step": 1481,
+    "loss": 0.36300453543663025,
+    "drift": 0.0005103681469336152,
+    "small_step": 0.0019793277606368065,
+    "strong_consistency": 0.3605148494243622
+  },
+  {
+    "step": 1482,
+    "loss": 0.41750088334083557,
+    "drift": 0.00052229332504794,
+    "small_step": 0.0008232524269260466,
+    "strong_consistency": 0.4161553382873535
+  },
+  {
+    "step": 1483,
+    "loss": 0.20562899112701416,
+    "drift": 0.00038498721551150084,
+    "small_step": 0.0010165568673983216,
+    "strong_consistency": 0.20422744750976562
+  },
+  {
+    "step": 1484,
+    "loss": 0.14224742352962494,
+    "drift": 0.0002645170025061816,
+    "small_step": 0.0019188268342986703,
+    "strong_consistency": 0.14006407558918
+  },
+  {
+    "step": 1485,
+    "loss": 0.12089966237545013,
+    "drift": 0.0008129285415634513,
+    "small_step": 0.0015577346784994006,
+    "strong_consistency": 0.11852899938821793
+  },
+  {
+    "step": 1486,
+    "loss": 0.15052999556064606,
+    "drift": 0.0002950553607661277,
+    "small_step": 0.001074818428605795,
+    "strong_consistency": 0.14916011691093445
+  },
+  {
+    "step": 1487,
+    "loss": 0.21426992118358612,
+    "drift": 0.00030963687459006906,
+    "small_step": 0.0010760787408798933,
+    "strong_consistency": 0.21288420259952545
+  },
+  {
+    "step": 1488,
+    "loss": 0.09730160236358643,
+    "drift": 0.00024389062309637666,
+    "small_step": 0.0005886128055863082,
+    "strong_consistency": 0.09646909683942795
+  },
+  {
+    "step": 1489,
+    "loss": 0.12823528051376343,
+    "drift": 0.00020316927111707628,
+    "small_step": 0.00110276835039258,
+    "strong_consistency": 0.12692934274673462
+  },
+  {
+    "step": 1490,
+    "loss": 0.15216076374053955,
+    "drift": 0.00028015641146339476,
+    "small_step": 0.000850390933919698,
+    "strong_consistency": 0.15103021264076233
+  },
+  {
+    "step": 1491,
+    "loss": 0.2983993887901306,
+    "drift": 0.0004693371010944247,
+    "small_step": 0.00135450076777488,
+    "strong_consistency": 0.29657554626464844
+  },
+  {
+    "step": 1492,
+    "loss": 0.16485753655433655,
+    "drift": 0.0007578185759484768,
+    "small_step": 0.0008478273521177471,
+    "strong_consistency": 0.16325189173221588
+  },
+  {
+    "step": 1493,
+    "loss": 0.1867222785949707,
+    "drift": 0.0006127246306277812,
+    "small_step": 0.0012596810702234507,
+    "strong_consistency": 0.18484987318515778
+  },
+  {
+    "step": 1494,
+    "loss": 0.1399659663438797,
+    "drift": 0.0004856599844060838,
+    "small_step": 0.0011771731078624725,
+    "strong_consistency": 0.13830313086509705
+  },
+  {
+    "step": 1495,
+    "loss": 0.14009691774845123,
+    "drift": 0.0005965505843050778,
+    "small_step": 0.0012642539804801345,
+    "strong_consistency": 0.1382361203432083
+  },
+  {
+    "step": 1496,
+    "loss": 0.17953777313232422,
+    "drift": 0.0006184186786413193,
+    "small_step": 0.0015494927065446973,
+    "strong_consistency": 0.1773698627948761
+  },
+  {
+    "step": 1497,
+    "loss": 0.19104889035224915,
+    "drift": 0.0004590957541950047,
+    "small_step": 0.0008143479353748262,
+    "strong_consistency": 0.18977545201778412
+  },
+  {
+    "step": 1498,
+    "loss": 0.12226030975580215,
+    "drift": 0.0006746737635694444,
+    "small_step": 0.0010629927273839712,
+    "strong_consistency": 0.120522640645504
+  },
+  {
+    "step": 1499,
+    "loss": 0.14110110700130463,
+    "drift": 0.0003541229525581002,
+    "small_step": 0.0009614318842068315,
+    "strong_consistency": 0.1397855579853058
+  },
+  {
+    "step": 1500,
+    "loss": 0.11788733303546906,
+    "drift": 0.0003046756028197706,
+    "small_step": 0.0013282664585858583,
+    "strong_consistency": 0.11625438928604126
+  },
+  {
+    "step": 1501,
+    "loss": 0.127193883061409,
+    "drift": 0.0006983093917369843,
+    "small_step": 0.0017683260375633836,
+    "strong_consistency": 0.12472724169492722
+  },
+  {
+    "step": 1502,
+    "loss": 0.2710603177547455,
+    "drift": 0.00028675267822109163,
+    "small_step": 0.0009429053170606494,
+    "strong_consistency": 0.2698306739330292
+  },
+  {
+    "step": 1503,
+    "loss": 0.11697091162204742,
+    "drift": 0.0008744384394958615,
+    "small_step": 0.0010617378866299987,
+    "strong_consistency": 0.11503473669290543
+  },
+  {
+    "step": 1504,
+    "loss": 0.08638540655374527,
+    "drift": 0.00034333867370150983,
+    "small_step": 0.001852210727520287,
+    "strong_consistency": 0.08418985456228256
+  },
+  {
+    "step": 1505,
+    "loss": 0.2775999903678894,
+    "drift": 0.00025209010345861316,
+    "small_step": 0.0014899239176884294,
+    "strong_consistency": 0.27585798501968384
+  },
+  {
+    "step": 1506,
+    "loss": 0.1947246640920639,
+    "drift": 0.0002616229758132249,
+    "small_step": 0.001130789052695036,
+    "strong_consistency": 0.1933322548866272
+  },
+  {
+    "step": 1507,
+    "loss": 0.0580604262650013,
+    "drift": 0.0003301365068182349,
+    "small_step": 0.001178804668597877,
+    "strong_consistency": 0.0565514862537384
+  },
+  {
+    "step": 1508,
+    "loss": 0.2567305266857147,
+    "drift": 0.0005096729146316648,
+    "small_step": 0.0015396468807011843,
+    "strong_consistency": 0.25468119978904724
+  },
+  {
+    "step": 1509,
+    "loss": 0.08890864253044128,
+    "drift": 0.000511259597260505,
+    "small_step": 0.0015219836495816708,
+    "strong_consistency": 0.08687540143728256
+  },
+  {
+    "step": 1510,
+    "loss": 0.12023001909255981,
+    "drift": 0.0005646267090924084,
+    "small_step": 0.0010741414735093713,
+    "strong_consistency": 0.11859124898910522
+  },
+  {
+    "step": 1511,
+    "loss": 0.14900659024715424,
+    "drift": 0.0004992693429812789,
+    "small_step": 0.0018447149777784944,
+    "strong_consistency": 0.1466626077890396
+  },
+  {
+    "step": 1512,
+    "loss": 0.26018956303596497,
+    "drift": 0.00040366515167988837,
+    "small_step": 0.0013758490094915032,
+    "strong_consistency": 0.2584100365638733
+  },
+  {
+    "step": 1513,
+    "loss": 0.15912704169750214,
+    "drift": 0.0001958995999302715,
+    "small_step": 0.0009979543974623084,
+    "strong_consistency": 0.15793319046497345
+  },
+  {
+    "step": 1514,
+    "loss": 0.2210875153541565,
+    "drift": 0.00036047230241820216,
+    "small_step": 0.001400554901920259,
+    "strong_consistency": 0.21932648122310638
+  },
+  {
+    "step": 1515,
+    "loss": 0.14567868411540985,
+    "drift": 0.0004893767763860524,
+    "small_step": 0.0016051544807851315,
+    "strong_consistency": 0.14358414709568024
+  },
+  {
+    "step": 1516,
+    "loss": 0.21976026892662048,
+    "drift": 0.0006839247653260827,
+    "small_step": 0.001200118800625205,
+    "strong_consistency": 0.21787622570991516
+  },
+  {
+    "step": 1517,
+    "loss": 0.10709505528211594,
+    "drift": 0.0002488237514626235,
+    "small_step": 0.0012856271350756288,
+    "strong_consistency": 0.10556060075759888
+  },
+  {
+    "step": 1518,
+    "loss": 0.16295157372951508,
+    "drift": 0.00044148857705295086,
+    "small_step": 0.001224528532475233,
+    "strong_consistency": 0.16128554940223694
+  },
+  {
+    "step": 1519,
+    "loss": 0.09185967594385147,
+    "drift": 0.0003030903171747923,
+    "small_step": 0.0009868483757600188,
+    "strong_consistency": 0.09056973457336426
+  },
+  {
+    "step": 1520,
+    "loss": 0.0749364048242569,
+    "drift": 0.00019906913803424686,
+    "small_step": 0.0011859284713864326,
+    "strong_consistency": 0.07355140894651413
+  },
+  {
+    "step": 1521,
+    "loss": 0.15442752838134766,
+    "drift": 0.0003790243645198643,
+    "small_step": 0.0009898989228531718,
+    "strong_consistency": 0.15305860340595245
+  },
+  {
+    "step": 1522,
+    "loss": 0.1793927103281021,
+    "drift": 0.000230240955715999,
+    "small_step": 0.0011046231957152486,
+    "strong_consistency": 0.17805784940719604
+  },
+  {
+    "step": 1523,
+    "loss": 0.16276781260967255,
+    "drift": 0.0004623968852683902,
+    "small_step": 0.001179299782961607,
+    "strong_consistency": 0.16112612187862396
+  },
+  {
+    "step": 1524,
+    "loss": 0.21976053714752197,
+    "drift": 0.0002721439232118428,
+    "small_step": 0.0006683575920760632,
+    "strong_consistency": 0.21882003545761108
+  },
+  {
+    "step": 1525,
+    "loss": 0.24022908508777618,
+    "drift": 0.00034634495386853814,
+    "small_step": 0.0012148816604167223,
+    "strong_consistency": 0.23866786062717438
+  },
+  {
+    "step": 1526,
+    "loss": 0.1372094601392746,
+    "drift": 0.0002726142411120236,
+    "small_step": 0.0015037173870950937,
+    "strong_consistency": 0.1354331225156784
+  },
+  {
+    "step": 1527,
+    "loss": 0.3180221617221832,
+    "drift": 0.0003738744999282062,
+    "small_step": 0.001790800248272717,
+    "strong_consistency": 0.31585749983787537
+  },
+  {
+    "step": 1528,
+    "loss": 0.0921785905957222,
+    "drift": 0.0003531300462782383,
+    "small_step": 0.0014699235325679183,
+    "strong_consistency": 0.0903555378317833
+  },
+  {
+    "step": 1529,
+    "loss": 0.1789029836654663,
+    "drift": 0.0005413872422650456,
+    "small_step": 0.0018042175797745585,
+    "strong_consistency": 0.17655737698078156
+  },
+  {
+    "step": 1530,
+    "loss": 0.2296755462884903,
+    "drift": 0.0011976701207458973,
+    "small_step": 0.001801279024221003,
+    "strong_consistency": 0.2266765981912613
+  },
+  {
+    "step": 1531,
+    "loss": 0.12564848363399506,
+    "drift": 0.0002258887398056686,
+    "small_step": 0.0013197209918871522,
+    "strong_consistency": 0.1241028681397438
+  },
+  {
+    "step": 1532,
+    "loss": 0.3112984001636505,
+    "drift": 0.0009254348115064204,
+    "small_step": 0.001476260251365602,
+    "strong_consistency": 0.3088966906070709
+  },
+  {
+    "step": 1533,
+    "loss": 0.16522690653800964,
+    "drift": 0.0011721118353307247,
+    "small_step": 0.0020984343718737364,
+    "strong_consistency": 0.16195635497570038
+  },
+  {
+    "step": 1534,
+    "loss": 0.29445746541023254,
+    "drift": 0.0014780116034671664,
+    "small_step": 0.001696349703706801,
+    "strong_consistency": 0.29128310084342957
+  },
+  {
+    "step": 1535,
+    "loss": 0.19027923047542572,
+    "drift": 0.0005236417637206614,
+    "small_step": 0.0018226561369374394,
+    "strong_consistency": 0.18793293833732605
+  },
+  {
+    "step": 1536,
+    "loss": 0.2578096389770508,
+    "drift": 0.0010610392782837152,
+    "small_step": 0.0018811069894582033,
+    "strong_consistency": 0.2548674941062927
+  },
+  {
+    "step": 1537,
+    "loss": 0.2272089719772339,
+    "drift": 0.0011911813635379076,
+    "small_step": 0.0017346455715596676,
+    "strong_consistency": 0.2242831438779831
+  },
+  {
+    "step": 1538,
+    "loss": 0.19313021004199982,
+    "drift": 0.0010806175414472818,
+    "small_step": 0.0012892866507172585,
+    "strong_consistency": 0.1907602995634079
+  },
+  {
+    "step": 1539,
+    "loss": 0.5360005497932434,
+    "drift": 0.0013574691256508231,
+    "small_step": 0.0015183639479801059,
+    "strong_consistency": 0.5331247448921204
+  },
+  {
+    "step": 1540,
+    "loss": 0.2080552875995636,
+    "drift": 0.0018390667391940951,
+    "small_step": 0.0014036651700735092,
+    "strong_consistency": 0.20481255650520325
+  },
+  {
+    "step": 1541,
+    "loss": 0.14787772297859192,
+    "drift": 0.006610107608139515,
+    "small_step": 0.001992833102121949,
+    "strong_consistency": 0.13927477598190308
+  },
+  {
+    "step": 1542,
+    "loss": 0.1742815226316452,
+    "drift": 0.0008357509505003691,
+    "small_step": 0.0021547297947108746,
+    "strong_consistency": 0.1712910383939743
+  },
+  {
+    "step": 1543,
+    "loss": 0.1331910490989685,
+    "drift": 0.003477374091744423,
+    "small_step": 0.0016349535435438156,
+    "strong_consistency": 0.12807871401309967
+  },
+  {
+    "step": 1544,
+    "loss": 0.2197922319173813,
+    "drift": 0.0014476460637524724,
+    "small_step": 0.001283886726014316,
+    "strong_consistency": 0.21706070005893707
+  },
+  {
+    "step": 1545,
+    "loss": 0.3558269739151001,
+    "drift": 0.0019226146396249533,
+    "small_step": 0.0017980380216613412,
+    "strong_consistency": 0.35210633277893066
+  },
+  {
+    "step": 1546,
+    "loss": 0.20978371798992157,
+    "drift": 0.0015021279687061906,
+    "small_step": 0.0017291767289862037,
+    "strong_consistency": 0.2065524160861969
+  },
+  {
+    "step": 1547,
+    "loss": 0.35854244232177734,
+    "drift": 0.0033793740440160036,
+    "small_step": 0.0017130636842921376,
+    "strong_consistency": 0.3534500002861023
+  },
+  {
+    "step": 1548,
+    "loss": 0.13569128513336182,
+    "drift": 0.0028430111706256866,
+    "small_step": 0.0019108003471046686,
+    "strong_consistency": 0.13093747198581696
+  },
+  {
+    "step": 1549,
+    "loss": 0.14483608305454254,
+    "drift": 0.0006979033933021128,
+    "small_step": 0.0012972267577424645,
+    "strong_consistency": 0.14284095168113708
+  },
+  {
+    "step": 1550,
+    "loss": 0.2818571627140045,
+    "drift": 0.0006775441579520702,
+    "small_step": 0.001738210441544652,
+    "strong_consistency": 0.2794414162635803
+  },
+  {
+    "step": 1551,
+    "loss": 0.228778675198555,
+    "drift": 0.001385590760037303,
+    "small_step": 0.0012088801013305783,
+    "strong_consistency": 0.2261842042207718
+  },
+  {
+    "step": 1552,
+    "loss": 0.1018826961517334,
+    "drift": 0.0010798637522384524,
+    "small_step": 0.0021590711548924446,
+    "strong_consistency": 0.09864375740289688
+  },
+  {
+    "step": 1553,
+    "loss": 0.07520335167646408,
+    "drift": 0.0004966058186255395,
+    "small_step": 0.0014614555984735489,
+    "strong_consistency": 0.07324528694152832
+  },
+  {
+    "step": 1554,
+    "loss": 0.15328265726566315,
+    "drift": 0.0004881045897491276,
+    "small_step": 0.0023429165594279766,
+    "strong_consistency": 0.1504516303539276
+  },
+  {
+    "step": 1555,
+    "loss": 0.23895631730556488,
+    "drift": 0.001962661975994706,
+    "small_step": 0.0013087400002405047,
+    "strong_consistency": 0.23568491637706757
+  },
+  {
+    "step": 1556,
+    "loss": 0.307235449552536,
+    "drift": 0.0011316206073388457,
+    "small_step": 0.0017618717392906547,
+    "strong_consistency": 0.30434197187423706
+  },
+  {
+    "step": 1557,
+    "loss": 0.18007665872573853,
+    "drift": 0.0017173034138977528,
+    "small_step": 0.001176389749161899,
+    "strong_consistency": 0.17718297243118286
+  },
+  {
+    "step": 1558,
+    "loss": 0.20282147824764252,
+    "drift": 0.001390602788887918,
+    "small_step": 0.0019476896850392222,
+    "strong_consistency": 0.19948318600654602
+  },
+  {
+    "step": 1559,
+    "loss": 0.3803435266017914,
+    "drift": 0.0009800976840779185,
+    "small_step": 0.0018842831486836076,
+    "strong_consistency": 0.3774791359901428
+  },
+  {
+    "step": 1560,
+    "loss": 0.36080875992774963,
+    "drift": 0.0007123752729967237,
+    "small_step": 0.0019511269638314843,
+    "strong_consistency": 0.35814526677131653
+  },
+  {
+    "step": 1561,
+    "loss": 0.26749300956726074,
+    "drift": 0.001298008719459176,
+    "small_step": 0.0021702551748603582,
+    "strong_consistency": 0.2640247344970703
+  },
+  {
+    "step": 1562,
+    "loss": 0.15069785714149475,
+    "drift": 0.0007965792901813984,
+    "small_step": 0.0019896202720701694,
+    "strong_consistency": 0.1479116529226303
+  },
+  {
+    "step": 1563,
+    "loss": 0.22124268114566803,
+    "drift": 0.0008411259623244405,
+    "small_step": 0.001765191787853837,
+    "strong_consistency": 0.21863636374473572
+  },
+  {
+    "step": 1564,
+    "loss": 0.157193124294281,
+    "drift": 0.0013737617991864681,
+    "small_step": 0.0027786134742200375,
+    "strong_consistency": 0.15304075181484222
+  },
+  {
+    "step": 1565,
+    "loss": 0.2478577345609665,
+    "drift": 0.00102540897205472,
+    "small_step": 0.0022905149962753057,
+    "strong_consistency": 0.24454180896282196
+  },
+  {
+    "step": 1566,
+    "loss": 0.2395988404750824,
+    "drift": 0.002589342650026083,
+    "small_step": 0.001494244672358036,
+    "strong_consistency": 0.23551525175571442
+  },
+  {
+    "step": 1567,
+    "loss": 0.27268433570861816,
+    "drift": 0.0012340843677520752,
+    "small_step": 0.0016554766334593296,
+    "strong_consistency": 0.269794762134552
+  },
+  {
+    "step": 1568,
+    "loss": 0.4792785346508026,
+    "drift": 0.002923969179391861,
+    "small_step": 0.002182003576308489,
+    "strong_consistency": 0.47417256236076355
+  },
+  {
+    "step": 1569,
+    "loss": 0.1563677191734314,
+    "drift": 0.0014205160550773144,
+    "small_step": 0.001882014679722488,
+    "strong_consistency": 0.15306518971920013
+  },
+  {
+    "step": 1570,
+    "loss": 0.12312735617160797,
+    "drift": 0.0014255809364840388,
+    "small_step": 0.0018548022489994764,
+    "strong_consistency": 0.11984696984291077
+  },
+  {
+    "step": 1571,
+    "loss": 0.2491256147623062,
+    "drift": 0.0022011096589267254,
+    "small_step": 0.002249164506793022,
+    "strong_consistency": 0.24467533826828003
+  },
+  {
+    "step": 1572,
+    "loss": 0.08720354735851288,
+    "drift": 0.0016300660790875554,
+    "small_step": 0.004045932088047266,
+    "strong_consistency": 0.08152754604816437
+  },
+  {
+    "step": 1573,
+    "loss": 0.2449309229850769,
+    "drift": 0.0014509808970615268,
+    "small_step": 0.002060595666989684,
+    "strong_consistency": 0.24141934514045715
+  },
+  {
+    "step": 1574,
+    "loss": 0.33827489614486694,
+    "drift": 0.0015228354604914784,
+    "small_step": 0.0022714785300195217,
+    "strong_consistency": 0.3344805836677551
+  },
+  {
+    "step": 1575,
+    "loss": 0.22067396342754364,
+    "drift": 0.002005824353545904,
+    "small_step": 0.001176906400360167,
+    "strong_consistency": 0.2174912393093109
+  },
+  {
+    "step": 1576,
+    "loss": 0.20057083666324615,
+    "drift": 0.0012120746541768312,
+    "small_step": 0.002470307517796755,
+    "strong_consistency": 0.19688846170902252
+  },
+  {
+    "step": 1577,
+    "loss": 0.3746100068092346,
+    "drift": 0.001411992241628468,
+    "small_step": 0.0019151541637256742,
+    "strong_consistency": 0.3712828457355499
+  },
+  {
+    "step": 1578,
+    "loss": 0.2568255662918091,
+    "drift": 0.0017033189069479704,
+    "small_step": 0.0020124802831560373,
+    "strong_consistency": 0.25310975313186646
+  },
+  {
+    "step": 1579,
+    "loss": 0.1809065043926239,
+    "drift": 0.0018557572038844228,
+    "small_step": 0.0022518285550177097,
+    "strong_consistency": 0.17679892480373383
+  },
+  {
+    "step": 1580,
+    "loss": 0.24804586172103882,
+    "drift": 0.0028177935164421797,
+    "small_step": 0.0020201741717755795,
+    "strong_consistency": 0.2432079017162323
+  },
+  {
+    "step": 1581,
+    "loss": 0.29423120617866516,
+    "drift": 0.002322325948625803,
+    "small_step": 0.002931937575340271,
+    "strong_consistency": 0.2889769375324249
+  },
+  {
+    "step": 1582,
+    "loss": 0.20196124911308289,
+    "drift": 0.005077922251075506,
+    "small_step": 0.0014658051077276468,
+    "strong_consistency": 0.19541752338409424
+  },
+  {
+    "step": 1583,
+    "loss": 0.2956157922744751,
+    "drift": 0.0022540921345353127,
+    "small_step": 0.0018995505524799228,
+    "strong_consistency": 0.29146215319633484
+  },
+  {
+    "step": 1584,
+    "loss": 0.26357224583625793,
+    "drift": 0.0044848257675766945,
+    "small_step": 0.002077836776152253,
+    "strong_consistency": 0.2570095956325531
+  },
+  {
+    "step": 1585,
+    "loss": 0.245799720287323,
+    "drift": 0.0048414734192192554,
+    "small_step": 0.0015262363012880087,
+    "strong_consistency": 0.23943200707435608
+  },
+  {
+    "step": 1586,
+    "loss": 0.14037129282951355,
+    "drift": 0.002418742747977376,
+    "small_step": 0.0014844299294054508,
+    "strong_consistency": 0.13646812736988068
+  },
+  {
+    "step": 1587,
+    "loss": 0.41694843769073486,
+    "drift": 0.0016711014322936535,
+    "small_step": 0.0016500621568411589,
+    "strong_consistency": 0.4136272668838501
+  },
+  {
+    "step": 1588,
+    "loss": 0.17688147723674774,
+    "drift": 0.0019587883725762367,
+    "small_step": 0.0020532996859401464,
+    "strong_consistency": 0.17286938428878784
+  },
+  {
+    "step": 1589,
+    "loss": 0.18442577123641968,
+    "drift": 0.0025582797825336456,
+    "small_step": 0.001889709266833961,
+    "strong_consistency": 0.17997778952121735
+  },
+  {
+    "step": 1590,
+    "loss": 0.1523968130350113,
+    "drift": 0.001312490552663803,
+    "small_step": 0.0021276979241520166,
+    "strong_consistency": 0.14895662665367126
+  },
+  {
+    "step": 1591,
+    "loss": 0.12281935662031174,
+    "drift": 0.0018350847531110048,
+    "small_step": 0.002838389715179801,
+    "strong_consistency": 0.1181458830833435
+  },
+  {
+    "step": 1592,
+    "loss": 0.3716605305671692,
+    "drift": 0.0021195029839873314,
+    "small_step": 0.003465736750513315,
+    "strong_consistency": 0.3660752773284912
+  },
+  {
+    "step": 1593,
+    "loss": 0.21688586473464966,
+    "drift": 0.0016388127114623785,
+    "small_step": 0.0020525178406387568,
+    "strong_consistency": 0.21319453418254852
+  },
+  {
+    "step": 1594,
+    "loss": 0.24605850875377655,
+    "drift": 0.002776374341920018,
+    "small_step": 0.00207345699891448,
+    "strong_consistency": 0.24120867252349854
+  },
+  {
+    "step": 1595,
+    "loss": 0.39809685945510864,
+    "drift": 0.0022414429113268852,
+    "small_step": 0.0017852903110906482,
+    "strong_consistency": 0.3940701186656952
+  },
+  {
+    "step": 1596,
+    "loss": 0.18093562126159668,
+    "drift": 0.0033568651415407658,
+    "small_step": 0.003785407869145274,
+    "strong_consistency": 0.17379334568977356
+  },
+  {
+    "step": 1597,
+    "loss": 0.274000883102417,
+    "drift": 0.0017358771292492747,
+    "small_step": 0.0019225121941417456,
+    "strong_consistency": 0.27034249901771545
+  },
+  {
+    "step": 1598,
+    "loss": 0.4348365068435669,
+    "drift": 0.0023505266290158033,
+    "small_step": 0.0015653922455385327,
+    "strong_consistency": 0.4309206008911133
+  },
+  {
+    "step": 1599,
+    "loss": 0.2581862509250641,
+    "drift": 0.003048480721190572,
+    "small_step": 0.0021522515453398228,
+    "strong_consistency": 0.25298550724983215
+  },
+  {
+    "step": 1600,
+    "loss": 0.30654630064964294,
+    "drift": 0.002582805696874857,
+    "small_step": 0.002505658194422722,
+    "strong_consistency": 0.30145782232284546
+  },
+  {
+    "step": 1601,
+    "loss": 0.40018802881240845,
+    "drift": 0.002732266904786229,
+    "small_step": 0.0020414283499121666,
+    "strong_consistency": 0.3954143226146698
+  },
+  {
+    "step": 1602,
+    "loss": 0.186147540807724,
+    "drift": 0.0025608204305171967,
+    "small_step": 0.002172000939026475,
+    "strong_consistency": 0.18141472339630127
+  },
+  {
+    "step": 1603,
+    "loss": 0.3674720525741577,
+    "drift": 0.0032372442074120045,
+    "small_step": 0.002630745992064476,
+    "strong_consistency": 0.36160406470298767
+  },
+  {
+    "step": 1604,
+    "loss": 0.46274861693382263,
+    "drift": 0.0023693840485066175,
+    "small_step": 0.001994348829612136,
+    "strong_consistency": 0.4583848714828491
+  },
+  {
+    "step": 1605,
+    "loss": 0.26014989614486694,
+    "drift": 0.003700846806168556,
+    "small_step": 0.0026243310421705246,
+    "strong_consistency": 0.25382471084594727
+  },
+  {
+    "step": 1606,
+    "loss": 0.28007638454437256,
+    "drift": 0.004510840866714716,
+    "small_step": 0.002422427525743842,
+    "strong_consistency": 0.27314311265945435
+  },
+  {
+    "step": 1607,
+    "loss": 0.2561998963356018,
+    "drift": 0.002684328705072403,
+    "small_step": 0.0028298695106059313,
+    "strong_consistency": 0.2506856918334961
+  },
+  {
+    "step": 1608,
+    "loss": 0.30233609676361084,
+    "drift": 0.003107883036136627,
+    "small_step": 0.0026216802652925253,
+    "strong_consistency": 0.29660654067993164
+  },
+  {
+    "step": 1609,
+    "loss": 0.24597761034965515,
+    "drift": 0.0019675230141729116,
+    "small_step": 0.003202467691153288,
+    "strong_consistency": 0.24080762267112732
+  },
+  {
+    "step": 1610,
+    "loss": 0.2782182991504669,
+    "drift": 0.008180222474038601,
+    "small_step": 0.0024755210615694523,
+    "strong_consistency": 0.2675625681877136
+  },
+  {
+    "step": 1611,
+    "loss": 0.20393532514572144,
+    "drift": 0.002567628398537636,
+    "small_step": 0.0036909799091517925,
+    "strong_consistency": 0.19767671823501587
+  },
+  {
+    "step": 1612,
+    "loss": 0.3147056996822357,
+    "drift": 0.003461934393271804,
+    "small_step": 0.0027892200741916895,
+    "strong_consistency": 0.3084545433521271
+  },
+  {
+    "step": 1613,
+    "loss": 0.2732583284378052,
+    "drift": 0.004457087721675634,
+    "small_step": 0.002346723573282361,
+    "strong_consistency": 0.2664545178413391
+  },
+  {
+    "step": 1614,
+    "loss": 0.21733763813972473,
+    "drift": 0.0030518139246851206,
+    "small_step": 0.0028255735523998737,
+    "strong_consistency": 0.21146024763584137
+  },
+  {
+    "step": 1615,
+    "loss": 0.456004798412323,
+    "drift": 0.0030659514013677835,
+    "small_step": 0.002781633287668228,
+    "strong_consistency": 0.4501572251319885
+  },
+  {
+    "step": 1616,
+    "loss": 0.32504531741142273,
+    "drift": 0.002784888492897153,
+    "small_step": 0.0019593359902501106,
+    "strong_consistency": 0.3203010857105255
+  },
+  {
+    "step": 1617,
+    "loss": 0.45950937271118164,
+    "drift": 0.005133369006216526,
+    "small_step": 0.003310626372694969,
+    "strong_consistency": 0.45106539130210876
+  },
+  {
+    "step": 1618,
+    "loss": 0.49819856882095337,
+    "drift": 0.008378522470593452,
+    "small_step": 0.0025389951188117266,
+    "strong_consistency": 0.48728105425834656
+  },
+  {
+    "step": 1619,
+    "loss": 0.35865408182144165,
+    "drift": 0.009283503517508507,
+    "small_step": 0.0029168189503252506,
+    "strong_consistency": 0.3464537560939789
+  },
+  {
+    "step": 1620,
+    "loss": 0.14584900438785553,
+    "drift": 0.003524082014337182,
+    "small_step": 0.00427107373252511,
+    "strong_consistency": 0.13805384933948517
+  },
+  {
+    "step": 1621,
+    "loss": 0.27407363057136536,
+    "drift": 0.0077947331592440605,
+    "small_step": 0.003783786203712225,
+    "strong_consistency": 0.26249510049819946
+  },
+  {
+    "step": 1622,
+    "loss": 0.2205502688884735,
+    "drift": 0.0032599603291600943,
+    "small_step": 0.0022763917222619057,
+    "strong_consistency": 0.21501392126083374
+  },
+  {
+    "step": 1623,
+    "loss": 0.13364963233470917,
+    "drift": 0.0043902890756726265,
+    "small_step": 0.0015926997875794768,
+    "strong_consistency": 0.127666637301445
+  },
+  {
+    "step": 1624,
+    "loss": 0.440088152885437,
+    "drift": 0.0028628427535295486,
+    "small_step": 0.0022369723301380873,
+    "strong_consistency": 0.4349883496761322
+  },
+  {
+    "step": 1625,
+    "loss": 0.3596237897872925,
+    "drift": 0.003996125888079405,
+    "small_step": 0.0033842187840491533,
+    "strong_consistency": 0.35224345326423645
+  },
+  {
+    "step": 1626,
+    "loss": 0.4703120291233063,
+    "drift": 0.006153330206871033,
+    "small_step": 0.0024123929906636477,
+    "strong_consistency": 0.46174630522727966
+  },
+  {
+    "step": 1627,
+    "loss": 0.13552825152873993,
+    "drift": 0.0050803907215595245,
+    "small_step": 0.004406362771987915,
+    "strong_consistency": 0.1260415017604828
+  },
+  {
+    "step": 1628,
+    "loss": 0.25517746806144714,
+    "drift": 0.005795284174382687,
+    "small_step": 0.0034300307743251324,
+    "strong_consistency": 0.24595214426517487
+  },
+  {
+    "step": 1629,
+    "loss": 0.24813269078731537,
+    "drift": 0.006564199458807707,
+    "small_step": 0.004484416451305151,
+    "strong_consistency": 0.23708407580852509
+  },
+  {
+    "step": 1630,
+    "loss": 0.20808452367782593,
+    "drift": 0.004683460108935833,
+    "small_step": 0.003162442008033395,
+    "strong_consistency": 0.20023861527442932
+  },
+  {
+    "step": 1631,
+    "loss": 0.22160235047340393,
+    "drift": 0.00440938537940383,
+    "small_step": 0.004376382566988468,
+    "strong_consistency": 0.21281658113002777
+  },
+  {
+    "step": 1632,
+    "loss": 0.30538317561149597,
+    "drift": 0.0062148855067789555,
+    "small_step": 0.003866408718749881,
+    "strong_consistency": 0.2953018844127655
+  },
+  {
+    "step": 1633,
+    "loss": 0.15837271511554718,
+    "drift": 0.006374460645020008,
+    "small_step": 0.004005555063486099,
+    "strong_consistency": 0.14799270033836365
+  },
+  {
+    "step": 1634,
+    "loss": 0.1513495296239853,
+    "drift": 0.0029819346964359283,
+    "small_step": 0.0034075607545673847,
+    "strong_consistency": 0.14496003091335297
+  },
+  {
+    "step": 1635,
+    "loss": 0.3505946099758148,
+    "drift": 0.003613971173763275,
+    "small_step": 0.003001562086865306,
+    "strong_consistency": 0.3439790904521942
+  },
+  {
+    "step": 1636,
+    "loss": 0.3091656565666199,
+    "drift": 0.0022306405007839203,
+    "small_step": 0.003226828295737505,
+    "strong_consistency": 0.30370819568634033
+  },
+  {
+    "step": 1637,
+    "loss": 0.22780776023864746,
+    "drift": 0.003319817828014493,
+    "small_step": 0.003830368397757411,
+    "strong_consistency": 0.2206575721502304
+  },
+  {
+    "step": 1638,
+    "loss": 0.17629431188106537,
+    "drift": 0.006427503656595945,
+    "small_step": 0.003331181826069951,
+    "strong_consistency": 0.1665356308221817
+  },
+  {
+    "step": 1639,
+    "loss": 0.22504886984825134,
+    "drift": 0.003169453702867031,
+    "small_step": 0.004927461035549641,
+    "strong_consistency": 0.21695195138454437
+  },
+  {
+    "step": 1640,
+    "loss": 0.3660780191421509,
+    "drift": 0.0018757081124931574,
+    "small_step": 0.004411979112774134,
+    "strong_consistency": 0.3597903251647949
+  },
+  {
+    "step": 1641,
+    "loss": 0.41580483317375183,
+    "drift": 0.0024182263296097517,
+    "small_step": 0.0032852981239557266,
+    "strong_consistency": 0.4101012945175171
+  },
+  {
+    "step": 1642,
+    "loss": 0.3731269836425781,
+    "drift": 0.006116204429417849,
+    "small_step": 0.001978558488190174,
+    "strong_consistency": 0.36503222584724426
+  },
+  {
+    "step": 1643,
+    "loss": 0.33721885085105896,
+    "drift": 0.00448249839246273,
+    "small_step": 0.004494816996157169,
+    "strong_consistency": 0.3282415270805359
+  },
+  {
+    "step": 1644,
+    "loss": 0.38384294509887695,
+    "drift": 0.005540749989449978,
+    "small_step": 0.004126192536205053,
+    "strong_consistency": 0.3741759955883026
+  },
+  {
+    "step": 1645,
+    "loss": 0.31087127327919006,
+    "drift": 0.004896754864603281,
+    "small_step": 0.0036285805981606245,
+    "strong_consistency": 0.3023459315299988
+  },
+  {
+    "step": 1646,
+    "loss": 0.3930325210094452,
+    "drift": 0.009817719459533691,
+    "small_step": 0.003545182989910245,
+    "strong_consistency": 0.3796696066856384
+  },
+  {
+    "step": 1647,
+    "loss": 0.22237712144851685,
+    "drift": 0.0030073546804487705,
+    "small_step": 0.00521682295948267,
+    "strong_consistency": 0.21415294706821442
+  },
+  {
+    "step": 1648,
+    "loss": 0.21208521723747253,
+    "drift": 0.004801763221621513,
+    "small_step": 0.003819275414571166,
+    "strong_consistency": 0.20346418023109436
+  },
+  {
+    "step": 1649,
+    "loss": 0.27179187536239624,
+    "drift": 0.004652824252843857,
+    "small_step": 0.003280849428847432,
+    "strong_consistency": 0.26385819911956787
+  },
+  {
+    "step": 1650,
+    "loss": 0.22005607187747955,
+    "drift": 0.004525314085185528,
+    "small_step": 0.004555763676762581,
+    "strong_consistency": 0.21097499132156372
+  },
+  {
+    "step": 1651,
+    "loss": 0.39348718523979187,
+    "drift": 0.009524446912109852,
+    "small_step": 0.003692383412271738,
+    "strong_consistency": 0.3802703619003296
+  },
+  {
+    "step": 1652,
+    "loss": 0.2724558413028717,
+    "drift": 0.006534886546432972,
+    "small_step": 0.0048711830750107765,
+    "strong_consistency": 0.2610497772693634
+  },
+  {
+    "step": 1653,
+    "loss": 0.3266586363315582,
+    "drift": 0.005405734293162823,
+    "small_step": 0.006213733926415443,
+    "strong_consistency": 0.31503915786743164
+  },
+  {
+    "step": 1654,
+    "loss": 0.26561132073402405,
+    "drift": 0.004788593389093876,
+    "small_step": 0.002669619396328926,
+    "strong_consistency": 0.25815311074256897
+  },
+  {
+    "step": 1655,
+    "loss": 0.4361365735530853,
+    "drift": 0.003241914790123701,
+    "small_step": 0.003877150360494852,
+    "strong_consistency": 0.4290175139904022
+  },
+  {
+    "step": 1656,
+    "loss": 0.16626767814159393,
+    "drift": 0.006046006456017494,
+    "small_step": 0.007159895729273558,
+    "strong_consistency": 0.15306177735328674
+  },
+  {
+    "step": 1657,
+    "loss": 0.4253576397895813,
+    "drift": 0.005716347135603428,
+    "small_step": 0.0026555934455245733,
+    "strong_consistency": 0.4169856905937195
+  },
+  {
+    "step": 1658,
+    "loss": 0.2674393355846405,
+    "drift": 0.005296794697642326,
+    "small_step": 0.006647375877946615,
+    "strong_consistency": 0.2554951608181
+  },
+  {
+    "step": 1659,
+    "loss": 0.23965635895729065,
+    "drift": 0.003657209686934948,
+    "small_step": 0.003916338086128235,
+    "strong_consistency": 0.2320828139781952
+  },
+  {
+    "step": 1660,
+    "loss": 0.34527724981307983,
+    "drift": 0.007171339821070433,
+    "small_step": 0.0058572134003043175,
+    "strong_consistency": 0.3322486877441406
+  },
+  {
+    "step": 1661,
+    "loss": 0.3041140139102936,
+    "drift": 0.006881107110530138,
+    "small_step": 0.003001426113769412,
+    "strong_consistency": 0.29423147439956665
+  },
+  {
+    "step": 1662,
+    "loss": 0.7345739006996155,
+    "drift": 0.010390040464699268,
+    "small_step": 0.004539869725704193,
+    "strong_consistency": 0.7196440100669861
+  },
+  {
+    "step": 1663,
+    "loss": 0.2890438139438629,
+    "drift": 0.0071072205901145935,
+    "small_step": 0.004832849837839603,
+    "strong_consistency": 0.2771037518978119
+  },
+  {
+    "step": 1664,
+    "loss": 0.40284860134124756,
+    "drift": 0.008374537341296673,
+    "small_step": 0.004721029195934534,
+    "strong_consistency": 0.3897530436515808
+  },
+  {
+    "step": 1665,
+    "loss": 0.4526938199996948,
+    "drift": 0.00561151560395956,
+    "small_step": 0.006588438060134649,
+    "strong_consistency": 0.4404938519001007
+  },
+  {
+    "step": 1666,
+    "loss": 0.3441895544528961,
+    "drift": 0.01218261569738388,
+    "small_step": 0.0026384659577161074,
+    "strong_consistency": 0.3293684720993042
+  },
+  {
+    "step": 1667,
+    "loss": 0.3686563968658447,
+    "drift": 0.009129956364631653,
+    "small_step": 0.004155675880610943,
+    "strong_consistency": 0.35537075996398926
+  },
+  {
+    "step": 1668,
+    "loss": 0.24867276847362518,
+    "drift": 0.011781517416238785,
+    "small_step": 0.003906395751982927,
+    "strong_consistency": 0.23298485577106476
+  },
+  {
+    "step": 1669,
+    "loss": 0.4480333924293518,
+    "drift": 0.010365563444793224,
+    "small_step": 0.004663405474275351,
+    "strong_consistency": 0.4330044090747833
+  },
+  {
+    "step": 1670,
+    "loss": 0.379635751247406,
+    "drift": 0.011808282695710659,
+    "small_step": 0.0025091455318033695,
+    "strong_consistency": 0.36531832814216614
+  },
+  {
+    "step": 1671,
+    "loss": 0.28301677107810974,
+    "drift": 0.012235547415912151,
+    "small_step": 0.005600136239081621,
+    "strong_consistency": 0.2651810944080353
+  },
+  {
+    "step": 1672,
+    "loss": 0.3265213370323181,
+    "drift": 0.017030522227287292,
+    "small_step": 0.0032693147659301758,
+    "strong_consistency": 0.30622148513793945
+  },
+  {
+    "step": 1673,
+    "loss": 0.2801309823989868,
+    "drift": 0.01371181383728981,
+    "small_step": 0.004667473491281271,
+    "strong_consistency": 0.2617516815662384
+  },
+  {
+    "step": 1674,
+    "loss": 0.3158031702041626,
+    "drift": 0.008547870442271233,
+    "small_step": 0.005561691243201494,
+    "strong_consistency": 0.3016936182975769
+  },
+  {
+    "step": 1675,
+    "loss": 0.34012189507484436,
+    "drift": 0.020268430933356285,
+    "small_step": 0.003615359775722027,
+    "strong_consistency": 0.3162381052970886
+  },
+  {
+    "step": 1676,
+    "loss": 0.33147746324539185,
+    "drift": 0.010529170744121075,
+    "small_step": 0.00396664347499609,
+    "strong_consistency": 0.31698164343833923
+  },
+  {
+    "step": 1677,
+    "loss": 0.5942621827125549,
+    "drift": 0.017450198531150818,
+    "small_step": 0.0059226760640740395,
+    "strong_consistency": 0.5708892941474915
+  },
+  {
+    "step": 1678,
+    "loss": 0.2481691837310791,
+    "drift": 0.017303096130490303,
+    "small_step": 0.004590777680277824,
+    "strong_consistency": 0.22627530992031097
+  },
+  {
+    "step": 1679,
+    "loss": 0.26037511229515076,
+    "drift": 0.019143477082252502,
+    "small_step": 0.005043957382440567,
+    "strong_consistency": 0.23618768155574799
+  },
+  {
+    "step": 1680,
+    "loss": 0.4000002443790436,
+    "drift": 0.02018674835562706,
+    "small_step": 0.00549712497740984,
+    "strong_consistency": 0.37431636452674866
+  },
+  {
+    "step": 1681,
+    "loss": 0.23056679964065552,
+    "drift": 0.023947592824697495,
+    "small_step": 0.006756450980901718,
+    "strong_consistency": 0.1998627483844757
+  },
+  {
+    "step": 1682,
+    "loss": 0.4250117838382721,
+    "drift": 0.016661982983350754,
+    "small_step": 0.0032281787134706974,
+    "strong_consistency": 0.4051216244697571
+  },
+  {
+    "step": 1683,
+    "loss": 0.30786752700805664,
+    "drift": 0.015880223363637924,
+    "small_step": 0.005112853832542896,
+    "strong_consistency": 0.2868744432926178
+  },
+  {
+    "step": 1684,
+    "loss": 0.29751211404800415,
+    "drift": 0.014705915004014969,
+    "small_step": 0.004795964807271957,
+    "strong_consistency": 0.27801021933555603
+  },
+  {
+    "step": 1685,
+    "loss": 0.35051730275154114,
+    "drift": 0.01222151517868042,
+    "small_step": 0.007250260561704636,
+    "strong_consistency": 0.331045538187027
+  },
+  {
+    "step": 1686,
+    "loss": 0.4499977231025696,
+    "drift": 0.025540076196193695,
+    "small_step": 0.008589347824454308,
+    "strong_consistency": 0.4158683121204376
+  },
+  {
+    "step": 1687,
+    "loss": 0.3053324222564697,
+    "drift": 0.014369310811161995,
+    "small_step": 0.006012566387653351,
+    "strong_consistency": 0.2849505543708801
+  },
+  {
+    "step": 1688,
+    "loss": 0.2109316885471344,
+    "drift": 0.013324323110282421,
+    "small_step": 0.004973820876330137,
+    "strong_consistency": 0.19263353943824768
+  },
+  {
+    "step": 1689,
+    "loss": 0.34334149956703186,
+    "drift": 0.014035043306648731,
+    "small_step": 0.006351766176521778,
+    "strong_consistency": 0.3229546844959259
+  },
+  {
+    "step": 1690,
+    "loss": 0.49202367663383484,
+    "drift": 0.010638329200446606,
+    "small_step": 0.0060507976450026035,
+    "strong_consistency": 0.4753345549106598
+  },
+  {
+    "step": 1691,
+    "loss": 0.32420971989631653,
+    "drift": 0.014807562343776226,
+    "small_step": 0.007252504117786884,
+    "strong_consistency": 0.3021496534347534
+  },
+  {
+    "step": 1692,
+    "loss": 0.3772829473018646,
+    "drift": 0.011001568287611008,
+    "small_step": 0.004259685054421425,
+    "strong_consistency": 0.36202168464660645
+  },
+  {
+    "step": 1693,
+    "loss": 0.45304983854293823,
+    "drift": 0.011845785193145275,
+    "small_step": 0.008315347135066986,
+    "strong_consistency": 0.4328887164592743
+  },
+  {
+    "step": 1694,
+    "loss": 0.299477219581604,
+    "drift": 0.016894135624170303,
+    "small_step": 0.0066285450011491776,
+    "strong_consistency": 0.27595454454421997
+  },
+  {
+    "step": 1695,
+    "loss": 0.8756072521209717,
+    "drift": 0.009623672813177109,
+    "small_step": 0.008032932877540588,
+    "strong_consistency": 0.8579506278038025
+  },
+  {
+    "step": 1696,
+    "loss": 0.2670111060142517,
+    "drift": 0.009391908533871174,
+    "small_step": 0.0061430479399859905,
+    "strong_consistency": 0.25147613883018494
+  },
+  {
+    "step": 1697,
+    "loss": 0.4393014907836914,
+    "drift": 0.01104645524173975,
+    "small_step": 0.006835065316408873,
+    "strong_consistency": 0.42141997814178467
+  },
+  {
+    "step": 1698,
+    "loss": 0.3113841116428375,
+    "drift": 0.013345086015760899,
+    "small_step": 0.004736119415611029,
+    "strong_consistency": 0.29330289363861084
+  },
+  {
+    "step": 1699,
+    "loss": 0.6897233128547668,
+    "drift": 0.010122693143785,
+    "small_step": 0.006954323034733534,
+    "strong_consistency": 0.6726462841033936
+  },
+  {
+    "step": 1700,
+    "loss": 0.5156600475311279,
+    "drift": 0.011503197252750397,
+    "small_step": 0.005343909375369549,
+    "strong_consistency": 0.4988129436969757
+  },
+  {
+    "step": 1701,
+    "loss": 0.17100216448307037,
+    "drift": 0.00958856102079153,
+    "small_step": 0.007487578317523003,
+    "strong_consistency": 0.1539260298013687
+  },
+  {
+    "step": 1702,
+    "loss": 0.3234255015850067,
+    "drift": 0.012174103409051895,
+    "small_step": 0.00829621683806181,
+    "strong_consistency": 0.30295518040657043
+  },
+  {
+    "step": 1703,
+    "loss": 0.6195033192634583,
+    "drift": 0.009221761487424374,
+    "small_step": 0.0065743280574679375,
+    "strong_consistency": 0.6037072539329529
+  },
+  {
+    "step": 1704,
+    "loss": 0.6657767295837402,
+    "drift": 0.013029513880610466,
+    "small_step": 0.007488232105970383,
+    "strong_consistency": 0.6452589631080627
+  },
+  {
+    "step": 1705,
+    "loss": 0.3219323456287384,
+    "drift": 0.014384151436388493,
+    "small_step": 0.0080425338819623,
+    "strong_consistency": 0.29950565099716187
+  },
+  {
+    "step": 1706,
+    "loss": 0.29221487045288086,
+    "drift": 0.024844812229275703,
+    "small_step": 0.006314574275165796,
+    "strong_consistency": 0.26105549931526184
+  },
+  {
+    "step": 1707,
+    "loss": 0.6092379093170166,
+    "drift": 0.009689844213426113,
+    "small_step": 0.005571294575929642,
+    "strong_consistency": 0.5939767956733704
+  },
+  {
+    "step": 1708,
+    "loss": 0.3620471954345703,
+    "drift": 0.019327016547322273,
+    "small_step": 0.005792477633804083,
+    "strong_consistency": 0.33692771196365356
+  },
+  {
+    "step": 1709,
+    "loss": 0.4827912151813507,
+    "drift": 0.016562819480895996,
+    "small_step": 0.006064478307962418,
+    "strong_consistency": 0.4601639211177826
+  },
+  {
+    "step": 1710,
+    "loss": 0.31507807970046997,
+    "drift": 0.013203774578869343,
+    "small_step": 0.007710091769695282,
+    "strong_consistency": 0.2941642105579376
+  },
+  {
+    "step": 1711,
+    "loss": 0.506976306438446,
+    "drift": 0.019283514469861984,
+    "small_step": 0.006298968568444252,
+    "strong_consistency": 0.48139384388923645
+  },
+  {
+    "step": 1712,
+    "loss": 0.3921653926372528,
+    "drift": 0.01694769784808159,
+    "small_step": 0.008228984661400318,
+    "strong_consistency": 0.3669887185096741
+  },
+  {
+    "step": 1713,
+    "loss": 0.32921963930130005,
+    "drift": 0.011908823624253273,
+    "small_step": 0.004333359654992819,
+    "strong_consistency": 0.31297746300697327
+  },
+  {
+    "step": 1714,
+    "loss": 0.691044807434082,
+    "drift": 0.01422541681677103,
+    "small_step": 0.007957352325320244,
+    "strong_consistency": 0.6688620448112488
+  },
+  {
+    "step": 1715,
+    "loss": 0.5101448893547058,
+    "drift": 0.014957821927964687,
+    "small_step": 0.00697625707834959,
+    "strong_consistency": 0.4882107973098755
+  },
+  {
+    "step": 1716,
+    "loss": 0.29805466532707214,
+    "drift": 0.017402036115527153,
+    "small_step": 0.007203170098364353,
+    "strong_consistency": 0.27344945073127747
+  },
+  {
+    "step": 1717,
+    "loss": 0.32005730271339417,
+    "drift": 0.009125779382884502,
+    "small_step": 0.00825806800276041,
+    "strong_consistency": 0.30267345905303955
+  },
+  {
+    "step": 1718,
+    "loss": 0.4443185329437256,
+    "drift": 0.02989465743303299,
+    "small_step": 0.011662876233458519,
+    "strong_consistency": 0.4027610123157501
+  },
+  {
+    "step": 1719,
+    "loss": 1.1484119892120361,
+    "drift": 0.01414578314870596,
+    "small_step": 0.005959608592092991,
+    "strong_consistency": 1.1283066272735596
+  },
+  {
+    "step": 1720,
+    "loss": 0.5990171432495117,
+    "drift": 0.02415519580245018,
+    "small_step": 0.010252662003040314,
+    "strong_consistency": 0.5646092891693115
+  },
+  {
+    "step": 1721,
+    "loss": 0.4651876986026764,
+    "drift": 0.01623569428920746,
+    "small_step": 0.00530447531491518,
+    "strong_consistency": 0.4436475336551666
+  },
+  {
+    "step": 1722,
+    "loss": 0.6049069166183472,
+    "drift": 0.022270958870649338,
+    "small_step": 0.008914942853152752,
+    "strong_consistency": 0.5737209916114807
+  },
+  {
+    "step": 1723,
+    "loss": 0.618352472782135,
+    "drift": 0.014513196423649788,
+    "small_step": 0.005554819013923407,
+    "strong_consistency": 0.5982844829559326
+  },
+  {
+    "step": 1724,
+    "loss": 0.29432612657546997,
+    "drift": 0.019895849749445915,
+    "small_step": 0.008535729721188545,
+    "strong_consistency": 0.2658945322036743
+  },
+  {
+    "step": 1725,
+    "loss": 0.37509483098983765,
+    "drift": 0.02682933211326599,
+    "small_step": 0.008365364745259285,
+    "strong_consistency": 0.3399001359939575
+  },
+  {
+    "step": 1726,
+    "loss": 0.7128726840019226,
+    "drift": 0.026438739150762558,
+    "small_step": 0.010483752936124802,
+    "strong_consistency": 0.6759501695632935
+  },
+  {
+    "step": 1727,
+    "loss": 0.27241021394729614,
+    "drift": 0.02078874409198761,
+    "small_step": 0.009185189381241798,
+    "strong_consistency": 0.24243628978729248
+  },
+  {
+    "step": 1728,
+    "loss": 0.32665911316871643,
+    "drift": 0.024320654571056366,
+    "small_step": 0.007924066856503487,
+    "strong_consistency": 0.2944144010543823
+  },
+  {
+    "step": 1729,
+    "loss": 0.21248163282871246,
+    "drift": 0.014220993965864182,
+    "small_step": 0.010627059265971184,
+    "strong_consistency": 0.18763357400894165
+  },
+  {
+    "step": 1730,
+    "loss": 0.38966116309165955,
+    "drift": 0.027790285646915436,
+    "small_step": 0.009787868708372116,
+    "strong_consistency": 0.3520829975605011
+  },
+  {
+    "step": 1731,
+    "loss": 0.4858625531196594,
+    "drift": 0.02577652409672737,
+    "small_step": 0.013112572953104973,
+    "strong_consistency": 0.44697344303131104
+  },
+  {
+    "step": 1732,
+    "loss": 0.4106631875038147,
+    "drift": 0.024754537269473076,
+    "small_step": 0.006985820829868317,
+    "strong_consistency": 0.37892282009124756
+  },
+  {
+    "step": 1733,
+    "loss": 0.3505345284938812,
+    "drift": 0.01775316894054413,
+    "small_step": 0.009576800279319286,
+    "strong_consistency": 0.32320454716682434
+  },
+  {
+    "step": 1734,
+    "loss": 0.42455556988716125,
+    "drift": 0.02028229832649231,
+    "small_step": 0.007155874744057655,
+    "strong_consistency": 0.39711740612983704
+  },
+  {
+    "step": 1735,
+    "loss": 0.5901355743408203,
+    "drift": 0.017072532325983047,
+    "small_step": 0.005821302533149719,
+    "strong_consistency": 0.5672417283058167
+  },
+  {
+    "step": 1736,
+    "loss": 0.549721360206604,
+    "drift": 0.01754314824938774,
+    "small_step": 0.0057178763672709465,
+    "strong_consistency": 0.5264603495597839
+  },
+  {
+    "step": 1737,
+    "loss": 0.7315982580184937,
+    "drift": 0.020300306379795074,
+    "small_step": 0.007572051137685776,
+    "strong_consistency": 0.7037258744239807
+  },
+  {
+    "step": 1738,
+    "loss": 0.8774688839912415,
+    "drift": 0.021045636385679245,
+    "small_step": 0.005763044115155935,
+    "strong_consistency": 0.8506602048873901
+  },
+  {
+    "step": 1739,
+    "loss": 0.707538366317749,
+    "drift": 0.018649907782673836,
+    "small_step": 0.019324615597724915,
+    "strong_consistency": 0.6695638298988342
+  },
+  {
+    "step": 1740,
+    "loss": 0.5098236203193665,
+    "drift": 0.013787812553346157,
+    "small_step": 0.00974647793918848,
+    "strong_consistency": 0.4862893521785736
+  },
+  {
+    "step": 1741,
+    "loss": 0.7085939049720764,
+    "drift": 0.024978231638669968,
+    "small_step": 0.009671986103057861,
+    "strong_consistency": 0.6739436984062195
+  },
+  {
+    "step": 1742,
+    "loss": 0.7454091906547546,
+    "drift": 0.024452906101942062,
+    "small_step": 0.00872817076742649,
+    "strong_consistency": 0.7122281193733215
+  },
+  {
+    "step": 1743,
+    "loss": 0.4485134482383728,
+    "drift": 0.02965664491057396,
+    "small_step": 0.010731877759099007,
+    "strong_consistency": 0.4081249237060547
+  },
+  {
+    "step": 1744,
+    "loss": 0.46686434745788574,
+    "drift": 0.03735000640153885,
+    "small_step": 0.010511697269976139,
+    "strong_consistency": 0.4190026521682739
+  },
+  {
+    "step": 1745,
+    "loss": 0.41369807720184326,
+    "drift": 0.056795891374349594,
+    "small_step": 0.0086348382756114,
+    "strong_consistency": 0.3482673466205597
+  },
+  {
+    "step": 1746,
+    "loss": 0.4392547905445099,
+    "drift": 0.03725116327404976,
+    "small_step": 0.010084928944706917,
+    "strong_consistency": 0.39191868901252747
+  },
+  {
+    "step": 1747,
+    "loss": 0.5516667366027832,
+    "drift": 0.03575070947408676,
+    "small_step": 0.010572350583970547,
+    "strong_consistency": 0.5053436756134033
+  },
+  {
+    "step": 1748,
+    "loss": 0.8904088735580444,
+    "drift": 0.02964426577091217,
+    "small_step": 0.013584527187049389,
+    "strong_consistency": 0.8471800684928894
+  },
+  {
+    "step": 1749,
+    "loss": 0.34195107221603394,
+    "drift": 0.03825104236602783,
+    "small_step": 0.015915388241410255,
+    "strong_consistency": 0.2877846360206604
+  },
+  {
+    "step": 1750,
+    "loss": 0.7187762260437012,
+    "drift": 0.03781065717339516,
+    "small_step": 0.009306898340582848,
+    "strong_consistency": 0.6716586947441101
+  },
+  {
+    "step": 1751,
+    "loss": 0.6364083290100098,
+    "drift": 0.034610021859407425,
+    "small_step": 0.008793596178293228,
+    "strong_consistency": 0.5930047035217285
+  },
+  {
+    "step": 1752,
+    "loss": 0.5278395414352417,
+    "drift": 0.042177293449640274,
+    "small_step": 0.008210107684135437,
+    "strong_consistency": 0.4774521589279175
+  },
+  {
+    "step": 1753,
+    "loss": 0.5236414670944214,
+    "drift": 0.055278241634368896,
+    "small_step": 0.009583432227373123,
+    "strong_consistency": 0.45877978205680847
+  },
+  {
+    "step": 1754,
+    "loss": 0.7323455214500427,
+    "drift": 0.030608931556344032,
+    "small_step": 0.010496738366782665,
+    "strong_consistency": 0.6912398338317871
+  },
+  {
+    "step": 1755,
+    "loss": 0.8090018033981323,
+    "drift": 0.07119140028953552,
+    "small_step": 0.014188461005687714,
+    "strong_consistency": 0.7236219644546509
+  },
+  {
+    "step": 1756,
+    "loss": 0.3523249328136444,
+    "drift": 0.03623085096478462,
+    "small_step": 0.008566949516534805,
+    "strong_consistency": 0.3075271248817444
+  },
+  {
+    "step": 1757,
+    "loss": 0.7225660085678101,
+    "drift": 0.038285523653030396,
+    "small_step": 0.010304179973900318,
+    "strong_consistency": 0.6739763021469116
+  },
+  {
+    "step": 1758,
+    "loss": 0.5509917736053467,
+    "drift": 0.03261353075504303,
+    "small_step": 0.007668931968510151,
+    "strong_consistency": 0.510709285736084
+  },
+  {
+    "step": 1759,
+    "loss": 0.5206245183944702,
+    "drift": 0.030350148677825928,
+    "small_step": 0.011737901717424393,
+    "strong_consistency": 0.4785364866256714
+  },
+  {
+    "step": 1760,
+    "loss": 0.7837995886802673,
+    "drift": 0.0373789519071579,
+    "small_step": 0.015296578407287598,
+    "strong_consistency": 0.7311240434646606
+  },
+  {
+    "step": 1761,
+    "loss": 0.8055621385574341,
+    "drift": 0.028230000287294388,
+    "small_step": 0.01040955726057291,
+    "strong_consistency": 0.7669225931167603
+  },
+  {
+    "step": 1762,
+    "loss": 0.502230167388916,
+    "drift": 0.031617555767297745,
+    "small_step": 0.010547489859163761,
+    "strong_consistency": 0.4600651264190674
+  },
+  {
+    "step": 1763,
+    "loss": 0.47973427176475525,
+    "drift": 0.03793225437402725,
+    "small_step": 0.01377625297755003,
+    "strong_consistency": 0.4280257523059845
+  },
+  {
+    "step": 1764,
+    "loss": 1.0205527544021606,
+    "drift": 0.052225641906261444,
+    "small_step": 0.008396068587899208,
+    "strong_consistency": 0.9599310159683228
+  },
+  {
+    "step": 1765,
+    "loss": 0.6335235834121704,
+    "drift": 0.04785029962658882,
+    "small_step": 0.01226851437240839,
+    "strong_consistency": 0.5734047889709473
+  },
+  {
+    "step": 1766,
+    "loss": 0.477061927318573,
+    "drift": 0.04274635389447212,
+    "small_step": 0.015565413981676102,
+    "strong_consistency": 0.41875016689300537
+  },
+  {
+    "step": 1767,
+    "loss": 0.4816220998764038,
+    "drift": 0.052235595881938934,
+    "small_step": 0.020590340718626976,
+    "strong_consistency": 0.40879616141319275
+  },
+  {
+    "step": 1768,
+    "loss": 1.103772521018982,
+    "drift": 0.05213167145848274,
+    "small_step": 0.012547511607408524,
+    "strong_consistency": 1.0390933752059937
+  },
+  {
+    "step": 1769,
+    "loss": 0.4122219383716583,
+    "drift": 0.03110230714082718,
+    "small_step": 0.01404272485524416,
+    "strong_consistency": 0.36707690358161926
+  },
+  {
+    "step": 1770,
+    "loss": 0.6733526587486267,
+    "drift": 0.0370759591460228,
+    "small_step": 0.009286778047680855,
+    "strong_consistency": 0.6269899010658264
+  },
+  {
+    "step": 1771,
+    "loss": 1.130156397819519,
+    "drift": 0.06346647441387177,
+    "small_step": 0.010853719897568226,
+    "strong_consistency": 1.0558362007141113
+  },
+  {
+    "step": 1772,
+    "loss": 0.3845466077327728,
+    "drift": 0.041061222553253174,
+    "small_step": 0.015779322013258934,
+    "strong_consistency": 0.32770606875419617
+  },
+  {
+    "step": 1773,
+    "loss": 0.6554397344589233,
+    "drift": 0.061404645442962646,
+    "small_step": 0.016142435371875763,
+    "strong_consistency": 0.5778926610946655
+  },
+  {
+    "step": 1774,
+    "loss": 0.4518650770187378,
+    "drift": 0.05205276980996132,
+    "small_step": 0.011958396062254906,
+    "strong_consistency": 0.3878539204597473
+  },
+  {
+    "step": 1775,
+    "loss": 0.3568823039531708,
+    "drift": 0.04622926563024521,
+    "small_step": 0.012005814351141453,
+    "strong_consistency": 0.2986472249031067
+  },
+  {
+    "step": 1776,
+    "loss": 0.507367730140686,
+    "drift": 0.0540589764714241,
+    "small_step": 0.014480449259281158,
+    "strong_consistency": 0.43882831931114197
+  },
+  {
+    "step": 1777,
+    "loss": 0.6306097507476807,
+    "drift": 0.0701957643032074,
+    "small_step": 0.015010012313723564,
+    "strong_consistency": 0.5454039573669434
+  },
+  {
+    "step": 1778,
+    "loss": 0.629173994064331,
+    "drift": 0.09352435171604156,
+    "small_step": 0.02022482454776764,
+    "strong_consistency": 0.5154248476028442
+  },
+  {
+    "step": 1779,
+    "loss": 0.5868588089942932,
+    "drift": 0.06664543598890305,
+    "small_step": 0.009913221001625061,
+    "strong_consistency": 0.5103001594543457
+  },
+  {
+    "step": 1780,
+    "loss": 0.5695027112960815,
+    "drift": 0.05444010719656944,
+    "small_step": 0.01232064701616764,
+    "strong_consistency": 0.5027419328689575
+  },
+  {
+    "step": 1781,
+    "loss": 0.4595971405506134,
+    "drift": 0.050649795681238174,
+    "small_step": 0.016095662489533424,
+    "strong_consistency": 0.39285168051719666
+  },
+  {
+    "step": 1782,
+    "loss": 0.6116218566894531,
+    "drift": 0.06047869473695755,
+    "small_step": 0.017646195366978645,
+    "strong_consistency": 0.5334969758987427
+  },
+  {
+    "step": 1783,
+    "loss": 0.7829455733299255,
+    "drift": 0.07414569705724716,
+    "small_step": 0.011323977261781693,
+    "strong_consistency": 0.6974759101867676
+  },
+  {
+    "step": 1784,
+    "loss": 0.6939501762390137,
+    "drift": 0.0449872761964798,
+    "small_step": 0.012148872949182987,
+    "strong_consistency": 0.6368140578269958
+  },
+  {
+    "step": 1785,
+    "loss": 0.7004631161689758,
+    "drift": 0.036144182085990906,
+    "small_step": 0.02106846496462822,
+    "strong_consistency": 0.6432504653930664
+  },
+  {
+    "step": 1786,
+    "loss": 0.706912636756897,
+    "drift": 0.043167419731616974,
+    "small_step": 0.014312014915049076,
+    "strong_consistency": 0.6494331955909729
+  },
+  {
+    "step": 1787,
+    "loss": 0.808953046798706,
+    "drift": 0.044310323894023895,
+    "small_step": 0.018047109246253967,
+    "strong_consistency": 0.7465956211090088
+  },
+  {
+    "step": 1788,
+    "loss": 0.856857180595398,
+    "drift": 0.058169689029455185,
+    "small_step": 0.01622493751347065,
+    "strong_consistency": 0.7824625372886658
+  },
+  {
+    "step": 1789,
+    "loss": 0.22015365958213806,
+    "drift": 0.05365405231714249,
+    "small_step": 0.011468514800071716,
+    "strong_consistency": 0.15503108501434326
+  },
+  {
+    "step": 1790,
+    "loss": 0.9546510577201843,
+    "drift": 0.06507673114538193,
+    "small_step": 0.016909584403038025,
+    "strong_consistency": 0.872664749622345
+  },
+  {
+    "step": 1791,
+    "loss": 0.6751183867454529,
+    "drift": 0.04113111272454262,
+    "small_step": 0.01383945718407631,
+    "strong_consistency": 0.6201478242874146
+  },
+  {
+    "step": 1792,
+    "loss": 0.6215956211090088,
+    "drift": 0.05310974642634392,
+    "small_step": 0.0144188879057765,
+    "strong_consistency": 0.5540669560432434
+  },
+  {
+    "step": 1793,
+    "loss": 0.6748267412185669,
+    "drift": 0.06835214793682098,
+    "small_step": 0.013392779044806957,
+    "strong_consistency": 0.5930818319320679
+  },
+  {
+    "step": 1794,
+    "loss": 0.6350706815719604,
+    "drift": 0.03567841649055481,
+    "small_step": 0.030115226283669472,
+    "strong_consistency": 0.5692770481109619
+  },
+  {
+    "step": 1795,
+    "loss": 0.523729145526886,
+    "drift": 0.04556702449917793,
+    "small_step": 0.008292734622955322,
+    "strong_consistency": 0.4698694050312042
+  },
+  {
+    "step": 1796,
+    "loss": 0.610973060131073,
+    "drift": 0.0808970183134079,
+    "small_step": 0.01842353120446205,
+    "strong_consistency": 0.5116525292396545
+  },
+  {
+    "step": 1797,
+    "loss": 0.7388126850128174,
+    "drift": 0.04836674779653549,
+    "small_step": 0.014417022466659546,
+    "strong_consistency": 0.6760289072990417
+  },
+  {
+    "step": 1798,
+    "loss": 0.954700767993927,
+    "drift": 0.0615549236536026,
+    "small_step": 0.010327449068427086,
+    "strong_consistency": 0.8828184008598328
+  },
+  {
+    "step": 1799,
+    "loss": 0.5416848659515381,
+    "drift": 0.04121284931898117,
+    "small_step": 0.014613727107644081,
+    "strong_consistency": 0.48585832118988037
+  },
+  {
+    "step": 1800,
+    "loss": 0.4585314989089966,
+    "drift": 0.04283451661467552,
+    "small_step": 0.007446961011737585,
+    "strong_consistency": 0.40825003385543823
+  },
+  {
+    "step": 1801,
+    "loss": 0.5285109877586365,
+    "drift": 0.05159785971045494,
+    "small_step": 0.01176642719656229,
+    "strong_consistency": 0.4651467204093933
+  },
+  {
+    "step": 1802,
+    "loss": 0.9563760757446289,
+    "drift": 0.05269675701856613,
+    "small_step": 0.021557603031396866,
+    "strong_consistency": 0.8821216821670532
+  },
+  {
+    "step": 1803,
+    "loss": 0.7646547555923462,
+    "drift": 0.06933064013719559,
+    "small_step": 0.014547467231750488,
+    "strong_consistency": 0.6807766556739807
+  },
+  {
+    "step": 1804,
+    "loss": 0.46449732780456543,
+    "drift": 0.07265427708625793,
+    "small_step": 0.02324460633099079,
+    "strong_consistency": 0.36859846115112305
+  },
+  {
+    "step": 1805,
+    "loss": 0.460386723279953,
+    "drift": 0.06954843550920486,
+    "small_step": 0.015521608293056488,
+    "strong_consistency": 0.37531667947769165
+  },
+  {
+    "step": 1806,
+    "loss": 0.5686944723129272,
+    "drift": 0.040767133235931396,
+    "small_step": 0.022564832121133804,
+    "strong_consistency": 0.5053625106811523
+  },
+  {
+    "step": 1807,
+    "loss": 0.5992695093154907,
+    "drift": 0.04769314453005791,
+    "small_step": 0.013017218559980392,
+    "strong_consistency": 0.5385591387748718
+  },
+  {
+    "step": 1808,
+    "loss": 0.4541947543621063,
+    "drift": 0.053574372082948685,
+    "small_step": 0.03198660537600517,
+    "strong_consistency": 0.36863377690315247
+  },
+  {
+    "step": 1809,
+    "loss": 0.6730349659919739,
+    "drift": 0.04278651252388954,
+    "small_step": 0.028090205043554306,
+    "strong_consistency": 0.60215824842453
+  },
+  {
+    "step": 1810,
+    "loss": 0.8501366376876831,
+    "drift": 0.04100010171532631,
+    "small_step": 0.02154718153178692,
+    "strong_consistency": 0.7875893712043762
+  },
+  {
+    "step": 1811,
+    "loss": 1.1409778594970703,
+    "drift": 0.04618223384022713,
+    "small_step": 0.015269450843334198,
+    "strong_consistency": 1.0795261859893799
+  },
+  {
+    "step": 1812,
+    "loss": 0.7660096287727356,
+    "drift": 0.04168136045336723,
+    "small_step": 0.01553378812968731,
+    "strong_consistency": 0.7087944746017456
+  },
+  {
+    "step": 1813,
+    "loss": 0.5576189756393433,
+    "drift": 0.04182550311088562,
+    "small_step": 0.01344304345548153,
+    "strong_consistency": 0.5023504495620728
+  },
+  {
+    "step": 1814,
+    "loss": 0.5675394535064697,
+    "drift": 0.064532570540905,
+    "small_step": 0.02125144749879837,
+    "strong_consistency": 0.48175543546676636
+  },
+  {
+    "step": 1815,
+    "loss": 0.45073163509368896,
+    "drift": 0.04074440896511078,
+    "small_step": 0.02289198525249958,
+    "strong_consistency": 0.38709524273872375
+  },
+  {
+    "step": 1816,
+    "loss": 1.0658622980117798,
+    "drift": 0.05614255368709564,
+    "small_step": 0.02082809992134571,
+    "strong_consistency": 0.9888916015625
+  },
+  {
+    "step": 1817,
+    "loss": 0.7098284959793091,
+    "drift": 0.06896080821752548,
+    "small_step": 0.023549165576696396,
+    "strong_consistency": 0.6173185110092163
+  },
+  {
+    "step": 1818,
+    "loss": 0.44067978858947754,
+    "drift": 0.04144544526934624,
+    "small_step": 0.01943795010447502,
+    "strong_consistency": 0.3797963857650757
+  },
+  {
+    "step": 1819,
+    "loss": 0.6569662094116211,
+    "drift": 0.08614391833543777,
+    "small_step": 0.02205328457057476,
+    "strong_consistency": 0.5487689971923828
+  },
+  {
+    "step": 1820,
+    "loss": 0.5515698790550232,
+    "drift": 0.06405144929885864,
+    "small_step": 0.021464332938194275,
+    "strong_consistency": 0.46605411171913147
+  },
+  {
+    "step": 1821,
+    "loss": 0.9726710319519043,
+    "drift": 0.0521739199757576,
+    "small_step": 0.025390727445483208,
+    "strong_consistency": 0.8951063752174377
+  },
+  {
+    "step": 1822,
+    "loss": 1.0999512672424316,
+    "drift": 0.06535488367080688,
+    "small_step": 0.018589643761515617,
+    "strong_consistency": 1.0160067081451416
+  },
+  {
+    "step": 1823,
+    "loss": 0.8082141280174255,
+    "drift": 0.054563216865062714,
+    "small_step": 0.01892412081360817,
+    "strong_consistency": 0.7347267866134644
+  },
+  {
+    "step": 1824,
+    "loss": 0.8648170828819275,
+    "drift": 0.051858969032764435,
+    "small_step": 0.020002398639917374,
+    "strong_consistency": 0.7929556965827942
+  },
+  {
+    "step": 1825,
+    "loss": 0.7695597410202026,
+    "drift": 0.05726582556962967,
+    "small_step": 0.03177377209067345,
+    "strong_consistency": 0.6805201172828674
+  },
+  {
+    "step": 1826,
+    "loss": 0.6499217748641968,
+    "drift": 0.06396051496267319,
+    "small_step": 0.021733347326517105,
+    "strong_consistency": 0.5642279386520386
+  },
+  {
+    "step": 1827,
+    "loss": 0.6930363178253174,
+    "drift": 0.07478412985801697,
+    "small_step": 0.015877705067396164,
+    "strong_consistency": 0.6023744940757751
+  },
+  {
+    "step": 1828,
+    "loss": 0.6611849665641785,
+    "drift": 0.08905801177024841,
+    "small_step": 0.027806678786873817,
+    "strong_consistency": 0.544320285320282
+  },
+  {
+    "step": 1829,
+    "loss": 0.478782594203949,
+    "drift": 0.07647129148244858,
+    "small_step": 0.015596497803926468,
+    "strong_consistency": 0.38671478629112244
+  },
+  {
+    "step": 1830,
+    "loss": 0.5644381046295166,
+    "drift": 0.052376843988895416,
+    "small_step": 0.022302968427538872,
+    "strong_consistency": 0.48975831270217896
+  },
+  {
+    "step": 1831,
+    "loss": 0.7894961833953857,
+    "drift": 0.06721038371324539,
+    "small_step": 0.03153802827000618,
+    "strong_consistency": 0.6907477378845215
+  },
+  {
+    "step": 1832,
+    "loss": 0.6862634420394897,
+    "drift": 0.07210162281990051,
+    "small_step": 0.014695508405566216,
+    "strong_consistency": 0.5994663238525391
+  },
+  {
+    "step": 1833,
+    "loss": 0.45540016889572144,
+    "drift": 0.051092058420181274,
+    "small_step": 0.019737916067242622,
+    "strong_consistency": 0.3845702111721039
+  },
+  {
+    "step": 1834,
+    "loss": 1.0809574127197266,
+    "drift": 0.05934693664312363,
+    "small_step": 0.02871028520166874,
+    "strong_consistency": 0.9929002523422241
+  },
+  {
+    "step": 1835,
+    "loss": 0.6033507585525513,
+    "drift": 0.05231492221355438,
+    "small_step": 0.02753879316151142,
+    "strong_consistency": 0.5234970450401306
+  },
+  {
+    "step": 1836,
+    "loss": 1.1059824228286743,
+    "drift": 0.0762387216091156,
+    "small_step": 0.01652779057621956,
+    "strong_consistency": 1.0132158994674683
+  },
+  {
+    "step": 1837,
+    "loss": 0.905705451965332,
+    "drift": 0.08020468056201935,
+    "small_step": 0.03137426823377609,
+    "strong_consistency": 0.7941265106201172
+  },
+  {
+    "step": 1838,
+    "loss": 1.1848336458206177,
+    "drift": 0.04795573279261589,
+    "small_step": 0.025229977443814278,
+    "strong_consistency": 1.1116479635238647
+  },
+  {
+    "step": 1839,
+    "loss": 0.9048341512680054,
+    "drift": 0.051434192806482315,
+    "small_step": 0.015198246575891972,
+    "strong_consistency": 0.8382017016410828
+  },
+  {
+    "step": 1840,
+    "loss": 1.252268671989441,
+    "drift": 0.06036665290594101,
+    "small_step": 0.0295266006141901,
+    "strong_consistency": 1.1623754501342773
+  },
+  {
+    "step": 1841,
+    "loss": 1.3733676671981812,
+    "drift": 0.08883938938379288,
+    "small_step": 0.01431980449706316,
+    "strong_consistency": 1.270208477973938
+  },
+  {
+    "step": 1842,
+    "loss": 0.5872004628181458,
+    "drift": 0.08497019857168198,
+    "small_step": 0.022696051746606827,
+    "strong_consistency": 0.47953420877456665
+  },
+  {
+    "step": 1843,
+    "loss": 0.7830966711044312,
+    "drift": 0.06308481097221375,
+    "small_step": 0.028883162885904312,
+    "strong_consistency": 0.6911287307739258
+  },
+  {
+    "step": 1844,
+    "loss": 0.7921046614646912,
+    "drift": 0.05463315173983574,
+    "small_step": 0.01728540100157261,
+    "strong_consistency": 0.7201861143112183
+  },
+  {
+    "step": 1845,
+    "loss": 1.1414350271224976,
+    "drift": 0.06664865463972092,
+    "small_step": 0.02131972648203373,
+    "strong_consistency": 1.0534666776657104
+  },
+  {
+    "step": 1846,
+    "loss": 1.1926417350769043,
+    "drift": 0.06507006287574768,
+    "small_step": 0.02755299024283886,
+    "strong_consistency": 1.1000187397003174
+  },
+  {
+    "step": 1847,
+    "loss": 1.2717739343643188,
+    "drift": 0.051740698516368866,
+    "small_step": 0.033840812742710114,
+    "strong_consistency": 1.1861923933029175
+  },
+  {
+    "step": 1848,
+    "loss": 0.89863121509552,
+    "drift": 0.06818657368421555,
+    "small_step": 0.04146912693977356,
+    "strong_consistency": 0.7889755368232727
+  },
+  {
+    "step": 1849,
+    "loss": 1.7022061347961426,
+    "drift": 0.08023923635482788,
+    "small_step": 0.020815614610910416,
+    "strong_consistency": 1.6011512279510498
+  },
+  {
+    "step": 1850,
+    "loss": 0.911369264125824,
+    "drift": 0.06661856919527054,
+    "small_step": 0.01998864859342575,
+    "strong_consistency": 0.8247620463371277
+  },
+  {
+    "step": 1851,
+    "loss": 1.4394276142120361,
+    "drift": 0.07110238820314407,
+    "small_step": 0.025199085474014282,
+    "strong_consistency": 1.3431261777877808
+  },
+  {
+    "step": 1852,
+    "loss": 0.9676717519760132,
+    "drift": 0.07758103311061859,
+    "small_step": 0.022858280688524246,
+    "strong_consistency": 0.8672324419021606
+  },
+  {
+    "step": 1853,
+    "loss": 0.9765505194664001,
+    "drift": 0.09361419081687927,
+    "small_step": 0.023356206715106964,
+    "strong_consistency": 0.8595800995826721
+  },
+  {
+    "step": 1854,
+    "loss": 0.455039381980896,
+    "drift": 0.1065501794219017,
+    "small_step": 0.026827562600374222,
+    "strong_consistency": 0.3216616213321686
+  },
+  {
+    "step": 1855,
+    "loss": 1.2416144609451294,
+    "drift": 0.10818307101726532,
+    "small_step": 0.027478091418743134,
+    "strong_consistency": 1.105953335762024
+  },
+  {
+    "step": 1856,
+    "loss": 0.8690053820610046,
+    "drift": 0.12298023700714111,
+    "small_step": 0.027488870546221733,
+    "strong_consistency": 0.7185362577438354
+  },
+  {
+    "step": 1857,
+    "loss": 0.9241502285003662,
+    "drift": 0.12497121095657349,
+    "small_step": 0.02923569455742836,
+    "strong_consistency": 0.769943356513977
+  },
+  {
+    "step": 1858,
+    "loss": 1.5947117805480957,
+    "drift": 0.11347665637731552,
+    "small_step": 0.021960053592920303,
+    "strong_consistency": 1.4592750072479248
+  },
+  {
+    "step": 1859,
+    "loss": 0.8416223526000977,
+    "drift": 0.09381042420864105,
+    "small_step": 0.03500806912779808,
+    "strong_consistency": 0.712803840637207
+  },
+  {
+    "step": 1860,
+    "loss": 1.129813551902771,
+    "drift": 0.13014867901802063,
+    "small_step": 0.021323248744010925,
+    "strong_consistency": 0.9783415794372559
+  },
+  {
+    "step": 1861,
+    "loss": 1.5209892988204956,
+    "drift": 0.0961148664355278,
+    "small_step": 0.03360296040773392,
+    "strong_consistency": 1.3912714719772339
+  },
+  {
+    "step": 1862,
+    "loss": 0.8890516757965088,
+    "drift": 0.14115606248378754,
+    "small_step": 0.02378063090145588,
+    "strong_consistency": 0.7241150140762329
+  },
+  {
+    "step": 1863,
+    "loss": 1.262620449066162,
+    "drift": 0.1602252721786499,
+    "small_step": 0.03825791925191879,
+    "strong_consistency": 1.0641372203826904
+  },
+  {
+    "step": 1864,
+    "loss": 1.1693416833877563,
+    "drift": 0.1559617668390274,
+    "small_step": 0.029109537601470947,
+    "strong_consistency": 0.9842703938484192
+  },
+  {
+    "step": 1865,
+    "loss": 0.7999107241630554,
+    "drift": 0.12227115780115128,
+    "small_step": 0.05348405987024307,
+    "strong_consistency": 0.6241555213928223
+  },
+  {
+    "step": 1866,
+    "loss": 1.9478733539581299,
+    "drift": 0.17293155193328857,
+    "small_step": 0.022262834012508392,
+    "strong_consistency": 1.7526789903640747
+  },
+  {
+    "step": 1867,
+    "loss": 0.5936263799667358,
+    "drift": 0.13843388855457306,
+    "small_step": 0.0381096787750721,
+    "strong_consistency": 0.41708284616470337
+  },
+  {
+    "step": 1868,
+    "loss": 1.1435825824737549,
+    "drift": 0.17642159759998322,
+    "small_step": 0.043599218130111694,
+    "strong_consistency": 0.9235618114471436
+  },
+  {
+    "step": 1869,
+    "loss": 0.9982830286026001,
+    "drift": 0.19098828732967377,
+    "small_step": 0.027662379667162895,
+    "strong_consistency": 0.7796323895454407
+  },
+  {
+    "step": 1870,
+    "loss": 0.8064312934875488,
+    "drift": 0.23578087985515594,
+    "small_step": 0.018274253234267235,
+    "strong_consistency": 0.5523761510848999
+  },
+  {
+    "step": 1871,
+    "loss": 1.555816888809204,
+    "drift": 0.16390791535377502,
+    "small_step": 0.04294844716787338,
+    "strong_consistency": 1.348960518836975
+  },
+  {
+    "step": 1872,
+    "loss": 1.1481951475143433,
+    "drift": 0.18683341145515442,
+    "small_step": 0.04214802011847496,
+    "strong_consistency": 0.9192137122154236
+  },
+  {
+    "step": 1873,
+    "loss": 0.8321839570999146,
+    "drift": 0.19734403491020203,
+    "small_step": 0.04225124046206474,
+    "strong_consistency": 0.5925886631011963
+  },
+  {
+    "step": 1874,
+    "loss": 0.900739848613739,
+    "drift": 0.1644454449415207,
+    "small_step": 0.03194400668144226,
+    "strong_consistency": 0.7043504118919373
+  },
+  {
+    "step": 1875,
+    "loss": 0.8841032981872559,
+    "drift": 0.15433773398399353,
+    "small_step": 0.031225912272930145,
+    "strong_consistency": 0.698539674282074
+  },
+  {
+    "step": 1876,
+    "loss": 1.7426645755767822,
+    "drift": 0.11017564684152603,
+    "small_step": 0.025368861854076385,
+    "strong_consistency": 1.6071200370788574
+  },
+  {
+    "step": 1877,
+    "loss": 1.6001300811767578,
+    "drift": 0.13314354419708252,
+    "small_step": 0.03258517384529114,
+    "strong_consistency": 1.4344013929367065
+  },
+  {
+    "step": 1878,
+    "loss": 1.2700755596160889,
+    "drift": 0.1716284602880478,
+    "small_step": 0.0605604387819767,
+    "strong_consistency": 1.037886619567871
+  },
+  {
+    "step": 1879,
+    "loss": 1.4394569396972656,
+    "drift": 0.1287980079650879,
+    "small_step": 0.0426216758787632,
+    "strong_consistency": 1.26803719997406
+  },
+  {
+    "step": 1880,
+    "loss": 0.6938831210136414,
+    "drift": 0.11799496412277222,
+    "small_step": 0.03233368694782257,
+    "strong_consistency": 0.5435544848442078
+  },
+  {
+    "step": 1881,
+    "loss": 0.7264708876609802,
+    "drift": 0.1149364709854126,
+    "small_step": 0.03452581539750099,
+    "strong_consistency": 0.5770086050033569
+  },
+  {
+    "step": 1882,
+    "loss": 0.8973782658576965,
+    "drift": 0.1758282631635666,
+    "small_step": 0.03313877433538437,
+    "strong_consistency": 0.6884112358093262
+  },
+  {
+    "step": 1883,
+    "loss": 0.9918431043624878,
+    "drift": 0.18929822742938995,
+    "small_step": 0.05137953534722328,
+    "strong_consistency": 0.7511653304100037
+  },
+  {
+    "step": 1884,
+    "loss": 1.4049161672592163,
+    "drift": 0.132760688662529,
+    "small_step": 0.028060488402843475,
+    "strong_consistency": 1.244094967842102
+  },
+  {
+    "step": 1885,
+    "loss": 1.3475337028503418,
+    "drift": 0.188526451587677,
+    "small_step": 0.04118804633617401,
+    "strong_consistency": 1.1178191900253296
+  },
+  {
+    "step": 1886,
+    "loss": 1.635705828666687,
+    "drift": 0.1735425740480423,
+    "small_step": 0.027655210345983505,
+    "strong_consistency": 1.4345080852508545
+  },
+  {
+    "step": 1887,
+    "loss": 0.9397703409194946,
+    "drift": 0.1460525393486023,
+    "small_step": 0.03630533814430237,
+    "strong_consistency": 0.7574124336242676
+  },
+  {
+    "step": 1888,
+    "loss": 0.9825209379196167,
+    "drift": 0.1935921162366867,
+    "small_step": 0.02672172151505947,
+    "strong_consistency": 0.7622070908546448
+  },
+  {
+    "step": 1889,
+    "loss": 1.4306306838989258,
+    "drift": 0.2173430472612381,
+    "small_step": 0.04698346555233002,
+    "strong_consistency": 1.166304111480713
+  },
+  {
+    "step": 1890,
+    "loss": 1.553863763809204,
+    "drift": 0.14568166434764862,
+    "small_step": 0.06100672855973244,
+    "strong_consistency": 1.3471753597259521
+  },
+  {
+    "step": 1891,
+    "loss": 1.4641953706741333,
+    "drift": 0.11720776557922363,
+    "small_step": 0.034033194184303284,
+    "strong_consistency": 1.3129544258117676
+  },
+  {
+    "step": 1892,
+    "loss": 1.3491549491882324,
+    "drift": 0.24147510528564453,
+    "small_step": 0.05963105708360672,
+    "strong_consistency": 1.048048734664917
+  },
+  {
+    "step": 1893,
+    "loss": 0.9139715433120728,
+    "drift": 0.1539289355278015,
+    "small_step": 0.04862281680107117,
+    "strong_consistency": 0.7114197611808777
+  },
+  {
+    "step": 1894,
+    "loss": 1.4823904037475586,
+    "drift": 0.22528426349163055,
+    "small_step": 0.04789690673351288,
+    "strong_consistency": 1.2092092037200928
+  },
+  {
+    "step": 1895,
+    "loss": 1.2865180969238281,
+    "drift": 0.16546861827373505,
+    "small_step": 0.04152483493089676,
+    "strong_consistency": 1.0795246362686157
+  },
+  {
+    "step": 1896,
+    "loss": 2.1376752853393555,
+    "drift": 0.13474717736244202,
+    "small_step": 0.048245321959257126,
+    "strong_consistency": 1.9546828269958496
+  },
+  {
+    "step": 1897,
+    "loss": 1.329382061958313,
+    "drift": 0.15433241426944733,
+    "small_step": 0.053161051124334335,
+    "strong_consistency": 1.1218886375427246
+  },
+  {
+    "step": 1898,
+    "loss": 1.2150559425354004,
+    "drift": 0.1552470475435257,
+    "small_step": 0.04255983605980873,
+    "strong_consistency": 1.0172491073608398
+  },
+  {
+    "step": 1899,
+    "loss": 1.444716453552246,
+    "drift": 0.1837036907672882,
+    "small_step": 0.05693677067756653,
+    "strong_consistency": 1.2040760517120361
+  },
+  {
+    "step": 1900,
+    "loss": 1.4857304096221924,
+    "drift": 0.20066575706005096,
+    "small_step": 0.05268997326493263,
+    "strong_consistency": 1.232374668121338
+  },
+  {
+    "step": 1901,
+    "loss": 1.136665940284729,
+    "drift": 0.22659394145011902,
+    "small_step": 0.038884688168764114,
+    "strong_consistency": 0.8711873292922974
+  },
+  {
+    "step": 1902,
+    "loss": 0.9844578504562378,
+    "drift": 0.312855064868927,
+    "small_step": 0.06760607659816742,
+    "strong_consistency": 0.6039966940879822
+  },
+  {
+    "step": 1903,
+    "loss": 1.1584032773971558,
+    "drift": 0.15362019836902618,
+    "small_step": 0.05018606409430504,
+    "strong_consistency": 0.954596996307373
+  },
+  {
+    "step": 1904,
+    "loss": 1.5071531534194946,
+    "drift": 0.18037067353725433,
+    "small_step": 0.034936897456645966,
+    "strong_consistency": 1.2918455600738525
+  },
+  {
+    "step": 1905,
+    "loss": 1.2003769874572754,
+    "drift": 0.18767058849334717,
+    "small_step": 0.046285055577754974,
+    "strong_consistency": 0.966421365737915
+  },
+  {
+    "step": 1906,
+    "loss": 1.480912685394287,
+    "drift": 0.15369951725006104,
+    "small_step": 0.04037058353424072,
+    "strong_consistency": 1.2868425846099854
+  },
+  {
+    "step": 1907,
+    "loss": 1.8657703399658203,
+    "drift": 0.14837199449539185,
+    "small_step": 0.05759326368570328,
+    "strong_consistency": 1.6598050594329834
+  },
+  {
+    "step": 1908,
+    "loss": 1.2983094453811646,
+    "drift": 0.17694240808486938,
+    "small_step": 0.05925731360912323,
+    "strong_consistency": 1.0621097087860107
+  },
+  {
+    "step": 1909,
+    "loss": 1.5952308177947998,
+    "drift": 0.20293961465358734,
+    "small_step": 0.02883170172572136,
+    "strong_consistency": 1.3634594678878784
+  },
+  {
+    "step": 1910,
+    "loss": 1.322739601135254,
+    "drift": 0.21996861696243286,
+    "small_step": 0.037697967141866684,
+    "strong_consistency": 1.065073013305664
+  },
+  {
+    "step": 1911,
+    "loss": 1.0172630548477173,
+    "drift": 0.15104620158672333,
+    "small_step": 0.05635274201631546,
+    "strong_consistency": 0.8098641037940979
+  },
+  {
+    "step": 1912,
+    "loss": 1.5717047452926636,
+    "drift": 0.15229590237140656,
+    "small_step": 0.07380331307649612,
+    "strong_consistency": 1.345605492591858
+  },
+  {
+    "step": 1913,
+    "loss": 2.027848243713379,
+    "drift": 0.1700238436460495,
+    "small_step": 0.0500502809882164,
+    "strong_consistency": 1.8077740669250488
+  },
+  {
+    "step": 1914,
+    "loss": 1.406799077987671,
+    "drift": 0.19107173383235931,
+    "small_step": 0.05935896560549736,
+    "strong_consistency": 1.156368374824524
+  },
+  {
+    "step": 1915,
+    "loss": 1.1931239366531372,
+    "drift": 0.21084967255592346,
+    "small_step": 0.07837128639221191,
+    "strong_consistency": 0.9039029479026794
+  },
+  {
+    "step": 1916,
+    "loss": 1.688730001449585,
+    "drift": 0.17967745661735535,
+    "small_step": 0.04535162076354027,
+    "strong_consistency": 1.4637008905410767
+  },
+  {
+    "step": 1917,
+    "loss": 1.0256539583206177,
+    "drift": 0.2349390834569931,
+    "small_step": 0.04516196623444557,
+    "strong_consistency": 0.7455528974533081
+  },
+  {
+    "step": 1918,
+    "loss": 2.6473770141601562,
+    "drift": 0.17538878321647644,
+    "small_step": 0.0551234595477581,
+    "strong_consistency": 2.4168648719787598
+  },
+  {
+    "step": 1919,
+    "loss": 1.2309629917144775,
+    "drift": 0.19814753532409668,
+    "small_step": 0.056011367589235306,
+    "strong_consistency": 0.9768040180206299
+  },
+  {
+    "step": 1920,
+    "loss": 1.0250993967056274,
+    "drift": 0.2110513299703598,
+    "small_step": 0.03807668760418892,
+    "strong_consistency": 0.7759713530540466
+  },
+  {
+    "step": 1921,
+    "loss": 1.5722748041152954,
+    "drift": 0.2605009078979492,
+    "small_step": 0.03926696255803108,
+    "strong_consistency": 1.2725069522857666
+  },
+  {
+    "step": 1922,
+    "loss": 1.5727081298828125,
+    "drift": 0.17524655163288116,
+    "small_step": 0.03320072218775749,
+    "strong_consistency": 1.3642609119415283
+  },
+  {
+    "step": 1923,
+    "loss": 1.6847659349441528,
+    "drift": 0.25236618518829346,
+    "small_step": 0.09774530678987503,
+    "strong_consistency": 1.334654450416565
+  },
+  {
+    "step": 1924,
+    "loss": 1.4927043914794922,
+    "drift": 0.22353582084178925,
+    "small_step": 0.05095844715833664,
+    "strong_consistency": 1.2182101011276245
+  },
+  {
+    "step": 1925,
+    "loss": 2.2299206256866455,
+    "drift": 0.21220237016677856,
+    "small_step": 0.06263242661952972,
+    "strong_consistency": 1.9550858736038208
+  },
+  {
+    "step": 1926,
+    "loss": 1.1355323791503906,
+    "drift": 0.2111596167087555,
+    "small_step": 0.04695546627044678,
+    "strong_consistency": 0.8774173259735107
+  },
+  {
+    "step": 1927,
+    "loss": 1.470076560974121,
+    "drift": 0.21253937482833862,
+    "small_step": 0.05540575087070465,
+    "strong_consistency": 1.2021315097808838
+  },
+  {
+    "step": 1928,
+    "loss": 1.2016310691833496,
+    "drift": 0.24263790249824524,
+    "small_step": 0.07975056767463684,
+    "strong_consistency": 0.8792425394058228
+  },
+  {
+    "step": 1929,
+    "loss": 2.2360281944274902,
+    "drift": 0.2457261085510254,
+    "small_step": 0.049305904656648636,
+    "strong_consistency": 1.9409961700439453
+  },
+  {
+    "step": 1930,
+    "loss": 1.3539677858352661,
+    "drift": 0.31928563117980957,
+    "small_step": 0.06257881969213486,
+    "strong_consistency": 0.9721033573150635
+  },
+  {
+    "step": 1931,
+    "loss": 1.4546830654144287,
+    "drift": 0.275883287191391,
+    "small_step": 0.04107970371842384,
+    "strong_consistency": 1.1377201080322266
+  },
+  {
+    "step": 1932,
+    "loss": 2.4212074279785156,
+    "drift": 0.22959162294864655,
+    "small_step": 0.05838887020945549,
+    "strong_consistency": 2.1332268714904785
+  },
+  {
+    "step": 1933,
+    "loss": 1.580924153327942,
+    "drift": 0.403764545917511,
+    "small_step": 0.05950267240405083,
+    "strong_consistency": 1.117656946182251
+  },
+  {
+    "step": 1934,
+    "loss": 1.9428386688232422,
+    "drift": 0.4016556143760681,
+    "small_step": 0.08202940225601196,
+    "strong_consistency": 1.459153652191162
+  },
+  {
+    "step": 1935,
+    "loss": 0.9810577630996704,
+    "drift": 0.26486924290657043,
+    "small_step": 0.032806094735860825,
+    "strong_consistency": 0.6833824515342712
+  },
+  {
+    "step": 1936,
+    "loss": 1.55440092086792,
+    "drift": 0.2567836046218872,
+    "small_step": 0.05930749326944351,
+    "strong_consistency": 1.2383098602294922
+  },
+  {
+    "step": 1937,
+    "loss": 1.735534429550171,
+    "drift": 0.2395218312740326,
+    "small_step": 0.06758542358875275,
+    "strong_consistency": 1.4284271001815796
+  },
+  {
+    "step": 1938,
+    "loss": 1.8447864055633545,
+    "drift": 0.22794760763645172,
+    "small_step": 0.07478433102369308,
+    "strong_consistency": 1.5420544147491455
+  },
+  {
+    "step": 1939,
+    "loss": 1.735784649848938,
+    "drift": 0.25920844078063965,
+    "small_step": 0.04693439230322838,
+    "strong_consistency": 1.429641842842102
+  },
+  {
+    "step": 1940,
+    "loss": 2.2929961681365967,
+    "drift": 0.23292599618434906,
+    "small_step": 0.08536014705896378,
+    "strong_consistency": 1.9747099876403809
+  },
+  {
+    "step": 1941,
+    "loss": 1.9898426532745361,
+    "drift": 0.33744296431541443,
+    "small_step": 0.0801614373922348,
+    "strong_consistency": 1.5722383260726929
+  },
+  {
+    "step": 1942,
+    "loss": 1.5173461437225342,
+    "drift": 0.2642371654510498,
+    "small_step": 0.05550331622362137,
+    "strong_consistency": 1.1976056098937988
+  },
+  {
+    "step": 1943,
+    "loss": 1.6919323205947876,
+    "drift": 0.23998960852622986,
+    "small_step": 0.06530863791704178,
+    "strong_consistency": 1.386634111404419
+  },
+  {
+    "step": 1944,
+    "loss": 1.6066169738769531,
+    "drift": 0.37279224395751953,
+    "small_step": 0.06035112962126732,
+    "strong_consistency": 1.173473596572876
+  },
+  {
+    "step": 1945,
+    "loss": 1.7998943328857422,
+    "drift": 0.2542025148868561,
+    "small_step": 0.04033355414867401,
+    "strong_consistency": 1.5053582191467285
+  },
+  {
+    "step": 1946,
+    "loss": 1.7484619617462158,
+    "drift": 0.23132666945457458,
+    "small_step": 0.07674109935760498,
+    "strong_consistency": 1.4403941631317139
+  },
+  {
+    "step": 1947,
+    "loss": 1.3068032264709473,
+    "drift": 0.3047707676887512,
+    "small_step": 0.10395985841751099,
+    "strong_consistency": 0.8980726599693298
+  },
+  {
+    "step": 1948,
+    "loss": 2.0584757328033447,
+    "drift": 0.3104037642478943,
+    "small_step": 0.05355147644877434,
+    "strong_consistency": 1.6945205926895142
+  },
+  {
+    "step": 1949,
+    "loss": 1.9014999866485596,
+    "drift": 0.26834237575531006,
+    "small_step": 0.06685923039913177,
+    "strong_consistency": 1.5662983655929565
+  },
+  {
+    "step": 1950,
+    "loss": 1.4894919395446777,
+    "drift": 0.26461437344551086,
+    "small_step": 0.07573927193880081,
+    "strong_consistency": 1.149138331413269
+  },
+  {
+    "step": 1951,
+    "loss": 1.6938700675964355,
+    "drift": 0.37235063314437866,
+    "small_step": 0.045560963451862335,
+    "strong_consistency": 1.2759584188461304
+  },
+  {
+    "step": 1952,
+    "loss": 2.1232213973999023,
+    "drift": 0.35287415981292725,
+    "small_step": 0.07580675929784775,
+    "strong_consistency": 1.6945405006408691
+  },
+  {
+    "step": 1953,
+    "loss": 1.7867119312286377,
+    "drift": 0.2530510723590851,
+    "small_step": 0.07500015199184418,
+    "strong_consistency": 1.4586607217788696
+  },
+  {
+    "step": 1954,
+    "loss": 1.739893913269043,
+    "drift": 0.36921435594558716,
+    "small_step": 0.09834706038236618,
+    "strong_consistency": 1.2723324298858643
+  },
+  {
+    "step": 1955,
+    "loss": 2.3882532119750977,
+    "drift": 0.3474915027618408,
+    "small_step": 0.06138171628117561,
+    "strong_consistency": 1.9793798923492432
+  },
+  {
+    "step": 1956,
+    "loss": 1.9199409484863281,
+    "drift": 0.28428637981414795,
+    "small_step": 0.06990692019462585,
+    "strong_consistency": 1.565747618675232
+  },
+  {
+    "step": 1957,
+    "loss": 1.267029881477356,
+    "drift": 0.2787478268146515,
+    "small_step": 0.07728862762451172,
+    "strong_consistency": 0.9109934568405151
+  },
+  {
+    "step": 1958,
+    "loss": 1.3200657367706299,
+    "drift": 0.3212028741836548,
+    "small_step": 0.09555386751890182,
+    "strong_consistency": 0.9033089876174927
+  },
+  {
+    "step": 1959,
+    "loss": 2.002033233642578,
+    "drift": 0.2775959074497223,
+    "small_step": 0.07641183584928513,
+    "strong_consistency": 1.648025393486023
+  },
+  {
+    "step": 1960,
+    "loss": 1.9571356773376465,
+    "drift": 0.24022158980369568,
+    "small_step": 0.05904307961463928,
+    "strong_consistency": 1.6578710079193115
+  },
+  {
+    "step": 1961,
+    "loss": 1.811924695968628,
+    "drift": 0.28310707211494446,
+    "small_step": 0.11432817578315735,
+    "strong_consistency": 1.414489507675171
+  },
+  {
+    "step": 1962,
+    "loss": 2.1917247772216797,
+    "drift": 0.43256908655166626,
+    "small_step": 0.0753101259469986,
+    "strong_consistency": 1.6838455200195312
+  },
+  {
+    "step": 1963,
+    "loss": 1.5623445510864258,
+    "drift": 0.4398714303970337,
+    "small_step": 0.08982064574956894,
+    "strong_consistency": 1.032652497291565
+  },
+  {
+    "step": 1964,
+    "loss": 2.4681692123413086,
+    "drift": 0.2827274799346924,
+    "small_step": 0.06998249143362045,
+    "strong_consistency": 2.1154592037200928
+  },
+  {
+    "step": 1965,
+    "loss": 1.6503304243087769,
+    "drift": 0.356067955493927,
+    "small_step": 0.05893513932824135,
+    "strong_consistency": 1.2353273630142212
+  },
+  {
+    "step": 1966,
+    "loss": 1.7023096084594727,
+    "drift": 0.22640211880207062,
+    "small_step": 0.11224310100078583,
+    "strong_consistency": 1.3636643886566162
+  },
+  {
+    "step": 1967,
+    "loss": 1.6024821996688843,
+    "drift": 0.304323673248291,
+    "small_step": 0.11557146906852722,
+    "strong_consistency": 1.1825870275497437
+  },
+  {
+    "step": 1968,
+    "loss": 1.8239909410476685,
+    "drift": 0.20584744215011597,
+    "small_step": 0.07269761711359024,
+    "strong_consistency": 1.5454459190368652
+  },
+  {
+    "step": 1969,
+    "loss": 2.815495014190674,
+    "drift": 0.3808533847332001,
+    "small_step": 0.08154993504285812,
+    "strong_consistency": 2.3530917167663574
+  },
+  {
+    "step": 1970,
+    "loss": 1.4355589151382446,
+    "drift": 0.30420225858688354,
+    "small_step": 0.09432800114154816,
+    "strong_consistency": 1.0370286703109741
+  },
+  {
+    "step": 1971,
+    "loss": 1.3487826585769653,
+    "drift": 0.2994409203529358,
+    "small_step": 0.07331884652376175,
+    "strong_consistency": 0.9760228991508484
+  },
+  {
+    "step": 1972,
+    "loss": 1.5795423984527588,
+    "drift": 0.3495996594429016,
+    "small_step": 0.07002748548984528,
+    "strong_consistency": 1.1599153280258179
+  },
+  {
+    "step": 1973,
+    "loss": 2.330669641494751,
+    "drift": 0.22236205637454987,
+    "small_step": 0.08023612946271896,
+    "strong_consistency": 2.028071403503418
+  },
+  {
+    "step": 1974,
+    "loss": 2.664132595062256,
+    "drift": 0.3377147912979126,
+    "small_step": 0.09491634368896484,
+    "strong_consistency": 2.231501579284668
+  },
+  {
+    "step": 1975,
+    "loss": 1.7854158878326416,
+    "drift": 0.35499680042266846,
+    "small_step": 0.12484563142061234,
+    "strong_consistency": 1.3055734634399414
+  },
+  {
+    "step": 1976,
+    "loss": 1.898261308670044,
+    "drift": 0.2731846272945404,
+    "small_step": 0.0732821524143219,
+    "strong_consistency": 1.5517945289611816
+  },
+  {
+    "step": 1977,
+    "loss": 2.5695784091949463,
+    "drift": 0.27783456444740295,
+    "small_step": 0.09935002774000168,
+    "strong_consistency": 2.1923937797546387
+  },
+  {
+    "step": 1978,
+    "loss": 1.9954696893692017,
+    "drift": 0.20227977633476257,
+    "small_step": 0.10331466794013977,
+    "strong_consistency": 1.6898752450942993
+  },
+  {
+    "step": 1979,
+    "loss": 1.975529432296753,
+    "drift": 0.21597892045974731,
+    "small_step": 0.0803050845861435,
+    "strong_consistency": 1.6792454719543457
+  },
+  {
+    "step": 1980,
+    "loss": 1.6851847171783447,
+    "drift": 0.4115361273288727,
+    "small_step": 0.10436848551034927,
+    "strong_consistency": 1.1692800521850586
+  },
+  {
+    "step": 1981,
+    "loss": 1.950404405593872,
+    "drift": 0.33436962962150574,
+    "small_step": 0.0741167813539505,
+    "strong_consistency": 1.5419179201126099
+  },
+  {
+    "step": 1982,
+    "loss": 1.6874079704284668,
+    "drift": 0.23420724272727966,
+    "small_step": 0.08765775710344315,
+    "strong_consistency": 1.365543007850647
+  },
+  {
+    "step": 1983,
+    "loss": 1.9344182014465332,
+    "drift": 0.38088080286979675,
+    "small_step": 0.1341974139213562,
+    "strong_consistency": 1.4193400144577026
+  },
+  {
+    "step": 1984,
+    "loss": 2.57055401802063,
+    "drift": 0.32552629709243774,
+    "small_step": 0.10369943827390671,
+    "strong_consistency": 2.1413283348083496
+  },
+  {
+    "step": 1985,
+    "loss": 2.0792276859283447,
+    "drift": 0.24316450953483582,
+    "small_step": 0.09422408044338226,
+    "strong_consistency": 1.741839051246643
+  },
+  {
+    "step": 1986,
+    "loss": 2.5147202014923096,
+    "drift": 0.28628024458885193,
+    "small_step": 0.14126451313495636,
+    "strong_consistency": 2.0871753692626953
+  },
+  {
+    "step": 1987,
+    "loss": 2.673405647277832,
+    "drift": 0.34192538261413574,
+    "small_step": 0.2060474157333374,
+    "strong_consistency": 2.1254329681396484
+  },
+  {
+    "step": 1988,
+    "loss": 1.978599190711975,
+    "drift": 0.2641679644584656,
+    "small_step": 0.0659150555729866,
+    "strong_consistency": 1.6485161781311035
+  },
+  {
+    "step": 1989,
+    "loss": 2.7681198120117188,
+    "drift": 0.42801418900489807,
+    "small_step": 0.06573349237442017,
+    "strong_consistency": 2.274372100830078
+  },
+  {
+    "step": 1990,
+    "loss": 2.489034652709961,
+    "drift": 0.36339691281318665,
+    "small_step": 0.13429602980613708,
+    "strong_consistency": 1.9913415908813477
+  },
+  {
+    "step": 1991,
+    "loss": 2.5898544788360596,
+    "drift": 0.4768944978713989,
+    "small_step": 0.16421301662921906,
+    "strong_consistency": 1.948746919631958
+  },
+  {
+    "step": 1992,
+    "loss": 1.6298401355743408,
+    "drift": 0.30353665351867676,
+    "small_step": 0.15218967199325562,
+    "strong_consistency": 1.1741138696670532
+  },
+  {
+    "step": 1993,
+    "loss": 2.687974691390991,
+    "drift": 0.3675061762332916,
+    "small_step": 0.1641310453414917,
+    "strong_consistency": 2.1563374996185303
+  },
+  {
+    "step": 1994,
+    "loss": 2.528730869293213,
+    "drift": 0.2887040674686432,
+    "small_step": 0.08503850549459457,
+    "strong_consistency": 2.1549882888793945
+  },
+  {
+    "step": 1995,
+    "loss": 3.1027286052703857,
+    "drift": 0.3648569583892822,
+    "small_step": 0.09433694183826447,
+    "strong_consistency": 2.6435346603393555
+  },
+  {
+    "step": 1996,
+    "loss": 2.777831792831421,
+    "drift": 0.30192652344703674,
+    "small_step": 0.07316218316555023,
+    "strong_consistency": 2.402743101119995
+  },
+  {
+    "step": 1997,
+    "loss": 2.0638389587402344,
+    "drift": 0.2391005903482437,
+    "small_step": 0.11217145621776581,
+    "strong_consistency": 1.71256685256958
+  },
+  {
+    "step": 1998,
+    "loss": 2.8184494972229004,
+    "drift": 0.3287304937839508,
+    "small_step": 0.1066361516714096,
+    "strong_consistency": 2.383082866668701
+  },
+  {
+    "step": 1999,
+    "loss": 2.31286358833313,
+    "drift": 0.39464619755744934,
+    "small_step": 0.10170809924602509,
+    "strong_consistency": 1.8165092468261719
+  }
+]
diff --git a/lecture_6/verified_examples/ssfm-paper/report.json b/lecture_6/verified_examples/ssfm-paper/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..a5a4e10394ad9fa485db12fae3d925e2c46611a4
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm-paper/report.json
@@ -0,0 +1,21 @@
+{
+  "method": "ssfm",
+  "data_kind": "ornstein-uhlenbeck",
+  "train_loss_first_20_mean": 0.5530126631259918,
+  "train_loss_last_20_mean": 2.3421594560146333,
+  "training_steps": 2000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "same_noise_reference_rmse": 3.8469111919403076,
+  "direct_vs_split_rmse": 18.642148971557617,
+  "one_step_reference_rmse": 22.396263122558594,
+  "reference_em_steps": 512,
+  "sample_variance": 18.699464797973633,
+  "exact_terminal_variance": 0.34717813884364257,
+  "reference_note": "Same Brownian increments; EM reference retains finite discretization error.",
+  "finite_samples": true,
+  "elapsed_seconds": 7.400261947994295
+}
diff --git a/lecture_6/verified_examples/ssfm-paper/samples.txt b/lecture_6/verified_examples/ssfm-paper/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..0c1d6c4ef81bb2c8f52e34ae113ae7b6b2878f20
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm-paper/samples.txt
@@ -0,0 +1,128 @@
+-3.5691342
+-5.9687004
+-3.5188773
+-1.6636375
+-0.8495917
+6.8974981
+-6.5843010
+-9.0627308
+-6.1373162
+-0.5029596
+-7.5134859
+2.4435005
+8.4222679
+-7.4357796
+-1.7080266
+1.0910541
+4.9457464
+-3.9336338
+-0.3050116
+-1.6511431
+-1.6094986
+-13.6934805
+2.6725416
+-4.4752584
+-7.3156514
+0.4620856
+-5.7242155
+3.5768998
+6.6434946
+6.6958652
+1.5201621
+-2.7602384
+1.0570451
+-5.3666997
+-3.9421818
+4.7623610
+-1.3230989
+0.3079050
+2.9030225
+0.8164359
+7.0878334
+3.3798482
+4.4464822
+-4.3626418
+-3.8449430
+4.5926881
+3.6786938
+0.2190764
+1.0103033
+0.2597452
+-6.0936551
+3.2058690
+8.3432465
+1.3966073
+1.7240884
+4.9068737
+6.6097474
+0.9456300
+2.7047315
+2.1397560
+1.6989002
+-0.0785159
+5.3855000
+0.0351314
+0.8610108
+-11.1821260
+-7.4386735
+-6.4555349
+-0.7705975
+-0.6766230
+-3.0550759
+2.1355302
+-1.5467653
+2.8047698
+-2.4397030
+-2.3383298
+-4.2847657
+0.5450832
+-2.7990775
+-0.9670787
+-5.0600066
+-2.0923758
+2.2041979
+0.7333170
+-2.2927015
+-7.6276627
+-9.8050280
+0.7608429
+0.5228726
+-0.7862515
+3.2740335
+3.8310721
+0.1743484
+-0.4644027
+3.6068273
+-0.8471674
+-0.7770578
+-7.0982895
+-0.6023003
+-3.4847162
+2.3497050
+-0.6450384
+2.2794242
+-5.0042586
+-1.7957661
+-0.3680181
+-4.2647152
+-1.4720910
+5.8185849
+0.4778431
+0.8927012
+-9.2361374
+1.4536750
+-3.5217357
+-12.6538887
+2.2430096
+-3.5989087
+-6.2222414
+2.1938336
+-2.9716759
+-6.6540642
+-0.1234567
+-2.3553166
+1.4887705
+-4.0598111
+-1.0370115
+-0.0166723
+0.7232878
diff --git a/lecture_6/verified_examples/ssfm/config.json b/lecture_6/verified_examples/ssfm/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..13fca913c27ef08e1fbc05536ab2042fcc13a809
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm/config.json
@@ -0,0 +1,21 @@
+{
+  "method": "ssfm",
+  "mode": "train-sample",
+  "train_steps": 1000,
+  "teacher_steps": 1000,
+  "finetune_steps": 0,
+  "sample_steps": 8,
+  "posterior_steps": 4,
+  "particles": 32,
+  "reward_strength": 1.0,
+  "ssfm_target": "official-code",
+  "batch_size": 64,
+  "samples": 128,
+  "width": 64,
+  "lr": 0.001,
+  "seed": 6270,
+  "threads": 1,
+  "device": "cpu",
+  "data": null,
+  "out": "outputs/verified-torch291/ssfm"
+}
diff --git a/lecture_6/verified_examples/ssfm/losses.json b/lecture_6/verified_examples/ssfm/losses.json
new file mode 100644
index 0000000000000000000000000000000000000000..b11d60384857182dfb8046ff9f296fd823fea5bc
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm/losses.json
@@ -0,0 +1,7002 @@
+[
+  {
+    "step": 0,
+    "loss": 0.5536361336708069,
+    "drift": 0.5483575463294983,
+    "small_step": 0.005278528667986393,
+    "strong_consistency": 8.609625183453318e-06
+  },
+  {
+    "step": 1,
+    "loss": 0.6843439340591431,
+    "drift": 0.6753528118133545,
+    "small_step": 0.008990183472633362,
+    "strong_consistency": 0.00012117341975681484
+  },
+  {
+    "step": 2,
+    "loss": 0.48352107405662537,
+    "drift": 0.47938019037246704,
+    "small_step": 0.004136933945119381,
+    "strong_consistency": 0.0003299268428236246
+  },
+  {
+    "step": 3,
+    "loss": 0.43532273173332214,
+    "drift": 0.430375337600708,
+    "small_step": 0.004934378899633884,
+    "strong_consistency": 0.0008143067243508995
+  },
+  {
+    "step": 4,
+    "loss": 0.481062650680542,
+    "drift": 0.4749395251274109,
+    "small_step": 0.006103992462158203,
+    "strong_consistency": 0.0009562596678733826
+  },
+  {
+    "step": 5,
+    "loss": 0.5196607112884521,
+    "drift": 0.5142366290092468,
+    "small_step": 0.005378001369535923,
+    "strong_consistency": 0.0019196092616766691
+  },
+  {
+    "step": 6,
+    "loss": 0.4520871043205261,
+    "drift": 0.4465739130973816,
+    "small_step": 0.0054500713013112545,
+    "strong_consistency": 0.002254756400361657
+  },
+  {
+    "step": 7,
+    "loss": 0.3831411302089691,
+    "drift": 0.3788634240627289,
+    "small_step": 0.0041978321969509125,
+    "strong_consistency": 0.0024955463595688343
+  },
+  {
+    "step": 8,
+    "loss": 0.31924983859062195,
+    "drift": 0.3156786262989044,
+    "small_step": 0.003466075286269188,
+    "strong_consistency": 0.0029203013982623816
+  },
+  {
+    "step": 9,
+    "loss": 0.4863288700580597,
+    "drift": 0.48031115531921387,
+    "small_step": 0.0057700262404978275,
+    "strong_consistency": 0.006192137021571398
+  },
+  {
+    "step": 10,
+    "loss": 0.5361961126327515,
+    "drift": 0.5295732021331787,
+    "small_step": 0.006189956329762936,
+    "strong_consistency": 0.009839806705713272
+  },
+  {
+    "step": 11,
+    "loss": 0.40303608775138855,
+    "drift": 0.3975842595100403,
+    "small_step": 0.005076509900391102,
+    "strong_consistency": 0.007819540798664093
+  },
+  {
+    "step": 12,
+    "loss": 0.27587008476257324,
+    "drift": 0.27237072587013245,
+    "small_step": 0.003173469565808773,
+    "strong_consistency": 0.006266803480684757
+  },
+  {
+    "step": 13,
+    "loss": 0.38206902146339417,
+    "drift": 0.3781006932258606,
+    "small_step": 0.0033863482531160116,
+    "strong_consistency": 0.01039243396371603
+  },
+  {
+    "step": 14,
+    "loss": 0.4372572600841522,
+    "drift": 0.43084055185317993,
+    "small_step": 0.005734854377806187,
+    "strong_consistency": 0.011363916099071503
+  },
+  {
+    "step": 15,
+    "loss": 0.3481995463371277,
+    "drift": 0.3441047668457031,
+    "small_step": 0.0033166459761559963,
+    "strong_consistency": 0.012158423662185669
+  },
+  {
+    "step": 16,
+    "loss": 0.29031381011009216,
+    "drift": 0.28624916076660156,
+    "small_step": 0.003183915978297591,
+    "strong_consistency": 0.012952294200658798
+  },
+  {
+    "step": 17,
+    "loss": 0.2911073565483093,
+    "drift": 0.2871726453304291,
+    "small_step": 0.0027209194377064705,
+    "strong_consistency": 0.016858240589499474
+  },
+  {
+    "step": 18,
+    "loss": 0.2707861661911011,
+    "drift": 0.26627039909362793,
+    "small_step": 0.002947335597127676,
+    "strong_consistency": 0.02063739113509655
+  },
+  {
+    "step": 19,
+    "loss": 0.1571246236562729,
+    "drift": 0.15454916656017303,
+    "small_step": 0.0015944933984428644,
+    "strong_consistency": 0.012261996977031231
+  },
+  {
+    "step": 20,
+    "loss": 0.26335588097572327,
+    "drift": 0.2584369480609894,
+    "small_step": 0.00285705435089767,
+    "strong_consistency": 0.0245459396392107
+  },
+  {
+    "step": 21,
+    "loss": 0.2307671308517456,
+    "drift": 0.22569388151168823,
+    "small_step": 0.002271842211484909,
+    "strong_consistency": 0.03183409571647644
+  },
+  {
+    "step": 22,
+    "loss": 0.22230412065982819,
+    "drift": 0.21753419935703278,
+    "small_step": 0.002522168681025505,
+    "strong_consistency": 0.02443208545446396
+  },
+  {
+    "step": 23,
+    "loss": 0.2545486390590668,
+    "drift": 0.24862155318260193,
+    "small_step": 0.002052444964647293,
+    "strong_consistency": 0.04036087542772293
+  },
+  {
+    "step": 24,
+    "loss": 0.14769910275936127,
+    "drift": 0.1438896358013153,
+    "small_step": 0.0012395174708217382,
+    "strong_consistency": 0.025699464604258537
+  },
+  {
+    "step": 25,
+    "loss": 0.23229563236236572,
+    "drift": 0.22419704496860504,
+    "small_step": 0.002496046479791403,
+    "strong_consistency": 0.053870536386966705
+  },
+  {
+    "step": 26,
+    "loss": 0.18616528809070587,
+    "drift": 0.18010765314102173,
+    "small_step": 0.0019389643566682935,
+    "strong_consistency": 0.03813581168651581
+  },
+  {
+    "step": 27,
+    "loss": 0.13589638471603394,
+    "drift": 0.13011188805103302,
+    "small_step": 0.0011134885717183352,
+    "strong_consistency": 0.041705355048179626
+  },
+  {
+    "step": 28,
+    "loss": 0.1334824562072754,
+    "drift": 0.12751328945159912,
+    "small_step": 0.0013569925213232636,
+    "strong_consistency": 0.039760150015354156
+  },
+  {
+    "step": 29,
+    "loss": 0.0953955203294754,
+    "drift": 0.08839976787567139,
+    "small_step": 0.000999528099782765,
+    "strong_consistency": 0.049968551844358444
+  },
+  {
+    "step": 30,
+    "loss": 0.09769655764102936,
+    "drift": 0.08733054250478745,
+    "small_step": 0.0008790768915787339,
+    "strong_consistency": 0.07650754600763321
+  },
+  {
+    "step": 31,
+    "loss": 0.13174359500408173,
+    "drift": 0.11875948309898376,
+    "small_step": 0.0010910715209320188,
+    "strong_consistency": 0.09291437268257141
+  },
+  {
+    "step": 32,
+    "loss": 0.05634543299674988,
+    "drift": 0.04891127720475197,
+    "small_step": 0.0004913000157102942,
+    "strong_consistency": 0.05259740352630615
+  },
+  {
+    "step": 33,
+    "loss": 0.04051801562309265,
+    "drift": 0.03392680734395981,
+    "small_step": 0.0003719349333550781,
+    "strong_consistency": 0.045729923993349075
+  },
+  {
+    "step": 34,
+    "loss": 0.0395968072116375,
+    "drift": 0.031115174293518066,
+    "small_step": 0.00023761704505886883,
+    "strong_consistency": 0.05888581648468971
+  },
+  {
+    "step": 35,
+    "loss": 0.03771718591451645,
+    "drift": 0.027337681502103806,
+    "small_step": 0.0002754156303126365,
+    "strong_consistency": 0.07016729563474655
+  },
+  {
+    "step": 36,
+    "loss": 0.04492570459842682,
+    "drift": 0.02892172336578369,
+    "small_step": 0.0002361912775086239,
+    "strong_consistency": 0.10653913766145706
+  },
+  {
+    "step": 37,
+    "loss": 0.027557186782360077,
+    "drift": 0.014950458891689777,
+    "small_step": 0.00017766281962394714,
+    "strong_consistency": 0.08177017420530319
+  },
+  {
+    "step": 38,
+    "loss": 0.02645568549633026,
+    "drift": 0.01349647156894207,
+    "small_step": 0.0001480009959777817,
+    "strong_consistency": 0.08212315291166306
+  },
+  {
+    "step": 39,
+    "loss": 0.02632305584847927,
+    "drift": 0.012162977829575539,
+    "small_step": 0.00015048087516333908,
+    "strong_consistency": 0.08755998313426971
+  },
+  {
+    "step": 40,
+    "loss": 0.029462791979312897,
+    "drift": 0.00929443072527647,
+    "small_step": 8.752905705478042e-05,
+    "strong_consistency": 0.12244409322738647
+  },
+  {
+    "step": 41,
+    "loss": 0.02363092079758644,
+    "drift": 0.0064055174589157104,
+    "small_step": 9.817540558287874e-05,
+    "strong_consistency": 0.10194779187440872
+  },
+  {
+    "step": 42,
+    "loss": 0.032483626157045364,
+    "drift": 0.004460434429347515,
+    "small_step": 3.399905108381063e-05,
+    "strong_consistency": 0.16272786259651184
+  },
+  {
+    "step": 43,
+    "loss": 0.057974182069301605,
+    "drift": 0.01109548844397068,
+    "small_step": 9.114763088291511e-05,
+    "strong_consistency": 0.2658383250236511
+  },
+  {
+    "step": 44,
+    "loss": 0.025478003546595573,
+    "drift": 0.0020485329441726208,
+    "small_step": 1.8620745322550647e-05,
+    "strong_consistency": 0.13006027042865753
+  },
+  {
+    "step": 45,
+    "loss": 0.04617138206958771,
+    "drift": 0.007767063565552235,
+    "small_step": 0.00010576526983641088,
+    "strong_consistency": 0.20814429223537445
+  },
+  {
+    "step": 46,
+    "loss": 0.0443156361579895,
+    "drift": 0.00795838050544262,
+    "small_step": 6.417002441594377e-05,
+    "strong_consistency": 0.19304832816123962
+  },
+  {
+    "step": 47,
+    "loss": 0.04485410451889038,
+    "drift": 0.004209299571812153,
+    "small_step": 6.0383579693734646e-05,
+    "strong_consistency": 0.21137720346450806
+  },
+  {
+    "step": 48,
+    "loss": 0.04288741201162338,
+    "drift": 0.00793625321239233,
+    "small_step": 6.980268517509103e-05,
+    "strong_consistency": 0.17796611785888672
+  },
+  {
+    "step": 49,
+    "loss": 0.048415232449769974,
+    "drift": 0.007789847441017628,
+    "small_step": 8.019448432605714e-05,
+    "strong_consistency": 0.20272596180438995
+  },
+  {
+    "step": 50,
+    "loss": 0.046990130096673965,
+    "drift": 0.00568103464320302,
+    "small_step": 4.524209361989051e-05,
+    "strong_consistency": 0.20227378606796265
+  },
+  {
+    "step": 51,
+    "loss": 0.03845629841089249,
+    "drift": 0.003695711027830839,
+    "small_step": 4.2494695662753657e-05,
+    "strong_consistency": 0.16691389679908752
+  },
+  {
+    "step": 52,
+    "loss": 0.0471678301692009,
+    "drift": 0.005394690204411745,
+    "small_step": 4.706921026809141e-05,
+    "strong_consistency": 0.19682109355926514
+  },
+  {
+    "step": 53,
+    "loss": 0.032332636415958405,
+    "drift": 0.0045607686042785645,
+    "small_step": 5.2235125622246414e-05,
+    "strong_consistency": 0.12833163142204285
+  },
+  {
+    "step": 54,
+    "loss": 0.04100002720952034,
+    "drift": 0.0031034955754876137,
+    "small_step": 3.917170033673756e-05,
+    "strong_consistency": 0.1720789074897766
+  },
+  {
+    "step": 55,
+    "loss": 0.02744453027844429,
+    "drift": 0.00218181568197906,
+    "small_step": 2.1297726561897434e-05,
+    "strong_consistency": 0.11268489807844162
+  },
+  {
+    "step": 56,
+    "loss": 0.031791236251592636,
+    "drift": 0.0022735963575541973,
+    "small_step": 2.5107234250754118e-05,
+    "strong_consistency": 0.12935321033000946
+  },
+  {
+    "step": 57,
+    "loss": 0.03336628898978233,
+    "drift": 0.0031326524913311005,
+    "small_step": 3.364026269991882e-05,
+    "strong_consistency": 0.13017240166664124
+  },
+  {
+    "step": 58,
+    "loss": 0.03838831186294556,
+    "drift": 0.0022048032842576504,
+    "small_step": 2.2303474906948395e-05,
+    "strong_consistency": 0.15322545170783997
+  },
+  {
+    "step": 59,
+    "loss": 0.032610051333904266,
+    "drift": 0.0012418064288794994,
+    "small_step": 1.0153512448596302e-05,
+    "strong_consistency": 0.13065873086452484
+  },
+  {
+    "step": 60,
+    "loss": 0.03697248548269272,
+    "drift": 0.001560721080750227,
+    "small_step": 2.154393951059319e-05,
+    "strong_consistency": 0.14504188299179077
+  },
+  {
+    "step": 61,
+    "loss": 0.03757605329155922,
+    "drift": 0.001794314244762063,
+    "small_step": 2.1251187718007714e-05,
+    "strong_consistency": 0.1441955268383026
+  },
+  {
+    "step": 62,
+    "loss": 0.037195656448602676,
+    "drift": 0.004682712722569704,
+    "small_step": 5.522387073142454e-05,
+    "strong_consistency": 0.12880048155784607
+  },
+  {
+    "step": 63,
+    "loss": 0.050733406096696854,
+    "drift": 0.006037581246346235,
+    "small_step": 5.7501780247548595e-05,
+    "strong_consistency": 0.17436844110488892
+  },
+  {
+    "step": 64,
+    "loss": 0.028518114238977432,
+    "drift": 0.00201961537823081,
+    "small_step": 1.9336615878273733e-05,
+    "strong_consistency": 0.10184293240308762
+  },
+  {
+    "step": 65,
+    "loss": 0.0388215035200119,
+    "drift": 0.003839516779407859,
+    "small_step": 4.390264439280145e-05,
+    "strong_consistency": 0.13234123587608337
+  },
+  {
+    "step": 66,
+    "loss": 0.023239463567733765,
+    "drift": 0.002808196470141411,
+    "small_step": 2.5947358153644018e-05,
+    "strong_consistency": 0.07613925635814667
+  },
+  {
+    "step": 67,
+    "loss": 0.043589212000370026,
+    "drift": 0.0041229394264519215,
+    "small_step": 3.889447179972194e-05,
+    "strong_consistency": 0.14495357871055603
+  },
+  {
+    "step": 68,
+    "loss": 0.03951481729745865,
+    "drift": 0.008410911075770855,
+    "small_step": 9.532675903756171e-05,
+    "strong_consistency": 0.11234993487596512
+  },
+  {
+    "step": 69,
+    "loss": 0.02636905014514923,
+    "drift": 0.004208523314446211,
+    "small_step": 5.146762850927189e-05,
+    "strong_consistency": 0.07896092534065247
+  },
+  {
+    "step": 70,
+    "loss": 0.018595939502120018,
+    "drift": 0.002691462868824601,
+    "small_step": 2.669011337275151e-05,
+    "strong_consistency": 0.05590770021080971
+  },
+  {
+    "step": 71,
+    "loss": 0.043506547808647156,
+    "drift": 0.010038760490715504,
+    "small_step": 0.0001041877330862917,
+    "strong_consistency": 0.11584583669900894
+  },
+  {
+    "step": 72,
+    "loss": 0.03154798224568367,
+    "drift": 0.007387420162558556,
+    "small_step": 8.253755368059501e-05,
+    "strong_consistency": 0.0824589878320694
+  },
+  {
+    "step": 73,
+    "loss": 0.020472170785069466,
+    "drift": 0.003339103888720274,
+    "small_step": 3.4235472412547097e-05,
+    "strong_consistency": 0.05776631832122803
+  },
+  {
+    "step": 74,
+    "loss": 0.0345761701464653,
+    "drift": 0.008193206042051315,
+    "small_step": 8.104542939690873e-05,
+    "strong_consistency": 0.08767306059598923
+  },
+  {
+    "step": 75,
+    "loss": 0.03527040034532547,
+    "drift": 0.004916369915008545,
+    "small_step": 5.3328323701862246e-05,
+    "strong_consistency": 0.09967336058616638
+  },
+  {
+    "step": 76,
+    "loss": 0.022984668612480164,
+    "drift": 0.005160469561815262,
+    "small_step": 5.007443542126566e-05,
+    "strong_consistency": 0.057708196341991425
+  },
+  {
+    "step": 77,
+    "loss": 0.031480446457862854,
+    "drift": 0.005267977714538574,
+    "small_step": 6.0854981711599976e-05,
+    "strong_consistency": 0.08381927758455276
+  },
+  {
+    "step": 78,
+    "loss": 0.031023167073726654,
+    "drift": 0.007938863709568977,
+    "small_step": 7.11655302438885e-05,
+    "strong_consistency": 0.07282637804746628
+  },
+  {
+    "step": 79,
+    "loss": 0.021251261234283447,
+    "drift": 0.0041049085557460785,
+    "small_step": 4.449770858627744e-05,
+    "strong_consistency": 0.053443294018507004
+  },
+  {
+    "step": 80,
+    "loss": 0.02460227906703949,
+    "drift": 0.003358388552442193,
+    "small_step": 3.3921336580533534e-05,
+    "strong_consistency": 0.0654628723859787
+  },
+  {
+    "step": 81,
+    "loss": 0.025404740124940872,
+    "drift": 0.004300087224692106,
+    "small_step": 3.771175761357881e-05,
+    "strong_consistency": 0.06422847509384155
+  },
+  {
+    "step": 82,
+    "loss": 0.019104694947600365,
+    "drift": 0.002774270949885249,
+    "small_step": 3.2896685297600925e-05,
+    "strong_consistency": 0.04908893629908562
+  },
+  {
+    "step": 83,
+    "loss": 0.035016655921936035,
+    "drift": 0.004607314709573984,
+    "small_step": 5.841569509357214e-05,
+    "strong_consistency": 0.09033013880252838
+  },
+  {
+    "step": 84,
+    "loss": 0.03446459025144577,
+    "drift": 0.0034207249991595745,
+    "small_step": 3.304395795566961e-05,
+    "strong_consistency": 0.09120829403400421
+  },
+  {
+    "step": 85,
+    "loss": 0.020668378099799156,
+    "drift": 0.003651030594483018,
+    "small_step": 4.323816028772853e-05,
+    "strong_consistency": 0.04934334009885788
+  },
+  {
+    "step": 86,
+    "loss": 0.02310599572956562,
+    "drift": 0.004810564685612917,
+    "small_step": 5.72589851799421e-05,
+    "strong_consistency": 0.05240854248404503
+  },
+  {
+    "step": 87,
+    "loss": 0.03785210847854614,
+    "drift": 0.004500638227909803,
+    "small_step": 4.92368963023182e-05,
+    "strong_consistency": 0.0946086198091507
+  },
+  {
+    "step": 88,
+    "loss": 0.01901242882013321,
+    "drift": 0.0031444625928997993,
+    "small_step": 3.6619705497287214e-05,
+    "strong_consistency": 0.04447007179260254
+  },
+  {
+    "step": 89,
+    "loss": 0.033895183354616165,
+    "drift": 0.006114266347140074,
+    "small_step": 6.403821316780522e-05,
+    "strong_consistency": 0.07699132710695267
+  },
+  {
+    "step": 90,
+    "loss": 0.019289178773760796,
+    "drift": 0.0018802887061610818,
+    "small_step": 1.9572458768379875e-05,
+    "strong_consistency": 0.0477728508412838
+  },
+  {
+    "step": 91,
+    "loss": 0.03424995765089989,
+    "drift": 0.004458595532923937,
+    "small_step": 5.2878913265885785e-05,
+    "strong_consistency": 0.08081109821796417
+  },
+  {
+    "step": 92,
+    "loss": 0.02821982651948929,
+    "drift": 0.0019065594533458352,
+    "small_step": 2.194757507822942e-05,
+    "strong_consistency": 0.07067558914422989
+  },
+  {
+    "step": 93,
+    "loss": 0.047346580773591995,
+    "drift": 0.004008839838206768,
+    "small_step": 3.8211765058804303e-05,
+    "strong_consistency": 0.1151583269238472
+  },
+  {
+    "step": 94,
+    "loss": 0.023781782016158104,
+    "drift": 0.0025185744743794203,
+    "small_step": 2.876535290852189e-05,
+    "strong_consistency": 0.0558801107108593
+  },
+  {
+    "step": 95,
+    "loss": 0.015264315530657768,
+    "drift": 0.001537762931548059,
+    "small_step": 1.3192346159485169e-05,
+    "strong_consistency": 0.035711877048015594
+  },
+  {
+    "step": 96,
+    "loss": 0.028345298022031784,
+    "drift": 0.0020595956593751907,
+    "small_step": 2.1005091184633784e-05,
+    "strong_consistency": 0.06769251823425293
+  },
+  {
+    "step": 97,
+    "loss": 0.018557272851467133,
+    "drift": 0.0026181598659604788,
+    "small_step": 3.01430445688311e-05,
+    "strong_consistency": 0.040584105998277664
+  },
+  {
+    "step": 98,
+    "loss": 0.028931666165590286,
+    "drift": 0.0026999139226973057,
+    "small_step": 2.9454022296704352e-05,
+    "strong_consistency": 0.0661674216389656
+  },
+  {
+    "step": 99,
+    "loss": 0.03197503834962845,
+    "drift": 0.0047892420552670956,
+    "small_step": 3.1442112231161445e-05,
+    "strong_consistency": 0.0678858831524849
+  },
+  {
+    "step": 100,
+    "loss": 0.03106330893933773,
+    "drift": 0.00400826521217823,
+    "small_step": 4.371390605228953e-05,
+    "strong_consistency": 0.06685972213745117
+  },
+  {
+    "step": 101,
+    "loss": 0.02375168725848198,
+    "drift": 0.0018590952968224883,
+    "small_step": 2.3969452740857378e-05,
+    "strong_consistency": 0.05359956622123718
+  },
+  {
+    "step": 102,
+    "loss": 0.021791601553559303,
+    "drift": 0.002479745075106621,
+    "small_step": 2.377255805185996e-05,
+    "strong_consistency": 0.04681573808193207
+  },
+  {
+    "step": 103,
+    "loss": 0.03206596523523331,
+    "drift": 0.0031725934240967035,
+    "small_step": 3.485154593363404e-05,
+    "strong_consistency": 0.06937144696712494
+  },
+  {
+    "step": 104,
+    "loss": 0.03416368365287781,
+    "drift": 0.003695359919220209,
+    "small_step": 4.541894668363966e-05,
+    "strong_consistency": 0.07243549078702927
+  },
+  {
+    "step": 105,
+    "loss": 0.023260941728949547,
+    "drift": 0.002369997324422002,
+    "small_step": 2.428629159112461e-05,
+    "strong_consistency": 0.049213819205760956
+  },
+  {
+    "step": 106,
+    "loss": 0.035925403237342834,
+    "drift": 0.004093295428901911,
+    "small_step": 3.9799928345019e-05,
+    "strong_consistency": 0.07428109645843506
+  },
+  {
+    "step": 107,
+    "loss": 0.02928675152361393,
+    "drift": 0.0026392191648483276,
+    "small_step": 3.1847790523897856e-05,
+    "strong_consistency": 0.061610378324985504
+  },
+  {
+    "step": 108,
+    "loss": 0.020667018368840218,
+    "drift": 0.0026048729196190834,
+    "small_step": 3.474003096926026e-05,
+    "strong_consistency": 0.041347261518239975
+  },
+  {
+    "step": 109,
+    "loss": 0.015259814448654652,
+    "drift": 0.0016112758312374353,
+    "small_step": 2.00154390768148e-05,
+    "strong_consistency": 0.03097391501069069
+  },
+  {
+    "step": 110,
+    "loss": 0.025756699964404106,
+    "drift": 0.002589485375210643,
+    "small_step": 2.7064777896157466e-05,
+    "strong_consistency": 0.05211745202541351
+  },
+  {
+    "step": 111,
+    "loss": 0.025648117065429688,
+    "drift": 0.002996775321662426,
+    "small_step": 2.750780913629569e-05,
+    "strong_consistency": 0.050499625504016876
+  },
+  {
+    "step": 112,
+    "loss": 0.01960531249642372,
+    "drift": 0.003037814050912857,
+    "small_step": 3.097047010669485e-05,
+    "strong_consistency": 0.0365852415561676
+  },
+  {
+    "step": 113,
+    "loss": 0.020908717066049576,
+    "drift": 0.0033971292432397604,
+    "small_step": 3.0995764973340556e-05,
+    "strong_consistency": 0.03833463042974472
+  },
+  {
+    "step": 114,
+    "loss": 0.021783946081995964,
+    "drift": 0.0024322918616235256,
+    "small_step": 2.4322936951648444e-05,
+    "strong_consistency": 0.042015936225652695
+  },
+  {
+    "step": 115,
+    "loss": 0.021344318985939026,
+    "drift": 0.002594209276139736,
+    "small_step": 2.3026555936667137e-05,
+    "strong_consistency": 0.040360093116760254
+  },
+  {
+    "step": 116,
+    "loss": 0.01984832063317299,
+    "drift": 0.0029800578486174345,
+    "small_step": 2.6396724933874793e-05,
+    "strong_consistency": 0.03598689287900925
+  },
+  {
+    "step": 117,
+    "loss": 0.01486639492213726,
+    "drift": 0.001760438666678965,
+    "small_step": 2.270579534524586e-05,
+    "strong_consistency": 0.02771875075995922
+  },
+  {
+    "step": 118,
+    "loss": 0.02747124433517456,
+    "drift": 0.002904266584664583,
+    "small_step": 2.9444952815538272e-05,
+    "strong_consistency": 0.05154943838715553
+  },
+  {
+    "step": 119,
+    "loss": 0.019038628786802292,
+    "drift": 0.0024654727894812822,
+    "small_step": 2.6169062039116398e-05,
+    "strong_consistency": 0.03447289019823074
+  },
+  {
+    "step": 120,
+    "loss": 0.02747294306755066,
+    "drift": 0.004114893265068531,
+    "small_step": 3.762507549254224e-05,
+    "strong_consistency": 0.04818269610404968
+  },
+  {
+    "step": 121,
+    "loss": 0.021927617490291595,
+    "drift": 0.002520700916647911,
+    "small_step": 3.1257353839464486e-05,
+    "strong_consistency": 0.03970421850681305
+  },
+  {
+    "step": 122,
+    "loss": 0.024348584935069084,
+    "drift": 0.0023965006694197655,
+    "small_step": 2.7372057957109064e-05,
+    "strong_consistency": 0.04456242173910141
+  },
+  {
+    "step": 123,
+    "loss": 0.023985859006643295,
+    "drift": 0.003019795287400484,
+    "small_step": 3.532113987603225e-05,
+    "strong_consistency": 0.04219907894730568
+  },
+  {
+    "step": 124,
+    "loss": 0.024572376161813736,
+    "drift": 0.0032009028363972902,
+    "small_step": 3.521526014083065e-05,
+    "strong_consistency": 0.04267251491546631
+  },
+  {
+    "step": 125,
+    "loss": 0.017712639644742012,
+    "drift": 0.002168460516259074,
+    "small_step": 2.662461338331923e-05,
+    "strong_consistency": 0.03078879974782467
+  },
+  {
+    "step": 126,
+    "loss": 0.020656954497098923,
+    "drift": 0.002798234112560749,
+    "small_step": 2.7914509701076895e-05,
+    "strong_consistency": 0.03510000929236412
+  },
+  {
+    "step": 127,
+    "loss": 0.021196145564317703,
+    "drift": 0.0030503463931381702,
+    "small_step": 2.848203803296201e-05,
+    "strong_consistency": 0.035385385155677795
+  },
+  {
+    "step": 128,
+    "loss": 0.02869313769042492,
+    "drift": 0.0027242768555879593,
+    "small_step": 3.126391675323248e-05,
+    "strong_consistency": 0.05026666074991226
+  },
+  {
+    "step": 129,
+    "loss": 0.01676579937338829,
+    "drift": 0.0023448762949556112,
+    "small_step": 3.0532370146829635e-05,
+    "strong_consistency": 0.027673829346895218
+  },
+  {
+    "step": 130,
+    "loss": 0.014932136051356792,
+    "drift": 0.002324749017134309,
+    "small_step": 2.8585964173544198e-05,
+    "strong_consistency": 0.02400534600019455
+  },
+  {
+    "step": 131,
+    "loss": 0.025505805388092995,
+    "drift": 0.0029936321079730988,
+    "small_step": 3.5304383345646784e-05,
+    "strong_consistency": 0.042569827288389206
+  },
+  {
+    "step": 132,
+    "loss": 0.02403704822063446,
+    "drift": 0.003171571996062994,
+    "small_step": 2.1919646314927377e-05,
+    "strong_consistency": 0.039179615676403046
+  },
+  {
+    "step": 133,
+    "loss": 0.02105691470205784,
+    "drift": 0.00267124455422163,
+    "small_step": 3.7720710679423064e-05,
+    "strong_consistency": 0.03423124551773071
+  },
+  {
+    "step": 134,
+    "loss": 0.0145409582182765,
+    "drift": 0.0027858454268425703,
+    "small_step": 3.1684776331530884e-05,
+    "strong_consistency": 0.021710051223635674
+  },
+  {
+    "step": 135,
+    "loss": 0.0169684998691082,
+    "drift": 0.0023539159446954727,
+    "small_step": 3.42258827004116e-05,
+    "strong_consistency": 0.026802126318216324
+  },
+  {
+    "step": 136,
+    "loss": 0.017806047573685646,
+    "drift": 0.0029407271649688482,
+    "small_step": 3.3312553568976e-05,
+    "strong_consistency": 0.027065709233283997
+  },
+  {
+    "step": 137,
+    "loss": 0.01453122403472662,
+    "drift": 0.003180993255227804,
+    "small_step": 3.2953488698694855e-05,
+    "strong_consistency": 0.02050231397151947
+  },
+  {
+    "step": 138,
+    "loss": 0.014383137226104736,
+    "drift": 0.0024412316270172596,
+    "small_step": 3.486304558464326e-05,
+    "strong_consistency": 0.02141554281115532
+  },
+  {
+    "step": 139,
+    "loss": 0.024118691682815552,
+    "drift": 0.0036688316613435745,
+    "small_step": 4.7586327127646655e-05,
+    "strong_consistency": 0.03643263131380081
+  },
+  {
+    "step": 140,
+    "loss": 0.026227155700325966,
+    "drift": 0.004383378196507692,
+    "small_step": 5.703048736904748e-05,
+    "strong_consistency": 0.03862898424267769
+  },
+  {
+    "step": 141,
+    "loss": 0.015563411638140678,
+    "drift": 0.002921729814261198,
+    "small_step": 3.3032247301889583e-05,
+    "strong_consistency": 0.022198326885700226
+  },
+  {
+    "step": 142,
+    "loss": 0.03044794872403145,
+    "drift": 0.003953725099563599,
+    "small_step": 3.664094037958421e-05,
+    "strong_consistency": 0.046254511922597885
+  },
+  {
+    "step": 143,
+    "loss": 0.01515373308211565,
+    "drift": 0.0026061246171593666,
+    "small_step": 2.9241826268844306e-05,
+    "strong_consistency": 0.021733276546001434
+  },
+  {
+    "step": 144,
+    "loss": 0.026174409314990044,
+    "drift": 0.003652493469417095,
+    "small_step": 3.645327524282038e-05,
+    "strong_consistency": 0.038768041878938675
+  },
+  {
+    "step": 145,
+    "loss": 0.011306953616440296,
+    "drift": 0.0026326007209718227,
+    "small_step": 3.3471424103481695e-05,
+    "strong_consistency": 0.014796029776334763
+  },
+  {
+    "step": 146,
+    "loss": 0.020755304023623466,
+    "drift": 0.00296054151840508,
+    "small_step": 3.533812559908256e-05,
+    "strong_consistency": 0.03020310215651989
+  },
+  {
+    "step": 147,
+    "loss": 0.015381250530481339,
+    "drift": 0.002728409832343459,
+    "small_step": 3.438675048528239e-05,
+    "strong_consistency": 0.02131495624780655
+  },
+  {
+    "step": 148,
+    "loss": 0.020724644884467125,
+    "drift": 0.0036905049346387386,
+    "small_step": 4.184271165286191e-05,
+    "strong_consistency": 0.0285105649381876
+  },
+  {
+    "step": 149,
+    "loss": 0.016565334051847458,
+    "drift": 0.003107647877186537,
+    "small_step": 2.1918240236118436e-05,
+    "strong_consistency": 0.022392943501472473
+  },
+  {
+    "step": 150,
+    "loss": 0.01100713387131691,
+    "drift": 0.002109441440552473,
+    "small_step": 1.8260583601659164e-05,
+    "strong_consistency": 0.014701046980917454
+  },
+  {
+    "step": 151,
+    "loss": 0.014419295825064182,
+    "drift": 0.004337645135819912,
+    "small_step": 4.8892368795350194e-05,
+    "strong_consistency": 0.016501247882843018
+  },
+  {
+    "step": 152,
+    "loss": 0.017401622608304024,
+    "drift": 0.0025489379186183214,
+    "small_step": 3.427725823712535e-05,
+    "strong_consistency": 0.02421308495104313
+  },
+  {
+    "step": 153,
+    "loss": 0.012315940111875534,
+    "drift": 0.0023666457273066044,
+    "small_step": 2.4459381165797822e-05,
+    "strong_consistency": 0.016111746430397034
+  },
+  {
+    "step": 154,
+    "loss": 0.020250331610441208,
+    "drift": 0.002512987470254302,
+    "small_step": 2.8708736863336526e-05,
+    "strong_consistency": 0.028562312945723534
+  },
+  {
+    "step": 155,
+    "loss": 0.013921836391091347,
+    "drift": 0.0025136652402579784,
+    "small_step": 2.943555955425836e-05,
+    "strong_consistency": 0.01823515258729458
+  },
+  {
+    "step": 156,
+    "loss": 0.011016212403774261,
+    "drift": 0.0019211163744330406,
+    "small_step": 1.9107803382212296e-05,
+    "strong_consistency": 0.014452209696173668
+  },
+  {
+    "step": 157,
+    "loss": 0.01572905108332634,
+    "drift": 0.002902023261412978,
+    "small_step": 3.1425850465893745e-05,
+    "strong_consistency": 0.020246203988790512
+  },
+  {
+    "step": 158,
+    "loss": 0.023308653384447098,
+    "drift": 0.0024509960785508156,
+    "small_step": 1.9861052351188846e-05,
+    "strong_consistency": 0.032763831317424774
+  },
+  {
+    "step": 159,
+    "loss": 0.01080321241170168,
+    "drift": 0.0016062089707702398,
+    "small_step": 2.070567279588431e-05,
+    "strong_consistency": 0.014337966218590736
+  },
+  {
+    "step": 160,
+    "loss": 0.011959888972342014,
+    "drift": 0.0023951223120093346,
+    "small_step": 2.8979953640373424e-05,
+    "strong_consistency": 0.014807121828198433
+  },
+  {
+    "step": 161,
+    "loss": 0.017296062782406807,
+    "drift": 0.002278212457895279,
+    "small_step": 3.0470391720882617e-05,
+    "strong_consistency": 0.023128673434257507
+  },
+  {
+    "step": 162,
+    "loss": 0.020493514835834503,
+    "drift": 0.0016652473714202642,
+    "small_step": 1.9779978174483404e-05,
+    "strong_consistency": 0.02884737215936184
+  },
+  {
+    "step": 163,
+    "loss": 0.017985690385103226,
+    "drift": 0.002352292649447918,
+    "small_step": 3.602437936933711e-05,
+    "strong_consistency": 0.023776482790708542
+  },
+  {
+    "step": 164,
+    "loss": 0.01519845612347126,
+    "drift": 0.0015165952499955893,
+    "small_step": 2.5463274141657166e-05,
+    "strong_consistency": 0.020691510289907455
+  },
+  {
+    "step": 165,
+    "loss": 0.01364024169743061,
+    "drift": 0.0024506065528839827,
+    "small_step": 2.9436207114486024e-05,
+    "strong_consistency": 0.01680752821266651
+  },
+  {
+    "step": 166,
+    "loss": 0.01843353919684887,
+    "drift": 0.0022698387037962675,
+    "small_step": 3.661110531538725e-05,
+    "strong_consistency": 0.024142349138855934
+  },
+  {
+    "step": 167,
+    "loss": 0.01030344795435667,
+    "drift": 0.0018556867726147175,
+    "small_step": 1.778027399268467e-05,
+    "strong_consistency": 0.012544614262878895
+  },
+  {
+    "step": 168,
+    "loss": 0.016438836231827736,
+    "drift": 0.0019315812969580293,
+    "small_step": 2.380049591010902e-05,
+    "strong_consistency": 0.02142522856593132
+  },
+  {
+    "step": 169,
+    "loss": 0.012253106571733952,
+    "drift": 0.0023270975798368454,
+    "small_step": 3.283214755356312e-05,
+    "strong_consistency": 0.014548789709806442
+  },
+  {
+    "step": 170,
+    "loss": 0.01681591384112835,
+    "drift": 0.0027932473458349705,
+    "small_step": 4.039062696392648e-05,
+    "strong_consistency": 0.020441923290491104
+  },
+  {
+    "step": 171,
+    "loss": 0.017073102295398712,
+    "drift": 0.0031427221838384867,
+    "small_step": 3.796779128606431e-05,
+    "strong_consistency": 0.020192459225654602
+  },
+  {
+    "step": 172,
+    "loss": 0.011952078901231289,
+    "drift": 0.002173709450289607,
+    "small_step": 2.7637341190711595e-05,
+    "strong_consistency": 0.014090653508901596
+  },
+  {
+    "step": 173,
+    "loss": 0.008695390075445175,
+    "drift": 0.0020225434564054012,
+    "small_step": 2.0485038476181217e-05,
+    "strong_consistency": 0.009557991288602352
+  },
+  {
+    "step": 174,
+    "loss": 0.010011062026023865,
+    "drift": 0.0020336511079221964,
+    "small_step": 2.477122689015232e-05,
+    "strong_consistency": 0.011360914446413517
+  },
+  {
+    "step": 175,
+    "loss": 0.010355214588344097,
+    "drift": 0.0017946892185136676,
+    "small_step": 2.180689807573799e-05,
+    "strong_consistency": 0.01212886068969965
+  },
+  {
+    "step": 176,
+    "loss": 0.013882957398891449,
+    "drift": 0.002312303986400366,
+    "small_step": 2.4299231881741434e-05,
+    "strong_consistency": 0.016308410093188286
+  },
+  {
+    "step": 177,
+    "loss": 0.02007545717060566,
+    "drift": 0.002890475792810321,
+    "small_step": 3.5015185858355835e-05,
+    "strong_consistency": 0.024087030440568924
+  },
+  {
+    "step": 178,
+    "loss": 0.01329911407083273,
+    "drift": 0.001646738382987678,
+    "small_step": 2.2286649254965596e-05,
+    "strong_consistency": 0.016243141144514084
+  },
+  {
+    "step": 179,
+    "loss": 0.011403677985072136,
+    "drift": 0.0032704672776162624,
+    "small_step": 3.769260729313828e-05,
+    "strong_consistency": 0.011243773624300957
+  },
+  {
+    "step": 180,
+    "loss": 0.016294974833726883,
+    "drift": 0.002987012267112732,
+    "small_step": 3.2025243854150176e-05,
+    "strong_consistency": 0.018336931243538857
+  },
+  {
+    "step": 181,
+    "loss": 0.015128941275179386,
+    "drift": 0.0030035001691430807,
+    "small_step": 3.226304761483334e-05,
+    "strong_consistency": 0.016611509025096893
+  },
+  {
+    "step": 182,
+    "loss": 0.016797423362731934,
+    "drift": 0.004095547366887331,
+    "small_step": 4.879291373072192e-05,
+    "strong_consistency": 0.017285631969571114
+  },
+  {
+    "step": 183,
+    "loss": 0.014858941547572613,
+    "drift": 0.0038774977438151836,
+    "small_step": 4.7358025767607614e-05,
+    "strong_consistency": 0.014856094494462013
+  },
+  {
+    "step": 184,
+    "loss": 0.011484375223517418,
+    "drift": 0.0025748275220394135,
+    "small_step": 2.512811988708563e-05,
+    "strong_consistency": 0.012005972675979137
+  },
+  {
+    "step": 185,
+    "loss": 0.010927470400929451,
+    "drift": 0.0024400169495493174,
+    "small_step": 3.0131366656860337e-05,
+    "strong_consistency": 0.011367369443178177
+  },
+  {
+    "step": 186,
+    "loss": 0.014913344755768776,
+    "drift": 0.0037189838476479053,
+    "small_step": 4.643843567464501e-05,
+    "strong_consistency": 0.014903638511896133
+  },
+  {
+    "step": 187,
+    "loss": 0.00944973062723875,
+    "drift": 0.0017385731916874647,
+    "small_step": 2.0646484699682333e-05,
+    "strong_consistency": 0.01022674422711134
+  },
+  {
+    "step": 188,
+    "loss": 0.017977476119995117,
+    "drift": 0.0037533631548285484,
+    "small_step": 4.695037932833657e-05,
+    "strong_consistency": 0.01875285990536213
+  },
+  {
+    "step": 189,
+    "loss": 0.007616282906383276,
+    "drift": 0.0014259819872677326,
+    "small_step": 2.1868223484489135e-05,
+    "strong_consistency": 0.008116358891129494
+  },
+  {
+    "step": 190,
+    "loss": 0.011678026057779789,
+    "drift": 0.0014215296832844615,
+    "small_step": 2.697854142752476e-05,
+    "strong_consistency": 0.013389421626925468
+  },
+  {
+    "step": 191,
+    "loss": 0.016046063974499702,
+    "drift": 0.0028114928863942623,
+    "small_step": 4.237684333929792e-05,
+    "strong_consistency": 0.017177335917949677
+  },
+  {
+    "step": 192,
+    "loss": 0.01401685643941164,
+    "drift": 0.0018946584314107895,
+    "small_step": 2.768249214568641e-05,
+    "strong_consistency": 0.015666469931602478
+  },
+  {
+    "step": 193,
+    "loss": 0.008570795878767967,
+    "drift": 0.0015128578525036573,
+    "small_step": 2.566570219642017e-05,
+    "strong_consistency": 0.009062206372618675
+  },
+  {
+    "step": 194,
+    "loss": 0.010714998468756676,
+    "drift": 0.0018500384176149964,
+    "small_step": 3.0795570637565106e-05,
+    "strong_consistency": 0.011325852945446968
+  },
+  {
+    "step": 195,
+    "loss": 0.008558571338653564,
+    "drift": 0.0016051949933171272,
+    "small_step": 1.9640194295789115e-05,
+    "strong_consistency": 0.008844051510095596
+  },
+  {
+    "step": 196,
+    "loss": 0.013216325081884861,
+    "drift": 0.0018033039523288608,
+    "small_step": 1.992843135667499e-05,
+    "strong_consistency": 0.014458240009844303
+  },
+  {
+    "step": 197,
+    "loss": 0.012698381207883358,
+    "drift": 0.0022310796193778515,
+    "small_step": 3.271159584983252e-05,
+    "strong_consistency": 0.013174988329410553
+  },
+  {
+    "step": 198,
+    "loss": 0.010136626660823822,
+    "drift": 0.0013391321990638971,
+    "small_step": 2.431258326396346e-05,
+    "strong_consistency": 0.011021584272384644
+  },
+  {
+    "step": 199,
+    "loss": 0.010623001493513584,
+    "drift": 0.0021453711669892073,
+    "small_step": 2.9902264941483736e-05,
+    "strong_consistency": 0.010559660382568836
+  },
+  {
+    "step": 200,
+    "loss": 0.010942916385829449,
+    "drift": 0.002595366910099983,
+    "small_step": 3.033805660379585e-05,
+    "strong_consistency": 0.010344790294766426
+  },
+  {
+    "step": 201,
+    "loss": 0.012487036176025867,
+    "drift": 0.0020119845867156982,
+    "small_step": 2.3068845621310174e-05,
+    "strong_consistency": 0.012935621663928032
+  },
+  {
+    "step": 202,
+    "loss": 0.01335589773952961,
+    "drift": 0.0015843058936297894,
+    "small_step": 2.0007377315778285e-05,
+    "strong_consistency": 0.014472395181655884
+  },
+  {
+    "step": 203,
+    "loss": 0.011340126395225525,
+    "drift": 0.0014600517461076379,
+    "small_step": 1.8583748897071928e-05,
+    "strong_consistency": 0.012085160240530968
+  },
+  {
+    "step": 204,
+    "loss": 0.01336107961833477,
+    "drift": 0.002193206688389182,
+    "small_step": 1.977154715859797e-05,
+    "strong_consistency": 0.013595245778560638
+  },
+  {
+    "step": 205,
+    "loss": 0.010853206738829613,
+    "drift": 0.0016822093166410923,
+    "small_step": 2.589491668913979e-05,
+    "strong_consistency": 0.011098425835371017
+  },
+  {
+    "step": 206,
+    "loss": 0.013158394955098629,
+    "drift": 0.0029174929950386286,
+    "small_step": 4.948279820382595e-05,
+    "strong_consistency": 0.01230847742408514
+  },
+  {
+    "step": 207,
+    "loss": 0.00892467051744461,
+    "drift": 0.0023070084862411022,
+    "small_step": 3.103207200183533e-05,
+    "strong_consistency": 0.00791662186384201
+  },
+  {
+    "step": 208,
+    "loss": 0.007540724240243435,
+    "drift": 0.002548621501773596,
+    "small_step": 4.159913441981189e-05,
+    "strong_consistency": 0.005921654403209686
+  },
+  {
+    "step": 209,
+    "loss": 0.010517873801290989,
+    "drift": 0.0022358722053468227,
+    "small_step": 2.1961361198918894e-05,
+    "strong_consistency": 0.009833382442593575
+  },
+  {
+    "step": 210,
+    "loss": 0.007318462245166302,
+    "drift": 0.0015193212311714888,
+    "small_step": 1.782608887879178e-05,
+    "strong_consistency": 0.006849899422377348
+  },
+  {
+    "step": 211,
+    "loss": 0.008825935423374176,
+    "drift": 0.0022833410184830427,
+    "small_step": 3.567193925846368e-05,
+    "strong_consistency": 0.0076732574962079525
+  },
+  {
+    "step": 212,
+    "loss": 0.016080163419246674,
+    "drift": 0.004420574754476547,
+    "small_step": 4.919678394799121e-05,
+    "strong_consistency": 0.013627219945192337
+  },
+  {
+    "step": 213,
+    "loss": 0.006509615108370781,
+    "drift": 0.002443758537992835,
+    "small_step": 2.8830416340497322e-05,
+    "strong_consistency": 0.004716151859611273
+  },
+  {
+    "step": 214,
+    "loss": 0.008783699944615364,
+    "drift": 0.0028537758626043797,
+    "small_step": 2.93954126391327e-05,
+    "strong_consistency": 0.0068610794842243195
+  },
+  {
+    "step": 215,
+    "loss": 0.010298031382262707,
+    "drift": 0.0027582314796745777,
+    "small_step": 4.365595668787137e-05,
+    "strong_consistency": 0.008676092140376568
+  },
+  {
+    "step": 216,
+    "loss": 0.00921549741178751,
+    "drift": 0.002136469352990389,
+    "small_step": 2.5249244572478347e-05,
+    "strong_consistency": 0.008126473985612392
+  },
+  {
+    "step": 217,
+    "loss": 0.012482980266213417,
+    "drift": 0.0030035737436264753,
+    "small_step": 4.4317974243313074e-05,
+    "strong_consistency": 0.0108200553804636
+  },
+  {
+    "step": 218,
+    "loss": 0.008118619211018085,
+    "drift": 0.0019223083509132266,
+    "small_step": 3.231535811210051e-05,
+    "strong_consistency": 0.00703652435913682
+  },
+  {
+    "step": 219,
+    "loss": 0.011951371096074581,
+    "drift": 0.0023737901356071234,
+    "small_step": 2.395406954747159e-05,
+    "strong_consistency": 0.010856394656002522
+  },
+  {
+    "step": 220,
+    "loss": 0.007859569042921066,
+    "drift": 0.001763486652635038,
+    "small_step": 2.5387345885974355e-05,
+    "strong_consistency": 0.006867302116006613
+  },
+  {
+    "step": 221,
+    "loss": 0.010164779610931873,
+    "drift": 0.002129234140738845,
+    "small_step": 2.6972576961270534e-05,
+    "strong_consistency": 0.009018663316965103
+  },
+  {
+    "step": 222,
+    "loss": 0.014176362194120884,
+    "drift": 0.002081050770357251,
+    "small_step": 3.384387673577294e-05,
+    "strong_consistency": 0.013521824032068253
+  },
+  {
+    "step": 223,
+    "loss": 0.011276613920927048,
+    "drift": 0.001690772594884038,
+    "small_step": 2.8239745006430894e-05,
+    "strong_consistency": 0.010666966438293457
+  },
+  {
+    "step": 224,
+    "loss": 0.005524729378521442,
+    "drift": 0.001427789917215705,
+    "small_step": 1.4169344467518385e-05,
+    "strong_consistency": 0.0045364112593233585
+  },
+  {
+    "step": 225,
+    "loss": 0.009545458480715752,
+    "drift": 0.0011171734659001231,
+    "small_step": 1.6758560377638787e-05,
+    "strong_consistency": 0.00930478610098362
+  },
+  {
+    "step": 226,
+    "loss": 0.009656829759478569,
+    "drift": 0.0020648902282118797,
+    "small_step": 3.074257983826101e-05,
+    "strong_consistency": 0.008327309042215347
+  },
+  {
+    "step": 227,
+    "loss": 0.0084011759608984,
+    "drift": 0.0013717955444008112,
+    "small_step": 1.7895930795930326e-05,
+    "strong_consistency": 0.007688031531870365
+  },
+  {
+    "step": 228,
+    "loss": 0.006906729657202959,
+    "drift": 0.001555030234158039,
+    "small_step": 2.0882594981230795e-05,
+    "strong_consistency": 0.005819668993353844
+  },
+  {
+    "step": 229,
+    "loss": 0.006324604153633118,
+    "drift": 0.0015325567219406366,
+    "small_step": 1.9275519662187435e-05,
+    "strong_consistency": 0.005187795497477055
+  },
+  {
+    "step": 230,
+    "loss": 0.006170694716274738,
+    "drift": 0.0016865987563505769,
+    "small_step": 3.281176759628579e-05,
+    "strong_consistency": 0.004817407112568617
+  },
+  {
+    "step": 231,
+    "loss": 0.008107684552669525,
+    "drift": 0.0019474381115287542,
+    "small_step": 2.2615089619648643e-05,
+    "strong_consistency": 0.006613827310502529
+  },
+  {
+    "step": 232,
+    "loss": 0.008225418627262115,
+    "drift": 0.0015924702165648341,
+    "small_step": 2.345855682506226e-05,
+    "strong_consistency": 0.00709172710776329
+  },
+  {
+    "step": 233,
+    "loss": 0.007124405354261398,
+    "drift": 0.0019939448684453964,
+    "small_step": 2.1772832042188384e-05,
+    "strong_consistency": 0.005457999650388956
+  },
+  {
+    "step": 234,
+    "loss": 0.005947413854300976,
+    "drift": 0.0017412195447832346,
+    "small_step": 3.770734474528581e-05,
+    "strong_consistency": 0.004434560891240835
+  },
+  {
+    "step": 235,
+    "loss": 0.006200247444212437,
+    "drift": 0.0018315924098715186,
+    "small_step": 2.2056676243664697e-05,
+    "strong_consistency": 0.00460444763302803
+  },
+  {
+    "step": 236,
+    "loss": 0.0075891525484621525,
+    "drift": 0.0016180763486772776,
+    "small_step": 2.497130844858475e-05,
+    "strong_consistency": 0.006272262427955866
+  },
+  {
+    "step": 237,
+    "loss": 0.007249905727803707,
+    "drift": 0.001987873110920191,
+    "small_step": 3.2770669349702075e-05,
+    "strong_consistency": 0.0054929219186306
+  },
+  {
+    "step": 238,
+    "loss": 0.008431561291217804,
+    "drift": 0.0018013337394222617,
+    "small_step": 2.7427153327153064e-05,
+    "strong_consistency": 0.006906695198267698
+  },
+  {
+    "step": 239,
+    "loss": 0.007545809727162123,
+    "drift": 0.0016170409508049488,
+    "small_step": 2.4187718736357056e-05,
+    "strong_consistency": 0.006150605157017708
+  },
+  {
+    "step": 240,
+    "loss": 0.009793034754693508,
+    "drift": 0.002189184073358774,
+    "small_step": 2.0440911612240598e-05,
+    "strong_consistency": 0.00786660797894001
+  },
+  {
+    "step": 241,
+    "loss": 0.0072727566584944725,
+    "drift": 0.0015732033643871546,
+    "small_step": 1.3445477634377312e-05,
+    "strong_consistency": 0.005874078255146742
+  },
+  {
+    "step": 242,
+    "loss": 0.011722941882908344,
+    "drift": 0.00177660770714283,
+    "small_step": 2.6956447982229292e-05,
+    "strong_consistency": 0.010205121710896492
+  },
+  {
+    "step": 243,
+    "loss": 0.005129161756485701,
+    "drift": 0.0008798306225799024,
+    "small_step": 1.7742022464517504e-05,
+    "strong_consistency": 0.004335644189268351
+  },
+  {
+    "step": 244,
+    "loss": 0.007724159862846136,
+    "drift": 0.0016660827677696943,
+    "small_step": 2.8245214707567357e-05,
+    "strong_consistency": 0.006152889225631952
+  },
+  {
+    "step": 245,
+    "loss": 0.007731004152446985,
+    "drift": 0.0017551241908222437,
+    "small_step": 2.770058563328348e-05,
+    "strong_consistency": 0.0060448977164924145
+  },
+  {
+    "step": 246,
+    "loss": 0.00805883388966322,
+    "drift": 0.0021178321912884712,
+    "small_step": 3.34125870722346e-05,
+    "strong_consistency": 0.005979341454803944
+  },
+  {
+    "step": 247,
+    "loss": 0.008420043624937534,
+    "drift": 0.0021646444220095873,
+    "small_step": 3.1351934012491256e-05,
+    "strong_consistency": 0.006274241488426924
+  },
+  {
+    "step": 248,
+    "loss": 0.010369517840445042,
+    "drift": 0.0021644255612045527,
+    "small_step": 3.3973599784076214e-05,
+    "strong_consistency": 0.008203934878110886
+  },
+  {
+    "step": 249,
+    "loss": 0.007135560270398855,
+    "drift": 0.001843324746005237,
+    "small_step": 2.5798295610002242e-05,
+    "strong_consistency": 0.00526643730700016
+  },
+  {
+    "step": 250,
+    "loss": 0.006934518460184336,
+    "drift": 0.0017792965518310666,
+    "small_step": 3.222420491511002e-05,
+    "strong_consistency": 0.005122997798025608
+  },
+  {
+    "step": 251,
+    "loss": 0.007752831093966961,
+    "drift": 0.002747371792793274,
+    "small_step": 4.8309848352801055e-05,
+    "strong_consistency": 0.004957149270921946
+  },
+  {
+    "step": 252,
+    "loss": 0.006305924151092768,
+    "drift": 0.002032192423939705,
+    "small_step": 2.9086526410537772e-05,
+    "strong_consistency": 0.0042446451261639595
+  },
+  {
+    "step": 253,
+    "loss": 0.006284188479185104,
+    "drift": 0.001438626553863287,
+    "small_step": 2.3888598661869764e-05,
+    "strong_consistency": 0.004821673035621643
+  },
+  {
+    "step": 254,
+    "loss": 0.006638078019022942,
+    "drift": 0.001701108762063086,
+    "small_step": 3.075574932154268e-05,
+    "strong_consistency": 0.004906213376671076
+  },
+  {
+    "step": 255,
+    "loss": 0.006303084082901478,
+    "drift": 0.0016619933303445578,
+    "small_step": 1.9127430277876556e-05,
+    "strong_consistency": 0.004621963482350111
+  },
+  {
+    "step": 256,
+    "loss": 0.006305179558694363,
+    "drift": 0.0017264283960685134,
+    "small_step": 2.587932067399379e-05,
+    "strong_consistency": 0.0045528719201684
+  },
+  {
+    "step": 257,
+    "loss": 0.005533548071980476,
+    "drift": 0.0014271471882238984,
+    "small_step": 3.242491584387608e-05,
+    "strong_consistency": 0.004073976073414087
+  },
+  {
+    "step": 258,
+    "loss": 0.0044203088618814945,
+    "drift": 0.0015515220584347844,
+    "small_step": 2.3078309823176824e-05,
+    "strong_consistency": 0.0028457085136324167
+  },
+  {
+    "step": 259,
+    "loss": 0.006199479568749666,
+    "drift": 0.0016180623788386583,
+    "small_step": 2.812759339576587e-05,
+    "strong_consistency": 0.004553289618343115
+  },
+  {
+    "step": 260,
+    "loss": 0.0045965793542563915,
+    "drift": 0.0009216039907187223,
+    "small_step": 2.106416468450334e-05,
+    "strong_consistency": 0.0036539111752063036
+  },
+  {
+    "step": 261,
+    "loss": 0.006723355036228895,
+    "drift": 0.0012678829953074455,
+    "small_step": 2.325599234609399e-05,
+    "strong_consistency": 0.0054322159849107265
+  },
+  {
+    "step": 262,
+    "loss": 0.003403564915060997,
+    "drift": 0.0010584410047158599,
+    "small_step": 2.1318353901733644e-05,
+    "strong_consistency": 0.0023238055873662233
+  },
+  {
+    "step": 263,
+    "loss": 0.00889002438634634,
+    "drift": 0.001254503382369876,
+    "small_step": 1.6132931705215015e-05,
+    "strong_consistency": 0.007619387935847044
+  },
+  {
+    "step": 264,
+    "loss": 0.009971212595701218,
+    "drift": 0.0018034251406788826,
+    "small_step": 2.8510312404250726e-05,
+    "strong_consistency": 0.008139276877045631
+  },
+  {
+    "step": 265,
+    "loss": 0.005133357830345631,
+    "drift": 0.0014369908021762967,
+    "small_step": 2.737762770266272e-05,
+    "strong_consistency": 0.003668989520519972
+  },
+  {
+    "step": 266,
+    "loss": 0.004512331914156675,
+    "drift": 0.0010329355718567967,
+    "small_step": 2.301907261426095e-05,
+    "strong_consistency": 0.003456377424299717
+  },
+  {
+    "step": 267,
+    "loss": 0.00578118534758687,
+    "drift": 0.0012173352297395468,
+    "small_step": 1.9075945601798594e-05,
+    "strong_consistency": 0.004544774070382118
+  },
+  {
+    "step": 268,
+    "loss": 0.008219221606850624,
+    "drift": 0.0016693498473614454,
+    "small_step": 3.548258246155456e-05,
+    "strong_consistency": 0.00651438906788826
+  },
+  {
+    "step": 269,
+    "loss": 0.009556161239743233,
+    "drift": 0.0020716360304504633,
+    "small_step": 4.1346407670062035e-05,
+    "strong_consistency": 0.007443178445100784
+  },
+  {
+    "step": 270,
+    "loss": 0.0066649517975747585,
+    "drift": 0.0017365477979183197,
+    "small_step": 2.4024069716688246e-05,
+    "strong_consistency": 0.004904380068182945
+  },
+  {
+    "step": 271,
+    "loss": 0.007838817313313484,
+    "drift": 0.0014585580211132765,
+    "small_step": 2.2533537048730068e-05,
+    "strong_consistency": 0.006357725244015455
+  },
+  {
+    "step": 272,
+    "loss": 0.005501448176801205,
+    "drift": 0.0019136895425617695,
+    "small_step": 2.7046700779465027e-05,
+    "strong_consistency": 0.0035607118625193834
+  },
+  {
+    "step": 273,
+    "loss": 0.00891698244959116,
+    "drift": 0.0018512378446757793,
+    "small_step": 2.8131273211329244e-05,
+    "strong_consistency": 0.007037613075226545
+  },
+  {
+    "step": 274,
+    "loss": 0.006548725068569183,
+    "drift": 0.0024084430187940598,
+    "small_step": 3.3681852073641494e-05,
+    "strong_consistency": 0.0041066003032028675
+  },
+  {
+    "step": 275,
+    "loss": 0.007873227819800377,
+    "drift": 0.0020340988412499428,
+    "small_step": 3.482909232843667e-05,
+    "strong_consistency": 0.0058042993769049644
+  },
+  {
+    "step": 276,
+    "loss": 0.007949773222208023,
+    "drift": 0.0020699133165180683,
+    "small_step": 2.6727790100267157e-05,
+    "strong_consistency": 0.005853131879121065
+  },
+  {
+    "step": 277,
+    "loss": 0.0053007109090685844,
+    "drift": 0.001857903553172946,
+    "small_step": 2.4201701307902113e-05,
+    "strong_consistency": 0.0034186055418103933
+  },
+  {
+    "step": 278,
+    "loss": 0.004821125417947769,
+    "drift": 0.0013281934661790729,
+    "small_step": 1.861000964709092e-05,
+    "strong_consistency": 0.0034743219148367643
+  },
+  {
+    "step": 279,
+    "loss": 0.00485828286036849,
+    "drift": 0.0013199734967201948,
+    "small_step": 2.239757486677263e-05,
+    "strong_consistency": 0.003515911754220724
+  },
+  {
+    "step": 280,
+    "loss": 0.004626336041837931,
+    "drift": 0.0015780471730977297,
+    "small_step": 2.46971922024386e-05,
+    "strong_consistency": 0.0030235915910452604
+  },
+  {
+    "step": 281,
+    "loss": 0.004212037660181522,
+    "drift": 0.0017757199238985777,
+    "small_step": 1.857079223555047e-05,
+    "strong_consistency": 0.002417747164145112
+  },
+  {
+    "step": 282,
+    "loss": 0.0053464993834495544,
+    "drift": 0.001866686623543501,
+    "small_step": 2.7015292289434e-05,
+    "strong_consistency": 0.0034527971874922514
+  },
+  {
+    "step": 283,
+    "loss": 0.01019214279949665,
+    "drift": 0.002728080376982689,
+    "small_step": 3.491520692477934e-05,
+    "strong_consistency": 0.007429147604852915
+  },
+  {
+    "step": 284,
+    "loss": 0.004954291507601738,
+    "drift": 0.0014974299119785428,
+    "small_step": 2.0867944840574637e-05,
+    "strong_consistency": 0.003435993567109108
+  },
+  {
+    "step": 285,
+    "loss": 0.005623925477266312,
+    "drift": 0.0013533419696614146,
+    "small_step": 2.5402265237062238e-05,
+    "strong_consistency": 0.004245181102305651
+  },
+  {
+    "step": 286,
+    "loss": 0.010303621180355549,
+    "drift": 0.0014350999845191836,
+    "small_step": 2.4082874006126076e-05,
+    "strong_consistency": 0.008844438008964062
+  },
+  {
+    "step": 287,
+    "loss": 0.003988897427916527,
+    "drift": 0.0011864856351166964,
+    "small_step": 1.7071180991479196e-05,
+    "strong_consistency": 0.0027853408828377724
+  },
+  {
+    "step": 288,
+    "loss": 0.006448633968830109,
+    "drift": 0.0016425390494987369,
+    "small_step": 3.6790275771636516e-05,
+    "strong_consistency": 0.004769304767251015
+  },
+  {
+    "step": 289,
+    "loss": 0.004429940599948168,
+    "drift": 0.001443994464352727,
+    "small_step": 2.8930711778230034e-05,
+    "strong_consistency": 0.002957015298306942
+  },
+  {
+    "step": 290,
+    "loss": 0.003313321154564619,
+    "drift": 0.0009476280538365245,
+    "small_step": 2.5558725610608235e-05,
+    "strong_consistency": 0.0023401344660669565
+  },
+  {
+    "step": 291,
+    "loss": 0.003128943033516407,
+    "drift": 0.0010515113826841116,
+    "small_step": 2.1351948817027733e-05,
+    "strong_consistency": 0.0020560796838253736
+  },
+  {
+    "step": 292,
+    "loss": 0.004094763658940792,
+    "drift": 0.0011001938255503774,
+    "small_step": 2.8368396669975482e-05,
+    "strong_consistency": 0.0029662013985216618
+  },
+  {
+    "step": 293,
+    "loss": 0.004720724653452635,
+    "drift": 0.0018228606786578894,
+    "small_step": 2.6096056899405085e-05,
+    "strong_consistency": 0.0028717678505927324
+  },
+  {
+    "step": 294,
+    "loss": 0.0026222052983939648,
+    "drift": 0.0009895983384922147,
+    "small_step": 2.3016353225102648e-05,
+    "strong_consistency": 0.0016095904866233468
+  },
+  {
+    "step": 295,
+    "loss": 0.0038528090808540583,
+    "drift": 0.0006256564520299435,
+    "small_step": 1.9351951777935028e-05,
+    "strong_consistency": 0.0032078006770461798
+  },
+  {
+    "step": 296,
+    "loss": 0.0034839194267988205,
+    "drift": 0.000945831707213074,
+    "small_step": 3.5365039366297424e-05,
+    "strong_consistency": 0.002502722665667534
+  },
+  {
+    "step": 297,
+    "loss": 0.00334946415387094,
+    "drift": 0.0010000995825976133,
+    "small_step": 1.9405453713261522e-05,
+    "strong_consistency": 0.0023299590684473515
+  },
+  {
+    "step": 298,
+    "loss": 0.004295226186513901,
+    "drift": 0.0010228228056803346,
+    "small_step": 2.101915015373379e-05,
+    "strong_consistency": 0.0032513842452317476
+  },
+  {
+    "step": 299,
+    "loss": 0.003126147435978055,
+    "drift": 0.0005666686338372529,
+    "small_step": 1.2414500815793872e-05,
+    "strong_consistency": 0.0025470643304288387
+  },
+  {
+    "step": 300,
+    "loss": 0.0046203709207475185,
+    "drift": 0.0010109767317771912,
+    "small_step": 2.9521152100642212e-05,
+    "strong_consistency": 0.0035798728931695223
+  },
+  {
+    "step": 301,
+    "loss": 0.0027062129229307175,
+    "drift": 0.0004810391692444682,
+    "small_step": 1.024029916152358e-05,
+    "strong_consistency": 0.0022149335127323866
+  },
+  {
+    "step": 302,
+    "loss": 0.003717352170497179,
+    "drift": 0.0007031037821434438,
+    "small_step": 2.0065546777914278e-05,
+    "strong_consistency": 0.002994182985275984
+  },
+  {
+    "step": 303,
+    "loss": 0.004323621280491352,
+    "drift": 0.0007959767244756222,
+    "small_step": 2.8342870791675523e-05,
+    "strong_consistency": 0.003499301616102457
+  },
+  {
+    "step": 304,
+    "loss": 0.003908531274646521,
+    "drift": 0.0009578607277944684,
+    "small_step": 2.0311737898737192e-05,
+    "strong_consistency": 0.002930358750745654
+  },
+  {
+    "step": 305,
+    "loss": 0.0036328863352537155,
+    "drift": 0.0007635778747498989,
+    "small_step": 2.0279789168853313e-05,
+    "strong_consistency": 0.002849028678610921
+  },
+  {
+    "step": 306,
+    "loss": 0.00417160801589489,
+    "drift": 0.0007738657295703888,
+    "small_step": 3.018559073098004e-05,
+    "strong_consistency": 0.003367556491866708
+  },
+  {
+    "step": 307,
+    "loss": 0.002195171546190977,
+    "drift": 0.0007663795258849859,
+    "small_step": 2.3163916921475902e-05,
+    "strong_consistency": 0.001405628165230155
+  },
+  {
+    "step": 308,
+    "loss": 0.0029119551181793213,
+    "drift": 0.0007838814053684473,
+    "small_step": 1.7122078133979812e-05,
+    "strong_consistency": 0.002110951580107212
+  },
+  {
+    "step": 309,
+    "loss": 0.0021871859207749367,
+    "drift": 0.0009026174666360021,
+    "small_step": 2.3931293981149793e-05,
+    "strong_consistency": 0.0012606370728462934
+  },
+  {
+    "step": 310,
+    "loss": 0.006998724304139614,
+    "drift": 0.001037311158142984,
+    "small_step": 1.974212864297442e-05,
+    "strong_consistency": 0.0059416708536446095
+  },
+  {
+    "step": 311,
+    "loss": 0.003095931140705943,
+    "drift": 0.0011341603239998221,
+    "small_step": 2.386673804721795e-05,
+    "strong_consistency": 0.0019379040459170938
+  },
+  {
+    "step": 312,
+    "loss": 0.002988206222653389,
+    "drift": 0.0011000251397490501,
+    "small_step": 2.6533212803769857e-05,
+    "strong_consistency": 0.0018616478191688657
+  },
+  {
+    "step": 313,
+    "loss": 0.004681281745433807,
+    "drift": 0.0008914279169403017,
+    "small_step": 1.4821053810010199e-05,
+    "strong_consistency": 0.003775032702833414
+  },
+  {
+    "step": 314,
+    "loss": 0.0036477893590927124,
+    "drift": 0.0008242774056270719,
+    "small_step": 2.0402692825882696e-05,
+    "strong_consistency": 0.0028031093534082174
+  },
+  {
+    "step": 315,
+    "loss": 0.0028387210331857204,
+    "drift": 0.001291428110562265,
+    "small_step": 3.352505518705584e-05,
+    "strong_consistency": 0.0015137679874897003
+  },
+  {
+    "step": 316,
+    "loss": 0.004225717857480049,
+    "drift": 0.001104827388189733,
+    "small_step": 1.8455524696037173e-05,
+    "strong_consistency": 0.0031024350319057703
+  },
+  {
+    "step": 317,
+    "loss": 0.00360634783282876,
+    "drift": 0.0013834531418979168,
+    "small_step": 1.9348774003447033e-05,
+    "strong_consistency": 0.002203545765951276
+  },
+  {
+    "step": 318,
+    "loss": 0.0044579338282346725,
+    "drift": 0.0016793226823210716,
+    "small_step": 3.344956348882988e-05,
+    "strong_consistency": 0.002745161298662424
+  },
+  {
+    "step": 319,
+    "loss": 0.002714932896196842,
+    "drift": 0.0009242078522220254,
+    "small_step": 1.97771041712258e-05,
+    "strong_consistency": 0.0017709480598568916
+  },
+  {
+    "step": 320,
+    "loss": 0.006969981826841831,
+    "drift": 0.0013226036680862308,
+    "small_step": 2.943031176982913e-05,
+    "strong_consistency": 0.005617947783321142
+  },
+  {
+    "step": 321,
+    "loss": 0.0032721052411943674,
+    "drift": 0.0010707597248256207,
+    "small_step": 2.101857535308227e-05,
+    "strong_consistency": 0.0021803269628435373
+  },
+  {
+    "step": 322,
+    "loss": 0.003163723973557353,
+    "drift": 0.0012414183001965284,
+    "small_step": 2.281379056512378e-05,
+    "strong_consistency": 0.001899491879157722
+  },
+  {
+    "step": 323,
+    "loss": 0.004798514302819967,
+    "drift": 0.0009364907746203244,
+    "small_step": 2.066256638499908e-05,
+    "strong_consistency": 0.003841361030936241
+  },
+  {
+    "step": 324,
+    "loss": 0.005028219893574715,
+    "drift": 0.001340178307145834,
+    "small_step": 2.2186513888300397e-05,
+    "strong_consistency": 0.0036658551543951035
+  },
+  {
+    "step": 325,
+    "loss": 0.002363765612244606,
+    "drift": 0.0007840465987101197,
+    "small_step": 1.5692319720983505e-05,
+    "strong_consistency": 0.0015640268102288246
+  },
+  {
+    "step": 326,
+    "loss": 0.0017536487430334091,
+    "drift": 0.000525756913702935,
+    "small_step": 1.8267113773617893e-05,
+    "strong_consistency": 0.0012096246937289834
+  },
+  {
+    "step": 327,
+    "loss": 0.0023698224686086178,
+    "drift": 0.0008583415765315294,
+    "small_step": 2.034409590123687e-05,
+    "strong_consistency": 0.0014911367325112224
+  },
+  {
+    "step": 328,
+    "loss": 0.003975763916969299,
+    "drift": 0.0006656107725575566,
+    "small_step": 2.7440793928690255e-05,
+    "strong_consistency": 0.0032827123068273067
+  },
+  {
+    "step": 329,
+    "loss": 0.003655692096799612,
+    "drift": 0.0007060352945700288,
+    "small_step": 1.7208622011821717e-05,
+    "strong_consistency": 0.002932448172941804
+  },
+  {
+    "step": 330,
+    "loss": 0.005305421072989702,
+    "drift": 0.0006239840877242386,
+    "small_step": 1.4694855053676292e-05,
+    "strong_consistency": 0.0046667419373989105
+  },
+  {
+    "step": 331,
+    "loss": 0.003033797722309828,
+    "drift": 0.0006628650007769465,
+    "small_step": 1.8287673810846172e-05,
+    "strong_consistency": 0.0023526449222117662
+  },
+  {
+    "step": 332,
+    "loss": 0.002123102080076933,
+    "drift": 0.0003532037080731243,
+    "small_step": 1.2063403119100258e-05,
+    "strong_consistency": 0.0017578350380063057
+  },
+  {
+    "step": 333,
+    "loss": 0.002023958135396242,
+    "drift": 0.0008792612352408469,
+    "small_step": 1.976215935428627e-05,
+    "strong_consistency": 0.0011249346425756812
+  },
+  {
+    "step": 334,
+    "loss": 0.0027978080324828625,
+    "drift": 0.001038725022226572,
+    "small_step": 2.6534160497249104e-05,
+    "strong_consistency": 0.0017325488151982427
+  },
+  {
+    "step": 335,
+    "loss": 0.004987657070159912,
+    "drift": 0.0013187313452363014,
+    "small_step": 3.352322892169468e-05,
+    "strong_consistency": 0.003635402536019683
+  },
+  {
+    "step": 336,
+    "loss": 0.004717198200523853,
+    "drift": 0.0014715427532792091,
+    "small_step": 3.493838448775932e-05,
+    "strong_consistency": 0.0032107168808579445
+  },
+  {
+    "step": 337,
+    "loss": 0.0020139405969530344,
+    "drift": 0.0011910534230992198,
+    "small_step": 2.3204345779959112e-05,
+    "strong_consistency": 0.0007996827480383217
+  },
+  {
+    "step": 338,
+    "loss": 0.003510894253849983,
+    "drift": 0.0009551631519570947,
+    "small_step": 2.2494747099699453e-05,
+    "strong_consistency": 0.0025332362856715918
+  },
+  {
+    "step": 339,
+    "loss": 0.002547026611864567,
+    "drift": 0.0009671931620687246,
+    "small_step": 3.09118622681126e-05,
+    "strong_consistency": 0.0015489215729758143
+  },
+  {
+    "step": 340,
+    "loss": 0.0021126079373061657,
+    "drift": 0.0009897657437250018,
+    "small_step": 1.8968865333590657e-05,
+    "strong_consistency": 0.0011038733646273613
+  },
+  {
+    "step": 341,
+    "loss": 0.0034372899681329727,
+    "drift": 0.0006497567519545555,
+    "small_step": 1.6916421373025514e-05,
+    "strong_consistency": 0.0027706169057637453
+  },
+  {
+    "step": 342,
+    "loss": 0.002906947396695614,
+    "drift": 0.0009044500766322017,
+    "small_step": 2.508304351067636e-05,
+    "strong_consistency": 0.001977414358407259
+  },
+  {
+    "step": 343,
+    "loss": 0.0019685537554323673,
+    "drift": 0.0006397404940798879,
+    "small_step": 1.5415515008498915e-05,
+    "strong_consistency": 0.0013133977772668004
+  },
+  {
+    "step": 344,
+    "loss": 0.001486714230850339,
+    "drift": 0.0007321466691792011,
+    "small_step": 2.4310968001373112e-05,
+    "strong_consistency": 0.000730256550014019
+  },
+  {
+    "step": 345,
+    "loss": 0.0032424628734588623,
+    "drift": 0.0005053818458691239,
+    "small_step": 1.7220620065927505e-05,
+    "strong_consistency": 0.002719860291108489
+  },
+  {
+    "step": 346,
+    "loss": 0.0019975192844867706,
+    "drift": 0.0006699648220092058,
+    "small_step": 1.657078246353194e-05,
+    "strong_consistency": 0.0013109836727380753
+  },
+  {
+    "step": 347,
+    "loss": 0.002600516192615032,
+    "drift": 0.0008196078706532717,
+    "small_step": 3.8003374356776476e-05,
+    "strong_consistency": 0.001742905005812645
+  },
+  {
+    "step": 348,
+    "loss": 0.001868023187853396,
+    "drift": 0.0004975372576154768,
+    "small_step": 2.6377787435194477e-05,
+    "strong_consistency": 0.0013441081391647458
+  },
+  {
+    "step": 349,
+    "loss": 0.0020717112347483635,
+    "drift": 0.0005744528607465327,
+    "small_step": 2.263539317937102e-05,
+    "strong_consistency": 0.001474622986279428
+  },
+  {
+    "step": 350,
+    "loss": 0.003135999431833625,
+    "drift": 0.0005744778318330646,
+    "small_step": 1.6212763512157835e-05,
+    "strong_consistency": 0.0025453087873756886
+  },
+  {
+    "step": 351,
+    "loss": 0.0024168966338038445,
+    "drift": 0.0006377309910021722,
+    "small_step": 2.470710751367733e-05,
+    "strong_consistency": 0.0017544584115967155
+  },
+  {
+    "step": 352,
+    "loss": 0.002893403172492981,
+    "drift": 0.0007444630609825253,
+    "small_step": 1.6405405403929763e-05,
+    "strong_consistency": 0.002132534747943282
+  },
+  {
+    "step": 353,
+    "loss": 0.0027785454876720905,
+    "drift": 0.0010335086844861507,
+    "small_step": 2.3744136342429556e-05,
+    "strong_consistency": 0.0017212927341461182
+  },
+  {
+    "step": 354,
+    "loss": 0.002527823206037283,
+    "drift": 0.000863460882101208,
+    "small_step": 2.1712032321374863e-05,
+    "strong_consistency": 0.0016426503425464034
+  },
+  {
+    "step": 355,
+    "loss": 0.002386245643720031,
+    "drift": 0.0006217497866600752,
+    "small_step": 2.566812327131629e-05,
+    "strong_consistency": 0.0017388277919963002
+  },
+  {
+    "step": 356,
+    "loss": 0.0025279847905039787,
+    "drift": 0.0007351001841016114,
+    "small_step": 3.071289029321633e-05,
+    "strong_consistency": 0.0017621717415750027
+  },
+  {
+    "step": 357,
+    "loss": 0.0032972898334264755,
+    "drift": 0.00040890014497563243,
+    "small_step": 2.7808961021946743e-05,
+    "strong_consistency": 0.0028605808038264513
+  },
+  {
+    "step": 358,
+    "loss": 0.0036344139371067286,
+    "drift": 0.0005826543783769011,
+    "small_step": 1.7308962924289517e-05,
+    "strong_consistency": 0.0030344505794346333
+  },
+  {
+    "step": 359,
+    "loss": 0.002747427439317107,
+    "drift": 0.0004589612944982946,
+    "small_step": 1.6048330508056097e-05,
+    "strong_consistency": 0.0022724177688360214
+  },
+  {
+    "step": 360,
+    "loss": 0.004242859780788422,
+    "drift": 0.0006289492012001574,
+    "small_step": 1.5053790775709786e-05,
+    "strong_consistency": 0.003598856972530484
+  },
+  {
+    "step": 361,
+    "loss": 0.0020405317191034555,
+    "drift": 0.0008431547903455794,
+    "small_step": 2.481669253029395e-05,
+    "strong_consistency": 0.0011725601507350802
+  },
+  {
+    "step": 362,
+    "loss": 0.0017073708586394787,
+    "drift": 0.0007587007712572813,
+    "small_step": 1.799205710995011e-05,
+    "strong_consistency": 0.0009306779829785228
+  },
+  {
+    "step": 363,
+    "loss": 0.0031336729880422354,
+    "drift": 0.0008222362375818193,
+    "small_step": 3.3662974601611495e-05,
+    "strong_consistency": 0.002277773804962635
+  },
+  {
+    "step": 364,
+    "loss": 0.001945469994097948,
+    "drift": 0.000630860507953912,
+    "small_step": 1.803975465008989e-05,
+    "strong_consistency": 0.0012965697096660733
+  },
+  {
+    "step": 365,
+    "loss": 0.0013230238109827042,
+    "drift": 0.0007292445516213775,
+    "small_step": 1.3809758456773125e-05,
+    "strong_consistency": 0.0005799694918096066
+  },
+  {
+    "step": 366,
+    "loss": 0.0013336518313735723,
+    "drift": 0.0006477106944657862,
+    "small_step": 2.098177901643794e-05,
+    "strong_consistency": 0.0006649593124166131
+  },
+  {
+    "step": 367,
+    "loss": 0.002682935446500778,
+    "drift": 0.0009620098280720413,
+    "small_step": 3.471584204817191e-05,
+    "strong_consistency": 0.001686209812760353
+  },
+  {
+    "step": 368,
+    "loss": 0.0018423742149025202,
+    "drift": 0.0008899843087419868,
+    "small_step": 2.0854147805948742e-05,
+    "strong_consistency": 0.0009315357310697436
+  },
+  {
+    "step": 369,
+    "loss": 0.0030414576176553965,
+    "drift": 0.0013916818425059319,
+    "small_step": 2.153444438590668e-05,
+    "strong_consistency": 0.00162824138533324
+  },
+  {
+    "step": 370,
+    "loss": 0.002713418798521161,
+    "drift": 0.0008849888108670712,
+    "small_step": 1.7535461665829644e-05,
+    "strong_consistency": 0.0018108944641426206
+  },
+  {
+    "step": 371,
+    "loss": 0.0020491774193942547,
+    "drift": 0.0007235252414830029,
+    "small_step": 1.952400998561643e-05,
+    "strong_consistency": 0.0013061281060799956
+  },
+  {
+    "step": 372,
+    "loss": 0.0023716920986771584,
+    "drift": 0.0009192682919092476,
+    "small_step": 3.447214839980006e-05,
+    "strong_consistency": 0.0014179515419527888
+  },
+  {
+    "step": 373,
+    "loss": 0.0015495368279516697,
+    "drift": 0.0008357404731214046,
+    "small_step": 2.486128141754307e-05,
+    "strong_consistency": 0.0006889350479468703
+  },
+  {
+    "step": 374,
+    "loss": 0.0014767860993742943,
+    "drift": 0.0005167303024791181,
+    "small_step": 2.5654571800259873e-05,
+    "strong_consistency": 0.0009344012942165136
+  },
+  {
+    "step": 375,
+    "loss": 0.0014778287149965763,
+    "drift": 0.0006659603677690029,
+    "small_step": 1.8600603652885184e-05,
+    "strong_consistency": 0.0007932677399367094
+  },
+  {
+    "step": 376,
+    "loss": 0.0019212723709642887,
+    "drift": 0.0004519944195635617,
+    "small_step": 2.644872074597515e-05,
+    "strong_consistency": 0.0014428292633965611
+  },
+  {
+    "step": 377,
+    "loss": 0.00206799921579659,
+    "drift": 0.0005552106304094195,
+    "small_step": 2.8302361897658557e-05,
+    "strong_consistency": 0.001484486274421215
+  },
+  {
+    "step": 378,
+    "loss": 0.0019348154310137033,
+    "drift": 0.00036896171513944864,
+    "small_step": 1.779415106284432e-05,
+    "strong_consistency": 0.0015480596339330077
+  },
+  {
+    "step": 379,
+    "loss": 0.001340212533250451,
+    "drift": 0.0005590453511103988,
+    "small_step": 1.881566277006641e-05,
+    "strong_consistency": 0.000762351555749774
+  },
+  {
+    "step": 380,
+    "loss": 0.0023562556598335505,
+    "drift": 0.0003618210321292281,
+    "small_step": 1.8882954464061186e-05,
+    "strong_consistency": 0.001975551713258028
+  },
+  {
+    "step": 381,
+    "loss": 0.0017315001459792256,
+    "drift": 0.0002527113538235426,
+    "small_step": 1.4491968613583595e-05,
+    "strong_consistency": 0.001464296830818057
+  },
+  {
+    "step": 382,
+    "loss": 0.0011966053862124681,
+    "drift": 0.0001975010964088142,
+    "small_step": 2.6349673134973273e-05,
+    "strong_consistency": 0.0009727546130307019
+  },
+  {
+    "step": 383,
+    "loss": 0.0029902521055191755,
+    "drift": 0.00039643014315515757,
+    "small_step": 1.593046181369573e-05,
+    "strong_consistency": 0.0025778915733098984
+  },
+  {
+    "step": 384,
+    "loss": 0.0020477836951613426,
+    "drift": 0.000694013200700283,
+    "small_step": 3.0447599783656187e-05,
+    "strong_consistency": 0.0013233227655291557
+  },
+  {
+    "step": 385,
+    "loss": 0.0013196952641010284,
+    "drift": 0.00042767872218973935,
+    "small_step": 1.5965400962159038e-05,
+    "strong_consistency": 0.0008760511409491301
+  },
+  {
+    "step": 386,
+    "loss": 0.0016658802051097155,
+    "drift": 0.0004152065666858107,
+    "small_step": 2.2041871488909237e-05,
+    "strong_consistency": 0.001228631823323667
+  },
+  {
+    "step": 387,
+    "loss": 0.0012946666684001684,
+    "drift": 0.0002932979550678283,
+    "small_step": 2.4484175810357556e-05,
+    "strong_consistency": 0.0009768845047801733
+  },
+  {
+    "step": 388,
+    "loss": 0.0019655374344438314,
+    "drift": 0.0006005539325997233,
+    "small_step": 1.7976417439058423e-05,
+    "strong_consistency": 0.0013470071135088801
+  },
+  {
+    "step": 389,
+    "loss": 0.0021576436702162027,
+    "drift": 0.00048544505261816084,
+    "small_step": 1.8582617485662922e-05,
+    "strong_consistency": 0.0016536160837858915
+  },
+  {
+    "step": 390,
+    "loss": 0.0012834109365940094,
+    "drift": 0.0003599491319619119,
+    "small_step": 1.4645464943896513e-05,
+    "strong_consistency": 0.0009088163496926427
+  },
+  {
+    "step": 391,
+    "loss": 0.0016014960128813982,
+    "drift": 0.0007048414554446936,
+    "small_step": 1.5438772607012652e-05,
+    "strong_consistency": 0.0008812157320789993
+  },
+  {
+    "step": 392,
+    "loss": 0.0012258216738700867,
+    "drift": 0.0004863461363129318,
+    "small_step": 1.744168548611924e-05,
+    "strong_consistency": 0.000722033844795078
+  },
+  {
+    "step": 393,
+    "loss": 0.0016637638909742236,
+    "drift": 0.001025287783704698,
+    "small_step": 2.6342251658206806e-05,
+    "strong_consistency": 0.0006121338810771704
+  },
+  {
+    "step": 394,
+    "loss": 0.0016825520433485508,
+    "drift": 0.000795600120909512,
+    "small_step": 2.3416929252562113e-05,
+    "strong_consistency": 0.0008635349804535508
+  },
+  {
+    "step": 395,
+    "loss": 0.0018958381842821836,
+    "drift": 0.0013274261727929115,
+    "small_step": 1.909870479721576e-05,
+    "strong_consistency": 0.0005493133212439716
+  },
+  {
+    "step": 396,
+    "loss": 0.0018860518466681242,
+    "drift": 0.0005196862621232867,
+    "small_step": 1.591918771737255e-05,
+    "strong_consistency": 0.0013504463713616133
+  },
+  {
+    "step": 397,
+    "loss": 0.0013273762306198478,
+    "drift": 0.0004085412947461009,
+    "small_step": 2.3942349798744544e-05,
+    "strong_consistency": 0.000894892611540854
+  },
+  {
+    "step": 398,
+    "loss": 0.0011375301983207464,
+    "drift": 0.0004484569071792066,
+    "small_step": 2.445079735480249e-05,
+    "strong_consistency": 0.0006646225228905678
+  },
+  {
+    "step": 399,
+    "loss": 0.0016062816139310598,
+    "drift": 0.000358506222255528,
+    "small_step": 2.1857742467545904e-05,
+    "strong_consistency": 0.001225917600095272
+  },
+  {
+    "step": 400,
+    "loss": 0.0013396544381976128,
+    "drift": 0.00037275932845659554,
+    "small_step": 1.6020936527638696e-05,
+    "strong_consistency": 0.0009508741786703467
+  },
+  {
+    "step": 401,
+    "loss": 0.0011884671403095126,
+    "drift": 0.00039652231498621404,
+    "small_step": 1.8109281882061623e-05,
+    "strong_consistency": 0.0007738355197943747
+  },
+  {
+    "step": 402,
+    "loss": 0.0024453054647892714,
+    "drift": 0.00040255149360746145,
+    "small_step": 2.269800279464107e-05,
+    "strong_consistency": 0.0020200558938086033
+  },
+  {
+    "step": 403,
+    "loss": 0.001233491231687367,
+    "drift": 0.0001899695344036445,
+    "small_step": 1.5309362424886785e-05,
+    "strong_consistency": 0.0010282123694196343
+  },
+  {
+    "step": 404,
+    "loss": 0.0018587848171591759,
+    "drift": 0.00017228038632310927,
+    "small_step": 1.8042435840470716e-05,
+    "strong_consistency": 0.0016684619477018714
+  },
+  {
+    "step": 405,
+    "loss": 0.0011540588457137346,
+    "drift": 0.00018902166630141437,
+    "small_step": 1.2988876733288635e-05,
+    "strong_consistency": 0.0009520483436062932
+  },
+  {
+    "step": 406,
+    "loss": 0.0009457397973164916,
+    "drift": 0.00022570829605683684,
+    "small_step": 1.67989401234081e-05,
+    "strong_consistency": 0.0007032325956970453
+  },
+  {
+    "step": 407,
+    "loss": 0.0009450644720345736,
+    "drift": 0.00024264262174256146,
+    "small_step": 1.451646130590234e-05,
+    "strong_consistency": 0.000687905412632972
+  },
+  {
+    "step": 408,
+    "loss": 0.0011873270850628614,
+    "drift": 0.0005495506338775158,
+    "small_step": 2.237376793345902e-05,
+    "strong_consistency": 0.000615402648691088
+  },
+  {
+    "step": 409,
+    "loss": 0.0014231466921046376,
+    "drift": 0.00028647531871683896,
+    "small_step": 2.0954879801138304e-05,
+    "strong_consistency": 0.001115716528147459
+  },
+  {
+    "step": 410,
+    "loss": 0.0016979648498818278,
+    "drift": 0.0004058265476487577,
+    "small_step": 1.7968770407605916e-05,
+    "strong_consistency": 0.0012741695391014218
+  },
+  {
+    "step": 411,
+    "loss": 0.001284168683923781,
+    "drift": 0.0004646119487006217,
+    "small_step": 2.228299854323268e-05,
+    "strong_consistency": 0.000797273765783757
+  },
+  {
+    "step": 412,
+    "loss": 0.001524690305814147,
+    "drift": 0.00021500502771232277,
+    "small_step": 2.0009680156363174e-05,
+    "strong_consistency": 0.0012896755943074822
+  },
+  {
+    "step": 413,
+    "loss": 0.0013905083760619164,
+    "drift": 0.0005723024951294065,
+    "small_step": 2.000296262849588e-05,
+    "strong_consistency": 0.0007982029346749187
+  },
+  {
+    "step": 414,
+    "loss": 0.001315114088356495,
+    "drift": 0.0005250258836895227,
+    "small_step": 1.9728560801013373e-05,
+    "strong_consistency": 0.0007703597075305879
+  },
+  {
+    "step": 415,
+    "loss": 0.0012782674748450518,
+    "drift": 0.00030193515704013407,
+    "small_step": 2.1087656932650134e-05,
+    "strong_consistency": 0.0009552447008900344
+  },
+  {
+    "step": 416,
+    "loss": 0.0016244188882410526,
+    "drift": 0.00036011566407978535,
+    "small_step": 1.9004342902917415e-05,
+    "strong_consistency": 0.0012452988885343075
+  },
+  {
+    "step": 417,
+    "loss": 0.0015859052073210478,
+    "drift": 0.000760783557780087,
+    "small_step": 1.8489905414753594e-05,
+    "strong_consistency": 0.0008066318114288151
+  },
+  {
+    "step": 418,
+    "loss": 0.002253240207210183,
+    "drift": 0.00041708126082085073,
+    "small_step": 2.0098499589948915e-05,
+    "strong_consistency": 0.0018160603940486908
+  },
+  {
+    "step": 419,
+    "loss": 0.0009273119503632188,
+    "drift": 0.0004350034287199378,
+    "small_step": 1.4400055079022422e-05,
+    "strong_consistency": 0.00047790847020223737
+  },
+  {
+    "step": 420,
+    "loss": 0.0014763895887881517,
+    "drift": 0.00030442315619438887,
+    "small_step": 2.0938658053637482e-05,
+    "strong_consistency": 0.0011510277399793267
+  },
+  {
+    "step": 421,
+    "loss": 0.0009794451761990786,
+    "drift": 0.00030323927057906985,
+    "small_step": 2.4815664801280946e-05,
+    "strong_consistency": 0.0006513902335427701
+  },
+  {
+    "step": 422,
+    "loss": 0.0011919421376660466,
+    "drift": 0.00039977816049940884,
+    "small_step": 2.5861896574497223e-05,
+    "strong_consistency": 0.000766302109695971
+  },
+  {
+    "step": 423,
+    "loss": 0.0011792023433372378,
+    "drift": 0.00038182458956725895,
+    "small_step": 2.0184890672680922e-05,
+    "strong_consistency": 0.0007771928212605417
+  },
+  {
+    "step": 424,
+    "loss": 0.0011940584518015385,
+    "drift": 0.00043176920735277236,
+    "small_step": 3.48953326465562e-05,
+    "strong_consistency": 0.0007273938972502947
+  },
+  {
+    "step": 425,
+    "loss": 0.0007892432622611523,
+    "drift": 0.0004890286363661289,
+    "small_step": 1.631725172046572e-05,
+    "strong_consistency": 0.0002838974178303033
+  },
+  {
+    "step": 426,
+    "loss": 0.0022073325235396624,
+    "drift": 0.0004241315764375031,
+    "small_step": 2.4568726075813174e-05,
+    "strong_consistency": 0.0017586322501301765
+  },
+  {
+    "step": 427,
+    "loss": 0.0010530096478760242,
+    "drift": 0.0003902086173184216,
+    "small_step": 2.7323407266521826e-05,
+    "strong_consistency": 0.0006354775978252292
+  },
+  {
+    "step": 428,
+    "loss": 0.0025219544768333435,
+    "drift": 0.0009284671396017075,
+    "small_step": 2.9532588087022305e-05,
+    "strong_consistency": 0.001563954632729292
+  },
+  {
+    "step": 429,
+    "loss": 0.0008517220849171281,
+    "drift": 0.0003036976559087634,
+    "small_step": 2.0102110283914953e-05,
+    "strong_consistency": 0.0005279223551042378
+  },
+  {
+    "step": 430,
+    "loss": 0.0010586024727672338,
+    "drift": 0.00021673821902368218,
+    "small_step": 1.9170111045241356e-05,
+    "strong_consistency": 0.0008226941572502255
+  },
+  {
+    "step": 431,
+    "loss": 0.0015817355597391725,
+    "drift": 0.0003041075833607465,
+    "small_step": 2.133240195689723e-05,
+    "strong_consistency": 0.0012562955962494016
+  },
+  {
+    "step": 432,
+    "loss": 0.001228331122547388,
+    "drift": 0.00030181926558725536,
+    "small_step": 1.3960556316305883e-05,
+    "strong_consistency": 0.0009125513606704772
+  },
+  {
+    "step": 433,
+    "loss": 0.0007931076106615365,
+    "drift": 0.00014825248217675835,
+    "small_step": 1.0497203220438678e-05,
+    "strong_consistency": 0.0006343579152598977
+  },
+  {
+    "step": 434,
+    "loss": 0.0015962879406288266,
+    "drift": 0.00047692074440419674,
+    "small_step": 2.1949528672848828e-05,
+    "strong_consistency": 0.0010974176693707705
+  },
+  {
+    "step": 435,
+    "loss": 0.0011958633549511433,
+    "drift": 0.00039063082658685744,
+    "small_step": 2.1442945580929518e-05,
+    "strong_consistency": 0.0007837895536795259
+  },
+  {
+    "step": 436,
+    "loss": 0.001869697356596589,
+    "drift": 0.0005357640911825001,
+    "small_step": 1.298251845582854e-05,
+    "strong_consistency": 0.00132095068693161
+  },
+  {
+    "step": 437,
+    "loss": 0.0007708730408921838,
+    "drift": 0.00030022801365703344,
+    "small_step": 1.3006652807234786e-05,
+    "strong_consistency": 0.0004576384089887142
+  },
+  {
+    "step": 438,
+    "loss": 0.0008243882330134511,
+    "drift": 0.00030352978501468897,
+    "small_step": 1.526810410723556e-05,
+    "strong_consistency": 0.000505590345710516
+  },
+  {
+    "step": 439,
+    "loss": 0.0010726058389991522,
+    "drift": 0.0003175164747517556,
+    "small_step": 1.6877795133041218e-05,
+    "strong_consistency": 0.000738211558200419
+  },
+  {
+    "step": 440,
+    "loss": 0.0011321842903271317,
+    "drift": 0.0003208422858733684,
+    "small_step": 2.1183099306654185e-05,
+    "strong_consistency": 0.000790158926974982
+  },
+  {
+    "step": 441,
+    "loss": 0.0016607081051915884,
+    "drift": 0.00033944196184165776,
+    "small_step": 1.575625174154993e-05,
+    "strong_consistency": 0.0013055098243057728
+  },
+  {
+    "step": 442,
+    "loss": 0.0010037868050858378,
+    "drift": 0.00038528861477971077,
+    "small_step": 2.437340845062863e-05,
+    "strong_consistency": 0.000594124780036509
+  },
+  {
+    "step": 443,
+    "loss": 0.0007980387890711427,
+    "drift": 0.0002699389006011188,
+    "small_step": 1.6799116565380245e-05,
+    "strong_consistency": 0.0005113007500767708
+  },
+  {
+    "step": 444,
+    "loss": 0.000927204149775207,
+    "drift": 0.00024265822139568627,
+    "small_step": 2.492433850420639e-05,
+    "strong_consistency": 0.0006596215534955263
+  },
+  {
+    "step": 445,
+    "loss": 0.0010849210666492581,
+    "drift": 0.00037380895810201764,
+    "small_step": 1.6275875168503262e-05,
+    "strong_consistency": 0.0006948362570255995
+  },
+  {
+    "step": 446,
+    "loss": 0.0007728039054200053,
+    "drift": 0.00019827467622235417,
+    "small_step": 1.7858757928479463e-05,
+    "strong_consistency": 0.0005566704785451293
+  },
+  {
+    "step": 447,
+    "loss": 0.0008697770535945892,
+    "drift": 0.00024230338749475777,
+    "small_step": 2.441736614855472e-05,
+    "strong_consistency": 0.0006030562799423933
+  },
+  {
+    "step": 448,
+    "loss": 0.0007947211852297187,
+    "drift": 0.0002443331468384713,
+    "small_step": 1.1781470675487071e-05,
+    "strong_consistency": 0.0005386065458878875
+  },
+  {
+    "step": 449,
+    "loss": 0.0010442245984449983,
+    "drift": 0.00044632612843997777,
+    "small_step": 1.1990203347522765e-05,
+    "strong_consistency": 0.0005859082448296249
+  },
+  {
+    "step": 450,
+    "loss": 0.0009647204424254596,
+    "drift": 0.0003141407505609095,
+    "small_step": 2.7359747036825866e-05,
+    "strong_consistency": 0.0006232199375517666
+  },
+  {
+    "step": 451,
+    "loss": 0.0007220702827908099,
+    "drift": 0.00020589545601978898,
+    "small_step": 2.2404432456823997e-05,
+    "strong_consistency": 0.0004937704070471227
+  },
+  {
+    "step": 452,
+    "loss": 0.0019834593404084444,
+    "drift": 0.00034829735523089767,
+    "small_step": 2.0612033040379174e-05,
+    "strong_consistency": 0.001614549895748496
+  },
+  {
+    "step": 453,
+    "loss": 0.0010006313677877188,
+    "drift": 0.00033806569990701973,
+    "small_step": 2.426189894322306e-05,
+    "strong_consistency": 0.0006383038125932217
+  },
+  {
+    "step": 454,
+    "loss": 0.001189130125567317,
+    "drift": 0.00037901601172052324,
+    "small_step": 1.8360991816734895e-05,
+    "strong_consistency": 0.0007917530601844192
+  },
+  {
+    "step": 455,
+    "loss": 0.0007340410957112908,
+    "drift": 0.00022936025925446302,
+    "small_step": 2.632382165757008e-05,
+    "strong_consistency": 0.0004783569893334061
+  },
+  {
+    "step": 456,
+    "loss": 0.0006471939850598574,
+    "drift": 0.00015883546438999474,
+    "small_step": 1.7853146346169524e-05,
+    "strong_consistency": 0.00047050538705661893
+  },
+  {
+    "step": 457,
+    "loss": 0.0007122794631868601,
+    "drift": 0.00016456368030048907,
+    "small_step": 2.0663097529904917e-05,
+    "strong_consistency": 0.0005270526744425297
+  },
+  {
+    "step": 458,
+    "loss": 0.0007823813939467072,
+    "drift": 0.00024602629127912223,
+    "small_step": 1.6360954759875312e-05,
+    "strong_consistency": 0.000519994122441858
+  },
+  {
+    "step": 459,
+    "loss": 0.0007156636565923691,
+    "drift": 0.0002648717781994492,
+    "small_step": 1.4221067431208212e-05,
+    "strong_consistency": 0.00043657078640535474
+  },
+  {
+    "step": 460,
+    "loss": 0.0006535151624120772,
+    "drift": 0.0001484771928517148,
+    "small_step": 2.806383781717159e-05,
+    "strong_consistency": 0.0004769741208292544
+  },
+  {
+    "step": 461,
+    "loss": 0.0006748451851308346,
+    "drift": 0.00023910625895950943,
+    "small_step": 1.517638702352997e-05,
+    "strong_consistency": 0.0004205625446047634
+  },
+  {
+    "step": 462,
+    "loss": 0.0006963114719837904,
+    "drift": 0.0001757497084327042,
+    "small_step": 1.796687865862623e-05,
+    "strong_consistency": 0.0005025948630645871
+  },
+  {
+    "step": 463,
+    "loss": 0.0010286825709044933,
+    "drift": 0.0002515314263291657,
+    "small_step": 2.0197527192067355e-05,
+    "strong_consistency": 0.0007569536101073027
+  },
+  {
+    "step": 464,
+    "loss": 0.000816585321445018,
+    "drift": 0.00022425407951232046,
+    "small_step": 2.0786783352377824e-05,
+    "strong_consistency": 0.0005715444567613304
+  },
+  {
+    "step": 465,
+    "loss": 0.0017026565037667751,
+    "drift": 0.0006973757990635931,
+    "small_step": 2.6947096557705663e-05,
+    "strong_consistency": 0.000978333642706275
+  },
+  {
+    "step": 466,
+    "loss": 0.0011462739203125238,
+    "drift": 0.00041718975990079343,
+    "small_step": 1.9849610907840542e-05,
+    "strong_consistency": 0.0007092345040291548
+  },
+  {
+    "step": 467,
+    "loss": 0.000693329144269228,
+    "drift": 0.0002905229921452701,
+    "small_step": 1.5010989955044352e-05,
+    "strong_consistency": 0.00038779518217779696
+  },
+  {
+    "step": 468,
+    "loss": 0.0008806485566310585,
+    "drift": 0.00019248409080319107,
+    "small_step": 2.5040892069227993e-05,
+    "strong_consistency": 0.0006631235592067242
+  },
+  {
+    "step": 469,
+    "loss": 0.0010536472545936704,
+    "drift": 0.00018117082072421908,
+    "small_step": 1.827579762903042e-05,
+    "strong_consistency": 0.0008542006835341454
+  },
+  {
+    "step": 470,
+    "loss": 0.0007307042251341045,
+    "drift": 0.00021756374917458743,
+    "small_step": 1.8131129763787612e-05,
+    "strong_consistency": 0.0004950093571096659
+  },
+  {
+    "step": 471,
+    "loss": 0.0006242934614419937,
+    "drift": 0.0002484802680555731,
+    "small_step": 2.0824385501327924e-05,
+    "strong_consistency": 0.00035498884972184896
+  },
+  {
+    "step": 472,
+    "loss": 0.0005757066537626088,
+    "drift": 0.00013021149788983166,
+    "small_step": 1.339879963779822e-05,
+    "strong_consistency": 0.0004320963635109365
+  },
+  {
+    "step": 473,
+    "loss": 0.0008047637529671192,
+    "drift": 0.00018412074132356793,
+    "small_step": 2.2119838831713423e-05,
+    "strong_consistency": 0.0005985231837257743
+  },
+  {
+    "step": 474,
+    "loss": 0.0006686744745820761,
+    "drift": 0.00032165434095077217,
+    "small_step": 1.5862526197452098e-05,
+    "strong_consistency": 0.0003311576438136399
+  },
+  {
+    "step": 475,
+    "loss": 0.0008331880671903491,
+    "drift": 0.0003476253186818212,
+    "small_step": 1.0831287909240928e-05,
+    "strong_consistency": 0.0004747314960695803
+  },
+  {
+    "step": 476,
+    "loss": 0.0005901243421249092,
+    "drift": 0.00023513702035415918,
+    "small_step": 2.4833701900206506e-05,
+    "strong_consistency": 0.0003301536198705435
+  },
+  {
+    "step": 477,
+    "loss": 0.0013074995949864388,
+    "drift": 0.00021212975843809545,
+    "small_step": 1.615420296730008e-05,
+    "strong_consistency": 0.0010792156681418419
+  },
+  {
+    "step": 478,
+    "loss": 0.0012925546616315842,
+    "drift": 0.00018290428852196783,
+    "small_step": 1.253640675713541e-05,
+    "strong_consistency": 0.001097113941796124
+  },
+  {
+    "step": 479,
+    "loss": 0.0007198950042948127,
+    "drift": 0.00026565510779619217,
+    "small_step": 1.9149820218444802e-05,
+    "strong_consistency": 0.00043509009992703795
+  },
+  {
+    "step": 480,
+    "loss": 0.0007073366432450712,
+    "drift": 0.00020356406457722187,
+    "small_step": 1.619219437998254e-05,
+    "strong_consistency": 0.0004875804006587714
+  },
+  {
+    "step": 481,
+    "loss": 0.0009767881128937006,
+    "drift": 0.0001247538602910936,
+    "small_step": 1.6093550584628247e-05,
+    "strong_consistency": 0.000835940707474947
+  },
+  {
+    "step": 482,
+    "loss": 0.0008427164284512401,
+    "drift": 0.00018056271073874086,
+    "small_step": 1.9812236132565886e-05,
+    "strong_consistency": 0.0006423414452001452
+  },
+  {
+    "step": 483,
+    "loss": 0.00047308619832620025,
+    "drift": 0.0002598732535261661,
+    "small_step": 2.468910133757163e-05,
+    "strong_consistency": 0.00018852384528145194
+  },
+  {
+    "step": 484,
+    "loss": 0.0009133474668487906,
+    "drift": 0.000268085248535499,
+    "small_step": 2.1196325178607367e-05,
+    "strong_consistency": 0.000624065927695483
+  },
+  {
+    "step": 485,
+    "loss": 0.0007777630817145109,
+    "drift": 0.0002487909805495292,
+    "small_step": 2.8818731152568944e-05,
+    "strong_consistency": 0.0005001533427275717
+  },
+  {
+    "step": 486,
+    "loss": 0.0005739284679293633,
+    "drift": 0.00023564936418551952,
+    "small_step": 2.2681830159854144e-05,
+    "strong_consistency": 0.0003155972808599472
+  },
+  {
+    "step": 487,
+    "loss": 0.0007824462954886258,
+    "drift": 0.00011270698450971395,
+    "small_step": 1.8358339730184525e-05,
+    "strong_consistency": 0.0006513809785246849
+  },
+  {
+    "step": 488,
+    "loss": 0.0011552126379683614,
+    "drift": 0.00017415103502571583,
+    "small_step": 1.5901061487966217e-05,
+    "strong_consistency": 0.0009651604923419654
+  },
+  {
+    "step": 489,
+    "loss": 0.0004766383790411055,
+    "drift": 0.00010652367927832529,
+    "small_step": 2.650952956173569e-05,
+    "strong_consistency": 0.00034360517747700214
+  },
+  {
+    "step": 490,
+    "loss": 0.0008151130750775337,
+    "drift": 0.00012559849710669369,
+    "small_step": 1.6650574252707884e-05,
+    "strong_consistency": 0.0006728639709763229
+  },
+  {
+    "step": 491,
+    "loss": 0.0009379008552059531,
+    "drift": 0.0001917202607728541,
+    "small_step": 1.717110899335239e-05,
+    "strong_consistency": 0.0007290095090866089
+  },
+  {
+    "step": 492,
+    "loss": 0.0006560109322890639,
+    "drift": 0.00014968542382121086,
+    "small_step": 1.430795691703679e-05,
+    "strong_consistency": 0.0004920175415463746
+  },
+  {
+    "step": 493,
+    "loss": 0.0008121260325424373,
+    "drift": 0.00015910690126474947,
+    "small_step": 1.623861498956103e-05,
+    "strong_consistency": 0.0006367805181071162
+  },
+  {
+    "step": 494,
+    "loss": 0.0010564997792243958,
+    "drift": 0.00033803749829530716,
+    "small_step": 2.3983906430657953e-05,
+    "strong_consistency": 0.0006944783963263035
+  },
+  {
+    "step": 495,
+    "loss": 0.000807404110673815,
+    "drift": 0.0001608975580893457,
+    "small_step": 2.1616340745822527e-05,
+    "strong_consistency": 0.0006248902063816786
+  },
+  {
+    "step": 496,
+    "loss": 0.0008852856699377298,
+    "drift": 0.0004079793579876423,
+    "small_step": 1.6350957594113424e-05,
+    "strong_consistency": 0.00046095537254586816
+  },
+  {
+    "step": 497,
+    "loss": 0.0005848810542374849,
+    "drift": 0.00033443013671785593,
+    "small_step": 2.9309585443115793e-05,
+    "strong_consistency": 0.00022114130842965096
+  },
+  {
+    "step": 498,
+    "loss": 0.00062423205235973,
+    "drift": 0.00018410601478535682,
+    "small_step": 2.3445847546099685e-05,
+    "strong_consistency": 0.00041668021003715694
+  },
+  {
+    "step": 499,
+    "loss": 0.0006260352674871683,
+    "drift": 0.0003005477483384311,
+    "small_step": 3.19259415846318e-05,
+    "strong_consistency": 0.00029356160666793585
+  },
+  {
+    "step": 500,
+    "loss": 0.0006077061407268047,
+    "drift": 0.00025327526964247227,
+    "small_step": 1.628828249522485e-05,
+    "strong_consistency": 0.0003381426213309169
+  },
+  {
+    "step": 501,
+    "loss": 0.000762391253374517,
+    "drift": 0.00015513610560446978,
+    "small_step": 2.0698440494015813e-05,
+    "strong_consistency": 0.0005865566781722009
+  },
+  {
+    "step": 502,
+    "loss": 0.0005920000257901847,
+    "drift": 0.00010381414904259145,
+    "small_step": 2.4777040380286053e-05,
+    "strong_consistency": 0.0004634088254533708
+  },
+  {
+    "step": 503,
+    "loss": 0.0005992257501929998,
+    "drift": 0.00011113514483440667,
+    "small_step": 2.0572557332343422e-05,
+    "strong_consistency": 0.00046751805348321795
+  },
+  {
+    "step": 504,
+    "loss": 0.000760429073125124,
+    "drift": 7.470294076483697e-05,
+    "small_step": 1.032739965012297e-05,
+    "strong_consistency": 0.0006753987399861217
+  },
+  {
+    "step": 505,
+    "loss": 0.0005121854483149946,
+    "drift": 0.00010859910253202543,
+    "small_step": 2.554923230491113e-05,
+    "strong_consistency": 0.00037803713348694146
+  },
+  {
+    "step": 506,
+    "loss": 0.0009091972024179995,
+    "drift": 0.00014237499271985143,
+    "small_step": 1.2271592822798993e-05,
+    "strong_consistency": 0.000754550623241812
+  },
+  {
+    "step": 507,
+    "loss": 0.0007563797989860177,
+    "drift": 0.00040085092769004405,
+    "small_step": 1.9418175725149922e-05,
+    "strong_consistency": 0.0003361106791999191
+  },
+  {
+    "step": 508,
+    "loss": 0.0004232444043736905,
+    "drift": 9.184265218209475e-05,
+    "small_step": 1.725393121887464e-05,
+    "strong_consistency": 0.0003141478227917105
+  },
+  {
+    "step": 509,
+    "loss": 0.000514995539560914,
+    "drift": 0.00017154424858745188,
+    "small_step": 1.737184174999129e-05,
+    "strong_consistency": 0.00032607943285256624
+  },
+  {
+    "step": 510,
+    "loss": 0.0006052526878193021,
+    "drift": 0.00011333636939525604,
+    "small_step": 1.9504637748468667e-05,
+    "strong_consistency": 0.000472411687951535
+  },
+  {
+    "step": 511,
+    "loss": 0.000594704644754529,
+    "drift": 0.0002432565379422158,
+    "small_step": 2.2747566617908888e-05,
+    "strong_consistency": 0.0003287005820311606
+  },
+  {
+    "step": 512,
+    "loss": 0.0009138670284301043,
+    "drift": 0.000175674504134804,
+    "small_step": 2.592258715594653e-05,
+    "strong_consistency": 0.0007122699171304703
+  },
+  {
+    "step": 513,
+    "loss": 0.0005101737333461642,
+    "drift": 0.00020907925500068814,
+    "small_step": 2.1471876607392915e-05,
+    "strong_consistency": 0.00027962258900515735
+  },
+  {
+    "step": 514,
+    "loss": 0.0007476343307644129,
+    "drift": 0.00017831067088991404,
+    "small_step": 2.178971226385329e-05,
+    "strong_consistency": 0.0005475339712575078
+  },
+  {
+    "step": 515,
+    "loss": 0.0005203358014114201,
+    "drift": 0.00017569288320373744,
+    "small_step": 2.317035978194326e-05,
+    "strong_consistency": 0.0003214725584257394
+  },
+  {
+    "step": 516,
+    "loss": 0.0005021568504162133,
+    "drift": 0.00021979099255986512,
+    "small_step": 1.8563545381766744e-05,
+    "strong_consistency": 0.0002638022997416556
+  },
+  {
+    "step": 517,
+    "loss": 0.0011094189248979092,
+    "drift": 0.000525971467141062,
+    "small_step": 2.3791655621607788e-05,
+    "strong_consistency": 0.0005596558330580592
+  },
+  {
+    "step": 518,
+    "loss": 0.0007664978038519621,
+    "drift": 0.0001601537223905325,
+    "small_step": 1.6863079508766532e-05,
+    "strong_consistency": 0.0005894809728488326
+  },
+  {
+    "step": 519,
+    "loss": 0.0003913334512617439,
+    "drift": 0.00015145247743930668,
+    "small_step": 2.8449947421904653e-05,
+    "strong_consistency": 0.0002114310336764902
+  },
+  {
+    "step": 520,
+    "loss": 0.0010492699220776558,
+    "drift": 5.4784322855994105e-05,
+    "small_step": 2.2932745196158066e-05,
+    "strong_consistency": 0.0009715529158711433
+  },
+  {
+    "step": 521,
+    "loss": 0.00034402712481096387,
+    "drift": 9.755759674590081e-05,
+    "small_step": 2.9364488000283018e-05,
+    "strong_consistency": 0.00021710505825467408
+  },
+  {
+    "step": 522,
+    "loss": 0.00046637922059744596,
+    "drift": 0.00013441206829156727,
+    "small_step": 1.6637206499581225e-05,
+    "strong_consistency": 0.00031532993307337165
+  },
+  {
+    "step": 523,
+    "loss": 0.0010875780135393143,
+    "drift": 7.01493991073221e-05,
+    "small_step": 1.9518676708685234e-05,
+    "strong_consistency": 0.0009979099268093705
+  },
+  {
+    "step": 524,
+    "loss": 0.00030299616628326476,
+    "drift": 9.367555321659893e-05,
+    "small_step": 1.9100314602837898e-05,
+    "strong_consistency": 0.00019022029300685972
+  },
+  {
+    "step": 525,
+    "loss": 0.0005103008006699383,
+    "drift": 0.00011238520528422669,
+    "small_step": 1.7915428543346934e-05,
+    "strong_consistency": 0.00038000018685124815
+  },
+  {
+    "step": 526,
+    "loss": 0.00033963454188778996,
+    "drift": 0.00016564055113121867,
+    "small_step": 2.0031617168569937e-05,
+    "strong_consistency": 0.00015396236267406493
+  },
+  {
+    "step": 527,
+    "loss": 0.0006629621493630111,
+    "drift": 0.0002486414450686425,
+    "small_step": 2.419709380774293e-05,
+    "strong_consistency": 0.0003901236050296575
+  },
+  {
+    "step": 528,
+    "loss": 0.0004196793306618929,
+    "drift": 9.897587733576074e-05,
+    "small_step": 2.029579263762571e-05,
+    "strong_consistency": 0.00030040767160244286
+  },
+  {
+    "step": 529,
+    "loss": 0.0006811008788645267,
+    "drift": 0.00013005804794374853,
+    "small_step": 1.391891510138521e-05,
+    "strong_consistency": 0.0005371239385567605
+  },
+  {
+    "step": 530,
+    "loss": 0.0005940183764323592,
+    "drift": 0.00019697388052009046,
+    "small_step": 3.657894558273256e-05,
+    "strong_consistency": 0.0003604655503295362
+  },
+  {
+    "step": 531,
+    "loss": 0.00044759546290151775,
+    "drift": 0.00014345408999361098,
+    "small_step": 1.742961467243731e-05,
+    "strong_consistency": 0.00028671175823546946
+  },
+  {
+    "step": 532,
+    "loss": 0.0007840775069780648,
+    "drift": 0.00019276910461485386,
+    "small_step": 1.5702851669630036e-05,
+    "strong_consistency": 0.0005756055470556021
+  },
+  {
+    "step": 533,
+    "loss": 0.0005153706297278404,
+    "drift": 0.00019199862435925752,
+    "small_step": 1.804376552172471e-05,
+    "strong_consistency": 0.00030532825621776283
+  },
+  {
+    "step": 534,
+    "loss": 0.0005165914772078395,
+    "drift": 0.0001444572990294546,
+    "small_step": 1.5497505955863744e-05,
+    "strong_consistency": 0.00035663667949847877
+  },
+  {
+    "step": 535,
+    "loss": 0.0005012281471863389,
+    "drift": 0.0002448574814479798,
+    "small_step": 2.0005438273074105e-05,
+    "strong_consistency": 0.00023636520199943334
+  },
+  {
+    "step": 536,
+    "loss": 0.0006809340557083488,
+    "drift": 0.00016797319403849542,
+    "small_step": 1.2608732504304498e-05,
+    "strong_consistency": 0.0005003521218895912
+  },
+  {
+    "step": 537,
+    "loss": 0.0007260626880452037,
+    "drift": 0.0001113319958676584,
+    "small_step": 1.7234908227692358e-05,
+    "strong_consistency": 0.0005974958185106516
+  },
+  {
+    "step": 538,
+    "loss": 0.00044280567090027034,
+    "drift": 0.0001398967724526301,
+    "small_step": 1.916041219374165e-05,
+    "strong_consistency": 0.0002837484935298562
+  },
+  {
+    "step": 539,
+    "loss": 0.0007893602014519274,
+    "drift": 0.0001721790904412046,
+    "small_step": 2.1287845811457373e-05,
+    "strong_consistency": 0.000595893245190382
+  },
+  {
+    "step": 540,
+    "loss": 0.0003882847377099097,
+    "drift": 0.00011748935503419489,
+    "small_step": 2.2517318939208053e-05,
+    "strong_consistency": 0.0002482780837453902
+  },
+  {
+    "step": 541,
+    "loss": 0.00040120247285813093,
+    "drift": 0.0001110381999751553,
+    "small_step": 2.007657712965738e-05,
+    "strong_consistency": 0.0002700877084862441
+  },
+  {
+    "step": 542,
+    "loss": 0.0005849264562129974,
+    "drift": 0.00019973395683337003,
+    "small_step": 1.701436485745944e-05,
+    "strong_consistency": 0.00036817812360823154
+  },
+  {
+    "step": 543,
+    "loss": 0.0003374457883182913,
+    "drift": 5.784364475402981e-05,
+    "small_step": 9.615509043214843e-06,
+    "strong_consistency": 0.00026998663088306785
+  },
+  {
+    "step": 544,
+    "loss": 0.00048053101636469364,
+    "drift": 8.041565888561308e-05,
+    "small_step": 1.5295487173716538e-05,
+    "strong_consistency": 0.0003848198684863746
+  },
+  {
+    "step": 545,
+    "loss": 0.00025273876963183284,
+    "drift": 0.00011067291779909283,
+    "small_step": 2.5282624847022817e-05,
+    "strong_consistency": 0.000116783230623696
+  },
+  {
+    "step": 546,
+    "loss": 0.0004595758218783885,
+    "drift": 5.787875488749705e-05,
+    "small_step": 1.1480246030259877e-05,
+    "strong_consistency": 0.0003902168245986104
+  },
+  {
+    "step": 547,
+    "loss": 0.0004365754430182278,
+    "drift": 0.00012162024358985946,
+    "small_step": 2.301785207237117e-05,
+    "strong_consistency": 0.000291937350993976
+  },
+  {
+    "step": 548,
+    "loss": 0.0002549585187807679,
+    "drift": 6.972427945584059e-05,
+    "small_step": 1.8451446521794423e-05,
+    "strong_consistency": 0.00016678280371706933
+  },
+  {
+    "step": 549,
+    "loss": 0.0005628233775496483,
+    "drift": 0.00013781487359665334,
+    "small_step": 1.6661933841533028e-05,
+    "strong_consistency": 0.00040834659012034535
+  },
+  {
+    "step": 550,
+    "loss": 0.0005280365003272891,
+    "drift": 0.00014126724272500724,
+    "small_step": 2.7846606826642528e-05,
+    "strong_consistency": 0.0003589226398617029
+  },
+  {
+    "step": 551,
+    "loss": 0.0006503101903945208,
+    "drift": 0.0001625332370167598,
+    "small_step": 2.335701537958812e-05,
+    "strong_consistency": 0.00046441995073109865
+  },
+  {
+    "step": 552,
+    "loss": 0.00031984923407435417,
+    "drift": 0.00013909392873756588,
+    "small_step": 1.313631310040364e-05,
+    "strong_consistency": 0.00016761898586992174
+  },
+  {
+    "step": 553,
+    "loss": 0.00046960986219346523,
+    "drift": 7.087555422913283e-05,
+    "small_step": 2.324199886061251e-05,
+    "strong_consistency": 0.00037549229455180466
+  },
+  {
+    "step": 554,
+    "loss": 0.0005405910196714103,
+    "drift": 9.917691204464063e-05,
+    "small_step": 1.7176693290821277e-05,
+    "strong_consistency": 0.0004242373979650438
+  },
+  {
+    "step": 555,
+    "loss": 0.0003227328706998378,
+    "drift": 0.00016911138663999736,
+    "small_step": 2.4846714950399473e-05,
+    "strong_consistency": 0.00012877477274741977
+  },
+  {
+    "step": 556,
+    "loss": 0.00034795451210811734,
+    "drift": 6.878508429508656e-05,
+    "small_step": 1.6025434888433665e-05,
+    "strong_consistency": 0.00026314400020055473
+  },
+  {
+    "step": 557,
+    "loss": 0.000440154573880136,
+    "drift": 9.767058509169146e-05,
+    "small_step": 1.5645558960386552e-05,
+    "strong_consistency": 0.0003268384316470474
+  },
+  {
+    "step": 558,
+    "loss": 0.0004332874668762088,
+    "drift": 5.361623698263429e-05,
+    "small_step": 2.6979883841704577e-05,
+    "strong_consistency": 0.00035269136424176395
+  },
+  {
+    "step": 559,
+    "loss": 0.00035039475187659264,
+    "drift": 0.00016742893785703927,
+    "small_step": 2.2428377633332275e-05,
+    "strong_consistency": 0.00016053742729127407
+  },
+  {
+    "step": 560,
+    "loss": 0.000703390222042799,
+    "drift": 0.00014950730837881565,
+    "small_step": 2.9536175134126097e-05,
+    "strong_consistency": 0.0005243467167019844
+  },
+  {
+    "step": 561,
+    "loss": 0.00037617841735482216,
+    "drift": 0.00010777156421681866,
+    "small_step": 2.7753641916206107e-05,
+    "strong_consistency": 0.00024065320030786097
+  },
+  {
+    "step": 562,
+    "loss": 0.000397054071072489,
+    "drift": 0.00010661618580343202,
+    "small_step": 2.19041667151032e-05,
+    "strong_consistency": 0.00026853373856283724
+  },
+  {
+    "step": 563,
+    "loss": 0.0002350376162212342,
+    "drift": 6.766951264580712e-05,
+    "small_step": 1.9846107534249313e-05,
+    "strong_consistency": 0.0001475220051361248
+  },
+  {
+    "step": 564,
+    "loss": 0.00036022078711539507,
+    "drift": 5.673439227393828e-05,
+    "small_step": 2.6840360078494996e-05,
+    "strong_consistency": 0.00027664602384902537
+  },
+  {
+    "step": 565,
+    "loss": 0.000328282592818141,
+    "drift": 6.680314254481345e-05,
+    "small_step": 2.358183337491937e-05,
+    "strong_consistency": 0.00023789762053638697
+  },
+  {
+    "step": 566,
+    "loss": 0.0003697795909829438,
+    "drift": 7.012974674580619e-05,
+    "small_step": 2.1609941541100852e-05,
+    "strong_consistency": 0.0002780398936010897
+  },
+  {
+    "step": 567,
+    "loss": 0.0002561327419243753,
+    "drift": 7.364458724623546e-05,
+    "small_step": 2.2328949853545055e-05,
+    "strong_consistency": 0.0001601592084625736
+  },
+  {
+    "step": 568,
+    "loss": 0.0003560823679435998,
+    "drift": 7.921669748611748e-05,
+    "small_step": 2.2236350559978746e-05,
+    "strong_consistency": 0.0002546293253544718
+  },
+  {
+    "step": 569,
+    "loss": 0.00023092227638699114,
+    "drift": 4.945278851664625e-05,
+    "small_step": 3.07898735627532e-05,
+    "strong_consistency": 0.00015067961066961288
+  },
+  {
+    "step": 570,
+    "loss": 0.00027446894091553986,
+    "drift": 6.094268974266015e-05,
+    "small_step": 2.5674540665932e-05,
+    "strong_consistency": 0.0001878517068689689
+  },
+  {
+    "step": 571,
+    "loss": 0.00028765355818904936,
+    "drift": 0.0001166576475952752,
+    "small_step": 2.6662655727704987e-05,
+    "strong_consistency": 0.000144333258504048
+  },
+  {
+    "step": 572,
+    "loss": 0.0003216962213627994,
+    "drift": 7.016847666818649e-05,
+    "small_step": 2.1659016056219116e-05,
+    "strong_consistency": 0.0002298687322763726
+  },
+  {
+    "step": 573,
+    "loss": 0.00024165576905943453,
+    "drift": 7.731001824140549e-05,
+    "small_step": 2.165080513805151e-05,
+    "strong_consistency": 0.00014269494567997754
+  },
+  {
+    "step": 574,
+    "loss": 0.0004491550789680332,
+    "drift": 9.566955122863874e-05,
+    "small_step": 1.4517490853904746e-05,
+    "strong_consistency": 0.0003389680350665003
+  },
+  {
+    "step": 575,
+    "loss": 0.00036960019497200847,
+    "drift": 0.00015545659698545933,
+    "small_step": 1.7385213141096756e-05,
+    "strong_consistency": 0.0001967583957593888
+  },
+  {
+    "step": 576,
+    "loss": 0.00033165636705234647,
+    "drift": 0.00013454578584060073,
+    "small_step": 1.5333867850131355e-05,
+    "strong_consistency": 0.0001817767188185826
+  },
+  {
+    "step": 577,
+    "loss": 0.0004036631144117564,
+    "drift": 7.946856931084767e-05,
+    "small_step": 2.842853427864611e-05,
+    "strong_consistency": 0.00029576601809822023
+  },
+  {
+    "step": 578,
+    "loss": 0.0004008326795883477,
+    "drift": 8.863183029461652e-05,
+    "small_step": 2.7042315196013078e-05,
+    "strong_consistency": 0.0002851585450116545
+  },
+  {
+    "step": 579,
+    "loss": 0.00306378654204309,
+    "drift": 0.00011696163710439578,
+    "small_step": 1.657315260672476e-05,
+    "strong_consistency": 0.0029302516486495733
+  },
+  {
+    "step": 580,
+    "loss": 0.00039233866846188903,
+    "drift": 5.529649934032932e-05,
+    "small_step": 2.468788625265006e-05,
+    "strong_consistency": 0.0003123542992398143
+  },
+  {
+    "step": 581,
+    "loss": 0.00039901211857795715,
+    "drift": 0.00011146739416290075,
+    "small_step": 2.4445715098408982e-05,
+    "strong_consistency": 0.0002630990056786686
+  },
+  {
+    "step": 582,
+    "loss": 0.0003936993598472327,
+    "drift": 0.0001274277310585603,
+    "small_step": 2.2608646759181283e-05,
+    "strong_consistency": 0.00024366298748645931
+  },
+  {
+    "step": 583,
+    "loss": 0.0003058413858525455,
+    "drift": 0.00012802939454559237,
+    "small_step": 2.883140950871166e-05,
+    "strong_consistency": 0.00014898058725520968
+  },
+  {
+    "step": 584,
+    "loss": 0.0004440811462700367,
+    "drift": 0.00017180899158120155,
+    "small_step": 2.2933207219466567e-05,
+    "strong_consistency": 0.0002493389474693686
+  },
+  {
+    "step": 585,
+    "loss": 0.000308256596326828,
+    "drift": 0.00014843218377791345,
+    "small_step": 1.5520818124059588e-05,
+    "strong_consistency": 0.00014430360170081258
+  },
+  {
+    "step": 586,
+    "loss": 0.00038981600664556026,
+    "drift": 0.00023143192811403424,
+    "small_step": 1.874317786132451e-05,
+    "strong_consistency": 0.00013964092067908496
+  },
+  {
+    "step": 587,
+    "loss": 0.00043187596020288765,
+    "drift": 0.00014649523654952645,
+    "small_step": 3.1886731449048966e-05,
+    "strong_consistency": 0.0002534939849283546
+  },
+  {
+    "step": 588,
+    "loss": 0.0004353642580099404,
+    "drift": 0.000191114580957219,
+    "small_step": 3.014313188032247e-05,
+    "strong_consistency": 0.00021410656336229295
+  },
+  {
+    "step": 589,
+    "loss": 0.0002957821125164628,
+    "drift": 8.642880129627883e-05,
+    "small_step": 2.1063649910502136e-05,
+    "strong_consistency": 0.00018828967586159706
+  },
+  {
+    "step": 590,
+    "loss": 0.0003391070640645921,
+    "drift": 6.725779530825093e-05,
+    "small_step": 1.517081636848161e-05,
+    "strong_consistency": 0.0002566784678492695
+  },
+  {
+    "step": 591,
+    "loss": 0.00034603069070726633,
+    "drift": 7.907302642706782e-05,
+    "small_step": 2.1669202396878973e-05,
+    "strong_consistency": 0.0002452884509693831
+  },
+  {
+    "step": 592,
+    "loss": 0.0002763769298326224,
+    "drift": 4.6136294258758426e-05,
+    "small_step": 1.7735979781718925e-05,
+    "strong_consistency": 0.00021250465943012387
+  },
+  {
+    "step": 593,
+    "loss": 0.0004786075442098081,
+    "drift": 4.504683238337748e-05,
+    "small_step": 1.1310344234516378e-05,
+    "strong_consistency": 0.00042225036304444075
+  },
+  {
+    "step": 594,
+    "loss": 0.00024814088828861713,
+    "drift": 6.273276085266843e-05,
+    "small_step": 2.1322124666767195e-05,
+    "strong_consistency": 0.00016408601368311793
+  },
+  {
+    "step": 595,
+    "loss": 0.0005857328651472926,
+    "drift": 8.595450344728306e-05,
+    "small_step": 1.8667868062038906e-05,
+    "strong_consistency": 0.0004811104736290872
+  },
+  {
+    "step": 596,
+    "loss": 0.00036116474075242877,
+    "drift": 4.427586463862099e-05,
+    "small_step": 2.808847784763202e-05,
+    "strong_consistency": 0.00028880039462819695
+  },
+  {
+    "step": 597,
+    "loss": 0.0004295309481676668,
+    "drift": 7.118176290532574e-05,
+    "small_step": 1.5520447050221264e-05,
+    "strong_consistency": 0.0003428287454880774
+  },
+  {
+    "step": 598,
+    "loss": 0.0004250846104696393,
+    "drift": 4.387667286209762e-05,
+    "small_step": 3.0750688893022016e-05,
+    "strong_consistency": 0.00035045723780058324
+  },
+  {
+    "step": 599,
+    "loss": 0.00048292329302057624,
+    "drift": 0.00016050413250923157,
+    "small_step": 1.571386746945791e-05,
+    "strong_consistency": 0.0003067053039558232
+  },
+  {
+    "step": 600,
+    "loss": 0.0005836926866322756,
+    "drift": 5.91248317505233e-05,
+    "small_step": 2.413919719401747e-05,
+    "strong_consistency": 0.0005004286649636924
+  },
+  {
+    "step": 601,
+    "loss": 0.0002903881832025945,
+    "drift": 4.6719804231543094e-05,
+    "small_step": 1.7364687664667144e-05,
+    "strong_consistency": 0.0002263037022203207
+  },
+  {
+    "step": 602,
+    "loss": 0.00031462355400435627,
+    "drift": 0.00011597217962844297,
+    "small_step": 1.3220217624621e-05,
+    "strong_consistency": 0.0001854311558417976
+  },
+  {
+    "step": 603,
+    "loss": 0.0003624986857175827,
+    "drift": 0.0001140519671025686,
+    "small_step": 2.0220970327500254e-05,
+    "strong_consistency": 0.00022822574828751385
+  },
+  {
+    "step": 604,
+    "loss": 0.0002573382225818932,
+    "drift": 0.0001379384775646031,
+    "small_step": 1.7752796338754706e-05,
+    "strong_consistency": 0.00010164695413550362
+  },
+  {
+    "step": 605,
+    "loss": 0.00031604099785909057,
+    "drift": 0.00012789717584382743,
+    "small_step": 2.1504394680960104e-05,
+    "strong_consistency": 0.00016663942369632423
+  },
+  {
+    "step": 606,
+    "loss": 0.00025747797917574644,
+    "drift": 0.00011802252993220463,
+    "small_step": 1.99768619495444e-05,
+    "strong_consistency": 0.00011947859456995502
+  },
+  {
+    "step": 607,
+    "loss": 0.00022784997418057173,
+    "drift": 6.385884626070037e-05,
+    "small_step": 2.353347917960491e-05,
+    "strong_consistency": 0.00014045764692127705
+  },
+  {
+    "step": 608,
+    "loss": 0.000294913916150108,
+    "drift": 0.00016782920283731073,
+    "small_step": 2.4811566618154757e-05,
+    "strong_consistency": 0.00010227314487565309
+  },
+  {
+    "step": 609,
+    "loss": 0.0004346619243733585,
+    "drift": 5.8269419241696596e-05,
+    "small_step": 1.672238067840226e-05,
+    "strong_consistency": 0.00035967014264315367
+  },
+  {
+    "step": 610,
+    "loss": 0.00031101921922527254,
+    "drift": 0.0001360781752737239,
+    "small_step": 1.717684972390998e-05,
+    "strong_consistency": 0.00015776419604662806
+  },
+  {
+    "step": 611,
+    "loss": 0.00020814244635403156,
+    "drift": 5.0407947128405795e-05,
+    "small_step": 1.7807296899263747e-05,
+    "strong_consistency": 0.00013992720050737262
+  },
+  {
+    "step": 612,
+    "loss": 0.00026737715234048665,
+    "drift": 4.9563986976863816e-05,
+    "small_step": 1.9059238184127025e-05,
+    "strong_consistency": 0.0001987539289984852
+  },
+  {
+    "step": 613,
+    "loss": 0.00017709092935547233,
+    "drift": 2.513652725610882e-05,
+    "small_step": 2.265462353534531e-05,
+    "strong_consistency": 0.0001292997767450288
+  },
+  {
+    "step": 614,
+    "loss": 0.00026263599283993244,
+    "drift": 4.24495738116093e-05,
+    "small_step": 2.77280396403512e-05,
+    "strong_consistency": 0.00019245839212089777
+  },
+  {
+    "step": 615,
+    "loss": 0.0003904887125827372,
+    "drift": 4.893233926850371e-05,
+    "small_step": 2.1461959477164783e-05,
+    "strong_consistency": 0.0003200944047421217
+  },
+  {
+    "step": 616,
+    "loss": 0.00018996305880136788,
+    "drift": 2.676395706657786e-05,
+    "small_step": 2.325235982425511e-05,
+    "strong_consistency": 0.00013994674372952431
+  },
+  {
+    "step": 617,
+    "loss": 0.0003134979051537812,
+    "drift": 5.492664422490634e-05,
+    "small_step": 2.5299861590610817e-05,
+    "strong_consistency": 0.00023327140661422163
+  },
+  {
+    "step": 618,
+    "loss": 0.00019276190141681582,
+    "drift": 4.056185207446106e-05,
+    "small_step": 1.4988712791819125e-05,
+    "strong_consistency": 0.00013721133291255683
+  },
+  {
+    "step": 619,
+    "loss": 0.0002772911684587598,
+    "drift": 2.762730946415104e-05,
+    "small_step": 2.72785073320847e-05,
+    "strong_consistency": 0.00022238533711060882
+  },
+  {
+    "step": 620,
+    "loss": 0.00019226271251682192,
+    "drift": 4.2058545659529045e-05,
+    "small_step": 1.5985377103788778e-05,
+    "strong_consistency": 0.0001342187897535041
+  },
+  {
+    "step": 621,
+    "loss": 0.0002389906148891896,
+    "drift": 6.515478162327781e-05,
+    "small_step": 2.3724800485069863e-05,
+    "strong_consistency": 0.00015011103823781013
+  },
+  {
+    "step": 622,
+    "loss": 0.00024363193369936198,
+    "drift": 2.250692341476679e-05,
+    "small_step": 1.9597893697209656e-05,
+    "strong_consistency": 0.00020152711658738554
+  },
+  {
+    "step": 623,
+    "loss": 0.0001993275509448722,
+    "drift": 5.362359661376104e-05,
+    "small_step": 2.0430936274351552e-05,
+    "strong_consistency": 0.0001252730144187808
+  },
+  {
+    "step": 624,
+    "loss": 0.000345187378115952,
+    "drift": 0.00014605199976358563,
+    "small_step": 2.4410772311966866e-05,
+    "strong_consistency": 0.0001747245987644419
+  },
+  {
+    "step": 625,
+    "loss": 0.00021955659030936658,
+    "drift": 5.496205631061457e-05,
+    "small_step": 1.845597944338806e-05,
+    "strong_consistency": 0.00014613855455536395
+  },
+  {
+    "step": 626,
+    "loss": 0.00016549095744267106,
+    "drift": 6.013720849296078e-05,
+    "small_step": 2.9530259780585766e-05,
+    "strong_consistency": 7.58234818931669e-05
+  },
+  {
+    "step": 627,
+    "loss": 0.00019096660253126174,
+    "drift": 6.741457036696374e-05,
+    "small_step": 1.9522307411534712e-05,
+    "strong_consistency": 0.00010402972111478448
+  },
+  {
+    "step": 628,
+    "loss": 0.00027665356174111366,
+    "drift": 6.122703052824363e-05,
+    "small_step": 2.7694319214788266e-05,
+    "strong_consistency": 0.00018773220654111356
+  },
+  {
+    "step": 629,
+    "loss": 0.0008920864202082157,
+    "drift": 6.075937926652841e-05,
+    "small_step": 1.3411376130534336e-05,
+    "strong_consistency": 0.0008179156575351954
+  },
+  {
+    "step": 630,
+    "loss": 0.0002565900213085115,
+    "drift": 4.164996789768338e-05,
+    "small_step": 2.859691267076414e-05,
+    "strong_consistency": 0.00018634312436915934
+  },
+  {
+    "step": 631,
+    "loss": 0.0002171289816033095,
+    "drift": 3.843998638330959e-05,
+    "small_step": 1.7430294974474236e-05,
+    "strong_consistency": 0.0001612587075214833
+  },
+  {
+    "step": 632,
+    "loss": 0.0003494717529974878,
+    "drift": 4.894938683719374e-05,
+    "small_step": 1.7386264516972005e-05,
+    "strong_consistency": 0.00028313611983321607
+  },
+  {
+    "step": 633,
+    "loss": 0.00014392806042451411,
+    "drift": 3.1242620025295764e-05,
+    "small_step": 1.774055272107944e-05,
+    "strong_consistency": 9.494488767813891e-05
+  },
+  {
+    "step": 634,
+    "loss": 0.000190163089428097,
+    "drift": 2.6877696654992178e-05,
+    "small_step": 2.1132698748260736e-05,
+    "strong_consistency": 0.0001421526976628229
+  },
+  {
+    "step": 635,
+    "loss": 0.0002031747717410326,
+    "drift": 2.6555377189652063e-05,
+    "small_step": 2.3438635253114626e-05,
+    "strong_consistency": 0.0001531807502033189
+  },
+  {
+    "step": 636,
+    "loss": 0.0002819719084072858,
+    "drift": 5.102968498249538e-05,
+    "small_step": 2.4497063350281678e-05,
+    "strong_consistency": 0.00020644515461754054
+  },
+  {
+    "step": 637,
+    "loss": 0.00017205388576257974,
+    "drift": 2.7148693334311247e-05,
+    "small_step": 1.9952185539295897e-05,
+    "strong_consistency": 0.0001249530032509938
+  },
+  {
+    "step": 638,
+    "loss": 0.00019360554870218039,
+    "drift": 2.4216107703978196e-05,
+    "small_step": 2.9074144549667835e-05,
+    "strong_consistency": 0.00014031530008651316
+  },
+  {
+    "step": 639,
+    "loss": 0.0002516596869099885,
+    "drift": 3.27645248034969e-05,
+    "small_step": 2.3265711206477135e-05,
+    "strong_consistency": 0.0001956294581759721
+  },
+  {
+    "step": 640,
+    "loss": 0.00032287416979670525,
+    "drift": 6.58342833048664e-05,
+    "small_step": 2.743590812315233e-05,
+    "strong_consistency": 0.00022960396017879248
+  },
+  {
+    "step": 641,
+    "loss": 0.00027410080656409264,
+    "drift": 7.949396240292117e-05,
+    "small_step": 2.0796898752450943e-05,
+    "strong_consistency": 0.00017380995268467814
+  },
+  {
+    "step": 642,
+    "loss": 0.000650475500151515,
+    "drift": 0.00036667290260083973,
+    "small_step": 2.2166757844388485e-05,
+    "strong_consistency": 0.00026163586881011724
+  },
+  {
+    "step": 643,
+    "loss": 0.0002614674449432641,
+    "drift": 4.288529817131348e-05,
+    "small_step": 1.6273197616101243e-05,
+    "strong_consistency": 0.00020230894733686
+  },
+  {
+    "step": 644,
+    "loss": 0.0001828057284001261,
+    "drift": 5.1528077165130526e-05,
+    "small_step": 2.5883698981488124e-05,
+    "strong_consistency": 0.00010539395589148626
+  },
+  {
+    "step": 645,
+    "loss": 0.00036774188629351556,
+    "drift": 9.830256021814421e-05,
+    "small_step": 2.8221169486641884e-05,
+    "strong_consistency": 0.00024121816386468709
+  },
+  {
+    "step": 646,
+    "loss": 0.00023905333364382386,
+    "drift": 5.7372439187020063e-05,
+    "small_step": 1.5288744179997593e-05,
+    "strong_consistency": 0.00016639215755276382
+  },
+  {
+    "step": 647,
+    "loss": 0.00031852442771196365,
+    "drift": 6.954932905500755e-05,
+    "small_step": 2.4134700652211905e-05,
+    "strong_consistency": 0.0002248403907287866
+  },
+  {
+    "step": 648,
+    "loss": 0.00025552543229423463,
+    "drift": 8.91878007678315e-05,
+    "small_step": 1.7611702787689865e-05,
+    "strong_consistency": 0.00014872592873871326
+  },
+  {
+    "step": 649,
+    "loss": 0.00018245280080009252,
+    "drift": 3.350430051796138e-05,
+    "small_step": 2.4886714527383447e-05,
+    "strong_consistency": 0.0001240617857547477
+  },
+  {
+    "step": 650,
+    "loss": 0.00047557297511957586,
+    "drift": 2.6352701752330177e-05,
+    "small_step": 2.3862205125624314e-05,
+    "strong_consistency": 0.00042535807006061077
+  },
+  {
+    "step": 651,
+    "loss": 0.0002362819795962423,
+    "drift": 3.400993955438025e-05,
+    "small_step": 1.5661100405850448e-05,
+    "strong_consistency": 0.0001866109378170222
+  },
+  {
+    "step": 652,
+    "loss": 0.000355532014509663,
+    "drift": 5.149381104274653e-05,
+    "small_step": 1.751870513544418e-05,
+    "strong_consistency": 0.0002865194983314723
+  },
+  {
+    "step": 653,
+    "loss": 0.00015194770821835846,
+    "drift": 2.9780141630908474e-05,
+    "small_step": 2.4715322069823742e-05,
+    "strong_consistency": 9.745224087964743e-05
+  },
+  {
+    "step": 654,
+    "loss": 0.00020172719086986035,
+    "drift": 6.939550075912848e-05,
+    "small_step": 1.682296715443954e-05,
+    "strong_consistency": 0.00011550872295629233
+  },
+  {
+    "step": 655,
+    "loss": 0.00018622422066982836,
+    "drift": 3.640750946942717e-05,
+    "small_step": 2.181691706937272e-05,
+    "strong_consistency": 0.00012799979595001787
+  },
+  {
+    "step": 656,
+    "loss": 0.0003429907083045691,
+    "drift": 5.587555642705411e-05,
+    "small_step": 3.2724849006626755e-05,
+    "strong_consistency": 0.00025439029559493065
+  },
+  {
+    "step": 657,
+    "loss": 0.0003065621422138065,
+    "drift": 2.5126808395725675e-05,
+    "small_step": 2.730021151364781e-05,
+    "strong_consistency": 0.000254135113209486
+  },
+  {
+    "step": 658,
+    "loss": 0.00019307632464915514,
+    "drift": 1.7075744835892692e-05,
+    "small_step": 1.7993930669035763e-05,
+    "strong_consistency": 0.00015800664550624788
+  },
+  {
+    "step": 659,
+    "loss": 0.00014813870075158775,
+    "drift": 2.0438437786651775e-05,
+    "small_step": 2.5514591470710002e-05,
+    "strong_consistency": 0.00010218567331321537
+  },
+  {
+    "step": 660,
+    "loss": 0.0004039456252939999,
+    "drift": 4.868099858867936e-05,
+    "small_step": 2.922968633356504e-05,
+    "strong_consistency": 0.0003260349330957979
+  },
+  {
+    "step": 661,
+    "loss": 0.00012701914238277823,
+    "drift": 1.870828418759629e-05,
+    "small_step": 2.6131810955121182e-05,
+    "strong_consistency": 8.217904542107135e-05
+  },
+  {
+    "step": 662,
+    "loss": 0.0002214883716078475,
+    "drift": 3.073229527217336e-05,
+    "small_step": 2.0430999938980676e-05,
+    "strong_consistency": 0.00017032507457770407
+  },
+  {
+    "step": 663,
+    "loss": 0.00015686321421526372,
+    "drift": 2.6130375772481784e-05,
+    "small_step": 1.8592458218336105e-05,
+    "strong_consistency": 0.00011214037658646703
+  },
+  {
+    "step": 664,
+    "loss": 0.0002108586486428976,
+    "drift": 4.238202018314041e-05,
+    "small_step": 2.3302753106690943e-05,
+    "strong_consistency": 0.00014517387899104506
+  },
+  {
+    "step": 665,
+    "loss": 0.0001421056513208896,
+    "drift": 4.784713746630587e-05,
+    "small_step": 2.683914681256283e-05,
+    "strong_consistency": 6.741935794707388e-05
+  },
+  {
+    "step": 666,
+    "loss": 0.00021758156071882695,
+    "drift": 3.9161110180430114e-05,
+    "small_step": 3.277628275100142e-05,
+    "strong_consistency": 0.00014564416778739542
+  },
+  {
+    "step": 667,
+    "loss": 0.00027504281024448574,
+    "drift": 4.642217390937731e-05,
+    "small_step": 2.1515123080462217e-05,
+    "strong_consistency": 0.0002071055059786886
+  },
+  {
+    "step": 668,
+    "loss": 0.0001672164653427899,
+    "drift": 3.948968878830783e-05,
+    "small_step": 1.9162611351930536e-05,
+    "strong_consistency": 0.00010856417065951973
+  },
+  {
+    "step": 669,
+    "loss": 0.00026982155395671725,
+    "drift": 8.351333963219076e-05,
+    "small_step": 3.2553612982155755e-05,
+    "strong_consistency": 0.0001537545904284343
+  },
+  {
+    "step": 670,
+    "loss": 0.00040682946564629674,
+    "drift": 3.8704718463122845e-05,
+    "small_step": 3.662855669972487e-05,
+    "strong_consistency": 0.00033149620867334306
+  },
+  {
+    "step": 671,
+    "loss": 0.00021302871755324304,
+    "drift": 5.063998105470091e-05,
+    "small_step": 4.336574420449324e-05,
+    "strong_consistency": 0.0001190229959320277
+  },
+  {
+    "step": 672,
+    "loss": 0.00020964446594007313,
+    "drift": 2.6284904379281215e-05,
+    "small_step": 1.604434146429412e-05,
+    "strong_consistency": 0.00016731521463952959
+  },
+  {
+    "step": 673,
+    "loss": 0.0003055699053220451,
+    "drift": 4.238508699927479e-05,
+    "small_step": 3.1065017537912354e-05,
+    "strong_consistency": 0.0002321197825949639
+  },
+  {
+    "step": 674,
+    "loss": 0.00024067622143775225,
+    "drift": 2.2784619432059117e-05,
+    "small_step": 3.095336796832271e-05,
+    "strong_consistency": 0.00018693823949433863
+  },
+  {
+    "step": 675,
+    "loss": 0.0003368347533978522,
+    "drift": 7.661857671337202e-05,
+    "small_step": 2.0418119675014168e-05,
+    "strong_consistency": 0.000239798057009466
+  },
+  {
+    "step": 676,
+    "loss": 0.00026906252605840564,
+    "drift": 4.0362287109019235e-05,
+    "small_step": 2.0504281565081328e-05,
+    "strong_consistency": 0.00020819595374632627
+  },
+  {
+    "step": 677,
+    "loss": 0.00026724248891696334,
+    "drift": 3.7719895772170275e-05,
+    "small_step": 2.4814054995658807e-05,
+    "strong_consistency": 0.00020470852905418724
+  },
+  {
+    "step": 678,
+    "loss": 0.0001830395485740155,
+    "drift": 2.299027437402401e-05,
+    "small_step": 2.4239154299721122e-05,
+    "strong_consistency": 0.00013581012899521738
+  },
+  {
+    "step": 679,
+    "loss": 0.00020313194545451552,
+    "drift": 3.1709969334769994e-05,
+    "small_step": 1.9952882212237455e-05,
+    "strong_consistency": 0.00015146909572649747
+  },
+  {
+    "step": 680,
+    "loss": 0.00020845956169068813,
+    "drift": 1.8944552721222863e-05,
+    "small_step": 2.373357528995257e-05,
+    "strong_consistency": 0.00016578144277445972
+  },
+  {
+    "step": 681,
+    "loss": 0.000251549732638523,
+    "drift": 3.5376004234422e-05,
+    "small_step": 3.507241126499139e-05,
+    "strong_consistency": 0.0001811013207770884
+  },
+  {
+    "step": 682,
+    "loss": 0.000211396676604636,
+    "drift": 1.683381196926348e-05,
+    "small_step": 2.370766560488846e-05,
+    "strong_consistency": 0.00017085520084947348
+  },
+  {
+    "step": 683,
+    "loss": 0.00017359502089675516,
+    "drift": 2.82106102531543e-05,
+    "small_step": 1.9607070498750545e-05,
+    "strong_consistency": 0.00012577734014485031
+  },
+  {
+    "step": 684,
+    "loss": 0.00025391962844878435,
+    "drift": 2.996242983499542e-05,
+    "small_step": 2.5632458346080966e-05,
+    "strong_consistency": 0.00019832474936265498
+  },
+  {
+    "step": 685,
+    "loss": 0.00022238583187572658,
+    "drift": 4.960061778547242e-05,
+    "small_step": 2.1072237359476276e-05,
+    "strong_consistency": 0.0001517129858257249
+  },
+  {
+    "step": 686,
+    "loss": 0.0002244945935672149,
+    "drift": 4.183890268905088e-05,
+    "small_step": 2.3312310077017173e-05,
+    "strong_consistency": 0.00015934338443912566
+  },
+  {
+    "step": 687,
+    "loss": 0.00014608557103201747,
+    "drift": 4.280128996470012e-05,
+    "small_step": 2.1858082618564367e-05,
+    "strong_consistency": 8.142620208673179e-05
+  },
+  {
+    "step": 688,
+    "loss": 0.00015956793504301459,
+    "drift": 5.7001368986675516e-05,
+    "small_step": 1.9689119653776288e-05,
+    "strong_consistency": 8.287745004054159e-05
+  },
+  {
+    "step": 689,
+    "loss": 0.000176345492945984,
+    "drift": 4.365414861240424e-05,
+    "small_step": 1.3699025657842867e-05,
+    "strong_consistency": 0.00011899231321876869
+  },
+  {
+    "step": 690,
+    "loss": 0.00011923498095711693,
+    "drift": 2.7451624191598967e-05,
+    "small_step": 2.165707883250434e-05,
+    "strong_consistency": 7.012627611402422e-05
+  },
+  {
+    "step": 691,
+    "loss": 0.00016246896120719612,
+    "drift": 2.7795584173873067e-05,
+    "small_step": 1.4088255738897715e-05,
+    "strong_consistency": 0.00012058511492796242
+  },
+  {
+    "step": 692,
+    "loss": 0.0002589308423921466,
+    "drift": 2.860223685274832e-05,
+    "small_step": 2.2008560335962102e-05,
+    "strong_consistency": 0.00020832003792747855
+  },
+  {
+    "step": 693,
+    "loss": 0.0001661901333136484,
+    "drift": 2.6361807613284327e-05,
+    "small_step": 2.434757334413007e-05,
+    "strong_consistency": 0.00011548075417522341
+  },
+  {
+    "step": 694,
+    "loss": 0.00015121267642825842,
+    "drift": 2.8096750611439347e-05,
+    "small_step": 2.4714971004868858e-05,
+    "strong_consistency": 9.840095299296081e-05
+  },
+  {
+    "step": 695,
+    "loss": 0.00016037649766076356,
+    "drift": 2.087921711790841e-05,
+    "small_step": 1.702150984783657e-05,
+    "strong_consistency": 0.00012247577251400799
+  },
+  {
+    "step": 696,
+    "loss": 0.0002145568432752043,
+    "drift": 3.062958421651274e-05,
+    "small_step": 2.3184613382909447e-05,
+    "strong_consistency": 0.00016074265295173973
+  },
+  {
+    "step": 697,
+    "loss": 0.000231789774261415,
+    "drift": 2.110501009155996e-05,
+    "small_step": 1.6615003914921544e-05,
+    "strong_consistency": 0.00019406976934988052
+  },
+  {
+    "step": 698,
+    "loss": 0.00019595594494603574,
+    "drift": 2.60514352703467e-05,
+    "small_step": 1.8149194147554226e-05,
+    "strong_consistency": 0.00015175531734712422
+  },
+  {
+    "step": 699,
+    "loss": 0.00020775369193870574,
+    "drift": 2.320333442185074e-05,
+    "small_step": 2.2790944058215246e-05,
+    "strong_consistency": 0.00016175940982066095
+  },
+  {
+    "step": 700,
+    "loss": 0.00016752305964473635,
+    "drift": 3.0304565370897762e-05,
+    "small_step": 2.2231097318581305e-05,
+    "strong_consistency": 0.00011498739331727847
+  },
+  {
+    "step": 701,
+    "loss": 0.0001601339754415676,
+    "drift": 4.65556513518095e-05,
+    "small_step": 2.214714368165005e-05,
+    "strong_consistency": 9.143118222709745e-05
+  },
+  {
+    "step": 702,
+    "loss": 0.00019256897212471813,
+    "drift": 2.4265491447295062e-05,
+    "small_step": 2.3562886781292036e-05,
+    "strong_consistency": 0.00014474059571512043
+  },
+  {
+    "step": 703,
+    "loss": 0.00015726551646366715,
+    "drift": 4.292962694307789e-05,
+    "small_step": 2.0541439880616963e-05,
+    "strong_consistency": 9.379444236401469e-05
+  },
+  {
+    "step": 704,
+    "loss": 9.438765118829906e-05,
+    "drift": 2.0250878151273355e-05,
+    "small_step": 1.794621675799135e-05,
+    "strong_consistency": 5.619055446004495e-05
+  },
+  {
+    "step": 705,
+    "loss": 0.00036080641439184546,
+    "drift": 4.111006637685932e-05,
+    "small_step": 2.966751708299853e-05,
+    "strong_consistency": 0.00029002883820794523
+  },
+  {
+    "step": 706,
+    "loss": 0.0002886866277549416,
+    "drift": 3.561290941433981e-05,
+    "small_step": 1.9598493963712826e-05,
+    "strong_consistency": 0.00023347522073891014
+  },
+  {
+    "step": 707,
+    "loss": 0.00018359745445195585,
+    "drift": 4.588383308146149e-05,
+    "small_step": 1.6491963833686896e-05,
+    "strong_consistency": 0.00012122165935579687
+  },
+  {
+    "step": 708,
+    "loss": 0.0001699371205177158,
+    "drift": 2.422676516289357e-05,
+    "small_step": 1.4386891052708961e-05,
+    "strong_consistency": 0.0001313234679400921
+  },
+  {
+    "step": 709,
+    "loss": 0.00024384897551499307,
+    "drift": 5.412165410234593e-05,
+    "small_step": 2.3742171833873726e-05,
+    "strong_consistency": 0.0001659851404838264
+  },
+  {
+    "step": 710,
+    "loss": 0.0001714759273454547,
+    "drift": 2.9842223739251494e-05,
+    "small_step": 1.5562023691018112e-05,
+    "strong_consistency": 0.0001260716817341745
+  },
+  {
+    "step": 711,
+    "loss": 0.00015741775860078633,
+    "drift": 2.1403197024483234e-05,
+    "small_step": 1.825608342187479e-05,
+    "strong_consistency": 0.0001177584781544283
+  },
+  {
+    "step": 712,
+    "loss": 0.00012496540148276836,
+    "drift": 2.620293525978923e-05,
+    "small_step": 2.028572816925589e-05,
+    "strong_consistency": 7.847673987271264e-05
+  },
+  {
+    "step": 713,
+    "loss": 0.00012442533625289798,
+    "drift": 2.1162821212783456e-05,
+    "small_step": 1.8104732589563355e-05,
+    "strong_consistency": 8.515777881257236e-05
+  },
+  {
+    "step": 714,
+    "loss": 0.00031617339118383825,
+    "drift": 2.5099148842855357e-05,
+    "small_step": 2.6330966647947207e-05,
+    "strong_consistency": 0.0002647432847879827
+  },
+  {
+    "step": 715,
+    "loss": 0.0002073393843602389,
+    "drift": 2.6095209250343032e-05,
+    "small_step": 1.1864385669468902e-05,
+    "strong_consistency": 0.00016937978216446936
+  },
+  {
+    "step": 716,
+    "loss": 0.00025357012054882944,
+    "drift": 1.8819209799403325e-05,
+    "small_step": 1.9951097783632576e-05,
+    "strong_consistency": 0.00021479980205185711
+  },
+  {
+    "step": 717,
+    "loss": 0.0001443894871044904,
+    "drift": 3.5418652259977534e-05,
+    "small_step": 2.4791934265522286e-05,
+    "strong_consistency": 8.417890785494819e-05
+  },
+  {
+    "step": 718,
+    "loss": 0.0001098288776120171,
+    "drift": 2.11677179322578e-05,
+    "small_step": 1.721118314890191e-05,
+    "strong_consistency": 7.144997653085738e-05
+  },
+  {
+    "step": 719,
+    "loss": 0.00014846166595816612,
+    "drift": 2.593460703792516e-05,
+    "small_step": 2.3557853637612425e-05,
+    "strong_consistency": 9.896921255858615e-05
+  },
+  {
+    "step": 720,
+    "loss": 0.00024050031788647175,
+    "drift": 1.5645848179701716e-05,
+    "small_step": 2.9070890377624892e-05,
+    "strong_consistency": 0.00019578357751015574
+  },
+  {
+    "step": 721,
+    "loss": 0.00013152710744179785,
+    "drift": 4.3135758460266516e-05,
+    "small_step": 2.420235068711918e-05,
+    "strong_consistency": 6.418900738935918e-05
+  },
+  {
+    "step": 722,
+    "loss": 0.0003204770910087973,
+    "drift": 8.242594776675105e-05,
+    "small_step": 2.2723448637407273e-05,
+    "strong_consistency": 0.00021532770188059658
+  },
+  {
+    "step": 723,
+    "loss": 0.0003096832078881562,
+    "drift": 5.750335185439326e-05,
+    "small_step": 1.940401671163272e-05,
+    "strong_consistency": 0.00023277585569303483
+  },
+  {
+    "step": 724,
+    "loss": 0.0001363182091154158,
+    "drift": 2.988880078191869e-05,
+    "small_step": 3.514884883770719e-05,
+    "strong_consistency": 7.128057040972635e-05
+  },
+  {
+    "step": 725,
+    "loss": 0.0001950031437445432,
+    "drift": 3.465735062491149e-05,
+    "small_step": 3.14204917231109e-05,
+    "strong_consistency": 0.000128925297758542
+  },
+  {
+    "step": 726,
+    "loss": 8.371637522941455e-05,
+    "drift": 1.731579686747864e-05,
+    "small_step": 1.8120046661351807e-05,
+    "strong_consistency": 4.828053351957351e-05
+  },
+  {
+    "step": 727,
+    "loss": 0.00020649538782890886,
+    "drift": 5.99167869950179e-05,
+    "small_step": 1.7392752852174453e-05,
+    "strong_consistency": 0.0001291858498007059
+  },
+  {
+    "step": 728,
+    "loss": 0.00019186337885912508,
+    "drift": 4.208300742902793e-05,
+    "small_step": 2.422001853119582e-05,
+    "strong_consistency": 0.00012556035653688014
+  },
+  {
+    "step": 729,
+    "loss": 0.00011684601486194879,
+    "drift": 1.537679236207623e-05,
+    "small_step": 1.811681613617111e-05,
+    "strong_consistency": 8.335241000168025e-05
+  },
+  {
+    "step": 730,
+    "loss": 0.00032390019623562694,
+    "drift": 3.34154065058101e-05,
+    "small_step": 3.038694012502674e-05,
+    "strong_consistency": 0.0002600978477858007
+  },
+  {
+    "step": 731,
+    "loss": 0.00015443407755810767,
+    "drift": 3.9731381548335776e-05,
+    "small_step": 1.7490068785264157e-05,
+    "strong_consistency": 9.721262904349715e-05
+  },
+  {
+    "step": 732,
+    "loss": 0.00029930222081020474,
+    "drift": 2.8393713364494033e-05,
+    "small_step": 1.819824319682084e-05,
+    "strong_consistency": 0.00025271024787798524
+  },
+  {
+    "step": 733,
+    "loss": 0.00016286387108266354,
+    "drift": 1.2621894711628556e-05,
+    "small_step": 2.0596115064108744e-05,
+    "strong_consistency": 0.00012964586494490504
+  },
+  {
+    "step": 734,
+    "loss": 0.0001376710133627057,
+    "drift": 3.580792690627277e-05,
+    "small_step": 2.9307384465937503e-05,
+    "strong_consistency": 7.255570380948484e-05
+  },
+  {
+    "step": 735,
+    "loss": 0.00016050125123001635,
+    "drift": 3.900294177583419e-05,
+    "small_step": 2.7670870622387156e-05,
+    "strong_consistency": 9.382744610775262e-05
+  },
+  {
+    "step": 736,
+    "loss": 0.00011171343794558197,
+    "drift": 2.6221077860100195e-05,
+    "small_step": 2.773110281850677e-05,
+    "strong_consistency": 5.776126272394322e-05
+  },
+  {
+    "step": 737,
+    "loss": 0.00018180528422817588,
+    "drift": 2.897683225455694e-05,
+    "small_step": 2.255182698718272e-05,
+    "strong_consistency": 0.0001302766177104786
+  },
+  {
+    "step": 738,
+    "loss": 0.0001824492064770311,
+    "drift": 2.4518878490198404e-05,
+    "small_step": 3.245915286242962e-05,
+    "strong_consistency": 0.0001254711824003607
+  },
+  {
+    "step": 739,
+    "loss": 0.00015927257481962442,
+    "drift": 2.7660080377245322e-05,
+    "small_step": 1.8727601855061948e-05,
+    "strong_consistency": 0.00011288489622529596
+  },
+  {
+    "step": 740,
+    "loss": 0.0002890380274038762,
+    "drift": 1.4883904441376217e-05,
+    "small_step": 1.351993705611676e-05,
+    "strong_consistency": 0.0002606341731734574
+  },
+  {
+    "step": 741,
+    "loss": 0.0002262029011035338,
+    "drift": 2.6371557396487333e-05,
+    "small_step": 1.7484511772636324e-05,
+    "strong_consistency": 0.00018234683375339955
+  },
+  {
+    "step": 742,
+    "loss": 0.0001274512178497389,
+    "drift": 2.537673390179407e-05,
+    "small_step": 2.7738522476283833e-05,
+    "strong_consistency": 7.43359632906504e-05
+  },
+  {
+    "step": 743,
+    "loss": 0.0003300637472420931,
+    "drift": 3.457006096141413e-05,
+    "small_step": 1.9290473574073985e-05,
+    "strong_consistency": 0.00027620320906862617
+  },
+  {
+    "step": 744,
+    "loss": 0.0001831742119975388,
+    "drift": 3.006121187354438e-05,
+    "small_step": 3.2049199944594875e-05,
+    "strong_consistency": 0.00012106380745535716
+  },
+  {
+    "step": 745,
+    "loss": 0.000193371728528291,
+    "drift": 5.971688369754702e-05,
+    "small_step": 2.0059815142303705e-05,
+    "strong_consistency": 0.00011359503696439788
+  },
+  {
+    "step": 746,
+    "loss": 0.0002813548198901117,
+    "drift": 4.531224840320647e-05,
+    "small_step": 2.3740432880003937e-05,
+    "strong_consistency": 0.00021230214042589068
+  },
+  {
+    "step": 747,
+    "loss": 0.00011103034921688959,
+    "drift": 3.848060441669077e-05,
+    "small_step": 1.377431908622384e-05,
+    "strong_consistency": 5.877542571397498e-05
+  },
+  {
+    "step": 748,
+    "loss": 0.0001820149482227862,
+    "drift": 3.829898196272552e-05,
+    "small_step": 3.511033719405532e-05,
+    "strong_consistency": 0.00010860562179004773
+  },
+  {
+    "step": 749,
+    "loss": 0.00016181895625777543,
+    "drift": 2.243394192191772e-05,
+    "small_step": 3.5855828173225746e-05,
+    "strong_consistency": 0.00010352918616263196
+  },
+  {
+    "step": 750,
+    "loss": 0.00027135826530866325,
+    "drift": 3.0391205655178055e-05,
+    "small_step": 1.6950834833551198e-05,
+    "strong_consistency": 0.0002240162284579128
+  },
+  {
+    "step": 751,
+    "loss": 0.00024330394808202982,
+    "drift": 1.4974531950429082e-05,
+    "small_step": 3.040856245206669e-05,
+    "strong_consistency": 0.00019792086095549166
+  },
+  {
+    "step": 752,
+    "loss": 9.8482720204629e-05,
+    "drift": 7.6882861321792e-06,
+    "small_step": 3.791136623476632e-05,
+    "strong_consistency": 5.288307147566229e-05
+  },
+  {
+    "step": 753,
+    "loss": 0.0002502886636648327,
+    "drift": 3.063445910811424e-05,
+    "small_step": 2.0334578948677517e-05,
+    "strong_consistency": 0.00019931963470298797
+  },
+  {
+    "step": 754,
+    "loss": 0.00025485598598606884,
+    "drift": 2.073648829536978e-05,
+    "small_step": 2.5353898308821954e-05,
+    "strong_consistency": 0.0002087655884679407
+  },
+  {
+    "step": 755,
+    "loss": 0.0001792385010048747,
+    "drift": 2.1598436433123425e-05,
+    "small_step": 2.488218160578981e-05,
+    "strong_consistency": 0.00013275787932798266
+  },
+  {
+    "step": 756,
+    "loss": 0.00016602524556219578,
+    "drift": 2.2174077457748353e-05,
+    "small_step": 2.202976611442864e-05,
+    "strong_consistency": 0.0001218214092659764
+  },
+  {
+    "step": 757,
+    "loss": 0.00021451545762829483,
+    "drift": 4.05060600314755e-05,
+    "small_step": 2.328582741029095e-05,
+    "strong_consistency": 0.00015072357200551778
+  },
+  {
+    "step": 758,
+    "loss": 0.00039873155765235424,
+    "drift": 2.3523882191511802e-05,
+    "small_step": 2.5925482987076975e-05,
+    "strong_consistency": 0.0003492821997497231
+  },
+  {
+    "step": 759,
+    "loss": 0.00022887687373440713,
+    "drift": 2.560498978709802e-05,
+    "small_step": 2.5769750209292397e-05,
+    "strong_consistency": 0.00017750213737599552
+  },
+  {
+    "step": 760,
+    "loss": 0.00015297214849852026,
+    "drift": 1.5893689123913646e-05,
+    "small_step": 1.7809374185162596e-05,
+    "strong_consistency": 0.00011926908337045461
+  },
+  {
+    "step": 761,
+    "loss": 7.553111936431378e-05,
+    "drift": 2.2405554773285985e-05,
+    "small_step": 1.5336627257056534e-05,
+    "strong_consistency": 3.778893733397126e-05
+  },
+  {
+    "step": 762,
+    "loss": 9.461255103815347e-05,
+    "drift": 1.2627800060727168e-05,
+    "small_step": 2.321389183634892e-05,
+    "strong_consistency": 5.8770856412593275e-05
+  },
+  {
+    "step": 763,
+    "loss": 0.00017604883760213852,
+    "drift": 1.9811483070952818e-05,
+    "small_step": 2.2958349291002378e-05,
+    "strong_consistency": 0.00013327901251614094
+  },
+  {
+    "step": 764,
+    "loss": 0.00022582382371183485,
+    "drift": 3.276239294791594e-05,
+    "small_step": 3.5525117709767073e-05,
+    "strong_consistency": 0.00015753631305415183
+  },
+  {
+    "step": 765,
+    "loss": 0.00011217842984478921,
+    "drift": 1.414743201166857e-05,
+    "small_step": 2.472007690812461e-05,
+    "strong_consistency": 7.331091910600662e-05
+  },
+  {
+    "step": 766,
+    "loss": 0.00016966706607490778,
+    "drift": 3.671465674415231e-05,
+    "small_step": 1.4967460629122797e-05,
+    "strong_consistency": 0.00011798495688708499
+  },
+  {
+    "step": 767,
+    "loss": 0.00020822384976781905,
+    "drift": 1.2367328054097015e-05,
+    "small_step": 2.2967602490098216e-05,
+    "strong_consistency": 0.00017288891831412911
+  },
+  {
+    "step": 768,
+    "loss": 0.00019507878459990025,
+    "drift": 2.810021942423191e-05,
+    "small_step": 2.2900087060406804e-05,
+    "strong_consistency": 0.00014407848357222974
+  },
+  {
+    "step": 769,
+    "loss": 0.0007176620420068502,
+    "drift": 8.911036275094375e-05,
+    "small_step": 3.0456987587967888e-05,
+    "strong_consistency": 0.0005980946589261293
+  },
+  {
+    "step": 770,
+    "loss": 0.00012025280011584982,
+    "drift": 2.9250222723931074e-05,
+    "small_step": 2.7709160349331796e-05,
+    "strong_consistency": 6.329341704258695e-05
+  },
+  {
+    "step": 771,
+    "loss": 0.00013654466602019966,
+    "drift": 2.0291210603318177e-05,
+    "small_step": 1.2631186109501868e-05,
+    "strong_consistency": 0.00010362227476434782
+  },
+  {
+    "step": 772,
+    "loss": 0.0001452128926757723,
+    "drift": 3.8626960304100066e-05,
+    "small_step": 3.656898479675874e-05,
+    "strong_consistency": 7.00169475749135e-05
+  },
+  {
+    "step": 773,
+    "loss": 8.817919297143817e-05,
+    "drift": 2.0011362721561454e-05,
+    "small_step": 1.5912231901893392e-05,
+    "strong_consistency": 5.2255603804951534e-05
+  },
+  {
+    "step": 774,
+    "loss": 0.00012183434591861442,
+    "drift": 1.6825673810672015e-05,
+    "small_step": 1.7510936231701635e-05,
+    "strong_consistency": 8.749773405725136e-05
+  },
+  {
+    "step": 775,
+    "loss": 0.00014635066327173263,
+    "drift": 1.1887979781022295e-05,
+    "small_step": 2.0601455616997555e-05,
+    "strong_consistency": 0.00011386122787371278
+  },
+  {
+    "step": 776,
+    "loss": 0.00020775098528247327,
+    "drift": 2.378998397034593e-05,
+    "small_step": 2.5392926545464434e-05,
+    "strong_consistency": 0.0001585680729476735
+  },
+  {
+    "step": 777,
+    "loss": 0.00014797644689679146,
+    "drift": 8.997473742056172e-06,
+    "small_step": 1.6801779565867037e-05,
+    "strong_consistency": 0.00012217719631735235
+  },
+  {
+    "step": 778,
+    "loss": 0.00010693247895687819,
+    "drift": 9.26727989281062e-06,
+    "small_step": 1.9617986254161224e-05,
+    "strong_consistency": 7.804721099091694e-05
+  },
+  {
+    "step": 779,
+    "loss": 0.00012329588935244828,
+    "drift": 1.0779786862258334e-05,
+    "small_step": 1.987907126022037e-05,
+    "strong_consistency": 9.263702668249607e-05
+  },
+  {
+    "step": 780,
+    "loss": 0.0001570224849274382,
+    "drift": 2.5195522539434023e-05,
+    "small_step": 1.2652040823013522e-05,
+    "strong_consistency": 0.00011917491792701185
+  },
+  {
+    "step": 781,
+    "loss": 0.00011015839118044823,
+    "drift": 1.8034965250990354e-05,
+    "small_step": 2.786538243526593e-05,
+    "strong_consistency": 6.425804167520255e-05
+  },
+  {
+    "step": 782,
+    "loss": 0.00014777036267332733,
+    "drift": 2.1643329091602936e-05,
+    "small_step": 1.763450200087391e-05,
+    "strong_consistency": 0.0001084925388568081
+  },
+  {
+    "step": 783,
+    "loss": 0.00020887672144453973,
+    "drift": 5.7451819884590805e-05,
+    "small_step": 1.4737116543983575e-05,
+    "strong_consistency": 0.00013668778410647064
+  },
+  {
+    "step": 784,
+    "loss": 8.718229946680367e-05,
+    "drift": 2.3165077436715364e-05,
+    "small_step": 1.5726833225926384e-05,
+    "strong_consistency": 4.829039244214073e-05
+  },
+  {
+    "step": 785,
+    "loss": 0.00022718028048984706,
+    "drift": 1.7764172298484482e-05,
+    "small_step": 1.4893419574946165e-05,
+    "strong_consistency": 0.00019452269771136343
+  },
+  {
+    "step": 786,
+    "loss": 0.00011009465379174799,
+    "drift": 1.4986282621975988e-05,
+    "small_step": 2.0417101040948182e-05,
+    "strong_consistency": 7.469127012882382e-05
+  },
+  {
+    "step": 787,
+    "loss": 0.0004083610256202519,
+    "drift": 2.1894840756431222e-05,
+    "small_step": 1.797645199985709e-05,
+    "strong_consistency": 0.0003684897383209318
+  },
+  {
+    "step": 788,
+    "loss": 0.00010699828271754086,
+    "drift": 1.53101900650654e-05,
+    "small_step": 2.3590291675645858e-05,
+    "strong_consistency": 6.80977973388508e-05
+  },
+  {
+    "step": 789,
+    "loss": 0.00020840883371420205,
+    "drift": 2.6737665393739007e-05,
+    "small_step": 2.194670378230512e-05,
+    "strong_consistency": 0.0001597244554432109
+  },
+  {
+    "step": 790,
+    "loss": 0.0001704669848550111,
+    "drift": 2.3450838853023015e-05,
+    "small_step": 2.067629247903824e-05,
+    "strong_consistency": 0.00012633985897991806
+  },
+  {
+    "step": 791,
+    "loss": 0.00012495617556851357,
+    "drift": 3.1084717193152755e-05,
+    "small_step": 3.5994155041407794e-05,
+    "strong_consistency": 5.787730333395302e-05
+  },
+  {
+    "step": 792,
+    "loss": 0.00020131730707362294,
+    "drift": 2.8399363145581447e-05,
+    "small_step": 2.6034174879896455e-05,
+    "strong_consistency": 0.00014688377268612385
+  },
+  {
+    "step": 793,
+    "loss": 0.00027293682796880603,
+    "drift": 3.0485431125271134e-05,
+    "small_step": 3.276850839029066e-05,
+    "strong_consistency": 0.00020968288299627602
+  },
+  {
+    "step": 794,
+    "loss": 0.00017396296607330441,
+    "drift": 8.405236258113291e-06,
+    "small_step": 2.1158333765924908e-05,
+    "strong_consistency": 0.00014439939695876092
+  },
+  {
+    "step": 795,
+    "loss": 0.00011056080984417349,
+    "drift": 2.1742334865848534e-05,
+    "small_step": 2.0428133211680688e-05,
+    "strong_consistency": 6.839034176664427e-05
+  },
+  {
+    "step": 796,
+    "loss": 0.0001684705202933401,
+    "drift": 1.775170130713377e-05,
+    "small_step": 1.5853813238209113e-05,
+    "strong_consistency": 0.00013486499665305018
+  },
+  {
+    "step": 797,
+    "loss": 0.00010781364107970148,
+    "drift": 1.4840265066595748e-05,
+    "small_step": 3.0414490538532846e-05,
+    "strong_consistency": 6.255888729356229e-05
+  },
+  {
+    "step": 798,
+    "loss": 0.00015966850332915783,
+    "drift": 1.957619133463595e-05,
+    "small_step": 4.153916597715579e-05,
+    "strong_consistency": 9.855313692241907e-05
+  },
+  {
+    "step": 799,
+    "loss": 0.0001874074514489621,
+    "drift": 8.370158866455313e-06,
+    "small_step": 1.4048400771571323e-05,
+    "strong_consistency": 0.00016498888726346195
+  },
+  {
+    "step": 800,
+    "loss": 0.00010800242307595909,
+    "drift": 1.2051968951709569e-05,
+    "small_step": 2.1053097952972166e-05,
+    "strong_consistency": 7.489735435228795e-05
+  },
+  {
+    "step": 801,
+    "loss": 0.00014898323570378125,
+    "drift": 1.5091462955751922e-05,
+    "small_step": 1.720374530123081e-05,
+    "strong_consistency": 0.00011668803199427202
+  },
+  {
+    "step": 802,
+    "loss": 0.00025691400514915586,
+    "drift": 1.527863605588209e-05,
+    "small_step": 3.092346742050722e-05,
+    "strong_consistency": 0.00021071189257781953
+  },
+  {
+    "step": 803,
+    "loss": 0.00020563033467624336,
+    "drift": 1.8674058082979172e-05,
+    "small_step": 3.79384946427308e-05,
+    "strong_consistency": 0.0001490177819505334
+  },
+  {
+    "step": 804,
+    "loss": 0.0002507561875972897,
+    "drift": 2.7626243536360562e-05,
+    "small_step": 2.1855979866813868e-05,
+    "strong_consistency": 0.00020127395691815764
+  },
+  {
+    "step": 805,
+    "loss": 0.00025697750970721245,
+    "drift": 2.2894706489751115e-05,
+    "small_step": 3.0513836463796906e-05,
+    "strong_consistency": 0.0002035689540207386
+  },
+  {
+    "step": 806,
+    "loss": 8.940330008044839e-05,
+    "drift": 1.4972003555158153e-05,
+    "small_step": 1.8620297851157375e-05,
+    "strong_consistency": 5.5811000493122265e-05
+  },
+  {
+    "step": 807,
+    "loss": 0.00012697756756097078,
+    "drift": 3.336337613291107e-05,
+    "small_step": 1.4819743228144944e-05,
+    "strong_consistency": 7.879445183789358e-05
+  },
+  {
+    "step": 808,
+    "loss": 0.000172231622855179,
+    "drift": 1.7179796486743726e-05,
+    "small_step": 2.46773906837916e-05,
+    "strong_consistency": 0.00013037443568464369
+  },
+  {
+    "step": 809,
+    "loss": 0.00012260599760338664,
+    "drift": 9.110295650316402e-06,
+    "small_step": 2.176366797357332e-05,
+    "strong_consistency": 9.173202852252871e-05
+  },
+  {
+    "step": 810,
+    "loss": 8.721344056539237e-05,
+    "drift": 1.0699869562813547e-05,
+    "small_step": 1.1498973435664084e-05,
+    "strong_consistency": 6.501459574792534e-05
+  },
+  {
+    "step": 811,
+    "loss": 0.0001453342556487769,
+    "drift": 1.1645047379715834e-05,
+    "small_step": 2.5595552870072424e-05,
+    "strong_consistency": 0.00010809366358444095
+  },
+  {
+    "step": 812,
+    "loss": 0.00013006082735955715,
+    "drift": 1.2479409633670002e-05,
+    "small_step": 2.138607123924885e-05,
+    "strong_consistency": 9.619535558158532e-05
+  },
+  {
+    "step": 813,
+    "loss": 0.00015108977095223963,
+    "drift": 1.4183849998516962e-05,
+    "small_step": 2.49332697421778e-05,
+    "strong_consistency": 0.00011197264393558726
+  },
+  {
+    "step": 814,
+    "loss": 0.00011246495705563575,
+    "drift": 3.0253451768658124e-05,
+    "small_step": 2.4445716917398386e-05,
+    "strong_consistency": 5.776579200755805e-05
+  },
+  {
+    "step": 815,
+    "loss": 0.0003311011241748929,
+    "drift": 0.0002103872539009899,
+    "small_step": 2.7371796022634953e-05,
+    "strong_consistency": 9.334205242339522e-05
+  },
+  {
+    "step": 816,
+    "loss": 7.637252565473318e-05,
+    "drift": 1.2384151887090411e-05,
+    "small_step": 3.4745327866403386e-05,
+    "strong_consistency": 2.9243046810734086e-05
+  },
+  {
+    "step": 817,
+    "loss": 0.0002442222030367702,
+    "drift": 1.7415217371308245e-05,
+    "small_step": 2.099162884405814e-05,
+    "strong_consistency": 0.00020581534772645682
+  },
+  {
+    "step": 818,
+    "loss": 6.552049308083951e-05,
+    "drift": 8.164462997228839e-06,
+    "small_step": 2.539366869314108e-05,
+    "strong_consistency": 3.196235775249079e-05
+  },
+  {
+    "step": 819,
+    "loss": 7.807191286701709e-05,
+    "drift": 6.664098236797145e-06,
+    "small_step": 2.0898312868666835e-05,
+    "strong_consistency": 5.050950494478457e-05
+  },
+  {
+    "step": 820,
+    "loss": 8.507217717124149e-05,
+    "drift": 1.045549834088888e-05,
+    "small_step": 2.4630844563944265e-05,
+    "strong_consistency": 4.998583608539775e-05
+  },
+  {
+    "step": 821,
+    "loss": 8.938608516473323e-05,
+    "drift": 1.3505362403520849e-05,
+    "small_step": 2.3011349185253493e-05,
+    "strong_consistency": 5.28693781234324e-05
+  },
+  {
+    "step": 822,
+    "loss": 0.0001626173034310341,
+    "drift": 5.812883955513826e-06,
+    "small_step": 2.0014034816995263e-05,
+    "strong_consistency": 0.00013679038966074586
+  },
+  {
+    "step": 823,
+    "loss": 0.00024160162138286978,
+    "drift": 1.140411404776387e-05,
+    "small_step": 2.2946704120840877e-05,
+    "strong_consistency": 0.00020725080685224384
+  },
+  {
+    "step": 824,
+    "loss": 0.0001594776113051921,
+    "drift": 1.744786641211249e-05,
+    "small_step": 2.6058680305141024e-05,
+    "strong_consistency": 0.00011597107368288562
+  },
+  {
+    "step": 825,
+    "loss": 0.00010436589946039021,
+    "drift": 1.365775733574992e-05,
+    "small_step": 3.194539749529213e-05,
+    "strong_consistency": 5.876274371985346e-05
+  },
+  {
+    "step": 826,
+    "loss": 0.0001966675918083638,
+    "drift": 1.4226148778107017e-05,
+    "small_step": 2.7680744096869603e-05,
+    "strong_consistency": 0.00015476069529540837
+  },
+  {
+    "step": 827,
+    "loss": 7.978398934938014e-05,
+    "drift": 2.079201840388123e-05,
+    "small_step": 1.3821219909004867e-05,
+    "strong_consistency": 4.517075285548344e-05
+  },
+  {
+    "step": 828,
+    "loss": 0.00010997975914506242,
+    "drift": 1.1149236343044322e-05,
+    "small_step": 2.1729105355916545e-05,
+    "strong_consistency": 7.710141653660685e-05
+  },
+  {
+    "step": 829,
+    "loss": 0.0001653465733397752,
+    "drift": 2.007431976380758e-05,
+    "small_step": 2.534395025577396e-05,
+    "strong_consistency": 0.00011992829968221486
+  },
+  {
+    "step": 830,
+    "loss": 0.00024314914480783045,
+    "drift": 2.2312569853966124e-05,
+    "small_step": 1.9122704543406144e-05,
+    "strong_consistency": 0.0002017138758674264
+  },
+  {
+    "step": 831,
+    "loss": 9.887122723739594e-05,
+    "drift": 7.600775461469311e-06,
+    "small_step": 1.6902664356166497e-05,
+    "strong_consistency": 7.436778832925484e-05
+  },
+  {
+    "step": 832,
+    "loss": 0.00011967438331339508,
+    "drift": 1.559376141813118e-05,
+    "small_step": 3.5185508750146255e-05,
+    "strong_consistency": 6.889511132612824e-05
+  },
+  {
+    "step": 833,
+    "loss": 0.00013504987873602659,
+    "drift": 8.240071110776626e-06,
+    "small_step": 2.825323463184759e-05,
+    "strong_consistency": 9.855657117441297e-05
+  },
+  {
+    "step": 834,
+    "loss": 0.00033023316063918173,
+    "drift": 1.7577349353814498e-05,
+    "small_step": 2.564669557614252e-05,
+    "strong_consistency": 0.0002870091120712459
+  },
+  {
+    "step": 835,
+    "loss": 8.264580537797883e-05,
+    "drift": 1.1622537385846954e-05,
+    "small_step": 2.1813770217704587e-05,
+    "strong_consistency": 4.920949868392199e-05
+  },
+  {
+    "step": 836,
+    "loss": 0.00019070159760303795,
+    "drift": 1.016534588416107e-05,
+    "small_step": 3.563745485735126e-05,
+    "strong_consistency": 0.000144898789585568
+  },
+  {
+    "step": 837,
+    "loss": 0.0002648209920153022,
+    "drift": 1.273231737286551e-05,
+    "small_step": 3.411289435462095e-05,
+    "strong_consistency": 0.00021797578665427864
+  },
+  {
+    "step": 838,
+    "loss": 0.00015692498709540814,
+    "drift": 1.4798686606809497e-05,
+    "small_step": 1.3463099094224162e-05,
+    "strong_consistency": 0.00012866320321336389
+  },
+  {
+    "step": 839,
+    "loss": 8.586550393374637e-05,
+    "drift": 1.0234401997877285e-05,
+    "small_step": 2.4275197574752383e-05,
+    "strong_consistency": 5.1355906180106103e-05
+  },
+  {
+    "step": 840,
+    "loss": 0.00013600634702015668,
+    "drift": 8.892358891898766e-06,
+    "small_step": 1.7118636606028304e-05,
+    "strong_consistency": 0.00010999535152222961
+  },
+  {
+    "step": 841,
+    "loss": 0.0001248893968295306,
+    "drift": 1.1218562576686963e-05,
+    "small_step": 2.9188737244112417e-05,
+    "strong_consistency": 8.448209700873122e-05
+  },
+  {
+    "step": 842,
+    "loss": 0.00015341141261160374,
+    "drift": 9.427701115782838e-06,
+    "small_step": 3.205898974556476e-05,
+    "strong_consistency": 0.00011192472447874025
+  },
+  {
+    "step": 843,
+    "loss": 0.00022305399761535227,
+    "drift": 1.9610841263784096e-05,
+    "small_step": 2.0223365936544724e-05,
+    "strong_consistency": 0.00018321978859603405
+  },
+  {
+    "step": 844,
+    "loss": 0.00011902015830855817,
+    "drift": 2.4355918867513537e-05,
+    "small_step": 1.9004995920113288e-05,
+    "strong_consistency": 7.565924170194194e-05
+  },
+  {
+    "step": 845,
+    "loss": 0.0001781192549970001,
+    "drift": 2.830283119692467e-05,
+    "small_step": 3.6095978430239484e-05,
+    "strong_consistency": 0.00011372045264579356
+  },
+  {
+    "step": 846,
+    "loss": 9.689810394775122e-05,
+    "drift": 1.4759978512302041e-05,
+    "small_step": 3.225346517865546e-05,
+    "strong_consistency": 4.988466389477253e-05
+  },
+  {
+    "step": 847,
+    "loss": 9.407223842572421e-05,
+    "drift": 2.5786554033402354e-05,
+    "small_step": 2.14343181141885e-05,
+    "strong_consistency": 4.6851371735101566e-05
+  },
+  {
+    "step": 848,
+    "loss": 0.00019560471992008388,
+    "drift": 1.3556796147895511e-05,
+    "small_step": 2.499761467333883e-05,
+    "strong_consistency": 0.00015705030818935484
+  },
+  {
+    "step": 849,
+    "loss": 0.00011792591249104589,
+    "drift": 2.1236402972135693e-05,
+    "small_step": 1.8947575881611556e-05,
+    "strong_consistency": 7.774193363729864e-05
+  },
+  {
+    "step": 850,
+    "loss": 8.653268741909415e-05,
+    "drift": 8.803272066870704e-06,
+    "small_step": 3.0328734283102676e-05,
+    "strong_consistency": 4.740067743114196e-05
+  },
+  {
+    "step": 851,
+    "loss": 0.0002018442319240421,
+    "drift": 1.0126359484274872e-05,
+    "small_step": 1.699239874142222e-05,
+    "strong_consistency": 0.0001747254718793556
+  },
+  {
+    "step": 852,
+    "loss": 7.989676669239998e-05,
+    "drift": 1.0434408068249468e-05,
+    "small_step": 3.0509983844240196e-05,
+    "strong_consistency": 3.895237387041561e-05
+  },
+  {
+    "step": 853,
+    "loss": 9.865731408353895e-05,
+    "drift": 9.307079380960204e-06,
+    "small_step": 1.4497021766146645e-05,
+    "strong_consistency": 7.48532111174427e-05
+  },
+  {
+    "step": 854,
+    "loss": 0.00013457184832077473,
+    "drift": 8.594007340434473e-06,
+    "small_step": 2.313977893209085e-05,
+    "strong_consistency": 0.0001028380575007759
+  },
+  {
+    "step": 855,
+    "loss": 0.00010658713290467858,
+    "drift": 2.283421235915739e-05,
+    "small_step": 2.693256647035014e-05,
+    "strong_consistency": 5.682035771314986e-05
+  },
+  {
+    "step": 856,
+    "loss": 9.823449363466352e-05,
+    "drift": 1.876359419838991e-05,
+    "small_step": 2.5691624614410102e-05,
+    "strong_consistency": 5.377927664085291e-05
+  },
+  {
+    "step": 857,
+    "loss": 9.515149577055126e-05,
+    "drift": 2.3274627892533317e-05,
+    "small_step": 1.4360190107254311e-05,
+    "strong_consistency": 5.751667413278483e-05
+  },
+  {
+    "step": 858,
+    "loss": 0.00017120596021413803,
+    "drift": 1.0666954040061682e-05,
+    "small_step": 2.408335240033921e-05,
+    "strong_consistency": 0.00013645565195474774
+  },
+  {
+    "step": 859,
+    "loss": 6.775851943530142e-05,
+    "drift": 8.664243068778887e-06,
+    "small_step": 2.4310604203492403e-05,
+    "strong_consistency": 3.4783668525051326e-05
+  },
+  {
+    "step": 860,
+    "loss": 0.00010814279085025191,
+    "drift": 7.381653176707914e-06,
+    "small_step": 2.2671083570457995e-05,
+    "strong_consistency": 7.809005182934925e-05
+  },
+  {
+    "step": 861,
+    "loss": 0.00017187654157169163,
+    "drift": 5.320172931533307e-06,
+    "small_step": 1.6940590285230428e-05,
+    "strong_consistency": 0.0001496157783549279
+  },
+  {
+    "step": 862,
+    "loss": 0.0001046257239067927,
+    "drift": 1.0779742297017947e-05,
+    "small_step": 2.9593022190965712e-05,
+    "strong_consistency": 6.425295578083023e-05
+  },
+  {
+    "step": 863,
+    "loss": 0.0001573800400365144,
+    "drift": 2.3337333914241754e-05,
+    "small_step": 2.3118078388506547e-05,
+    "strong_consistency": 0.00011092463682871312
+  },
+  {
+    "step": 864,
+    "loss": 0.00014411115262191743,
+    "drift": 6.809770638938062e-06,
+    "small_step": 2.9785031074425206e-05,
+    "strong_consistency": 0.00010751635272754356
+  },
+  {
+    "step": 865,
+    "loss": 8.753711881581694e-05,
+    "drift": 4.740081749332603e-06,
+    "small_step": 2.116860014211852e-05,
+    "strong_consistency": 6.162843783386052e-05
+  },
+  {
+    "step": 866,
+    "loss": 0.00028100211056880653,
+    "drift": 4.195900601189351e-06,
+    "small_step": 2.176142152165994e-05,
+    "strong_consistency": 0.0002550447825342417
+  },
+  {
+    "step": 867,
+    "loss": 0.00019455020083114505,
+    "drift": 1.0338558240619022e-05,
+    "small_step": 2.0486395442276262e-05,
+    "strong_consistency": 0.00016372524260077626
+  },
+  {
+    "step": 868,
+    "loss": 0.00015428222832269967,
+    "drift": 7.158529115258716e-06,
+    "small_step": 2.135744216502644e-05,
+    "strong_consistency": 0.0001257662515854463
+  },
+  {
+    "step": 869,
+    "loss": 0.00015423235890921205,
+    "drift": 4.564265691442415e-05,
+    "small_step": 2.3786600650055334e-05,
+    "strong_consistency": 8.480310498271137e-05
+  },
+  {
+    "step": 870,
+    "loss": 0.00016965641407296062,
+    "drift": 6.8345248109835666e-06,
+    "small_step": 1.990665987250395e-05,
+    "strong_consistency": 0.00014291523257270455
+  },
+  {
+    "step": 871,
+    "loss": 0.00015129121311474591,
+    "drift": 7.395912689389661e-06,
+    "small_step": 2.7879934350494295e-05,
+    "strong_consistency": 0.00011601536971284077
+  },
+  {
+    "step": 872,
+    "loss": 8.504508150508627e-05,
+    "drift": 1.1033609553123824e-05,
+    "small_step": 1.7689606465864927e-05,
+    "strong_consistency": 5.632186366710812e-05
+  },
+  {
+    "step": 873,
+    "loss": 0.00020852407033089548,
+    "drift": 6.964907242945628e-06,
+    "small_step": 2.652904913702514e-05,
+    "strong_consistency": 0.00017503011622466147
+  },
+  {
+    "step": 874,
+    "loss": 0.0001114896876970306,
+    "drift": 1.1391119187464938e-05,
+    "small_step": 1.4850847037450876e-05,
+    "strong_consistency": 8.52477242005989e-05
+  },
+  {
+    "step": 875,
+    "loss": 0.00010420836042612791,
+    "drift": 6.720087640132988e-06,
+    "small_step": 3.0122102543828078e-05,
+    "strong_consistency": 6.73661706969142e-05
+  },
+  {
+    "step": 876,
+    "loss": 7.117519999155775e-05,
+    "drift": 8.233304470195435e-06,
+    "small_step": 1.4364100934471935e-05,
+    "strong_consistency": 4.857779640587978e-05
+  },
+  {
+    "step": 877,
+    "loss": 0.00023934102500788867,
+    "drift": 1.234648243553238e-05,
+    "small_step": 2.1282166926539503e-05,
+    "strong_consistency": 0.0002057123783743009
+  },
+  {
+    "step": 878,
+    "loss": 0.0001256985851796344,
+    "drift": 1.0780993761727586e-05,
+    "small_step": 2.220704482169822e-05,
+    "strong_consistency": 9.271054295822978e-05
+  },
+  {
+    "step": 879,
+    "loss": 9.813340147957206e-05,
+    "drift": 1.3067970940028317e-05,
+    "small_step": 1.8512668248149566e-05,
+    "strong_consistency": 6.655276229139417e-05
+  },
+  {
+    "step": 880,
+    "loss": 9.098902228288352e-05,
+    "drift": 1.4630814803240355e-05,
+    "small_step": 2.356545883230865e-05,
+    "strong_consistency": 5.279274773783982e-05
+  },
+  {
+    "step": 881,
+    "loss": 0.00011109279876109213,
+    "drift": 2.0104127543163486e-05,
+    "small_step": 1.8187902242061682e-05,
+    "strong_consistency": 7.280077261384577e-05
+  },
+  {
+    "step": 882,
+    "loss": 0.00012082376633770764,
+    "drift": 1.5386987797683105e-05,
+    "small_step": 1.7249330994673073e-05,
+    "strong_consistency": 8.818745118333027e-05
+  },
+  {
+    "step": 883,
+    "loss": 0.00013576497440226376,
+    "drift": 1.0254530934616923e-05,
+    "small_step": 1.3050747838860843e-05,
+    "strong_consistency": 0.00011245970381423831
+  },
+  {
+    "step": 884,
+    "loss": 0.00011021835234714672,
+    "drift": 9.237415724783204e-06,
+    "small_step": 3.306601502117701e-05,
+    "strong_consistency": 6.791492342017591e-05
+  },
+  {
+    "step": 885,
+    "loss": 0.0001396820298396051,
+    "drift": 9.566587323206477e-06,
+    "small_step": 2.2196178179001436e-05,
+    "strong_consistency": 0.0001079192734323442
+  },
+  {
+    "step": 886,
+    "loss": 0.0001254915405297652,
+    "drift": 1.4572933650924824e-05,
+    "small_step": 2.837157080648467e-05,
+    "strong_consistency": 8.254703425336629e-05
+  },
+  {
+    "step": 887,
+    "loss": 0.000129972817376256,
+    "drift": 6.95540757078561e-06,
+    "small_step": 2.2261107005761005e-05,
+    "strong_consistency": 0.00010075630416395143
+  },
+  {
+    "step": 888,
+    "loss": 0.0001742915774229914,
+    "drift": 7.683177500439342e-06,
+    "small_step": 9.283964573114645e-06,
+    "strong_consistency": 0.0001573244371684268
+  },
+  {
+    "step": 889,
+    "loss": 0.00020253562252037227,
+    "drift": 1.5454543245141394e-05,
+    "small_step": 1.8703929526964203e-05,
+    "strong_consistency": 0.00016837714065331966
+  },
+  {
+    "step": 890,
+    "loss": 0.00010928520350717008,
+    "drift": 1.3483149814419448e-05,
+    "small_step": 3.7098874599905685e-05,
+    "strong_consistency": 5.870317545486614e-05
+  },
+  {
+    "step": 891,
+    "loss": 7.941378862597048e-05,
+    "drift": 6.250122169149108e-06,
+    "small_step": 3.082331386394799e-05,
+    "strong_consistency": 4.2340350773883983e-05
+  },
+  {
+    "step": 892,
+    "loss": 0.00011429563164710999,
+    "drift": 2.2779302526032552e-05,
+    "small_step": 1.2408029760990757e-05,
+    "strong_consistency": 7.910830026958138e-05
+  },
+  {
+    "step": 893,
+    "loss": 0.00014982567518018186,
+    "drift": 1.2712591342278756e-05,
+    "small_step": 2.6476613129489124e-05,
+    "strong_consistency": 0.00011063647252740338
+  },
+  {
+    "step": 894,
+    "loss": 9.046682680491358e-05,
+    "drift": 1.1058998097723816e-05,
+    "small_step": 2.5828558136709034e-05,
+    "strong_consistency": 5.357927511795424e-05
+  },
+  {
+    "step": 895,
+    "loss": 0.0001831679983297363,
+    "drift": 1.230602811119752e-05,
+    "small_step": 2.248957935080398e-05,
+    "strong_consistency": 0.0001483723899582401
+  },
+  {
+    "step": 896,
+    "loss": 9.408278856426477e-05,
+    "drift": 7.505826488340972e-06,
+    "small_step": 3.726763679878786e-05,
+    "strong_consistency": 4.930932118440978e-05
+  },
+  {
+    "step": 897,
+    "loss": 0.0001496028999099508,
+    "drift": 4.185935540590435e-05,
+    "small_step": 2.196287277911324e-05,
+    "strong_consistency": 8.57806735439226e-05
+  },
+  {
+    "step": 898,
+    "loss": 6.618650513701141e-05,
+    "drift": 8.359321327588987e-06,
+    "small_step": 2.1275751350913197e-05,
+    "strong_consistency": 3.655143518699333e-05
+  },
+  {
+    "step": 899,
+    "loss": 0.00014448550064116716,
+    "drift": 1.7509388271719217e-05,
+    "small_step": 1.5406394595629536e-05,
+    "strong_consistency": 0.00011156971595482901
+  },
+  {
+    "step": 900,
+    "loss": 0.0001996731589315459,
+    "drift": 6.2291292124427855e-06,
+    "small_step": 2.647979090397712e-05,
+    "strong_consistency": 0.0001669642369961366
+  },
+  {
+    "step": 901,
+    "loss": 8.910120232030749e-05,
+    "drift": 5.288833108352264e-06,
+    "small_step": 2.840009801730048e-05,
+    "strong_consistency": 5.54122707399074e-05
+  },
+  {
+    "step": 902,
+    "loss": 0.00012891947699245065,
+    "drift": 6.576710347871995e-06,
+    "small_step": 2.4512533855158836e-05,
+    "strong_consistency": 9.783023415366188e-05
+  },
+  {
+    "step": 903,
+    "loss": 0.00019482345669530332,
+    "drift": 4.5128062993171625e-06,
+    "small_step": 3.364886651979759e-05,
+    "strong_consistency": 0.00015666178660467267
+  },
+  {
+    "step": 904,
+    "loss": 8.03143484517932e-05,
+    "drift": 7.817249752406497e-06,
+    "small_step": 2.775543907773681e-05,
+    "strong_consistency": 4.474165689316578e-05
+  },
+  {
+    "step": 905,
+    "loss": 0.00019170483574271202,
+    "drift": 8.588136552134529e-06,
+    "small_step": 3.316314541734755e-05,
+    "strong_consistency": 0.00014995355741120875
+  },
+  {
+    "step": 906,
+    "loss": 0.00019365879416000098,
+    "drift": 1.4195831681718118e-05,
+    "small_step": 1.5384121070383117e-05,
+    "strong_consistency": 0.00016407883958891034
+  },
+  {
+    "step": 907,
+    "loss": 0.00012190286361146718,
+    "drift": 1.3203994967625476e-05,
+    "small_step": 1.7304071661783382e-05,
+    "strong_consistency": 9.139479516306892e-05
+  },
+  {
+    "step": 908,
+    "loss": 0.00021784350974485278,
+    "drift": 3.468186332611367e-05,
+    "small_step": 3.004616519319825e-05,
+    "strong_consistency": 0.00015311548486351967
+  },
+  {
+    "step": 909,
+    "loss": 0.00010799511801451445,
+    "drift": 1.2599276487890165e-05,
+    "small_step": 2.1303334506228566e-05,
+    "strong_consistency": 7.409250974887982e-05
+  },
+  {
+    "step": 910,
+    "loss": 7.621666736667976e-05,
+    "drift": 7.031876975815976e-06,
+    "small_step": 2.0304107238189317e-05,
+    "strong_consistency": 4.8880683607421815e-05
+  },
+  {
+    "step": 911,
+    "loss": 8.484895079163834e-05,
+    "drift": 1.0158257282455452e-05,
+    "small_step": 1.901258474390488e-05,
+    "strong_consistency": 5.567810876527801e-05
+  },
+  {
+    "step": 912,
+    "loss": 0.00014812110748607665,
+    "drift": 5.236880042502889e-06,
+    "small_step": 2.507961107767187e-05,
+    "strong_consistency": 0.00011780461500165984
+  },
+  {
+    "step": 913,
+    "loss": 0.00016941923240665346,
+    "drift": 6.05405830356176e-06,
+    "small_step": 3.0640021577710286e-05,
+    "strong_consistency": 0.00013272515207063407
+  },
+  {
+    "step": 914,
+    "loss": 0.00010258654219796881,
+    "drift": 9.201494322041981e-06,
+    "small_step": 2.30114546866389e-05,
+    "strong_consistency": 7.037359318928793e-05
+  },
+  {
+    "step": 915,
+    "loss": 0.00016666611190885305,
+    "drift": 8.68775441631442e-06,
+    "small_step": 2.013336415984668e-05,
+    "strong_consistency": 0.00013784499606117606
+  },
+  {
+    "step": 916,
+    "loss": 0.0001691334618953988,
+    "drift": 8.707962479093112e-06,
+    "small_step": 2.3446853447239846e-05,
+    "strong_consistency": 0.00013697864778805524
+  },
+  {
+    "step": 917,
+    "loss": 0.00010811367974383757,
+    "drift": 1.4538153664034326e-05,
+    "small_step": 1.6939187844400294e-05,
+    "strong_consistency": 7.663633732590824e-05
+  },
+  {
+    "step": 918,
+    "loss": 0.00013893877621740103,
+    "drift": 6.431492693081964e-06,
+    "small_step": 1.845324004534632e-05,
+    "strong_consistency": 0.00011405404075048864
+  },
+  {
+    "step": 919,
+    "loss": 0.00011382094817236066,
+    "drift": 7.11125903762877e-06,
+    "small_step": 1.584028359502554e-05,
+    "strong_consistency": 9.086940553970635e-05
+  },
+  {
+    "step": 920,
+    "loss": 8.75768018886447e-05,
+    "drift": 8.234406777773984e-06,
+    "small_step": 2.2784681277698837e-05,
+    "strong_consistency": 5.6557713833171874e-05
+  },
+  {
+    "step": 921,
+    "loss": 0.00012031778896925971,
+    "drift": 3.727948569576256e-05,
+    "small_step": 2.3310838514589705e-05,
+    "strong_consistency": 5.972746293991804e-05
+  },
+  {
+    "step": 922,
+    "loss": 9.513540135230869e-05,
+    "drift": 8.855509804561734e-06,
+    "small_step": 9.822603715292644e-06,
+    "strong_consistency": 7.645729056093842e-05
+  },
+  {
+    "step": 923,
+    "loss": 8.467782754451036e-05,
+    "drift": 8.452275324088987e-06,
+    "small_step": 2.501783092156984e-05,
+    "strong_consistency": 5.120771675137803e-05
+  },
+  {
+    "step": 924,
+    "loss": 0.0001466384856030345,
+    "drift": 1.2329646779107861e-05,
+    "small_step": 3.2591276976745576e-05,
+    "strong_consistency": 0.00010171755275223404
+  },
+  {
+    "step": 925,
+    "loss": 8.732997957849875e-05,
+    "drift": 6.050062438589521e-06,
+    "small_step": 1.7562311768415384e-05,
+    "strong_consistency": 6.371760537149385e-05
+  },
+  {
+    "step": 926,
+    "loss": 0.00015531713142991066,
+    "drift": 9.510488780506421e-06,
+    "small_step": 4.038652332383208e-05,
+    "strong_consistency": 0.00010542011295910925
+  },
+  {
+    "step": 927,
+    "loss": 0.00020551434135995805,
+    "drift": 7.061745691316901e-06,
+    "small_step": 3.80478122679051e-05,
+    "strong_consistency": 0.0001604047865839675
+  },
+  {
+    "step": 928,
+    "loss": 7.967986311996356e-05,
+    "drift": 5.62479817745043e-06,
+    "small_step": 1.777041870809626e-05,
+    "strong_consistency": 5.628464714391157e-05
+  },
+  {
+    "step": 929,
+    "loss": 0.00012751310714520514,
+    "drift": 4.453993824427016e-06,
+    "small_step": 2.3359076294582337e-05,
+    "strong_consistency": 9.970003884518519e-05
+  },
+  {
+    "step": 930,
+    "loss": 8.353440352948382e-05,
+    "drift": 2.9617276595672593e-06,
+    "small_step": 2.7821120966109447e-05,
+    "strong_consistency": 5.275155490380712e-05
+  },
+  {
+    "step": 931,
+    "loss": 0.00010741213918663561,
+    "drift": 5.904971658310387e-06,
+    "small_step": 1.959134533535689e-05,
+    "strong_consistency": 8.191582310246304e-05
+  },
+  {
+    "step": 932,
+    "loss": 0.0002896592777688056,
+    "drift": 2.8363530873320997e-05,
+    "small_step": 2.0969140678062104e-05,
+    "strong_consistency": 0.00024032661167439073
+  },
+  {
+    "step": 933,
+    "loss": 7.880460179876536e-05,
+    "drift": 5.178624178370228e-06,
+    "small_step": 2.06960739888018e-05,
+    "strong_consistency": 5.292990317684598e-05
+  },
+  {
+    "step": 934,
+    "loss": 7.180434477049857e-05,
+    "drift": 8.703763342055026e-06,
+    "small_step": 2.0842318917857483e-05,
+    "strong_consistency": 4.225826705805957e-05
+  },
+  {
+    "step": 935,
+    "loss": 0.00010522242519073188,
+    "drift": 7.192213615780929e-06,
+    "small_step": 2.1281650333548896e-05,
+    "strong_consistency": 7.674856169614941e-05
+  },
+  {
+    "step": 936,
+    "loss": 0.0003330550971440971,
+    "drift": 0.0001482301449868828,
+    "small_step": 2.5031311452039517e-05,
+    "strong_consistency": 0.00015979362069629133
+  },
+  {
+    "step": 937,
+    "loss": 6.820008275099099e-05,
+    "drift": 5.937638889008667e-06,
+    "small_step": 1.4692461263621226e-05,
+    "strong_consistency": 4.7569978050887585e-05
+  },
+  {
+    "step": 938,
+    "loss": 7.56628141971305e-05,
+    "drift": 3.6792025639442727e-06,
+    "small_step": 1.505340333096683e-05,
+    "strong_consistency": 5.6930206483229995e-05
+  },
+  {
+    "step": 939,
+    "loss": 0.00010439800098538399,
+    "drift": 3.192903477611253e-06,
+    "small_step": 1.9891578631359152e-05,
+    "strong_consistency": 8.131351933116093e-05
+  },
+  {
+    "step": 940,
+    "loss": 9.656389011070132e-05,
+    "drift": 5.270100245979847e-06,
+    "small_step": 2.2425203496823087e-05,
+    "strong_consistency": 6.886858318466693e-05
+  },
+  {
+    "step": 941,
+    "loss": 0.0004649981565307826,
+    "drift": 2.1372259652707726e-05,
+    "small_step": 3.694796760100871e-05,
+    "strong_consistency": 0.00040667792200110853
+  },
+  {
+    "step": 942,
+    "loss": 0.00027151472750119865,
+    "drift": 7.090521648933645e-06,
+    "small_step": 2.4179409592761658e-05,
+    "strong_consistency": 0.00024024478625506163
+  },
+  {
+    "step": 943,
+    "loss": 7.46160076232627e-05,
+    "drift": 1.38491432153387e-05,
+    "small_step": 1.4162074876367114e-05,
+    "strong_consistency": 4.660478589357808e-05
+  },
+  {
+    "step": 944,
+    "loss": 8.233464905060828e-05,
+    "drift": 1.0535452020121738e-05,
+    "small_step": 2.217654400737956e-05,
+    "strong_consistency": 4.9622656661085784e-05
+  },
+  {
+    "step": 945,
+    "loss": 0.00018916657427325845,
+    "drift": 2.1150515749468468e-05,
+    "small_step": 2.5429068045923486e-05,
+    "strong_consistency": 0.0001425869995728135
+  },
+  {
+    "step": 946,
+    "loss": 0.0002679314638953656,
+    "drift": 2.3111802875064313e-05,
+    "small_step": 1.7373055015923455e-05,
+    "strong_consistency": 0.00022744660964235663
+  },
+  {
+    "step": 947,
+    "loss": 0.00014437525533139706,
+    "drift": 2.3031758246361278e-05,
+    "small_step": 2.301755012013018e-05,
+    "strong_consistency": 9.832593786995858e-05
+  },
+  {
+    "step": 948,
+    "loss": 0.00015680551587138325,
+    "drift": 1.2777897609339561e-05,
+    "small_step": 2.468835373292677e-05,
+    "strong_consistency": 0.00011933925998164341
+  },
+  {
+    "step": 949,
+    "loss": 0.00011242304026382044,
+    "drift": 6.135441708465805e-06,
+    "small_step": 3.7758374674012884e-05,
+    "strong_consistency": 6.85292252455838e-05
+  },
+  {
+    "step": 950,
+    "loss": 9.582900383975357e-05,
+    "drift": 8.319615517393686e-06,
+    "small_step": 2.5760973585420288e-05,
+    "strong_consistency": 6.17484183749184e-05
+  },
+  {
+    "step": 951,
+    "loss": 0.00016832296387292445,
+    "drift": 8.16217561805388e-06,
+    "small_step": 2.18984205275774e-05,
+    "strong_consistency": 0.00013826237409375608
+  },
+  {
+    "step": 952,
+    "loss": 0.00012408055772539228,
+    "drift": 8.554568012186792e-06,
+    "small_step": 1.9493001673254184e-05,
+    "strong_consistency": 9.603299258742481e-05
+  },
+  {
+    "step": 953,
+    "loss": 0.00010095589095726609,
+    "drift": 4.856906343775336e-06,
+    "small_step": 3.0142184186843224e-05,
+    "strong_consistency": 6.595680315513164e-05
+  },
+  {
+    "step": 954,
+    "loss": 0.00020808400586247444,
+    "drift": 6.80904122418724e-06,
+    "small_step": 3.6672267015092075e-05,
+    "strong_consistency": 0.00016460269398521632
+  },
+  {
+    "step": 955,
+    "loss": 0.0002133109956048429,
+    "drift": 5.4918223213462625e-06,
+    "small_step": 3.032799759239424e-05,
+    "strong_consistency": 0.00017749117978382856
+  },
+  {
+    "step": 956,
+    "loss": 0.00010083588131237775,
+    "drift": 5.141718247614335e-06,
+    "small_step": 2.563051566539798e-05,
+    "strong_consistency": 7.006364467088133e-05
+  },
+  {
+    "step": 957,
+    "loss": 0.0001309928484261036,
+    "drift": 1.1249720955675002e-05,
+    "small_step": 2.3864333343226463e-05,
+    "strong_consistency": 9.587880049366504e-05
+  },
+  {
+    "step": 958,
+    "loss": 0.00013603935076389462,
+    "drift": 1.7529733668197878e-05,
+    "small_step": 2.765801218629349e-05,
+    "strong_consistency": 9.085160127142444e-05
+  },
+  {
+    "step": 959,
+    "loss": 0.0001087324635591358,
+    "drift": 7.783988621667959e-06,
+    "small_step": 2.9199991331552155e-05,
+    "strong_consistency": 7.174847996793687e-05
+  },
+  {
+    "step": 960,
+    "loss": 0.00027939703431911767,
+    "drift": 9.967994628823362e-06,
+    "small_step": 1.7923071936820634e-05,
+    "strong_consistency": 0.00025150596047751606
+  },
+  {
+    "step": 961,
+    "loss": 0.00015560939209535718,
+    "drift": 3.718105290317908e-05,
+    "small_step": 3.0681152566103265e-05,
+    "strong_consistency": 8.774718298809603e-05
+  },
+  {
+    "step": 962,
+    "loss": 7.425656076520681e-05,
+    "drift": 9.045090337167494e-06,
+    "small_step": 2.9635870305355638e-05,
+    "strong_consistency": 3.5575601941673085e-05
+  },
+  {
+    "step": 963,
+    "loss": 9.095590212382376e-05,
+    "drift": 1.159509065473685e-05,
+    "small_step": 1.965795127034653e-05,
+    "strong_consistency": 5.970286292722449e-05
+  },
+  {
+    "step": 964,
+    "loss": 0.0001384799979859963,
+    "drift": 8.028484444366768e-06,
+    "small_step": 3.0447752578766085e-05,
+    "strong_consistency": 0.00010000375914387405
+  },
+  {
+    "step": 965,
+    "loss": 0.00010286326869390905,
+    "drift": 1.4486808140645735e-05,
+    "small_step": 3.594719237298705e-05,
+    "strong_consistency": 5.242926999926567e-05
+  },
+  {
+    "step": 966,
+    "loss": 9.965550270862877e-05,
+    "drift": 1.895475907076616e-05,
+    "small_step": 2.307326576556079e-05,
+    "strong_consistency": 5.762747605331242e-05
+  },
+  {
+    "step": 967,
+    "loss": 8.862337563186884e-05,
+    "drift": 1.3575886441685725e-05,
+    "small_step": 2.84656180156162e-05,
+    "strong_consistency": 4.658187390305102e-05
+  },
+  {
+    "step": 968,
+    "loss": 8.869577141012996e-05,
+    "drift": 8.13645965536125e-06,
+    "small_step": 2.399468212388456e-05,
+    "strong_consistency": 5.656462599290535e-05
+  },
+  {
+    "step": 969,
+    "loss": 7.113262836355716e-05,
+    "drift": 4.8809629333845805e-06,
+    "small_step": 2.3783455617376603e-05,
+    "strong_consistency": 4.246821117703803e-05
+  },
+  {
+    "step": 970,
+    "loss": 0.00012524149497039616,
+    "drift": 6.227333869901486e-06,
+    "small_step": 3.178334009135142e-05,
+    "strong_consistency": 8.723081555217505e-05
+  },
+  {
+    "step": 971,
+    "loss": 0.00011293330317130312,
+    "drift": 7.1537051553605124e-06,
+    "small_step": 2.628046422614716e-05,
+    "strong_consistency": 7.949913560878485e-05
+  },
+  {
+    "step": 972,
+    "loss": 0.0001504954998381436,
+    "drift": 1.0977661986544263e-05,
+    "small_step": 2.949425470433198e-05,
+    "strong_consistency": 0.00011002358223777264
+  },
+  {
+    "step": 973,
+    "loss": 0.0002252893173135817,
+    "drift": 1.019084174913587e-05,
+    "small_step": 3.21488369081635e-05,
+    "strong_consistency": 0.00018294964684173465
+  },
+  {
+    "step": 974,
+    "loss": 0.00016404814959969372,
+    "drift": 6.077239959267899e-06,
+    "small_step": 4.1912353481166065e-05,
+    "strong_consistency": 0.00011605855252128094
+  },
+  {
+    "step": 975,
+    "loss": 0.00020390804274939,
+    "drift": 4.5783592213410884e-05,
+    "small_step": 3.035905865544919e-05,
+    "strong_consistency": 0.00012776539369951934
+  },
+  {
+    "step": 976,
+    "loss": 7.612646732013673e-05,
+    "drift": 9.578738172422163e-06,
+    "small_step": 2.877928091038484e-05,
+    "strong_consistency": 3.776844823732972e-05
+  },
+  {
+    "step": 977,
+    "loss": 7.250733324326575e-05,
+    "drift": 1.6298728951369412e-05,
+    "small_step": 2.2340866053127684e-05,
+    "strong_consistency": 3.386773823876865e-05
+  },
+  {
+    "step": 978,
+    "loss": 9.200487693306059e-05,
+    "drift": 1.1980527233390603e-05,
+    "small_step": 1.7558730178279802e-05,
+    "strong_consistency": 6.246562406886369e-05
+  },
+  {
+    "step": 979,
+    "loss": 9.283156396122649e-05,
+    "drift": 1.1358205483702477e-05,
+    "small_step": 3.413235754123889e-05,
+    "strong_consistency": 4.7341000026790425e-05
+  },
+  {
+    "step": 980,
+    "loss": 8.234067354351282e-05,
+    "drift": 9.376175512443297e-06,
+    "small_step": 2.6713383704191074e-05,
+    "strong_consistency": 4.625111978384666e-05
+  },
+  {
+    "step": 981,
+    "loss": 8.500039257341996e-05,
+    "drift": 5.096579116070643e-06,
+    "small_step": 2.2806949345977046e-05,
+    "strong_consistency": 5.7096862292382866e-05
+  },
+  {
+    "step": 982,
+    "loss": 0.00010112726886291057,
+    "drift": 4.648071808333043e-06,
+    "small_step": 1.661048190726433e-05,
+    "strong_consistency": 7.98687178757973e-05
+  },
+  {
+    "step": 983,
+    "loss": 0.0001232672657351941,
+    "drift": 1.3015870536037255e-05,
+    "small_step": 3.4158856578869745e-05,
+    "strong_consistency": 7.609253952978179e-05
+  },
+  {
+    "step": 984,
+    "loss": 8.446902938885614e-05,
+    "drift": 1.1062249541282654e-05,
+    "small_step": 2.8687369194813073e-05,
+    "strong_consistency": 4.4719410652760416e-05
+  },
+  {
+    "step": 985,
+    "loss": 9.894095273921266e-05,
+    "drift": 5.685340511263348e-06,
+    "small_step": 2.6859459467232227e-05,
+    "strong_consistency": 6.639615457970649e-05
+  },
+  {
+    "step": 986,
+    "loss": 0.00018552271649241447,
+    "drift": 2.461463191139046e-05,
+    "small_step": 4.1525676351739094e-05,
+    "strong_consistency": 0.00011938241368625313
+  },
+  {
+    "step": 987,
+    "loss": 8.954734948929399e-05,
+    "drift": 5.603790214081528e-06,
+    "small_step": 2.18430686800275e-05,
+    "strong_consistency": 6.210048741195351e-05
+  },
+  {
+    "step": 988,
+    "loss": 8.378847996937111e-05,
+    "drift": 6.719214070471935e-06,
+    "small_step": 2.1655599994119257e-05,
+    "strong_consistency": 5.5413664085790515e-05
+  },
+  {
+    "step": 989,
+    "loss": 8.7347136286553e-05,
+    "drift": 8.899616659618914e-06,
+    "small_step": 2.229001074738335e-05,
+    "strong_consistency": 5.615750706056133e-05
+  },
+  {
+    "step": 990,
+    "loss": 8.718145545572042e-05,
+    "drift": 6.303583631961374e-06,
+    "small_step": 1.6279042029054835e-05,
+    "strong_consistency": 6.459883297793567e-05
+  },
+  {
+    "step": 991,
+    "loss": 0.0002226249489467591,
+    "drift": 1.4545756130246446e-05,
+    "small_step": 2.011740616580937e-05,
+    "strong_consistency": 0.00018796177755575627
+  },
+  {
+    "step": 992,
+    "loss": 0.000151047483086586,
+    "drift": 3.6015146633872064e-06,
+    "small_step": 1.7804244635044597e-05,
+    "strong_consistency": 0.00012964171764906496
+  },
+  {
+    "step": 993,
+    "loss": 8.894021448213607e-05,
+    "drift": 8.588195669290144e-06,
+    "small_step": 2.6232024538330734e-05,
+    "strong_consistency": 5.4119995184009895e-05
+  },
+  {
+    "step": 994,
+    "loss": 0.0003583335201255977,
+    "drift": 1.147491730080219e-05,
+    "small_step": 2.2225849534152076e-05,
+    "strong_consistency": 0.0003246327687520534
+  },
+  {
+    "step": 995,
+    "loss": 0.00013832679542247206,
+    "drift": 7.942558113427367e-06,
+    "small_step": 2.435501664876938e-05,
+    "strong_consistency": 0.00010602921975078061
+  },
+  {
+    "step": 996,
+    "loss": 5.945746670477092e-05,
+    "drift": 9.64665105129825e-06,
+    "small_step": 2.228633275080938e-05,
+    "strong_consistency": 2.7524483812157996e-05
+  },
+  {
+    "step": 997,
+    "loss": 8.32601435831748e-05,
+    "drift": 5.506738489202689e-06,
+    "small_step": 3.0542942113243043e-05,
+    "strong_consistency": 4.721046207123436e-05
+  },
+  {
+    "step": 998,
+    "loss": 0.0001640265400055796,
+    "drift": 1.0454782568558585e-05,
+    "small_step": 2.9306076612556353e-05,
+    "strong_consistency": 0.00012426568719092757
+  },
+  {
+    "step": 999,
+    "loss": 6.190027488628402e-05,
+    "drift": 7.571642527182121e-06,
+    "small_step": 2.6692607207223773e-05,
+    "strong_consistency": 2.7636024242383428e-05
+  }
+]
diff --git a/lecture_6/verified_examples/ssfm/report.json b/lecture_6/verified_examples/ssfm/report.json
new file mode 100644
index 0000000000000000000000000000000000000000..fe484cdf6f7c11547cbbdf66342cf5326cce3e18
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm/report.json
@@ -0,0 +1,21 @@
+{
+  "method": "ssfm",
+  "data_kind": "ornstein-uhlenbeck",
+  "train_loss_first_20_mean": 0.40951571241021156,
+  "train_loss_last_20_mean": 0.00012182250538899098,
+  "training_steps": 1000,
+  "python": "3.12.14",
+  "torch": "2.9.1+cpu",
+  "sample_steps": 8,
+  "samples": 128,
+  "sampling_seed": 6370,
+  "same_noise_reference_rmse": 0.004829633515328169,
+  "direct_vs_split_rmse": 0.03928930684924126,
+  "one_step_reference_rmse": 0.0396474152803421,
+  "reference_em_steps": 512,
+  "sample_variance": 0.3847738206386566,
+  "exact_terminal_variance": 0.34717813884364257,
+  "reference_note": "Same Brownian increments; EM reference retains finite discretization error.",
+  "finite_samples": true,
+  "elapsed_seconds": 2.4875807970020105
+}
diff --git a/lecture_6/verified_examples/ssfm/samples.txt b/lecture_6/verified_examples/ssfm/samples.txt
new file mode 100644
index 0000000000000000000000000000000000000000..8773b28038b214d75299d70447fa31ed4194353f
--- /dev/null
+++ b/lecture_6/verified_examples/ssfm/samples.txt
@@ -0,0 +1,128 @@
+-0.6834419
+-0.6789215
+-0.4562523
+-0.3183639
+-0.0366383
+0.9858801
+-0.6655349
+-1.4315989
+-0.9608517
+0.0852364
+-0.7846396
+0.6397098
+0.8213859
+-1.2054771
+0.5329985
+0.2354515
+0.3058444
+-0.3296975
+-0.2075952
+-0.4107418
+0.0079598
+-1.6212178
+0.4404473
+-0.1972733
+-0.9216487
+0.1868932
+-0.8344053
+0.5282875
+1.2305822
+1.1275629
+0.3524925
+-0.3609512
+0.1595955
+-0.5397429
+-0.3881667
+0.1024067
+-0.1171156
+0.1750999
+0.1485829
+-0.0249583
+1.1209311
+0.4452530
+0.6893753
+-0.5074249
+-0.4139334
+1.0020726
+0.1474906
+0.1366340
+0.3011284
+-0.0410690
+-1.1016185
+0.6555198
+1.5335206
+-0.0198658
+0.1980170
+0.8924365
+1.0826101
+0.1499328
+0.7504328
+0.9189623
+0.7830111
+-0.1872118
+0.4769868
+-0.1265928
+0.5445367
+-0.8042399
+-1.3707906
+-0.2605996
+-0.1333342
+0.0381102
+-0.6266897
+0.7740120
+0.2051301
+0.5140593
+-0.0363874
+-0.1651233
+-0.5950338
+0.2162768
+-0.2888794
+0.0361910
+-0.6358243
+0.2819200
+0.2844477
+0.3340794
+-0.1649905
+-0.6618704
+-1.6414374
+0.2756823
+-0.2478583
+0.3003962
+0.6407919
+0.2008700
+0.2563408
+-0.0036211
+0.4538172
+0.0480317
+0.1776888
+-0.5590545
+-0.1620549
+-0.5923905
+-0.1348465
+0.2349794
+1.0340233
+-1.0221784
+-0.3680335
+-0.4263237
+-0.4231155
+-0.3686356
+0.8711838
+0.0071369
+0.4368323
+-0.7412702
+0.4186013
+-0.0529745
+-1.3257911
+0.4670566
+-0.2197452
+-0.7439435
+0.5441602
+-0.4116543
+-0.8764173
+-0.0864979
+-0.2105043
+0.2688649
+-0.3274689
+-0.6257399
+0.2322355
+0.2492823
diff --git a/lecture_6/verified_examples/training_reload_log.txt b/lecture_6/verified_examples/training_reload_log.txt
new file mode 100644
index 0000000000000000000000000000000000000000..b2c192cf5547879b2ff435965023048548545857
--- /dev/null
+++ b/lecture_6/verified_examples/training_reload_log.txt
@@ -0,0 +1,33 @@
+{"method": "flow-matching", "out": "outputs/verified-torch291/flow-matching", "loss": 2.0242882668972015, "seconds": 2.210745528995176}
+{"method": "flow-matching", "mode": "sample", "out": "outputs/verified-torch291/flow-matching", "seconds": 0.005338316004781518}
+{"method": "fmm-lagrangian", "out": "outputs/verified-torch291/fmm-lagrangian", "loss": 2.0523160219192507, "seconds": 5.863147705000301}
+{"method": "fmm-lagrangian", "mode": "sample", "out": "outputs/verified-torch291/fmm-lagrangian", "seconds": 0.005786456000350881}
+{"method": "fmm-eulerian", "out": "outputs/verified-torch291/fmm-eulerian", "loss": 2.0371171474456786, "seconds": 5.261868300003698}
+{"method": "fmm-eulerian", "mode": "sample", "out": "outputs/verified-torch291/fmm-eulerian", "seconds": 0.004115334995731246}
+{"method": "self-distill", "out": "outputs/verified-torch291/self-distill", "loss": 2.1831001818180082, "seconds": 1.9765548720024526}
+{"method": "self-distill", "mode": "sample", "out": "outputs/verified-torch291/self-distill", "seconds": 0.0036691740024252795}
+{"method": "consistency", "out": "outputs/verified-torch291/consistency", "loss": 1.979964154958725, "seconds": 3.6416576160045224}
+{"method": "consistency", "mode": "sample", "out": "outputs/verified-torch291/consistency", "seconds": 0.0030551349991583265}
+{"method": "shortcut", "out": "outputs/verified-torch291/shortcut", "loss": 2.1837141811847687, "seconds": 2.735806157004845}
+{"method": "shortcut", "mode": "sample", "out": "outputs/verified-torch291/shortcut", "seconds": 0.006531202998303343}
+{"method": "meanflow", "out": "outputs/verified-torch291/meanflow", "loss": 1.5747917950153352, "seconds": 2.9319772759990883}
+{"method": "meanflow", "mode": "sample", "out": "outputs/verified-torch291/meanflow", "seconds": 0.003650777005532291}
+{"method": "latent", "out": "outputs/verified-torch291/latent", "loss": 1.4714181840419769, "seconds": 3.618038576998515}
+{"method": "latent", "mode": "sample", "out": "outputs/verified-torch291/latent", "seconds": 0.0070175579967326485}
+{"method": "fmlm", "out": "outputs/verified-torch291/fmlm", "loss": 0.5210289716720581, "seconds": 3.229403880999598}
+{"method": "fmlm", "mode": "sample", "out": "outputs/verified-torch291/fmlm", "seconds": 0.009706972996355034}
+{"method": "categorical", "out": "outputs/verified-torch291/categorical", "loss": 0.5313047975301742, "seconds": 5.423348005999287}
+{"method": "categorical", "mode": "sample", "out": "outputs/verified-torch291/categorical", "seconds": 0.009315825001976918}
+{"method": "discrete-lsd", "out": "outputs/verified-torch291/discrete-lsd", "loss": 0.5278535842895508, "seconds": 4.936540884998976}
+{"method": "discrete-lsd", "mode": "sample", "out": "outputs/verified-torch291/discrete-lsd", "seconds": 0.009318361997429747}
+{"method": "discrete-esd", "out": "outputs/verified-torch291/discrete-esd", "loss": 0.5522287711501122, "seconds": 4.619678268994903}
+{"method": "discrete-esd", "mode": "sample", "out": "outputs/verified-torch291/discrete-esd", "seconds": 0.00982432599994354}
+{"method": "diamond", "out": "outputs/verified-torch291/diamond", "loss": 1.3909348011016847, "seconds": 4.959251613996457}
+{"method": "diamond", "mode": "sample", "out": "outputs/verified-torch291/diamond", "seconds": 0.07566004899854306}
+{"method": "meta", "out": "outputs/verified-torch291/meta", "loss": 1.5032016336917877, "seconds": 2.076603032001003}
+{"method": "meta", "mode": "sample", "out": "outputs/verified-torch291/meta", "seconds": 0.0813792570043006}
+{"method": "expanding", "out": "outputs/verified-torch291/expanding", "loss": 2.9194031715393067, "seconds": 21.383618507999927}
+{"method": "expanding", "mode": "sample", "out": "outputs/verified-torch291/expanding", "seconds": 0.5061805700024706}
+{"method": "ssfm", "out": "outputs/verified-torch291/ssfm", "loss": 0.00012182250538899098, "seconds": 2.4875807970020105}
+{"method": "ssfm", "mode": "sample", "out": "outputs/verified-torch291/ssfm", "seconds": 0.015510053002799395}
+All 16 methods trained, sampled, and reproduced samples after checkpoint reload.